Jul 24 18:05:06.038294 ip-10-0-128-233 systemd[1]: Starting Kubernetes Kubelet... Jul 24 18:05:06.411302 ip-10-0-128-233 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 18:05:06.411302 ip-10-0-128-233 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 24 18:05:06.411302 ip-10-0-128-233 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 18:05:06.411302 ip-10-0-128-233 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 24 18:05:06.411302 ip-10-0-128-233 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 18:05:06.413211 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.413062 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 24 18:05:06.419328 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419311 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 18:05:06.419328 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419328 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 18:05:06.419415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419331 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 18:05:06.419415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419335 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 18:05:06.419415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419337 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 18:05:06.419415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419340 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 18:05:06.419415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419343 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 18:05:06.419415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419346 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 18:05:06.419415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419349 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 18:05:06.419415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419352 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 18:05:06.419415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419354 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 18:05:06.419415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419357 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 18:05:06.419415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419359 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 18:05:06.419415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419366 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 18:05:06.419415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419368 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 18:05:06.419415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419371 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 18:05:06.419415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419375 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 18:05:06.419415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419379 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 18:05:06.419415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419382 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 18:05:06.419415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419385 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 18:05:06.419415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419388 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 18:05:06.419867 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419391 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 18:05:06.419867 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419394 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 18:05:06.419867 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419397 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 18:05:06.419867 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419400 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 18:05:06.419867 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419402 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 18:05:06.419867 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419405 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 18:05:06.419867 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419408 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 18:05:06.419867 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419410 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 18:05:06.419867 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419413 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 18:05:06.419867 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419415 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 18:05:06.419867 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419418 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 18:05:06.419867 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419421 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 18:05:06.419867 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419423 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 18:05:06.419867 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419426 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 18:05:06.419867 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419429 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 18:05:06.419867 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419431 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 18:05:06.419867 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419434 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 18:05:06.419867 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419437 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 18:05:06.419867 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419439 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 18:05:06.419867 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419442 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 18:05:06.420388 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419444 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 18:05:06.420388 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419447 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 18:05:06.420388 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419450 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 18:05:06.420388 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419452 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 18:05:06.420388 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419454 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 18:05:06.420388 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419457 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 18:05:06.420388 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419459 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 18:05:06.420388 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419461 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 18:05:06.420388 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419464 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 18:05:06.420388 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419466 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 18:05:06.420388 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419469 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 18:05:06.420388 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419471 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 18:05:06.420388 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419473 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 18:05:06.420388 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419476 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 18:05:06.420388 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419480 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 18:05:06.420388 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419482 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 24 18:05:06.420388 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419485 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 18:05:06.420388 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419487 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 18:05:06.420388 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419489 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 18:05:06.420388 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419492 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 18:05:06.420896 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419495 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 18:05:06.420896 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419497 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 18:05:06.420896 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419500 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 18:05:06.420896 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419503 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 18:05:06.420896 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419505 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 18:05:06.420896 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419508 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 18:05:06.420896 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419510 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 18:05:06.420896 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419513 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 18:05:06.420896 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419516 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 18:05:06.420896 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419518 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 18:05:06.420896 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419520 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 18:05:06.420896 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419523 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 18:05:06.420896 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419525 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 18:05:06.420896 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419528 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 18:05:06.420896 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419532 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 18:05:06.420896 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419536 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 18:05:06.420896 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419539 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 18:05:06.420896 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419543 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 18:05:06.420896 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419546 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 18:05:06.421417 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419549 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 18:05:06.421417 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419551 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 18:05:06.421417 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419555 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 18:05:06.421417 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419557 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 18:05:06.421417 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419560 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 18:05:06.421417 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419563 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 18:05:06.421417 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419567 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 18:05:06.421417 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419569 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 18:05:06.421417 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419572 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 18:05:06.421417 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419574 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 18:05:06.421417 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419577 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 18:05:06.421417 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419579 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 18:05:06.421417 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419582 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 18:05:06.421417 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419584 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 18:05:06.421417 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419587 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 18:05:06.421417 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419589 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 18:05:06.421417 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419592 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 18:05:06.421417 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419595 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 18:05:06.421417 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.419598 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 18:05:06.421417 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420333 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 18:05:06.421956 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420340 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 18:05:06.421956 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420343 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 18:05:06.421956 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420346 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 18:05:06.421956 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420348 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 24 18:05:06.421956 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420353 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 18:05:06.421956 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420357 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 18:05:06.421956 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420360 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 18:05:06.421956 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420364 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 18:05:06.421956 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420367 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 18:05:06.421956 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420370 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 18:05:06.421956 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420373 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 18:05:06.421956 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420376 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 18:05:06.421956 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420379 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 18:05:06.421956 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420381 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 18:05:06.421956 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420384 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 18:05:06.421956 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420386 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 18:05:06.421956 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420388 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 18:05:06.421956 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420391 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 18:05:06.421956 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420395 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 18:05:06.421956 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420398 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 18:05:06.422472 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420400 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 18:05:06.422472 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420403 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 18:05:06.422472 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420405 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 18:05:06.422472 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420408 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 18:05:06.422472 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420411 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 18:05:06.422472 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420413 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 18:05:06.422472 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420416 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 18:05:06.422472 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420418 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 18:05:06.422472 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420421 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 18:05:06.422472 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420423 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 18:05:06.422472 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420426 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 18:05:06.422472 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420429 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 18:05:06.422472 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420432 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 18:05:06.422472 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420436 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 18:05:06.422472 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420438 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 18:05:06.422472 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420441 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 18:05:06.422472 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420443 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 18:05:06.422472 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420446 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 18:05:06.422472 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420448 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 18:05:06.422933 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420452 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 18:05:06.422933 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420455 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 18:05:06.422933 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420458 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 18:05:06.422933 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420463 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 18:05:06.422933 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420465 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 18:05:06.422933 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420468 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 18:05:06.422933 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420470 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 18:05:06.422933 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420473 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 18:05:06.422933 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420475 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 18:05:06.422933 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420478 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 18:05:06.422933 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420480 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 18:05:06.422933 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420484 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 18:05:06.422933 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420486 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 18:05:06.422933 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420489 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 18:05:06.422933 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420491 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 18:05:06.422933 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420494 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 18:05:06.422933 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420496 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 18:05:06.422933 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420500 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 18:05:06.422933 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420502 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 18:05:06.423415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420507 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 18:05:06.423415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420509 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 18:05:06.423415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420512 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 18:05:06.423415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420514 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 18:05:06.423415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420517 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 18:05:06.423415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420523 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 18:05:06.423415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420526 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 18:05:06.423415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420528 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 18:05:06.423415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420531 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 18:05:06.423415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420534 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 18:05:06.423415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420536 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 18:05:06.423415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420539 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 18:05:06.423415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420541 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 18:05:06.423415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420544 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 18:05:06.423415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420546 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 18:05:06.423415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420549 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 18:05:06.423415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420552 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 18:05:06.423415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420554 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 18:05:06.423415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420557 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 18:05:06.423415 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420559 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 18:05:06.423909 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420562 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 18:05:06.423909 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420564 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 18:05:06.423909 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420567 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 18:05:06.423909 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420570 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 18:05:06.423909 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420573 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 18:05:06.423909 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420575 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 18:05:06.423909 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420578 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 18:05:06.423909 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420581 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 18:05:06.423909 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420583 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 18:05:06.423909 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420586 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 18:05:06.423909 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420589 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 18:05:06.423909 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420591 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 18:05:06.423909 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420594 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 18:05:06.423909 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420597 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 18:05:06.423909 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420599 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 18:05:06.423909 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420602 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 18:05:06.423909 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420605 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 18:05:06.423909 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420607 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 18:05:06.423909 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420610 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 18:05:06.423909 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420614 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 18:05:06.424407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420988 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 18:05:06.424407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420994 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 18:05:06.424407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.420997 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 18:05:06.424407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421000 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 18:05:06.424407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421003 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 18:05:06.424407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421007 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 18:05:06.424407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421009 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 18:05:06.424407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421012 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 18:05:06.424407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421015 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 18:05:06.424407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421017 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 18:05:06.424407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421020 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 18:05:06.424407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421023 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 18:05:06.424407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421025 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 18:05:06.424407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421027 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 18:05:06.424407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421030 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 18:05:06.424407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421033 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 18:05:06.424407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421036 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 18:05:06.424407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421038 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 18:05:06.424407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421042 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 18:05:06.424862 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421044 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 18:05:06.424862 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421047 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 18:05:06.424862 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421050 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 18:05:06.424862 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421052 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 24 18:05:06.424862 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421055 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 18:05:06.424862 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421057 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 18:05:06.424862 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421060 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 18:05:06.424862 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421062 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 18:05:06.424862 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421065 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 18:05:06.424862 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421068 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 18:05:06.424862 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421070 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 18:05:06.424862 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421073 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 18:05:06.424862 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421076 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 18:05:06.424862 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421079 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 18:05:06.424862 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421082 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 18:05:06.424862 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421084 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 18:05:06.424862 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421087 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 18:05:06.424862 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421089 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 18:05:06.424862 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421092 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 18:05:06.424862 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421094 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 18:05:06.425355 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421097 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 18:05:06.425355 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421100 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 18:05:06.425355 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421102 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 18:05:06.425355 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421104 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 18:05:06.425355 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421109 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 18:05:06.425355 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421112 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 18:05:06.425355 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421116 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 18:05:06.425355 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421119 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 18:05:06.425355 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421122 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 18:05:06.425355 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421125 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 18:05:06.425355 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421129 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 18:05:06.425355 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421132 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 18:05:06.425355 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421135 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 18:05:06.425355 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421137 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 18:05:06.425355 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421140 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 18:05:06.425355 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421142 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 18:05:06.425355 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421145 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 18:05:06.425355 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421147 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 18:05:06.425355 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421150 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 18:05:06.425802 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421153 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 18:05:06.425802 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421155 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 18:05:06.425802 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421157 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 18:05:06.425802 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421160 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 18:05:06.425802 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421163 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 18:05:06.425802 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421166 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 18:05:06.425802 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421169 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 18:05:06.425802 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421171 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 18:05:06.425802 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421173 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 18:05:06.425802 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421176 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 18:05:06.425802 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421178 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 18:05:06.425802 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421181 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 18:05:06.425802 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421183 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 18:05:06.425802 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421186 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 18:05:06.425802 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421188 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 18:05:06.425802 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421191 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 18:05:06.425802 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421193 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 18:05:06.425802 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421195 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 18:05:06.425802 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421198 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 18:05:06.426264 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421200 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 18:05:06.426264 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421203 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 18:05:06.426264 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421205 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 18:05:06.426264 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421208 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 18:05:06.426264 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421211 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 18:05:06.426264 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421214 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 18:05:06.426264 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421217 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 18:05:06.426264 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421220 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 18:05:06.426264 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421222 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 18:05:06.426264 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421224 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 18:05:06.426264 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421227 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 18:05:06.426264 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421230 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 18:05:06.426264 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421232 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 18:05:06.426264 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421235 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 18:05:06.426264 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421238 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 18:05:06.426264 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421240 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 18:05:06.426264 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421253 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 18:05:06.426264 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421256 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 18:05:06.426264 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421259 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 18:05:06.426264 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421275 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 18:05:06.426745 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421278 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 18:05:06.426745 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.421280 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 18:05:06.426745 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421352 2562 flags.go:64] FLAG: --address="0.0.0.0" Jul 24 18:05:06.426745 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421364 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 24 18:05:06.426745 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421375 2562 flags.go:64] FLAG: --anonymous-auth="true" Jul 24 18:05:06.426745 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421382 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 24 18:05:06.426745 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421388 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 24 18:05:06.426745 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421394 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 24 18:05:06.426745 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421399 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 24 18:05:06.426745 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421403 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 24 18:05:06.426745 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421407 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 24 18:05:06.426745 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421410 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 24 18:05:06.426745 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421413 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 24 18:05:06.426745 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421417 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 24 18:05:06.426745 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421420 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 24 18:05:06.426745 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421426 2562 flags.go:64] FLAG: --cgroup-root="" Jul 24 18:05:06.426745 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421429 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 24 18:05:06.426745 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421433 2562 flags.go:64] FLAG: --client-ca-file="" Jul 24 18:05:06.426745 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421436 2562 flags.go:64] FLAG: --cloud-provider="external" Jul 24 18:05:06.426745 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421439 2562 flags.go:64] FLAG: --cluster-dns="[]" Jul 24 18:05:06.426745 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421442 2562 flags.go:64] FLAG: --cluster-domain="" Jul 24 18:05:06.426745 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421445 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 24 18:05:06.426745 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421448 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 24 18:05:06.426745 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421451 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 24 18:05:06.427349 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421454 2562 flags.go:64] FLAG: --container-log-max-files="5" Jul 24 18:05:06.427349 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421458 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 24 18:05:06.427349 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421463 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 24 18:05:06.427349 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421466 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 24 18:05:06.427349 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421470 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 24 18:05:06.427349 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421473 2562 flags.go:64] FLAG: --contention-profiling="false" Jul 24 18:05:06.427349 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421475 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 24 18:05:06.427349 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421479 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 24 18:05:06.427349 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421483 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 24 18:05:06.427349 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421486 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 24 18:05:06.427349 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421490 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 24 18:05:06.427349 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421493 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 24 18:05:06.427349 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421496 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 24 18:05:06.427349 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421499 2562 flags.go:64] FLAG: --enable-load-reader="false" Jul 24 18:05:06.427349 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421502 2562 flags.go:64] FLAG: --enable-server="true" Jul 24 18:05:06.427349 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421505 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 24 18:05:06.427349 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421510 2562 flags.go:64] FLAG: --event-burst="100" Jul 24 18:05:06.427349 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421513 2562 flags.go:64] FLAG: --event-qps="50" Jul 24 18:05:06.427349 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421516 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 24 18:05:06.427349 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421519 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 24 18:05:06.427349 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421522 2562 flags.go:64] FLAG: --eviction-hard="" Jul 24 18:05:06.427349 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421526 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 24 18:05:06.427349 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421529 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 24 18:05:06.427349 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421533 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 24 18:05:06.427349 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421536 2562 flags.go:64] FLAG: --eviction-soft="" Jul 24 18:05:06.428021 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421539 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 24 18:05:06.428021 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421542 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 24 18:05:06.428021 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421545 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 24 18:05:06.428021 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421547 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jul 24 18:05:06.428021 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421550 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 24 18:05:06.428021 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421554 2562 flags.go:64] FLAG: --fail-swap-on="true" Jul 24 18:05:06.428021 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421557 2562 flags.go:64] FLAG: --feature-gates="" Jul 24 18:05:06.428021 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421560 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jul 24 18:05:06.428021 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421563 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 24 18:05:06.428021 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421567 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 24 18:05:06.428021 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421570 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 24 18:05:06.428021 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421573 2562 flags.go:64] FLAG: --healthz-port="10248" Jul 24 18:05:06.428021 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421577 2562 flags.go:64] FLAG: --help="false" Jul 24 18:05:06.428021 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421580 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-128-233.ec2.internal" Jul 24 18:05:06.428021 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421583 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 24 18:05:06.428021 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421586 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jul 24 18:05:06.428021 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421589 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 24 18:05:06.428021 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421592 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 24 18:05:06.428021 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421596 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 24 18:05:06.428021 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421599 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 24 18:05:06.428021 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421602 2562 flags.go:64] FLAG: --image-service-endpoint="" Jul 24 18:05:06.428021 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421605 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 24 18:05:06.428021 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421608 2562 flags.go:64] FLAG: --kube-api-burst="100" Jul 24 18:05:06.428590 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421611 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 24 18:05:06.428590 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421614 2562 flags.go:64] FLAG: --kube-api-qps="50" Jul 24 18:05:06.428590 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421617 2562 flags.go:64] FLAG: --kube-reserved="" Jul 24 18:05:06.428590 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421620 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 24 18:05:06.428590 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421622 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 24 18:05:06.428590 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421625 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jul 24 18:05:06.428590 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421628 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 24 18:05:06.428590 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421632 2562 flags.go:64] FLAG: --lock-file="" Jul 24 18:05:06.428590 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421635 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 24 18:05:06.428590 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421638 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 24 18:05:06.428590 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421641 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 24 18:05:06.428590 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421646 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jul 24 18:05:06.428590 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421649 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 24 18:05:06.428590 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421652 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jul 24 18:05:06.428590 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421655 2562 flags.go:64] FLAG: --logging-format="text" Jul 24 18:05:06.428590 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421658 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 24 18:05:06.428590 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421661 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 24 18:05:06.428590 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421663 2562 flags.go:64] FLAG: --manifest-url="" Jul 24 18:05:06.428590 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421668 2562 flags.go:64] FLAG: --manifest-url-header="" Jul 24 18:05:06.428590 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421672 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 24 18:05:06.428590 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421675 2562 flags.go:64] FLAG: --max-open-files="1000000" Jul 24 18:05:06.428590 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421679 2562 flags.go:64] FLAG: --max-pods="110" Jul 24 18:05:06.428590 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421682 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 24 18:05:06.428590 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421685 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 24 18:05:06.428590 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421688 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jul 24 18:05:06.429217 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421690 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 24 18:05:06.429217 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421694 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 24 18:05:06.429217 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421697 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 24 18:05:06.429217 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421700 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 24 18:05:06.429217 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421707 2562 flags.go:64] FLAG: --node-status-max-images="50" Jul 24 18:05:06.429217 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421711 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 24 18:05:06.429217 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421713 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jul 24 18:05:06.429217 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421716 2562 flags.go:64] FLAG: --pod-cidr="" Jul 24 18:05:06.429217 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421719 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 24 18:05:06.429217 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421725 2562 flags.go:64] FLAG: --pod-manifest-path="" Jul 24 18:05:06.429217 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421728 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jul 24 18:05:06.429217 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421731 2562 flags.go:64] FLAG: --pods-per-core="0" Jul 24 18:05:06.429217 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421734 2562 flags.go:64] FLAG: --port="10250" Jul 24 18:05:06.429217 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421737 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 24 18:05:06.429217 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421739 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e84645fe5cbc426d" Jul 24 18:05:06.429217 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421744 2562 flags.go:64] FLAG: --qos-reserved="" Jul 24 18:05:06.429217 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421747 2562 flags.go:64] FLAG: --read-only-port="10255" Jul 24 18:05:06.429217 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421750 2562 flags.go:64] FLAG: --register-node="true" Jul 24 18:05:06.429217 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421752 2562 flags.go:64] FLAG: --register-with-taints="" Jul 24 18:05:06.429217 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421756 2562 flags.go:64] FLAG: --registry-burst="10" Jul 24 18:05:06.429217 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421759 2562 flags.go:64] FLAG: --registry-qps="5" Jul 24 18:05:06.429217 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421761 2562 flags.go:64] FLAG: --reserved-cpus="" Jul 24 18:05:06.429217 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421764 2562 flags.go:64] FLAG: --reserved-memory="" Jul 24 18:05:06.429217 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421768 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 24 18:05:06.429217 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421772 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 24 18:05:06.429826 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421776 2562 flags.go:64] FLAG: --rotate-certificates="false" Jul 24 18:05:06.429826 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421778 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 24 18:05:06.429826 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421781 2562 flags.go:64] FLAG: --runonce="false" Jul 24 18:05:06.429826 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421784 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 24 18:05:06.429826 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421787 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 24 18:05:06.429826 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421790 2562 flags.go:64] FLAG: --seccomp-default="false" Jul 24 18:05:06.429826 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421792 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 24 18:05:06.429826 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421795 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 24 18:05:06.429826 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421798 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 24 18:05:06.429826 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421802 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 24 18:05:06.429826 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421805 2562 flags.go:64] FLAG: --storage-driver-password="root" Jul 24 18:05:06.429826 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421807 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jul 24 18:05:06.429826 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421810 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jul 24 18:05:06.429826 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421813 2562 flags.go:64] FLAG: --storage-driver-user="root" Jul 24 18:05:06.429826 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421815 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 24 18:05:06.429826 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421818 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 24 18:05:06.429826 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421821 2562 flags.go:64] FLAG: --system-cgroups="" Jul 24 18:05:06.429826 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421823 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 24 18:05:06.429826 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421829 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 24 18:05:06.429826 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421831 2562 flags.go:64] FLAG: --tls-cert-file="" Jul 24 18:05:06.429826 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421834 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 24 18:05:06.429826 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421838 2562 flags.go:64] FLAG: --tls-min-version="" Jul 24 18:05:06.429826 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421842 2562 flags.go:64] FLAG: --tls-private-key-file="" Jul 24 18:05:06.429826 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421845 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jul 24 18:05:06.429826 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421848 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 24 18:05:06.430548 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421851 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jul 24 18:05:06.430548 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421854 2562 flags.go:64] FLAG: --v="2" Jul 24 18:05:06.430548 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421858 2562 flags.go:64] FLAG: --version="false" Jul 24 18:05:06.430548 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421861 2562 flags.go:64] FLAG: --vmodule="" Jul 24 18:05:06.430548 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421865 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 24 18:05:06.430548 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.421868 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 24 18:05:06.430548 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422003 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 18:05:06.430548 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422010 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 18:05:06.430548 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422013 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 24 18:05:06.430548 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422016 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 18:05:06.430548 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422019 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 18:05:06.430548 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422021 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 18:05:06.430548 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422024 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 18:05:06.430548 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422028 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 18:05:06.430548 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422030 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 18:05:06.430548 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422033 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 18:05:06.430548 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422035 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 18:05:06.430548 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422040 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 18:05:06.430548 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422044 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 18:05:06.430548 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422047 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 18:05:06.430548 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422050 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 18:05:06.431294 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422052 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 18:05:06.431294 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422055 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 18:05:06.431294 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422057 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 18:05:06.431294 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422059 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 18:05:06.431294 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422062 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 18:05:06.431294 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422064 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 18:05:06.431294 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422067 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 18:05:06.431294 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422069 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 18:05:06.431294 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422072 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 18:05:06.431294 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422075 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 18:05:06.431294 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422077 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 18:05:06.431294 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422079 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 18:05:06.431294 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422082 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 18:05:06.431294 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422084 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 18:05:06.431294 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422087 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 18:05:06.431294 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422089 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 18:05:06.431294 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422092 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 18:05:06.431294 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422094 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 18:05:06.431294 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422099 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 18:05:06.431294 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422101 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 18:05:06.432064 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422104 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 18:05:06.432064 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422106 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 18:05:06.432064 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422108 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 18:05:06.432064 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422111 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 18:05:06.432064 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422115 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 18:05:06.432064 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422118 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 18:05:06.432064 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422121 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 18:05:06.432064 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422124 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 18:05:06.432064 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422127 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 18:05:06.432064 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422131 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 18:05:06.432064 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422133 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 18:05:06.432064 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422136 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 18:05:06.432064 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422138 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 18:05:06.432064 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422140 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 18:05:06.432064 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422143 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 18:05:06.432064 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422146 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 18:05:06.432064 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422149 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 18:05:06.432064 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422152 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 18:05:06.432064 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422155 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 18:05:06.432561 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422158 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 18:05:06.432561 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422160 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 18:05:06.432561 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422163 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 18:05:06.432561 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422166 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 18:05:06.432561 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422168 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 18:05:06.432561 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422170 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 18:05:06.432561 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422173 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 18:05:06.432561 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422176 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 18:05:06.432561 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422178 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 18:05:06.432561 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422181 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 18:05:06.432561 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422183 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 18:05:06.432561 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422187 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 18:05:06.432561 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422190 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 18:05:06.432561 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422192 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 18:05:06.432561 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422195 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 18:05:06.432561 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422197 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 18:05:06.432561 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422200 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 18:05:06.432561 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422202 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 18:05:06.432561 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422205 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 18:05:06.432561 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422207 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 18:05:06.433066 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422210 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 18:05:06.433066 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422212 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 18:05:06.433066 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422215 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 18:05:06.433066 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422218 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 18:05:06.433066 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422220 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 18:05:06.433066 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422222 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 18:05:06.433066 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422225 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 18:05:06.433066 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422227 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 18:05:06.433066 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422230 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 18:05:06.433066 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422232 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 18:05:06.433066 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422235 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 18:05:06.433066 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422237 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 18:05:06.433066 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422240 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 18:05:06.433066 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422242 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 18:05:06.433066 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422245 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 18:05:06.433066 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422250 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 18:05:06.433066 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422252 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 18:05:06.433066 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422255 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 18:05:06.433066 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422258 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 18:05:06.433066 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422260 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 18:05:06.433586 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422262 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 18:05:06.433586 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422265 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 18:05:06.433586 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422268 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 18:05:06.433586 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422273 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 18:05:06.433586 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.422275 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 18:05:06.433586 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.422281 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 18:05:06.433586 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.429263 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 24 18:05:06.433586 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.429279 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 24 18:05:06.433586 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.430066 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 24 18:05:06.433586 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.430077 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 24 18:05:06.433586 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430149 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 18:05:06.433586 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430155 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 18:05:06.433586 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430158 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 18:05:06.433586 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430161 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 18:05:06.433586 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430163 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 18:05:06.433973 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430172 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 18:05:06.433973 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430175 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 18:05:06.433973 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430178 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 18:05:06.433973 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430181 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 18:05:06.433973 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430184 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 18:05:06.433973 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430189 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 18:05:06.433973 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430191 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 18:05:06.433973 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430194 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 18:05:06.433973 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430196 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 18:05:06.433973 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430199 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 18:05:06.433973 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430202 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 18:05:06.433973 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430205 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 18:05:06.433973 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430207 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 18:05:06.433973 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430209 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 18:05:06.433973 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430212 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 18:05:06.433973 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430214 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 18:05:06.433973 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430217 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 18:05:06.433973 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430220 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 18:05:06.433973 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430222 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 18:05:06.434439 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430224 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 18:05:06.434439 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430227 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 18:05:06.434439 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430229 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 18:05:06.434439 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430232 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 18:05:06.434439 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430235 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 18:05:06.434439 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430238 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 18:05:06.434439 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430240 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 18:05:06.434439 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430243 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 18:05:06.434439 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430246 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 18:05:06.434439 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430248 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 18:05:06.434439 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430251 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 18:05:06.434439 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430253 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 18:05:06.434439 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430256 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 18:05:06.434439 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430258 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 18:05:06.434439 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430266 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 18:05:06.434439 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430269 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 18:05:06.434439 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430271 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 18:05:06.434439 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430274 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 18:05:06.434439 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430277 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 18:05:06.434439 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430279 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 18:05:06.434955 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430281 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 18:05:06.434955 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430284 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 18:05:06.434955 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430287 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 18:05:06.434955 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430289 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 18:05:06.434955 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430291 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 18:05:06.434955 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430294 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 18:05:06.434955 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430296 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 18:05:06.434955 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430299 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 18:05:06.434955 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430301 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 18:05:06.434955 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430305 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 18:05:06.434955 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430308 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 18:05:06.434955 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430311 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 18:05:06.434955 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430314 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 18:05:06.434955 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430317 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 18:05:06.434955 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430319 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 18:05:06.434955 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430323 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 18:05:06.434955 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430326 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 18:05:06.434955 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430330 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 18:05:06.434955 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430332 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 18:05:06.434955 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430334 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 18:05:06.435522 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430337 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 18:05:06.435522 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430339 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 18:05:06.435522 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430342 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 18:05:06.435522 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430345 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 18:05:06.435522 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430348 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 18:05:06.435522 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430351 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 18:05:06.435522 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430353 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 18:05:06.435522 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430402 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 18:05:06.435522 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430797 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 18:05:06.435522 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430804 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 18:05:06.435522 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430809 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 18:05:06.435522 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430814 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 18:05:06.435522 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430818 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 18:05:06.435522 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430823 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 18:05:06.435522 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430827 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 18:05:06.435522 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430832 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 18:05:06.435522 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430836 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 18:05:06.435522 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430840 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 18:05:06.435522 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430845 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 18:05:06.436011 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430856 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 18:05:06.436011 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430861 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 18:05:06.436011 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430865 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 18:05:06.436011 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430870 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 18:05:06.436011 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430874 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 18:05:06.436011 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430878 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 18:05:06.436011 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430882 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 18:05:06.436011 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430887 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 18:05:06.436011 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430892 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 18:05:06.436011 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430896 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 18:05:06.436011 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430900 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 18:05:06.436011 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430904 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 18:05:06.436011 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430909 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 18:05:06.436011 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430918 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 18:05:06.436011 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430922 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 24 18:05:06.436011 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.430926 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 18:05:06.436407 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.430935 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 18:05:06.436407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431563 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 18:05:06.436407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431576 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 24 18:05:06.436407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431581 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 18:05:06.436407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431586 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 18:05:06.436407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431620 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 18:05:06.436407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431625 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 18:05:06.436407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431628 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 18:05:06.436407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431633 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 18:05:06.436407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431638 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 18:05:06.436407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431642 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 18:05:06.436407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431646 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 18:05:06.436407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431650 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 18:05:06.436407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431660 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 18:05:06.436407 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431665 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 18:05:06.436783 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431680 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 18:05:06.436783 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431685 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 18:05:06.436783 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431689 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 18:05:06.436783 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431692 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 18:05:06.436783 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431697 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 18:05:06.436783 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431700 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 18:05:06.436783 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431704 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 18:05:06.436783 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431708 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 18:05:06.436783 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431712 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 18:05:06.436783 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431717 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 18:05:06.436783 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431721 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 18:05:06.436783 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431730 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 18:05:06.436783 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431734 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 18:05:06.436783 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431739 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 18:05:06.436783 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431743 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 18:05:06.436783 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431748 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 18:05:06.436783 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431752 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 18:05:06.436783 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431756 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 18:05:06.436783 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431761 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 18:05:06.436783 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431764 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 18:05:06.437276 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431768 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 18:05:06.437276 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431773 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 18:05:06.437276 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431777 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 18:05:06.437276 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431811 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 18:05:06.437276 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431820 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 18:05:06.437276 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431825 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 18:05:06.437276 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431829 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 18:05:06.437276 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431833 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 18:05:06.437276 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431837 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 18:05:06.437276 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431841 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 18:05:06.437276 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431845 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 18:05:06.437276 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431849 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 18:05:06.437276 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431853 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 18:05:06.437276 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431857 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 18:05:06.437276 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431861 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 18:05:06.437276 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431865 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 18:05:06.437276 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431873 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 18:05:06.437276 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431877 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 18:05:06.437276 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431881 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 18:05:06.437276 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431885 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 18:05:06.437759 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431889 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 18:05:06.437759 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431893 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 18:05:06.437759 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431898 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 18:05:06.437759 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431902 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 18:05:06.437759 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431907 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 18:05:06.437759 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431910 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 18:05:06.437759 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431914 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 18:05:06.437759 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431918 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 18:05:06.437759 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431922 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 18:05:06.437759 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431931 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 18:05:06.437759 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431935 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 18:05:06.437759 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431940 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 18:05:06.437759 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431947 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 18:05:06.437759 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431953 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 18:05:06.437759 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431974 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 18:05:06.437759 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.431979 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 18:05:06.437759 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432013 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 18:05:06.437759 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432019 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 18:05:06.437759 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432024 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 18:05:06.438289 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432093 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 18:05:06.438289 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432173 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 18:05:06.438289 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432269 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 18:05:06.438289 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432275 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 18:05:06.438289 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432279 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 18:05:06.438289 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432282 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 18:05:06.438289 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432284 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 18:05:06.438289 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432287 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 18:05:06.438289 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432290 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 18:05:06.438289 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432292 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 18:05:06.438289 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432295 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 18:05:06.438289 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432298 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 18:05:06.438289 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432300 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 18:05:06.438289 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432302 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 18:05:06.438289 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432305 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 18:05:06.438289 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432307 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 18:05:06.438289 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432310 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 18:05:06.438289 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432312 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 18:05:06.438289 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432315 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 18:05:06.438289 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432318 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 18:05:06.438799 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432321 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 18:05:06.438799 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432326 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 18:05:06.438799 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432330 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 18:05:06.438799 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432334 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 18:05:06.438799 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432337 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 18:05:06.438799 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:06.432339 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 18:05:06.438799 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.432346 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 18:05:06.438799 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.432487 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jul 24 18:05:06.438799 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.435245 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 24 18:05:06.438799 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.436453 2562 server.go:1019] "Starting client certificate rotation" Jul 24 18:05:06.438799 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.436551 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 18:05:06.438799 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.436590 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 18:05:06.439125 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.439053 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 18:05:06.443577 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.443551 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 18:05:06.451527 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.451507 2562 log.go:25] "Validated CRI v1 runtime API" Jul 24 18:05:06.453402 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.453384 2562 log.go:25] "Validated CRI v1 image API" Jul 24 18:05:06.454531 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.454517 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 24 18:05:06.457432 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.457415 2562 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ba320e53-ea78-44ec-97d4-e7e17b47995e:/dev/nvme0n1p3 c38ac75a-d442-417a-b781-8e0d4306b9a0:/dev/nvme0n1p4] Jul 24 18:05:06.457490 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.457433 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 24 18:05:06.462662 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.462556 2562 manager.go:216] Machine: {Timestamp:2026-07-24 18:05:06.46207992 +0000 UTC m=+0.302627640 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097923 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24901630eadfd6beb5113fc5b3a66b SystemUUID:ec249016-30ea-dfd6-beb5-113fc5b3a66b BootID:2337ab64-5f4c-4630-b26d-3672cecefc1e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b5:8d:da:f0:67 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b5:8d:da:f0:67 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:cd:ab:3b:65:16 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 24 18:05:06.462662 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.462657 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 24 18:05:06.462753 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.462732 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 24 18:05:06.465765 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.465743 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 24 18:05:06.465918 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.465769 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-233.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 24 18:05:06.466425 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.466416 2562 topology_manager.go:138] "Creating topology manager with none policy" Jul 24 18:05:06.466457 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.466428 2562 container_manager_linux.go:309] "Creating device plugin manager" Jul 24 18:05:06.466457 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.466435 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 18:05:06.466457 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.466451 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 18:05:06.467047 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.467037 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 24 18:05:06.468872 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.468859 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 24 18:05:06.469063 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.469053 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 24 18:05:06.469201 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.469192 2562 kubelet.go:486] "Attempting to sync node with API server" Jul 24 18:05:06.469256 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.469213 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 24 18:05:06.469256 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.469224 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 24 18:05:06.469256 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.469233 2562 kubelet.go:398] "Adding apiserver pod source" Jul 24 18:05:06.469256 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.469242 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 24 18:05:06.469809 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.469792 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 18:05:06.469897 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.469814 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 18:05:06.472128 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.472095 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 18:05:06.473084 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.473062 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 24 18:05:06.474554 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.474538 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 24 18:05:06.474626 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.474569 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 24 18:05:06.475858 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.475845 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 24 18:05:06.475905 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.475862 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 24 18:05:06.475905 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.475868 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 24 18:05:06.475905 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.475874 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 24 18:05:06.475905 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.475882 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 24 18:05:06.475905 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.475888 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 24 18:05:06.475905 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.475897 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 24 18:05:06.475905 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.475902 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 24 18:05:06.476137 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.475909 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 24 18:05:06.476137 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.475915 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 24 18:05:06.476137 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.475924 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 24 18:05:06.476137 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.475929 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 24 18:05:06.476537 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.476528 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 24 18:05:06.476537 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.476537 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 24 18:05:06.479780 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.479764 2562 server.go:1268] "Started kubelet" Jul 24 18:05:06.479906 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.479853 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 24 18:05:06.479946 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.479878 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 24 18:05:06.479946 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.479931 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 24 18:05:06.480724 ip-10-0-128-233 systemd[1]: Started Kubernetes Kubelet. Jul 24 18:05:06.481518 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.481500 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 24 18:05:06.481812 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.481799 2562 server.go:310] "Adding debug handlers to kubelet server" Jul 24 18:05:06.486207 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:06.486188 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 24 18:05:06.486634 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.486607 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-233.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 24 18:05:06.486724 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:06.486707 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-233.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 24 18:05:06.486863 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:06.486843 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 24 18:05:06.487464 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.487450 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 24 18:05:06.487514 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.487468 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 24 18:05:06.487573 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:06.487557 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-233.ec2.internal\" not found" Jul 24 18:05:06.488047 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.488028 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 24 18:05:06.488047 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.488031 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 24 18:05:06.488175 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.488060 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 24 18:05:06.488175 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:06.487005 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-233.ec2.internal.18c54bec8186e6e3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-233.ec2.internal,UID:ip-10-0-128-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-233.ec2.internal,},FirstTimestamp:2026-07-24 18:05:06.479736547 +0000 UTC m=+0.320284267,LastTimestamp:2026-07-24 18:05:06.479736547 +0000 UTC m=+0.320284267,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-233.ec2.internal,}" Jul 24 18:05:06.488278 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.488219 2562 reconstruct.go:97] "Volume reconstruction finished" Jul 24 18:05:06.488278 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.488227 2562 reconciler.go:29] "Reconciler: start to sync state" Jul 24 18:05:06.488278 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.488253 2562 factory.go:55] Registering systemd factory Jul 24 18:05:06.488278 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.488265 2562 factory.go:223] Registration of the systemd container factory successfully Jul 24 18:05:06.488631 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.488617 2562 factory.go:153] Registering CRI-O factory Jul 24 18:05:06.488700 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.488633 2562 factory.go:223] Registration of the crio container factory successfully Jul 24 18:05:06.488700 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.488694 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 24 18:05:06.488796 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.488714 2562 factory.go:103] Registering Raw factory Jul 24 18:05:06.488796 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.488730 2562 manager.go:1196] Started watching for new ooms in manager Jul 24 18:05:06.489207 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.489192 2562 manager.go:349] Starting recovery of all containers Jul 24 18:05:06.491100 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:06.491078 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 24 18:05:06.491638 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:06.491421 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-233.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 24 18:05:06.502495 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.502473 2562 manager.go:354] Recovery completed Jul 24 18:05:06.506685 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.506673 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 18:05:06.508616 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.508597 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasSufficientMemory" Jul 24 18:05:06.508687 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.508631 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 18:05:06.508687 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.508644 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasSufficientPID" Jul 24 18:05:06.509211 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.509195 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 24 18:05:06.509211 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.509206 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 18:05:06.509211 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.509212 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 24 18:05:06.509392 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.509231 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 24 18:05:06.509948 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.509935 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasSufficientMemory" Jul 24 18:05:06.510019 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.509975 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 18:05:06.510019 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.510001 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasSufficientPID" Jul 24 18:05:06.510867 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.510853 2562 policy_none.go:49] "None policy: Start" Jul 24 18:05:06.510927 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.510872 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 24 18:05:06.510927 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.510886 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 24 18:05:06.511697 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:06.511616 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-233.ec2.internal.18c54bec833f9684 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-233.ec2.internal,UID:ip-10-0-128-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-233.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-233.ec2.internal,},FirstTimestamp:2026-07-24 18:05:06.508617348 +0000 UTC m=+0.349165071,LastTimestamp:2026-07-24 18:05:06.508617348 +0000 UTC m=+0.349165071,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-233.ec2.internal,}" Jul 24 18:05:06.511910 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.511899 2562 policy_none.go:47] "Start" Jul 24 18:05:06.529047 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:06.528828 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-233.ec2.internal.18c54bec833fe20b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-233.ec2.internal,UID:ip-10-0-128-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-233.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-233.ec2.internal,},FirstTimestamp:2026-07-24 18:05:06.508636683 +0000 UTC m=+0.349184403,LastTimestamp:2026-07-24 18:05:06.508636683 +0000 UTC m=+0.349184403,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-233.ec2.internal,}" Jul 24 18:05:06.537059 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.537019 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j4rxv" Jul 24 18:05:06.542639 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:06.541283 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-233.ec2.internal.18c54bec83400efe default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-233.ec2.internal,UID:ip-10-0-128-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-233.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-233.ec2.internal,},FirstTimestamp:2026-07-24 18:05:06.50864819 +0000 UTC m=+0.349195910,LastTimestamp:2026-07-24 18:05:06.50864819 +0000 UTC m=+0.349195910,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-233.ec2.internal,}" Jul 24 18:05:06.545997 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.545981 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j4rxv" Jul 24 18:05:06.553546 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.553532 2562 manager.go:337] "Starting Device Plugin manager" Jul 24 18:05:06.553605 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:06.553564 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 24 18:05:06.553605 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.553578 2562 server.go:87] "Starting device plugin registration server" Jul 24 18:05:06.553847 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.553831 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 24 18:05:06.553926 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.553847 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 24 18:05:06.553986 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.553939 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 24 18:05:06.554048 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.554031 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 24 18:05:06.554048 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.554044 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 24 18:05:06.555109 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:06.555087 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 24 18:05:06.555177 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:06.555144 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-233.ec2.internal\" not found" Jul 24 18:05:06.654213 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.654171 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 18:05:06.655329 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.655171 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasSufficientMemory" Jul 24 18:05:06.655329 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.655203 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 18:05:06.655329 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.655217 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasSufficientPID" Jul 24 18:05:06.655329 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.655251 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-233.ec2.internal" Jul 24 18:05:06.664997 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.664921 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-233.ec2.internal" Jul 24 18:05:06.664997 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:06.664950 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-233.ec2.internal\": node \"ip-10-0-128-233.ec2.internal\" not found" Jul 24 18:05:06.681828 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:06.681798 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-233.ec2.internal\" not found" Jul 24 18:05:06.725440 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.725398 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 24 18:05:06.726862 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.726829 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 24 18:05:06.727001 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.726904 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 24 18:05:06.727001 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.726935 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jul 24 18:05:06.727001 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:06.726985 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 24 18:05:06.729858 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.729839 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 18:05:06.782744 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:06.782712 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-233.ec2.internal\" not found" Jul 24 18:05:06.827249 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.827214 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-233.ec2.internal"] Jul 24 18:05:06.827386 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.827289 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 18:05:06.828325 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.828304 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasSufficientMemory" Jul 24 18:05:06.828442 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.828340 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 18:05:06.828442 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.828353 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasSufficientPID" Jul 24 18:05:06.829476 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.829463 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 18:05:06.829628 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.829612 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal" Jul 24 18:05:06.829700 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.829659 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 18:05:06.830187 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.830173 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasSufficientMemory" Jul 24 18:05:06.830270 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.830198 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 18:05:06.830270 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.830219 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasSufficientPID" Jul 24 18:05:06.830270 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.830218 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasSufficientMemory" Jul 24 18:05:06.830270 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.830247 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 18:05:06.830270 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.830255 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasSufficientPID" Jul 24 18:05:06.831337 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.831321 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-233.ec2.internal" Jul 24 18:05:06.831424 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.831349 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 18:05:06.831993 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.831978 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasSufficientMemory" Jul 24 18:05:06.832062 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.832010 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 18:05:06.832062 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.832028 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasSufficientPID" Jul 24 18:05:06.865666 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:06.865643 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-233.ec2.internal\" not found" node="ip-10-0-128-233.ec2.internal" Jul 24 18:05:06.870092 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:06.870077 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-233.ec2.internal\" not found" node="ip-10-0-128-233.ec2.internal" Jul 24 18:05:06.883075 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:06.883060 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-233.ec2.internal\" not found" Jul 24 18:05:06.892156 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.892136 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3cfd5414b866fa7c304bf5793599e9c5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal\" (UID: \"3cfd5414b866fa7c304bf5793599e9c5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal" Jul 24 18:05:06.892214 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.892164 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cfd5414b866fa7c304bf5793599e9c5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal\" (UID: \"3cfd5414b866fa7c304bf5793599e9c5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal" Jul 24 18:05:06.892214 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.892181 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e5af1d32bcd4dadeb92279281a901285-config\") pod \"kube-apiserver-proxy-ip-10-0-128-233.ec2.internal\" (UID: \"e5af1d32bcd4dadeb92279281a901285\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-233.ec2.internal" Jul 24 18:05:06.984117 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:06.984042 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-233.ec2.internal\" not found" Jul 24 18:05:06.992317 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.992296 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e5af1d32bcd4dadeb92279281a901285-config\") pod \"kube-apiserver-proxy-ip-10-0-128-233.ec2.internal\" (UID: \"e5af1d32bcd4dadeb92279281a901285\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-233.ec2.internal" Jul 24 18:05:06.992379 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.992323 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3cfd5414b866fa7c304bf5793599e9c5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal\" (UID: \"3cfd5414b866fa7c304bf5793599e9c5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal" Jul 24 18:05:06.992379 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.992342 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cfd5414b866fa7c304bf5793599e9c5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal\" (UID: \"3cfd5414b866fa7c304bf5793599e9c5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal" Jul 24 18:05:06.992455 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.992391 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cfd5414b866fa7c304bf5793599e9c5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal\" (UID: \"3cfd5414b866fa7c304bf5793599e9c5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal" Jul 24 18:05:06.992455 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.992404 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e5af1d32bcd4dadeb92279281a901285-config\") pod \"kube-apiserver-proxy-ip-10-0-128-233.ec2.internal\" (UID: \"e5af1d32bcd4dadeb92279281a901285\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-233.ec2.internal" Jul 24 18:05:06.992455 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:06.992411 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3cfd5414b866fa7c304bf5793599e9c5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal\" (UID: \"3cfd5414b866fa7c304bf5793599e9c5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal" Jul 24 18:05:07.084524 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:07.084478 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-233.ec2.internal\" not found" Jul 24 18:05:07.168024 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:07.167990 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal" Jul 24 18:05:07.172836 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:07.172819 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-233.ec2.internal" Jul 24 18:05:07.184831 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:07.184812 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-233.ec2.internal\" not found" Jul 24 18:05:07.285502 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:07.285411 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-233.ec2.internal\" not found" Jul 24 18:05:07.385935 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:07.385904 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-233.ec2.internal\" not found" Jul 24 18:05:07.436435 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:07.436407 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 24 18:05:07.436849 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:07.436565 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 18:05:07.486225 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:07.486198 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-233.ec2.internal\" not found" Jul 24 18:05:07.490481 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:07.490465 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 18:05:07.549494 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:07.549408 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 18:00:07 +0000 UTC" deadline="2028-04-25 01:09:52.795048314 +0000 UTC" Jul 24 18:05:07.549494 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:07.549449 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15367h4m45.245607842s" Jul 24 18:05:07.586736 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:07.586711 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-233.ec2.internal\" not found" Jul 24 18:05:07.603588 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:07.603565 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 18:05:08.770875 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:08.770848 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 18:05:08.790061 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:08.790035 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-233.ec2.internal" Jul 24 18:05:08.801073 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:08.801046 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 18:05:08.801865 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:08.801849 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal" Jul 24 18:05:08.813553 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:08.813535 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 18:05:08.867820 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:08.867790 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cfd5414b866fa7c304bf5793599e9c5.slice/crio-0c2cffd9675325c0928697486f8e020286ba3e3b79451f06b0672521a4c540b1 WatchSource:0}: Error finding container 0c2cffd9675325c0928697486f8e020286ba3e3b79451f06b0672521a4c540b1: Status 404 returned error can't find the container with id 0c2cffd9675325c0928697486f8e020286ba3e3b79451f06b0672521a4c540b1 Jul 24 18:05:08.868298 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:08.868277 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5af1d32bcd4dadeb92279281a901285.slice/crio-32a4e37fbdf9ce4f939916209af2c57cc82f33bb78f8995e893c5f1129795570 WatchSource:0}: Error finding container 32a4e37fbdf9ce4f939916209af2c57cc82f33bb78f8995e893c5f1129795570: Status 404 returned error can't find the container with id 32a4e37fbdf9ce4f939916209af2c57cc82f33bb78f8995e893c5f1129795570 Jul 24 18:05:08.874382 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:08.874364 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 18:05:09.574230 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.574168 2562 apiserver.go:52] "Watching apiserver" Jul 24 18:05:09.582686 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.582657 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 24 18:05:09.584011 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.583984 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-t2s7k","kube-system/global-pull-secret-syncer-nhn86","kube-system/konnectivity-agent-xhz5x","kube-system/kube-apiserver-proxy-ip-10-0-128-233.ec2.internal","openshift-multus/multus-additional-cni-plugins-qbwjd","openshift-multus/network-metrics-daemon-lrwkd","openshift-network-diagnostics/network-check-target-7bf8g","openshift-network-operator/iptables-alerter-zhwpj","openshift-ovn-kubernetes/ovnkube-node-6q2bl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6","openshift-cluster-node-tuning-operator/tuned-rl2gk","openshift-dns/node-resolver-lghjd","openshift-image-registry/node-ca-jd9x5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal"] Jul 24 18:05:09.586171 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.585455 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6" Jul 24 18:05:09.586850 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.586832 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jd9x5" Jul 24 18:05:09.588428 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.587724 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xhz5x" Jul 24 18:05:09.588428 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.588004 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 24 18:05:09.588428 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.588250 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 24 18:05:09.588575 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.588470 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7d5nz\"" Jul 24 18:05:09.588643 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.588468 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 24 18:05:09.589054 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.589036 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zhwpj" Jul 24 18:05:09.590252 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.590232 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qbwjd" Jul 24 18:05:09.591252 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.591230 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 24 18:05:09.591376 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.591293 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 24 18:05:09.591511 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.591494 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 24 18:05:09.591658 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.591643 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 24 18:05:09.591813 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.591797 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 24 18:05:09.592401 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.592379 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-g7jbf\"" Jul 24 18:05:09.592673 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.592656 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 24 18:05:09.592754 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.592707 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 24 18:05:09.592818 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.592662 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 24 18:05:09.592947 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.592929 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 24 18:05:09.593066 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.592979 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-n7kmd\"" Jul 24 18:05:09.593192 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.593177 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:09.593288 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.593203 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zv9n7\"" Jul 24 18:05:09.593288 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:09.593237 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrwkd" podUID="aa3e62c3-b552-4e46-8715-70fa52700805" Jul 24 18:05:09.593713 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.593694 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6k7kj\"" Jul 24 18:05:09.593790 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.593723 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 24 18:05:09.593898 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.593878 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 24 18:05:09.594429 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.594044 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 24 18:05:09.594429 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.594112 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 24 18:05:09.594429 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.594229 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 24 18:05:09.597731 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.596400 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.598767 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.598400 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:09.598767 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:09.598501 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bf8g" podUID="346e9e7f-16c1-4b99-b339-c88ea048ba64" Jul 24 18:05:09.599128 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.599034 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 24 18:05:09.599428 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.599040 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 24 18:05:09.600257 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.599835 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 24 18:05:09.600257 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.600037 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hpqb8\"" Jul 24 18:05:09.600257 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.600265 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:09.600506 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:09.600336 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhn86" podUID="3d977d3f-700c-41a7-b570-34b267cf97cf" Jul 24 18:05:09.601621 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.601603 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.602153 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.602136 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 24 18:05:09.603015 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.602996 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 24 18:05:09.603368 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.603350 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 24 18:05:09.604350 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.604332 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 24 18:05:09.604589 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.604574 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lmtmn\"" Jul 24 18:05:09.604851 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.604828 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f618324-186e-432d-bbdb-40e7439e3550-host-slash\") pod \"iptables-alerter-zhwpj\" (UID: \"0f618324-186e-432d-bbdb-40e7439e3550\") " pod="openshift-network-operator/iptables-alerter-zhwpj" Jul 24 18:05:09.604934 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.604880 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68a2426f-2fa7-448d-a3fb-682cc0a4cc84-system-cni-dir\") pod \"multus-additional-cni-plugins-qbwjd\" (UID: \"68a2426f-2fa7-448d-a3fb-682cc0a4cc84\") " pod="openshift-multus/multus-additional-cni-plugins-qbwjd" Jul 24 18:05:09.604934 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.604917 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/68a2426f-2fa7-448d-a3fb-682cc0a4cc84-os-release\") pod \"multus-additional-cni-plugins-qbwjd\" (UID: \"68a2426f-2fa7-448d-a3fb-682cc0a4cc84\") " pod="openshift-multus/multus-additional-cni-plugins-qbwjd" Jul 24 18:05:09.605038 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.604948 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc6gg\" (UniqueName: \"kubernetes.io/projected/68a2426f-2fa7-448d-a3fb-682cc0a4cc84-kube-api-access-vc6gg\") pod \"multus-additional-cni-plugins-qbwjd\" (UID: \"68a2426f-2fa7-448d-a3fb-682cc0a4cc84\") " pod="openshift-multus/multus-additional-cni-plugins-qbwjd" Jul 24 18:05:09.605038 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.604980 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqdlx\" (UniqueName: \"kubernetes.io/projected/aa3e62c3-b552-4e46-8715-70fa52700805-kube-api-access-vqdlx\") pod \"network-metrics-daemon-lrwkd\" (UID: \"aa3e62c3-b552-4e46-8715-70fa52700805\") " pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:09.605038 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.605010 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/21047180-3830-440c-84c7-0043c99a51f9-etc-selinux\") pod \"aws-ebs-csi-driver-node-vwmx6\" (UID: \"21047180-3830-440c-84c7-0043c99a51f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6" Jul 24 18:05:09.605142 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.605036 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/21047180-3830-440c-84c7-0043c99a51f9-sys-fs\") pod \"aws-ebs-csi-driver-node-vwmx6\" (UID: \"21047180-3830-440c-84c7-0043c99a51f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6" Jul 24 18:05:09.605142 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.605068 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z85h\" (UniqueName: \"kubernetes.io/projected/0f618324-186e-432d-bbdb-40e7439e3550-kube-api-access-6z85h\") pod \"iptables-alerter-zhwpj\" (UID: \"0f618324-186e-432d-bbdb-40e7439e3550\") " pod="openshift-network-operator/iptables-alerter-zhwpj" Jul 24 18:05:09.605142 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.605099 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/68a2426f-2fa7-448d-a3fb-682cc0a4cc84-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qbwjd\" (UID: \"68a2426f-2fa7-448d-a3fb-682cc0a4cc84\") " pod="openshift-multus/multus-additional-cni-plugins-qbwjd" Jul 24 18:05:09.605142 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.605132 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/68a2426f-2fa7-448d-a3fb-682cc0a4cc84-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qbwjd\" (UID: \"68a2426f-2fa7-448d-a3fb-682cc0a4cc84\") " pod="openshift-multus/multus-additional-cni-plugins-qbwjd" Jul 24 18:05:09.605304 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.605164 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa3e62c3-b552-4e46-8715-70fa52700805-metrics-certs\") pod \"network-metrics-daemon-lrwkd\" (UID: \"aa3e62c3-b552-4e46-8715-70fa52700805\") " pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:09.605304 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.605191 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/21047180-3830-440c-84c7-0043c99a51f9-socket-dir\") pod \"aws-ebs-csi-driver-node-vwmx6\" (UID: \"21047180-3830-440c-84c7-0043c99a51f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6" Jul 24 18:05:09.605304 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.605228 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tbk6\" (UniqueName: \"kubernetes.io/projected/21047180-3830-440c-84c7-0043c99a51f9-kube-api-access-7tbk6\") pod \"aws-ebs-csi-driver-node-vwmx6\" (UID: \"21047180-3830-440c-84c7-0043c99a51f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6" Jul 24 18:05:09.605304 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.605261 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5s5f\" (UniqueName: \"kubernetes.io/projected/26b225f1-0841-4c29-9cbb-ecd98b274a50-kube-api-access-f5s5f\") pod \"node-ca-jd9x5\" (UID: \"26b225f1-0841-4c29-9cbb-ecd98b274a50\") " pod="openshift-image-registry/node-ca-jd9x5" Jul 24 18:05:09.605304 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.605291 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0f618324-186e-432d-bbdb-40e7439e3550-iptables-alerter-script\") pod \"iptables-alerter-zhwpj\" (UID: \"0f618324-186e-432d-bbdb-40e7439e3550\") " pod="openshift-network-operator/iptables-alerter-zhwpj" Jul 24 18:05:09.605559 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.605341 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/68a2426f-2fa7-448d-a3fb-682cc0a4cc84-cnibin\") pod \"multus-additional-cni-plugins-qbwjd\" (UID: \"68a2426f-2fa7-448d-a3fb-682cc0a4cc84\") " pod="openshift-multus/multus-additional-cni-plugins-qbwjd" Jul 24 18:05:09.605559 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.605368 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/21047180-3830-440c-84c7-0043c99a51f9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vwmx6\" (UID: \"21047180-3830-440c-84c7-0043c99a51f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6" Jul 24 18:05:09.605559 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.605398 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/21047180-3830-440c-84c7-0043c99a51f9-registration-dir\") pod \"aws-ebs-csi-driver-node-vwmx6\" (UID: \"21047180-3830-440c-84c7-0043c99a51f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6" Jul 24 18:05:09.605559 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.605419 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/68a2426f-2fa7-448d-a3fb-682cc0a4cc84-cni-binary-copy\") pod \"multus-additional-cni-plugins-qbwjd\" (UID: \"68a2426f-2fa7-448d-a3fb-682cc0a4cc84\") " pod="openshift-multus/multus-additional-cni-plugins-qbwjd" Jul 24 18:05:09.605559 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.605443 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/68a2426f-2fa7-448d-a3fb-682cc0a4cc84-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qbwjd\" (UID: \"68a2426f-2fa7-448d-a3fb-682cc0a4cc84\") " pod="openshift-multus/multus-additional-cni-plugins-qbwjd" Jul 24 18:05:09.605559 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.605475 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/21047180-3830-440c-84c7-0043c99a51f9-device-dir\") pod \"aws-ebs-csi-driver-node-vwmx6\" (UID: \"21047180-3830-440c-84c7-0043c99a51f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6" Jul 24 18:05:09.605559 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.605505 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26b225f1-0841-4c29-9cbb-ecd98b274a50-host\") pod \"node-ca-jd9x5\" (UID: \"26b225f1-0841-4c29-9cbb-ecd98b274a50\") " pod="openshift-image-registry/node-ca-jd9x5" Jul 24 18:05:09.605559 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.605532 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/26b225f1-0841-4c29-9cbb-ecd98b274a50-serviceca\") pod \"node-ca-jd9x5\" (UID: \"26b225f1-0841-4c29-9cbb-ecd98b274a50\") " pod="openshift-image-registry/node-ca-jd9x5" Jul 24 18:05:09.605815 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.605564 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/58be88c8-ba61-4987-925c-7dfacc2a7170-agent-certs\") pod \"konnectivity-agent-xhz5x\" (UID: \"58be88c8-ba61-4987-925c-7dfacc2a7170\") " pod="kube-system/konnectivity-agent-xhz5x" Jul 24 18:05:09.605815 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.605595 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/58be88c8-ba61-4987-925c-7dfacc2a7170-konnectivity-ca\") pod \"konnectivity-agent-xhz5x\" (UID: \"58be88c8-ba61-4987-925c-7dfacc2a7170\") " pod="kube-system/konnectivity-agent-xhz5x" Jul 24 18:05:09.606372 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.606350 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.607989 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.607931 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lghjd" Jul 24 18:05:09.609429 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.609408 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 24 18:05:09.610878 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.610860 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hrzrf\"" Jul 24 18:05:09.611843 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.611826 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 24 18:05:09.612306 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.612290 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 24 18:05:09.612893 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.612874 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 24 18:05:09.613380 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.613364 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p2tkb\"" Jul 24 18:05:09.614278 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.614244 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 18:05:09.636407 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.636382 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7nfxm" Jul 24 18:05:09.648676 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.648649 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7nfxm" Jul 24 18:05:09.692194 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.692165 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 24 18:05:09.706060 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706030 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-host-slash\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.706205 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706072 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-run-systemd\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.706205 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706101 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-host-var-lib-cni-bin\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.706205 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706126 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-host-var-lib-cni-multus\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.706205 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706152 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-run-openvswitch\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.706205 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706180 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/68a2426f-2fa7-448d-a3fb-682cc0a4cc84-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qbwjd\" (UID: \"68a2426f-2fa7-448d-a3fb-682cc0a4cc84\") " pod="openshift-multus/multus-additional-cni-plugins-qbwjd" Jul 24 18:05:09.706433 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706205 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/68a2426f-2fa7-448d-a3fb-682cc0a4cc84-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qbwjd\" (UID: \"68a2426f-2fa7-448d-a3fb-682cc0a4cc84\") " pod="openshift-multus/multus-additional-cni-plugins-qbwjd" Jul 24 18:05:09.706433 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706228 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-host-run-netns\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.706433 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706250 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-var-lib-openvswitch\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.706433 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706274 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/10eea99f-1962-47cc-9a25-5dffe9df4490-multus-daemon-config\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.706433 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706299 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-host-run-multus-certs\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.706433 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706334 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-etc-systemd\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.706433 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706370 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0f618324-186e-432d-bbdb-40e7439e3550-iptables-alerter-script\") pod \"iptables-alerter-zhwpj\" (UID: \"0f618324-186e-432d-bbdb-40e7439e3550\") " pod="openshift-network-operator/iptables-alerter-zhwpj" Jul 24 18:05:09.706433 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706395 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/68a2426f-2fa7-448d-a3fb-682cc0a4cc84-cnibin\") pod \"multus-additional-cni-plugins-qbwjd\" (UID: \"68a2426f-2fa7-448d-a3fb-682cc0a4cc84\") " pod="openshift-multus/multus-additional-cni-plugins-qbwjd" Jul 24 18:05:09.706433 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706414 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/21047180-3830-440c-84c7-0043c99a51f9-registration-dir\") pod \"aws-ebs-csi-driver-node-vwmx6\" (UID: \"21047180-3830-440c-84c7-0043c99a51f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6" Jul 24 18:05:09.706433 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706432 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/61177079-7b8e-4730-b13b-6d49c72e9ac8-ovn-node-metrics-cert\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.706787 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706454 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/61177079-7b8e-4730-b13b-6d49c72e9ac8-ovnkube-script-lib\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.706787 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706475 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-os-release\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.706787 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706500 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26b225f1-0841-4c29-9cbb-ecd98b274a50-host\") pod \"node-ca-jd9x5\" (UID: \"26b225f1-0841-4c29-9cbb-ecd98b274a50\") " pod="openshift-image-registry/node-ca-jd9x5" Jul 24 18:05:09.706787 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706529 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ae345ba-357f-42e7-a9d8-9a969ac16761-hosts-file\") pod \"node-resolver-lghjd\" (UID: \"0ae345ba-357f-42e7-a9d8-9a969ac16761\") " pod="openshift-dns/node-resolver-lghjd" Jul 24 18:05:09.706787 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706553 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-host-run-ovn-kubernetes\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.706787 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706575 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-hostroot\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.706787 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706603 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/21047180-3830-440c-84c7-0043c99a51f9-etc-selinux\") pod \"aws-ebs-csi-driver-node-vwmx6\" (UID: \"21047180-3830-440c-84c7-0043c99a51f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6" Jul 24 18:05:09.706787 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706628 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.706787 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706653 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/61177079-7b8e-4730-b13b-6d49c72e9ac8-ovnkube-config\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.706787 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706677 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/61177079-7b8e-4730-b13b-6d49c72e9ac8-env-overrides\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.706787 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706701 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-sys\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.706787 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706723 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-tmp\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.706787 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706747 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-etc-sysconfig\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.706787 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706769 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-etc-kubernetes\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.707216 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706793 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-etc-sysctl-conf\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.707216 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706817 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/21047180-3830-440c-84c7-0043c99a51f9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vwmx6\" (UID: \"21047180-3830-440c-84c7-0043c99a51f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6" Jul 24 18:05:09.707216 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706840 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfbcf\" (UniqueName: \"kubernetes.io/projected/0ae345ba-357f-42e7-a9d8-9a969ac16761-kube-api-access-nfbcf\") pod \"node-resolver-lghjd\" (UID: \"0ae345ba-357f-42e7-a9d8-9a969ac16761\") " pod="openshift-dns/node-resolver-lghjd" Jul 24 18:05:09.707216 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706866 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-host-kubelet\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.707216 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706892 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-systemd-units\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.707216 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706916 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-run-ovn\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.707216 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706938 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-host-cni-bin\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.707216 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706960 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-multus-socket-dir-parent\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.707216 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.706995 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-host-run-k8s-cni-cncf-io\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.707216 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.707021 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/68a2426f-2fa7-448d-a3fb-682cc0a4cc84-cni-binary-copy\") pod \"multus-additional-cni-plugins-qbwjd\" (UID: \"68a2426f-2fa7-448d-a3fb-682cc0a4cc84\") " pod="openshift-multus/multus-additional-cni-plugins-qbwjd" Jul 24 18:05:09.707216 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.707049 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/58be88c8-ba61-4987-925c-7dfacc2a7170-agent-certs\") pod \"konnectivity-agent-xhz5x\" (UID: \"58be88c8-ba61-4987-925c-7dfacc2a7170\") " pod="kube-system/konnectivity-agent-xhz5x" Jul 24 18:05:09.707216 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.707073 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/10eea99f-1962-47cc-9a25-5dffe9df4490-cni-binary-copy\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.707216 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.707096 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-multus-conf-dir\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.707216 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.707122 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2vr7\" (UniqueName: \"kubernetes.io/projected/10eea99f-1962-47cc-9a25-5dffe9df4490-kube-api-access-j2vr7\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.707216 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.707145 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-etc-tuned\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.707216 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.707167 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-node-log\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.707216 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.707195 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-system-cni-dir\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.707957 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.707217 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-multus-cni-dir\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.707957 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.707242 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-etc-sysctl-d\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.707957 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.707266 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-run\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.707957 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.707291 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa3e62c3-b552-4e46-8715-70fa52700805-metrics-certs\") pod \"network-metrics-daemon-lrwkd\" (UID: \"aa3e62c3-b552-4e46-8715-70fa52700805\") " pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:09.707957 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.707336 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tbk6\" (UniqueName: \"kubernetes.io/projected/21047180-3830-440c-84c7-0043c99a51f9-kube-api-access-7tbk6\") pod \"aws-ebs-csi-driver-node-vwmx6\" (UID: \"21047180-3830-440c-84c7-0043c99a51f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6" Jul 24 18:05:09.707957 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.707361 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3d977d3f-700c-41a7-b570-34b267cf97cf-dbus\") pod \"global-pull-secret-syncer-nhn86\" (UID: \"3d977d3f-700c-41a7-b570-34b267cf97cf\") " pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:09.707957 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.707386 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d977d3f-700c-41a7-b570-34b267cf97cf-original-pull-secret\") pod \"global-pull-secret-syncer-nhn86\" (UID: \"3d977d3f-700c-41a7-b570-34b267cf97cf\") " pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:09.707957 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.707430 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-cnibin\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.707957 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.707458 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3d977d3f-700c-41a7-b570-34b267cf97cf-kubelet-config\") pod \"global-pull-secret-syncer-nhn86\" (UID: \"3d977d3f-700c-41a7-b570-34b267cf97cf\") " pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:09.707957 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.707475 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/68a2426f-2fa7-448d-a3fb-682cc0a4cc84-cnibin\") pod \"multus-additional-cni-plugins-qbwjd\" (UID: \"68a2426f-2fa7-448d-a3fb-682cc0a4cc84\") " pod="openshift-multus/multus-additional-cni-plugins-qbwjd" Jul 24 18:05:09.707957 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.707567 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/68a2426f-2fa7-448d-a3fb-682cc0a4cc84-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qbwjd\" (UID: \"68a2426f-2fa7-448d-a3fb-682cc0a4cc84\") " pod="openshift-multus/multus-additional-cni-plugins-qbwjd" Jul 24 18:05:09.707957 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.707608 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/21047180-3830-440c-84c7-0043c99a51f9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vwmx6\" (UID: \"21047180-3830-440c-84c7-0043c99a51f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6" Jul 24 18:05:09.707957 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.707636 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbsqc\" (UniqueName: \"kubernetes.io/projected/61177079-7b8e-4730-b13b-6d49c72e9ac8-kube-api-access-wbsqc\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.707957 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.707642 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/21047180-3830-440c-84c7-0043c99a51f9-etc-selinux\") pod \"aws-ebs-csi-driver-node-vwmx6\" (UID: \"21047180-3830-440c-84c7-0043c99a51f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6" Jul 24 18:05:09.707957 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.707653 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-etc-kubernetes\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.707957 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:09.707665 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 18:05:09.708726 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:09.707754 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa3e62c3-b552-4e46-8715-70fa52700805-metrics-certs podName:aa3e62c3-b552-4e46-8715-70fa52700805 nodeName:}" failed. No retries permitted until 2026-07-24 18:05:10.2077296 +0000 UTC m=+2.945920663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa3e62c3-b552-4e46-8715-70fa52700805-metrics-certs") pod "network-metrics-daemon-lrwkd" (UID: "aa3e62c3-b552-4e46-8715-70fa52700805") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 18:05:09.708726 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.707671 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/26b225f1-0841-4c29-9cbb-ecd98b274a50-serviceca\") pod \"node-ca-jd9x5\" (UID: \"26b225f1-0841-4c29-9cbb-ecd98b274a50\") " pod="openshift-image-registry/node-ca-jd9x5" Jul 24 18:05:09.708726 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.707935 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 24 18:05:09.708726 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.707945 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ae345ba-357f-42e7-a9d8-9a969ac16761-tmp-dir\") pod \"node-resolver-lghjd\" (UID: \"0ae345ba-357f-42e7-a9d8-9a969ac16761\") " pod="openshift-dns/node-resolver-lghjd" Jul 24 18:05:09.708726 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.707950 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/21047180-3830-440c-84c7-0043c99a51f9-registration-dir\") pod \"aws-ebs-csi-driver-node-vwmx6\" (UID: \"21047180-3830-440c-84c7-0043c99a51f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6" Jul 24 18:05:09.708726 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.707992 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps6f9\" (UniqueName: \"kubernetes.io/projected/346e9e7f-16c1-4b99-b339-c88ea048ba64-kube-api-access-ps6f9\") pod \"network-check-target-7bf8g\" (UID: \"346e9e7f-16c1-4b99-b339-c88ea048ba64\") " pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:09.708726 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.708014 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/26b225f1-0841-4c29-9cbb-ecd98b274a50-serviceca\") pod \"node-ca-jd9x5\" (UID: \"26b225f1-0841-4c29-9cbb-ecd98b274a50\") " pod="openshift-image-registry/node-ca-jd9x5" Jul 24 18:05:09.708726 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.708029 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/58be88c8-ba61-4987-925c-7dfacc2a7170-konnectivity-ca\") pod \"konnectivity-agent-xhz5x\" (UID: \"58be88c8-ba61-4987-925c-7dfacc2a7170\") " pod="kube-system/konnectivity-agent-xhz5x" Jul 24 18:05:09.708726 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.708066 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/68a2426f-2fa7-448d-a3fb-682cc0a4cc84-os-release\") pod \"multus-additional-cni-plugins-qbwjd\" (UID: \"68a2426f-2fa7-448d-a3fb-682cc0a4cc84\") " pod="openshift-multus/multus-additional-cni-plugins-qbwjd" Jul 24 18:05:09.708726 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.708094 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc6gg\" (UniqueName: \"kubernetes.io/projected/68a2426f-2fa7-448d-a3fb-682cc0a4cc84-kube-api-access-vc6gg\") pod \"multus-additional-cni-plugins-qbwjd\" (UID: \"68a2426f-2fa7-448d-a3fb-682cc0a4cc84\") " pod="openshift-multus/multus-additional-cni-plugins-qbwjd" Jul 24 18:05:09.708726 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.708121 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5s5f\" (UniqueName: \"kubernetes.io/projected/26b225f1-0841-4c29-9cbb-ecd98b274a50-kube-api-access-f5s5f\") pod \"node-ca-jd9x5\" (UID: \"26b225f1-0841-4c29-9cbb-ecd98b274a50\") " pod="openshift-image-registry/node-ca-jd9x5" Jul 24 18:05:09.708726 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.708136 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/68a2426f-2fa7-448d-a3fb-682cc0a4cc84-cni-binary-copy\") pod \"multus-additional-cni-plugins-qbwjd\" (UID: \"68a2426f-2fa7-448d-a3fb-682cc0a4cc84\") " pod="openshift-multus/multus-additional-cni-plugins-qbwjd" Jul 24 18:05:09.708726 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.708149 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-etc-openvswitch\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.708726 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.708192 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26b225f1-0841-4c29-9cbb-ecd98b274a50-host\") pod \"node-ca-jd9x5\" (UID: \"26b225f1-0841-4c29-9cbb-ecd98b274a50\") " pod="openshift-image-registry/node-ca-jd9x5" Jul 24 18:05:09.708726 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.708210 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-host-run-netns\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.708726 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.708240 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-host-var-lib-kubelet\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.709449 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.708269 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z85h\" (UniqueName: \"kubernetes.io/projected/0f618324-186e-432d-bbdb-40e7439e3550-kube-api-access-6z85h\") pod \"iptables-alerter-zhwpj\" (UID: \"0f618324-186e-432d-bbdb-40e7439e3550\") " pod="openshift-network-operator/iptables-alerter-zhwpj" Jul 24 18:05:09.709449 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.708284 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/68a2426f-2fa7-448d-a3fb-682cc0a4cc84-os-release\") pod \"multus-additional-cni-plugins-qbwjd\" (UID: \"68a2426f-2fa7-448d-a3fb-682cc0a4cc84\") " pod="openshift-multus/multus-additional-cni-plugins-qbwjd" Jul 24 18:05:09.709449 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.708297 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/21047180-3830-440c-84c7-0043c99a51f9-socket-dir\") pod \"aws-ebs-csi-driver-node-vwmx6\" (UID: \"21047180-3830-440c-84c7-0043c99a51f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6" Jul 24 18:05:09.709449 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.708496 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/68a2426f-2fa7-448d-a3fb-682cc0a4cc84-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qbwjd\" (UID: \"68a2426f-2fa7-448d-a3fb-682cc0a4cc84\") " pod="openshift-multus/multus-additional-cni-plugins-qbwjd" Jul 24 18:05:09.709449 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.708502 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0f618324-186e-432d-bbdb-40e7439e3550-iptables-alerter-script\") pod \"iptables-alerter-zhwpj\" (UID: \"0f618324-186e-432d-bbdb-40e7439e3550\") " pod="openshift-network-operator/iptables-alerter-zhwpj" Jul 24 18:05:09.709449 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.708606 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-host-cni-netd\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.709449 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.708638 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-etc-modprobe-d\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.709449 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.708669 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-lib-modules\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.709449 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.708698 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-var-lib-kubelet\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.709449 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.708723 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-log-socket\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.709449 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.708746 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-host\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.709449 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.708803 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/68a2426f-2fa7-448d-a3fb-682cc0a4cc84-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qbwjd\" (UID: \"68a2426f-2fa7-448d-a3fb-682cc0a4cc84\") " pod="openshift-multus/multus-additional-cni-plugins-qbwjd" Jul 24 18:05:09.709449 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.708848 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/21047180-3830-440c-84c7-0043c99a51f9-socket-dir\") pod \"aws-ebs-csi-driver-node-vwmx6\" (UID: \"21047180-3830-440c-84c7-0043c99a51f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6" Jul 24 18:05:09.709449 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.708856 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/58be88c8-ba61-4987-925c-7dfacc2a7170-konnectivity-ca\") pod \"konnectivity-agent-xhz5x\" (UID: \"58be88c8-ba61-4987-925c-7dfacc2a7170\") " pod="kube-system/konnectivity-agent-xhz5x" Jul 24 18:05:09.709449 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.708857 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/21047180-3830-440c-84c7-0043c99a51f9-device-dir\") pod \"aws-ebs-csi-driver-node-vwmx6\" (UID: \"21047180-3830-440c-84c7-0043c99a51f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6" Jul 24 18:05:09.709449 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.708973 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4bfd\" (UniqueName: \"kubernetes.io/projected/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-kube-api-access-v4bfd\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.710004 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.708982 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/21047180-3830-440c-84c7-0043c99a51f9-device-dir\") pod \"aws-ebs-csi-driver-node-vwmx6\" (UID: \"21047180-3830-440c-84c7-0043c99a51f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6" Jul 24 18:05:09.710004 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.709015 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f618324-186e-432d-bbdb-40e7439e3550-host-slash\") pod \"iptables-alerter-zhwpj\" (UID: \"0f618324-186e-432d-bbdb-40e7439e3550\") " pod="openshift-network-operator/iptables-alerter-zhwpj" Jul 24 18:05:09.710004 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.709054 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f618324-186e-432d-bbdb-40e7439e3550-host-slash\") pod \"iptables-alerter-zhwpj\" (UID: \"0f618324-186e-432d-bbdb-40e7439e3550\") " pod="openshift-network-operator/iptables-alerter-zhwpj" Jul 24 18:05:09.710004 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.709094 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68a2426f-2fa7-448d-a3fb-682cc0a4cc84-system-cni-dir\") pod \"multus-additional-cni-plugins-qbwjd\" (UID: \"68a2426f-2fa7-448d-a3fb-682cc0a4cc84\") " pod="openshift-multus/multus-additional-cni-plugins-qbwjd" Jul 24 18:05:09.710004 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.709131 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68a2426f-2fa7-448d-a3fb-682cc0a4cc84-system-cni-dir\") pod \"multus-additional-cni-plugins-qbwjd\" (UID: \"68a2426f-2fa7-448d-a3fb-682cc0a4cc84\") " pod="openshift-multus/multus-additional-cni-plugins-qbwjd" Jul 24 18:05:09.710004 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.709173 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqdlx\" (UniqueName: \"kubernetes.io/projected/aa3e62c3-b552-4e46-8715-70fa52700805-kube-api-access-vqdlx\") pod \"network-metrics-daemon-lrwkd\" (UID: \"aa3e62c3-b552-4e46-8715-70fa52700805\") " pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:09.710004 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.709229 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/21047180-3830-440c-84c7-0043c99a51f9-sys-fs\") pod \"aws-ebs-csi-driver-node-vwmx6\" (UID: \"21047180-3830-440c-84c7-0043c99a51f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6" Jul 24 18:05:09.710004 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.709288 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/68a2426f-2fa7-448d-a3fb-682cc0a4cc84-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qbwjd\" (UID: \"68a2426f-2fa7-448d-a3fb-682cc0a4cc84\") " pod="openshift-multus/multus-additional-cni-plugins-qbwjd" Jul 24 18:05:09.710004 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.709369 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/21047180-3830-440c-84c7-0043c99a51f9-sys-fs\") pod \"aws-ebs-csi-driver-node-vwmx6\" (UID: \"21047180-3830-440c-84c7-0043c99a51f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6" Jul 24 18:05:09.712217 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.712195 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/58be88c8-ba61-4987-925c-7dfacc2a7170-agent-certs\") pod \"konnectivity-agent-xhz5x\" (UID: \"58be88c8-ba61-4987-925c-7dfacc2a7170\") " pod="kube-system/konnectivity-agent-xhz5x" Jul 24 18:05:09.720510 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.720484 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5s5f\" (UniqueName: \"kubernetes.io/projected/26b225f1-0841-4c29-9cbb-ecd98b274a50-kube-api-access-f5s5f\") pod \"node-ca-jd9x5\" (UID: \"26b225f1-0841-4c29-9cbb-ecd98b274a50\") " pod="openshift-image-registry/node-ca-jd9x5" Jul 24 18:05:09.721669 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.721647 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tbk6\" (UniqueName: \"kubernetes.io/projected/21047180-3830-440c-84c7-0043c99a51f9-kube-api-access-7tbk6\") pod \"aws-ebs-csi-driver-node-vwmx6\" (UID: \"21047180-3830-440c-84c7-0043c99a51f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6" Jul 24 18:05:09.725062 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.725039 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z85h\" (UniqueName: \"kubernetes.io/projected/0f618324-186e-432d-bbdb-40e7439e3550-kube-api-access-6z85h\") pod \"iptables-alerter-zhwpj\" (UID: \"0f618324-186e-432d-bbdb-40e7439e3550\") " pod="openshift-network-operator/iptables-alerter-zhwpj" Jul 24 18:05:09.725899 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.725826 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqdlx\" (UniqueName: \"kubernetes.io/projected/aa3e62c3-b552-4e46-8715-70fa52700805-kube-api-access-vqdlx\") pod \"network-metrics-daemon-lrwkd\" (UID: \"aa3e62c3-b552-4e46-8715-70fa52700805\") " pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:09.731218 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.731197 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc6gg\" (UniqueName: \"kubernetes.io/projected/68a2426f-2fa7-448d-a3fb-682cc0a4cc84-kube-api-access-vc6gg\") pod \"multus-additional-cni-plugins-qbwjd\" (UID: \"68a2426f-2fa7-448d-a3fb-682cc0a4cc84\") " pod="openshift-multus/multus-additional-cni-plugins-qbwjd" Jul 24 18:05:09.810184 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.809969 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/10eea99f-1962-47cc-9a25-5dffe9df4490-cni-binary-copy\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.810184 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810006 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-multus-conf-dir\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.810184 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810039 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2vr7\" (UniqueName: \"kubernetes.io/projected/10eea99f-1962-47cc-9a25-5dffe9df4490-kube-api-access-j2vr7\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.810184 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810061 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-etc-tuned\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.810184 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810083 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-node-log\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.810184 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810102 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-system-cni-dir\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.810184 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810118 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-multus-cni-dir\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.810184 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810153 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-multus-conf-dir\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.810184 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810188 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-etc-sysctl-d\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.810818 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810230 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-system-cni-dir\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.810818 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810234 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-run\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.810818 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810289 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3d977d3f-700c-41a7-b570-34b267cf97cf-dbus\") pod \"global-pull-secret-syncer-nhn86\" (UID: \"3d977d3f-700c-41a7-b570-34b267cf97cf\") " pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:09.810818 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810310 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-etc-sysctl-d\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.810818 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810333 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d977d3f-700c-41a7-b570-34b267cf97cf-original-pull-secret\") pod \"global-pull-secret-syncer-nhn86\" (UID: \"3d977d3f-700c-41a7-b570-34b267cf97cf\") " pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:09.810818 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810380 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-cnibin\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.810818 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810412 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3d977d3f-700c-41a7-b570-34b267cf97cf-kubelet-config\") pod \"global-pull-secret-syncer-nhn86\" (UID: \"3d977d3f-700c-41a7-b570-34b267cf97cf\") " pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:09.810818 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:09.810429 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 18:05:09.810818 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810379 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-multus-cni-dir\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.810818 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810447 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbsqc\" (UniqueName: \"kubernetes.io/projected/61177079-7b8e-4730-b13b-6d49c72e9ac8-kube-api-access-wbsqc\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.810818 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810489 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-node-log\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.810818 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:09.810497 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d977d3f-700c-41a7-b570-34b267cf97cf-original-pull-secret podName:3d977d3f-700c-41a7-b570-34b267cf97cf nodeName:}" failed. No retries permitted until 2026-07-24 18:05:10.310475052 +0000 UTC m=+3.048666104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d977d3f-700c-41a7-b570-34b267cf97cf-original-pull-secret") pod "global-pull-secret-syncer-nhn86" (UID: "3d977d3f-700c-41a7-b570-34b267cf97cf") : object "kube-system"/"original-pull-secret" not registered Jul 24 18:05:09.810818 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810433 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-cnibin\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.810818 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810534 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-etc-kubernetes\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.810818 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810566 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ae345ba-357f-42e7-a9d8-9a969ac16761-tmp-dir\") pod \"node-resolver-lghjd\" (UID: \"0ae345ba-357f-42e7-a9d8-9a969ac16761\") " pod="openshift-dns/node-resolver-lghjd" Jul 24 18:05:09.810818 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810588 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-etc-kubernetes\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.810818 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810598 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps6f9\" (UniqueName: \"kubernetes.io/projected/346e9e7f-16c1-4b99-b339-c88ea048ba64-kube-api-access-ps6f9\") pod \"network-check-target-7bf8g\" (UID: \"346e9e7f-16c1-4b99-b339-c88ea048ba64\") " pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:09.810818 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810630 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-etc-openvswitch\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.811755 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810659 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-host-run-netns\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.811755 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810687 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-host-var-lib-kubelet\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.811755 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810744 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-etc-openvswitch\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.811755 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810754 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-host-cni-netd\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.811755 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810790 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-host-var-lib-kubelet\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.811755 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810806 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-etc-modprobe-d\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.811755 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810839 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-lib-modules\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.811755 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810859 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-host-cni-netd\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.811755 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810862 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-var-lib-kubelet\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.811755 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.810934 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-var-lib-kubelet\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.811755 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811005 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-run\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.811755 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811020 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-lib-modules\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.811755 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811058 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-log-socket\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.811755 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811065 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3d977d3f-700c-41a7-b570-34b267cf97cf-dbus\") pod \"global-pull-secret-syncer-nhn86\" (UID: \"3d977d3f-700c-41a7-b570-34b267cf97cf\") " pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:09.811755 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811065 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ae345ba-357f-42e7-a9d8-9a969ac16761-tmp-dir\") pod \"node-resolver-lghjd\" (UID: \"0ae345ba-357f-42e7-a9d8-9a969ac16761\") " pod="openshift-dns/node-resolver-lghjd" Jul 24 18:05:09.811755 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811109 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-host\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.811755 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811128 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-log-socket\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.811755 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811149 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-etc-modprobe-d\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.812591 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811154 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4bfd\" (UniqueName: \"kubernetes.io/projected/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-kube-api-access-v4bfd\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.812591 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811182 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/10eea99f-1962-47cc-9a25-5dffe9df4490-cni-binary-copy\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.812591 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811185 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3d977d3f-700c-41a7-b570-34b267cf97cf-kubelet-config\") pod \"global-pull-secret-syncer-nhn86\" (UID: \"3d977d3f-700c-41a7-b570-34b267cf97cf\") " pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:09.812591 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811114 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-host-run-netns\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.812591 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811215 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-host-slash\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.812591 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811227 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-host\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.812591 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811252 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-host-slash\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.812591 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811256 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-run-systemd\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.812591 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811336 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-run-systemd\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.812591 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811375 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-host-var-lib-cni-bin\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.812591 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811404 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-host-var-lib-cni-multus\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.812591 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811419 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-host-var-lib-cni-bin\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.812591 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811448 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-run-openvswitch\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.812591 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811458 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-host-var-lib-cni-multus\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.812591 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811488 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-host-run-netns\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.812591 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811505 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-run-openvswitch\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.812591 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811514 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-var-lib-openvswitch\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.812591 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811544 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/10eea99f-1962-47cc-9a25-5dffe9df4490-multus-daemon-config\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.813495 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811553 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-host-run-netns\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.813495 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811575 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-host-run-multus-certs\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.813495 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811597 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-var-lib-openvswitch\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.813495 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811604 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-etc-systemd\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.813495 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811637 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/61177079-7b8e-4730-b13b-6d49c72e9ac8-ovn-node-metrics-cert\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.813495 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811651 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-host-run-multus-certs\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.813495 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811697 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/61177079-7b8e-4730-b13b-6d49c72e9ac8-ovnkube-script-lib\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.813495 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811903 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-os-release\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.813495 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811943 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ae345ba-357f-42e7-a9d8-9a969ac16761-hosts-file\") pod \"node-resolver-lghjd\" (UID: \"0ae345ba-357f-42e7-a9d8-9a969ac16761\") " pod="openshift-dns/node-resolver-lghjd" Jul 24 18:05:09.813495 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811973 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-host-run-ovn-kubernetes\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.813495 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.811996 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-hostroot\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.813495 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.812025 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.813495 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.812054 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/61177079-7b8e-4730-b13b-6d49c72e9ac8-ovnkube-config\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.813495 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.812081 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/61177079-7b8e-4730-b13b-6d49c72e9ac8-env-overrides\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.813495 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.812109 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-sys\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.813495 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.812134 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-tmp\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.813495 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.812162 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-etc-sysconfig\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.813495 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.812192 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-etc-kubernetes\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.814405 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.812220 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-etc-sysctl-conf\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.814405 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.812252 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfbcf\" (UniqueName: \"kubernetes.io/projected/0ae345ba-357f-42e7-a9d8-9a969ac16761-kube-api-access-nfbcf\") pod \"node-resolver-lghjd\" (UID: \"0ae345ba-357f-42e7-a9d8-9a969ac16761\") " pod="openshift-dns/node-resolver-lghjd" Jul 24 18:05:09.814405 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.812654 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/10eea99f-1962-47cc-9a25-5dffe9df4490-multus-daemon-config\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.814405 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.812734 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ae345ba-357f-42e7-a9d8-9a969ac16761-hosts-file\") pod \"node-resolver-lghjd\" (UID: \"0ae345ba-357f-42e7-a9d8-9a969ac16761\") " pod="openshift-dns/node-resolver-lghjd" Jul 24 18:05:09.814405 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.812790 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-etc-systemd\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.814405 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.813068 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-host-run-ovn-kubernetes\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.814405 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.813125 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-hostroot\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.814405 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.813181 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.814405 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.813207 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/61177079-7b8e-4730-b13b-6d49c72e9ac8-ovnkube-config\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.814405 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.813294 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/61177079-7b8e-4730-b13b-6d49c72e9ac8-ovnkube-script-lib\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.814405 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.813413 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-os-release\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.814405 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.813504 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-sys\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.814405 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.813977 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-etc-tuned\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.814405 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.814088 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/61177079-7b8e-4730-b13b-6d49c72e9ac8-env-overrides\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.816468 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.815440 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-etc-kubernetes\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.816468 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.815625 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-etc-sysctl-conf\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.816468 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.815709 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-host-kubelet\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.816468 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.815745 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-systemd-units\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.816468 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.815778 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-run-ovn\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.816468 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.815809 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-host-cni-bin\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.816468 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.815860 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-etc-sysconfig\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.816468 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.815906 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-multus-socket-dir-parent\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.816468 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.815942 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-host-run-k8s-cni-cncf-io\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.816468 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.816053 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-host-cni-bin\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.816468 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.816101 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-host-kubelet\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.816468 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.816148 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-systemd-units\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.816468 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.816373 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/61177079-7b8e-4730-b13b-6d49c72e9ac8-run-ovn\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.816468 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.816402 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-host-run-k8s-cni-cncf-io\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.816468 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.816406 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/10eea99f-1962-47cc-9a25-5dffe9df4490-multus-socket-dir-parent\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.816954 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.816537 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-tmp\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.819204 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.819025 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/61177079-7b8e-4730-b13b-6d49c72e9ac8-ovn-node-metrics-cert\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.828607 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:09.828541 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 18:05:09.828607 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:09.828566 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 18:05:09.828607 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:09.828580 2562 projected.go:196] Error preparing data for projected volume kube-api-access-ps6f9 for pod openshift-network-diagnostics/network-check-target-7bf8g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 18:05:09.828816 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:09.828655 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/346e9e7f-16c1-4b99-b339-c88ea048ba64-kube-api-access-ps6f9 podName:346e9e7f-16c1-4b99-b339-c88ea048ba64 nodeName:}" failed. No retries permitted until 2026-07-24 18:05:10.328636867 +0000 UTC m=+3.066827915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ps6f9" (UniqueName: "kubernetes.io/projected/346e9e7f-16c1-4b99-b339-c88ea048ba64-kube-api-access-ps6f9") pod "network-check-target-7bf8g" (UID: "346e9e7f-16c1-4b99-b339-c88ea048ba64") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 18:05:09.830420 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.830395 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfbcf\" (UniqueName: \"kubernetes.io/projected/0ae345ba-357f-42e7-a9d8-9a969ac16761-kube-api-access-nfbcf\") pod \"node-resolver-lghjd\" (UID: \"0ae345ba-357f-42e7-a9d8-9a969ac16761\") " pod="openshift-dns/node-resolver-lghjd" Jul 24 18:05:09.830941 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.830919 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4bfd\" (UniqueName: \"kubernetes.io/projected/6a57fff6-be4e-49eb-b89e-0b25c9f4474d-kube-api-access-v4bfd\") pod \"tuned-rl2gk\" (UID: \"6a57fff6-be4e-49eb-b89e-0b25c9f4474d\") " pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.833275 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.833256 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2vr7\" (UniqueName: \"kubernetes.io/projected/10eea99f-1962-47cc-9a25-5dffe9df4490-kube-api-access-j2vr7\") pod \"multus-t2s7k\" (UID: \"10eea99f-1962-47cc-9a25-5dffe9df4490\") " pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.834930 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.834913 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbsqc\" (UniqueName: \"kubernetes.io/projected/61177079-7b8e-4730-b13b-6d49c72e9ac8-kube-api-access-wbsqc\") pod \"ovnkube-node-6q2bl\" (UID: \"61177079-7b8e-4730-b13b-6d49c72e9ac8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.836141 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.836050 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal" event={"ID":"3cfd5414b866fa7c304bf5793599e9c5","Type":"ContainerStarted","Data":"0c2cffd9675325c0928697486f8e020286ba3e3b79451f06b0672521a4c540b1"} Jul 24 18:05:09.837733 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.837709 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-233.ec2.internal" event={"ID":"e5af1d32bcd4dadeb92279281a901285","Type":"ContainerStarted","Data":"32a4e37fbdf9ce4f939916209af2c57cc82f33bb78f8995e893c5f1129795570"} Jul 24 18:05:09.900626 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.900360 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6" Jul 24 18:05:09.913304 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.913257 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jd9x5" Jul 24 18:05:09.922056 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.922031 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xhz5x" Jul 24 18:05:09.928642 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.928620 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zhwpj" Jul 24 18:05:09.935120 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.935101 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qbwjd" Jul 24 18:05:09.943136 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.943112 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:09.952863 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.952838 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t2s7k" Jul 24 18:05:09.960855 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.960833 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" Jul 24 18:05:09.965400 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.965369 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lghjd" Jul 24 18:05:09.975559 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:09.975537 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 18:05:10.219466 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:10.219358 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa3e62c3-b552-4e46-8715-70fa52700805-metrics-certs\") pod \"network-metrics-daemon-lrwkd\" (UID: \"aa3e62c3-b552-4e46-8715-70fa52700805\") " pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:10.219629 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:10.219500 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 18:05:10.219629 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:10.219567 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa3e62c3-b552-4e46-8715-70fa52700805-metrics-certs podName:aa3e62c3-b552-4e46-8715-70fa52700805 nodeName:}" failed. No retries permitted until 2026-07-24 18:05:11.21954632 +0000 UTC m=+3.957737388 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa3e62c3-b552-4e46-8715-70fa52700805-metrics-certs") pod "network-metrics-daemon-lrwkd" (UID: "aa3e62c3-b552-4e46-8715-70fa52700805") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 18:05:10.320463 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:10.320418 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d977d3f-700c-41a7-b570-34b267cf97cf-original-pull-secret\") pod \"global-pull-secret-syncer-nhn86\" (UID: \"3d977d3f-700c-41a7-b570-34b267cf97cf\") " pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:10.320636 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:10.320570 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 18:05:10.320636 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:10.320624 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d977d3f-700c-41a7-b570-34b267cf97cf-original-pull-secret podName:3d977d3f-700c-41a7-b570-34b267cf97cf nodeName:}" failed. No retries permitted until 2026-07-24 18:05:11.320609458 +0000 UTC m=+4.058800506 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d977d3f-700c-41a7-b570-34b267cf97cf-original-pull-secret") pod "global-pull-secret-syncer-nhn86" (UID: "3d977d3f-700c-41a7-b570-34b267cf97cf") : object "kube-system"/"original-pull-secret" not registered Jul 24 18:05:10.421584 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:10.421551 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps6f9\" (UniqueName: \"kubernetes.io/projected/346e9e7f-16c1-4b99-b339-c88ea048ba64-kube-api-access-ps6f9\") pod \"network-check-target-7bf8g\" (UID: \"346e9e7f-16c1-4b99-b339-c88ea048ba64\") " pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:10.421753 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:10.421715 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 18:05:10.421753 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:10.421733 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 18:05:10.421753 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:10.421749 2562 projected.go:196] Error preparing data for projected volume kube-api-access-ps6f9 for pod openshift-network-diagnostics/network-check-target-7bf8g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 18:05:10.421869 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:10.421801 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/346e9e7f-16c1-4b99-b339-c88ea048ba64-kube-api-access-ps6f9 podName:346e9e7f-16c1-4b99-b339-c88ea048ba64 nodeName:}" failed. No retries permitted until 2026-07-24 18:05:11.421787404 +0000 UTC m=+4.159978452 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ps6f9" (UniqueName: "kubernetes.io/projected/346e9e7f-16c1-4b99-b339-c88ea048ba64-kube-api-access-ps6f9") pod "network-check-target-7bf8g" (UID: "346e9e7f-16c1-4b99-b339-c88ea048ba64") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 18:05:10.651695 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:10.651649 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 18:00:09 +0000 UTC" deadline="2028-01-05 19:16:04.307030619 +0000 UTC" Jul 24 18:05:10.651695 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:10.651691 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12721h10m53.655343388s" Jul 24 18:05:10.777743 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:10.777714 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21047180_3830_440c_84c7_0043c99a51f9.slice/crio-a1228e2bcdcacc5b14aef49dbfd9e6af386d561ac65a7470fe5063a3af764449 WatchSource:0}: Error finding container a1228e2bcdcacc5b14aef49dbfd9e6af386d561ac65a7470fe5063a3af764449: Status 404 returned error can't find the container with id a1228e2bcdcacc5b14aef49dbfd9e6af386d561ac65a7470fe5063a3af764449 Jul 24 18:05:10.794981 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:10.793049 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ae345ba_357f_42e7_a9d8_9a969ac16761.slice/crio-a76782cd15f0da8b822c6667e1fd9b44028822233d99b7a735f7633436e15259 WatchSource:0}: Error finding container a76782cd15f0da8b822c6667e1fd9b44028822233d99b7a735f7633436e15259: Status 404 returned error can't find the container with id a76782cd15f0da8b822c6667e1fd9b44028822233d99b7a735f7633436e15259 Jul 24 18:05:10.795358 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:10.795306 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26b225f1_0841_4c29_9cbb_ecd98b274a50.slice/crio-a505d4d3615cabbce1a8348688925a56635dd7246dbdcde1ff720e80e6a3ca91 WatchSource:0}: Error finding container a505d4d3615cabbce1a8348688925a56635dd7246dbdcde1ff720e80e6a3ca91: Status 404 returned error can't find the container with id a505d4d3615cabbce1a8348688925a56635dd7246dbdcde1ff720e80e6a3ca91 Jul 24 18:05:10.795811 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:10.795667 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10eea99f_1962_47cc_9a25_5dffe9df4490.slice/crio-a0e271bb8da0633433b5f6a0cef4b8c060547584f834c77e49d450436a61e070 WatchSource:0}: Error finding container a0e271bb8da0633433b5f6a0cef4b8c060547584f834c77e49d450436a61e070: Status 404 returned error can't find the container with id a0e271bb8da0633433b5f6a0cef4b8c060547584f834c77e49d450436a61e070 Jul 24 18:05:10.796759 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:10.796530 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a57fff6_be4e_49eb_b89e_0b25c9f4474d.slice/crio-f745728fc74cbecb1d696b529c313ce3a372791ccdb142e2c2e9d66b466604a5 WatchSource:0}: Error finding container f745728fc74cbecb1d696b529c313ce3a372791ccdb142e2c2e9d66b466604a5: Status 404 returned error can't find the container with id f745728fc74cbecb1d696b529c313ce3a372791ccdb142e2c2e9d66b466604a5 Jul 24 18:05:10.797868 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:10.797742 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68a2426f_2fa7_448d_a3fb_682cc0a4cc84.slice/crio-f3cf53d2aa544394617189fa0ddee2cac63adf13b3137d418b1483ccae260c72 WatchSource:0}: Error finding container f3cf53d2aa544394617189fa0ddee2cac63adf13b3137d418b1483ccae260c72: Status 404 returned error can't find the container with id f3cf53d2aa544394617189fa0ddee2cac63adf13b3137d418b1483ccae260c72 Jul 24 18:05:10.798870 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:10.798833 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58be88c8_ba61_4987_925c_7dfacc2a7170.slice/crio-b85033664ef473c114d217bc015600f431e04ed9281855c9083fa5bd4b9573c9 WatchSource:0}: Error finding container b85033664ef473c114d217bc015600f431e04ed9281855c9083fa5bd4b9573c9: Status 404 returned error can't find the container with id b85033664ef473c114d217bc015600f431e04ed9281855c9083fa5bd4b9573c9 Jul 24 18:05:10.799614 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:10.799592 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f618324_186e_432d_bbdb_40e7439e3550.slice/crio-fd1b59b6fb776ad2753e0836d28fdb1428184894ee9c3815ea92839bdfd2aa5c WatchSource:0}: Error finding container fd1b59b6fb776ad2753e0836d28fdb1428184894ee9c3815ea92839bdfd2aa5c: Status 404 returned error can't find the container with id fd1b59b6fb776ad2753e0836d28fdb1428184894ee9c3815ea92839bdfd2aa5c Jul 24 18:05:10.801728 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:05:10.800514 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61177079_7b8e_4730_b13b_6d49c72e9ac8.slice/crio-5af7d766f2e1ba5cac7e5734caac2ee27f6109c37171be737cfe1afee3786ddf WatchSource:0}: Error finding container 5af7d766f2e1ba5cac7e5734caac2ee27f6109c37171be737cfe1afee3786ddf: Status 404 returned error can't find the container with id 5af7d766f2e1ba5cac7e5734caac2ee27f6109c37171be737cfe1afee3786ddf Jul 24 18:05:10.829796 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:10.829772 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:10.829885 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:10.829772 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:10.829929 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:10.829907 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhn86" podUID="3d977d3f-700c-41a7-b570-34b267cf97cf" Jul 24 18:05:10.830009 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:10.829989 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrwkd" podUID="aa3e62c3-b552-4e46-8715-70fa52700805" Jul 24 18:05:10.843135 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:10.843103 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jd9x5" event={"ID":"26b225f1-0841-4c29-9cbb-ecd98b274a50","Type":"ContainerStarted","Data":"a505d4d3615cabbce1a8348688925a56635dd7246dbdcde1ff720e80e6a3ca91"} Jul 24 18:05:10.844337 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:10.844293 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xhz5x" event={"ID":"58be88c8-ba61-4987-925c-7dfacc2a7170","Type":"ContainerStarted","Data":"b85033664ef473c114d217bc015600f431e04ed9281855c9083fa5bd4b9573c9"} Jul 24 18:05:10.845450 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:10.845278 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" event={"ID":"6a57fff6-be4e-49eb-b89e-0b25c9f4474d","Type":"ContainerStarted","Data":"f745728fc74cbecb1d696b529c313ce3a372791ccdb142e2c2e9d66b466604a5"} Jul 24 18:05:10.846371 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:10.846352 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lghjd" event={"ID":"0ae345ba-357f-42e7-a9d8-9a969ac16761","Type":"ContainerStarted","Data":"a76782cd15f0da8b822c6667e1fd9b44028822233d99b7a735f7633436e15259"} Jul 24 18:05:10.847597 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:10.847571 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6" event={"ID":"21047180-3830-440c-84c7-0043c99a51f9","Type":"ContainerStarted","Data":"a1228e2bcdcacc5b14aef49dbfd9e6af386d561ac65a7470fe5063a3af764449"} Jul 24 18:05:10.848793 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:10.848774 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" event={"ID":"61177079-7b8e-4730-b13b-6d49c72e9ac8","Type":"ContainerStarted","Data":"5af7d766f2e1ba5cac7e5734caac2ee27f6109c37171be737cfe1afee3786ddf"} Jul 24 18:05:10.849944 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:10.849920 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zhwpj" event={"ID":"0f618324-186e-432d-bbdb-40e7439e3550","Type":"ContainerStarted","Data":"fd1b59b6fb776ad2753e0836d28fdb1428184894ee9c3815ea92839bdfd2aa5c"} Jul 24 18:05:10.851079 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:10.851054 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbwjd" event={"ID":"68a2426f-2fa7-448d-a3fb-682cc0a4cc84","Type":"ContainerStarted","Data":"f3cf53d2aa544394617189fa0ddee2cac63adf13b3137d418b1483ccae260c72"} Jul 24 18:05:10.852243 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:10.852199 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t2s7k" event={"ID":"10eea99f-1962-47cc-9a25-5dffe9df4490","Type":"ContainerStarted","Data":"a0e271bb8da0633433b5f6a0cef4b8c060547584f834c77e49d450436a61e070"} Jul 24 18:05:11.228203 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:11.228085 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa3e62c3-b552-4e46-8715-70fa52700805-metrics-certs\") pod \"network-metrics-daemon-lrwkd\" (UID: \"aa3e62c3-b552-4e46-8715-70fa52700805\") " pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:11.228374 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:11.228267 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 18:05:11.228374 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:11.228347 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa3e62c3-b552-4e46-8715-70fa52700805-metrics-certs podName:aa3e62c3-b552-4e46-8715-70fa52700805 nodeName:}" failed. No retries permitted until 2026-07-24 18:05:13.228311503 +0000 UTC m=+5.966502554 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa3e62c3-b552-4e46-8715-70fa52700805-metrics-certs") pod "network-metrics-daemon-lrwkd" (UID: "aa3e62c3-b552-4e46-8715-70fa52700805") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 18:05:11.328699 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:11.328659 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d977d3f-700c-41a7-b570-34b267cf97cf-original-pull-secret\") pod \"global-pull-secret-syncer-nhn86\" (UID: \"3d977d3f-700c-41a7-b570-34b267cf97cf\") " pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:11.328876 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:11.328817 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 18:05:11.328963 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:11.328889 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d977d3f-700c-41a7-b570-34b267cf97cf-original-pull-secret podName:3d977d3f-700c-41a7-b570-34b267cf97cf nodeName:}" failed. No retries permitted until 2026-07-24 18:05:13.328870284 +0000 UTC m=+6.067061336 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d977d3f-700c-41a7-b570-34b267cf97cf-original-pull-secret") pod "global-pull-secret-syncer-nhn86" (UID: "3d977d3f-700c-41a7-b570-34b267cf97cf") : object "kube-system"/"original-pull-secret" not registered Jul 24 18:05:11.429928 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:11.429889 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps6f9\" (UniqueName: \"kubernetes.io/projected/346e9e7f-16c1-4b99-b339-c88ea048ba64-kube-api-access-ps6f9\") pod \"network-check-target-7bf8g\" (UID: \"346e9e7f-16c1-4b99-b339-c88ea048ba64\") " pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:11.430122 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:11.430066 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 18:05:11.430122 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:11.430090 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 18:05:11.430122 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:11.430103 2562 projected.go:196] Error preparing data for projected volume kube-api-access-ps6f9 for pod openshift-network-diagnostics/network-check-target-7bf8g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 18:05:11.430280 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:11.430178 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/346e9e7f-16c1-4b99-b339-c88ea048ba64-kube-api-access-ps6f9 podName:346e9e7f-16c1-4b99-b339-c88ea048ba64 nodeName:}" failed. No retries permitted until 2026-07-24 18:05:13.430159275 +0000 UTC m=+6.168350339 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ps6f9" (UniqueName: "kubernetes.io/projected/346e9e7f-16c1-4b99-b339-c88ea048ba64-kube-api-access-ps6f9") pod "network-check-target-7bf8g" (UID: "346e9e7f-16c1-4b99-b339-c88ea048ba64") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 18:05:11.652226 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:11.652121 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 18:00:09 +0000 UTC" deadline="2028-01-02 14:18:36.361162336 +0000 UTC" Jul 24 18:05:11.652226 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:11.652162 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12644h13m24.709004716s" Jul 24 18:05:11.832080 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:11.832045 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:11.832223 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:11.832202 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bf8g" podUID="346e9e7f-16c1-4b99-b339-c88ea048ba64" Jul 24 18:05:11.875063 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:11.874389 2562 generic.go:356] "Generic (PLEG): container finished" podID="3cfd5414b866fa7c304bf5793599e9c5" containerID="4f057c9ddddde59352a51c22659850dce24855c5b726637777349efbf023484d" exitCode=0 Jul 24 18:05:11.875063 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:11.874475 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal" event={"ID":"3cfd5414b866fa7c304bf5793599e9c5","Type":"ContainerDied","Data":"4f057c9ddddde59352a51c22659850dce24855c5b726637777349efbf023484d"} Jul 24 18:05:11.896868 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:11.896835 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-233.ec2.internal" event={"ID":"e5af1d32bcd4dadeb92279281a901285","Type":"ContainerStarted","Data":"dd5eae3f57af28a96b919160134845325bfdb8ea71ddc799206f411c138fcd71"} Jul 24 18:05:12.831181 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:12.830434 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:12.831181 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:12.830571 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhn86" podUID="3d977d3f-700c-41a7-b570-34b267cf97cf" Jul 24 18:05:12.831181 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:12.830986 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:12.831181 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:12.831092 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrwkd" podUID="aa3e62c3-b552-4e46-8715-70fa52700805" Jul 24 18:05:12.921909 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:12.921875 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal" event={"ID":"3cfd5414b866fa7c304bf5793599e9c5","Type":"ContainerStarted","Data":"775cf4307733d9f55b29b0ac5164cb1c716b77111d9793d3cc266955d0a7cc90"} Jul 24 18:05:12.939151 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:12.939098 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-233.ec2.internal" podStartSLOduration=4.9390794190000005 podStartE2EDuration="4.939079419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:05:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:05:11.912259383 +0000 UTC m=+4.650450456" watchObservedRunningTime="2026-07-24 18:05:12.939079419 +0000 UTC m=+5.677270492" Jul 24 18:05:13.246635 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:13.244289 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa3e62c3-b552-4e46-8715-70fa52700805-metrics-certs\") pod \"network-metrics-daemon-lrwkd\" (UID: \"aa3e62c3-b552-4e46-8715-70fa52700805\") " pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:13.246635 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:13.244477 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 18:05:13.246635 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:13.244544 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa3e62c3-b552-4e46-8715-70fa52700805-metrics-certs podName:aa3e62c3-b552-4e46-8715-70fa52700805 nodeName:}" failed. No retries permitted until 2026-07-24 18:05:17.244526936 +0000 UTC m=+9.982717991 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa3e62c3-b552-4e46-8715-70fa52700805-metrics-certs") pod "network-metrics-daemon-lrwkd" (UID: "aa3e62c3-b552-4e46-8715-70fa52700805") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 18:05:13.344906 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:13.344850 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d977d3f-700c-41a7-b570-34b267cf97cf-original-pull-secret\") pod \"global-pull-secret-syncer-nhn86\" (UID: \"3d977d3f-700c-41a7-b570-34b267cf97cf\") " pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:13.345093 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:13.345028 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 18:05:13.345093 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:13.345092 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d977d3f-700c-41a7-b570-34b267cf97cf-original-pull-secret podName:3d977d3f-700c-41a7-b570-34b267cf97cf nodeName:}" failed. No retries permitted until 2026-07-24 18:05:17.345072978 +0000 UTC m=+10.083264030 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d977d3f-700c-41a7-b570-34b267cf97cf-original-pull-secret") pod "global-pull-secret-syncer-nhn86" (UID: "3d977d3f-700c-41a7-b570-34b267cf97cf") : object "kube-system"/"original-pull-secret" not registered Jul 24 18:05:13.445452 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:13.445415 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps6f9\" (UniqueName: \"kubernetes.io/projected/346e9e7f-16c1-4b99-b339-c88ea048ba64-kube-api-access-ps6f9\") pod \"network-check-target-7bf8g\" (UID: \"346e9e7f-16c1-4b99-b339-c88ea048ba64\") " pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:13.445653 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:13.445623 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 18:05:13.445653 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:13.445652 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 18:05:13.445768 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:13.445664 2562 projected.go:196] Error preparing data for projected volume kube-api-access-ps6f9 for pod openshift-network-diagnostics/network-check-target-7bf8g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 18:05:13.445768 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:13.445726 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/346e9e7f-16c1-4b99-b339-c88ea048ba64-kube-api-access-ps6f9 podName:346e9e7f-16c1-4b99-b339-c88ea048ba64 nodeName:}" failed. No retries permitted until 2026-07-24 18:05:17.445707464 +0000 UTC m=+10.183898535 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ps6f9" (UniqueName: "kubernetes.io/projected/346e9e7f-16c1-4b99-b339-c88ea048ba64-kube-api-access-ps6f9") pod "network-check-target-7bf8g" (UID: "346e9e7f-16c1-4b99-b339-c88ea048ba64") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 18:05:13.832456 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:13.832423 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:13.832892 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:13.832557 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bf8g" podUID="346e9e7f-16c1-4b99-b339-c88ea048ba64" Jul 24 18:05:14.829922 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:14.829889 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:14.830128 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:14.830047 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrwkd" podUID="aa3e62c3-b552-4e46-8715-70fa52700805" Jul 24 18:05:14.830431 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:14.830408 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:14.830538 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:14.830516 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhn86" podUID="3d977d3f-700c-41a7-b570-34b267cf97cf" Jul 24 18:05:15.831003 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:15.830427 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:15.831003 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:15.830557 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bf8g" podUID="346e9e7f-16c1-4b99-b339-c88ea048ba64" Jul 24 18:05:16.830091 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:16.830052 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:16.830267 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:16.830191 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhn86" podUID="3d977d3f-700c-41a7-b570-34b267cf97cf" Jul 24 18:05:16.830593 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:16.830576 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:16.830671 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:16.830652 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrwkd" podUID="aa3e62c3-b552-4e46-8715-70fa52700805" Jul 24 18:05:17.281607 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:17.281517 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa3e62c3-b552-4e46-8715-70fa52700805-metrics-certs\") pod \"network-metrics-daemon-lrwkd\" (UID: \"aa3e62c3-b552-4e46-8715-70fa52700805\") " pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:17.282066 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:17.281689 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 18:05:17.282066 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:17.281737 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa3e62c3-b552-4e46-8715-70fa52700805-metrics-certs podName:aa3e62c3-b552-4e46-8715-70fa52700805 nodeName:}" failed. No retries permitted until 2026-07-24 18:05:25.281723661 +0000 UTC m=+18.019914709 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa3e62c3-b552-4e46-8715-70fa52700805-metrics-certs") pod "network-metrics-daemon-lrwkd" (UID: "aa3e62c3-b552-4e46-8715-70fa52700805") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 18:05:17.382525 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:17.382478 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d977d3f-700c-41a7-b570-34b267cf97cf-original-pull-secret\") pod \"global-pull-secret-syncer-nhn86\" (UID: \"3d977d3f-700c-41a7-b570-34b267cf97cf\") " pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:17.382682 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:17.382630 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 18:05:17.382750 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:17.382697 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d977d3f-700c-41a7-b570-34b267cf97cf-original-pull-secret podName:3d977d3f-700c-41a7-b570-34b267cf97cf nodeName:}" failed. No retries permitted until 2026-07-24 18:05:25.382677218 +0000 UTC m=+18.120868267 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d977d3f-700c-41a7-b570-34b267cf97cf-original-pull-secret") pod "global-pull-secret-syncer-nhn86" (UID: "3d977d3f-700c-41a7-b570-34b267cf97cf") : object "kube-system"/"original-pull-secret" not registered Jul 24 18:05:17.483181 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:17.483145 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps6f9\" (UniqueName: \"kubernetes.io/projected/346e9e7f-16c1-4b99-b339-c88ea048ba64-kube-api-access-ps6f9\") pod \"network-check-target-7bf8g\" (UID: \"346e9e7f-16c1-4b99-b339-c88ea048ba64\") " pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:17.483384 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:17.483360 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 18:05:17.483438 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:17.483389 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 18:05:17.483438 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:17.483403 2562 projected.go:196] Error preparing data for projected volume kube-api-access-ps6f9 for pod openshift-network-diagnostics/network-check-target-7bf8g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 18:05:17.483531 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:17.483466 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/346e9e7f-16c1-4b99-b339-c88ea048ba64-kube-api-access-ps6f9 podName:346e9e7f-16c1-4b99-b339-c88ea048ba64 nodeName:}" failed. No retries permitted until 2026-07-24 18:05:25.483447963 +0000 UTC m=+18.221639027 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ps6f9" (UniqueName: "kubernetes.io/projected/346e9e7f-16c1-4b99-b339-c88ea048ba64-kube-api-access-ps6f9") pod "network-check-target-7bf8g" (UID: "346e9e7f-16c1-4b99-b339-c88ea048ba64") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 18:05:17.830527 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:17.830494 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:17.831691 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:17.831652 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bf8g" podUID="346e9e7f-16c1-4b99-b339-c88ea048ba64" Jul 24 18:05:18.830407 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:18.830372 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:18.830407 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:18.830401 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:18.830891 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:18.830523 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhn86" podUID="3d977d3f-700c-41a7-b570-34b267cf97cf" Jul 24 18:05:18.830891 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:18.830654 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrwkd" podUID="aa3e62c3-b552-4e46-8715-70fa52700805" Jul 24 18:05:19.830838 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:19.830803 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:19.831295 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:19.830935 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bf8g" podUID="346e9e7f-16c1-4b99-b339-c88ea048ba64" Jul 24 18:05:20.829539 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:20.829509 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:20.829716 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:20.829509 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:20.829716 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:20.829626 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhn86" podUID="3d977d3f-700c-41a7-b570-34b267cf97cf" Jul 24 18:05:20.829796 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:20.829727 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrwkd" podUID="aa3e62c3-b552-4e46-8715-70fa52700805" Jul 24 18:05:21.830283 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:21.830239 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:21.830770 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:21.830403 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bf8g" podUID="346e9e7f-16c1-4b99-b339-c88ea048ba64" Jul 24 18:05:22.829673 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:22.829638 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:22.829876 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:22.829636 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:22.829876 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:22.829775 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrwkd" podUID="aa3e62c3-b552-4e46-8715-70fa52700805" Jul 24 18:05:22.829876 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:22.829850 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhn86" podUID="3d977d3f-700c-41a7-b570-34b267cf97cf" Jul 24 18:05:23.830483 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:23.830443 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:23.830984 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:23.830582 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bf8g" podUID="346e9e7f-16c1-4b99-b339-c88ea048ba64" Jul 24 18:05:24.829578 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:24.829548 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:24.829700 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:24.829659 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhn86" podUID="3d977d3f-700c-41a7-b570-34b267cf97cf" Jul 24 18:05:24.829736 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:24.829705 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:24.829810 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:24.829794 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrwkd" podUID="aa3e62c3-b552-4e46-8715-70fa52700805" Jul 24 18:05:25.343992 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:25.343955 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa3e62c3-b552-4e46-8715-70fa52700805-metrics-certs\") pod \"network-metrics-daemon-lrwkd\" (UID: \"aa3e62c3-b552-4e46-8715-70fa52700805\") " pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:25.344490 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:25.344093 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 18:05:25.344490 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:25.344151 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa3e62c3-b552-4e46-8715-70fa52700805-metrics-certs podName:aa3e62c3-b552-4e46-8715-70fa52700805 nodeName:}" failed. No retries permitted until 2026-07-24 18:05:41.344136762 +0000 UTC m=+34.082327813 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa3e62c3-b552-4e46-8715-70fa52700805-metrics-certs") pod "network-metrics-daemon-lrwkd" (UID: "aa3e62c3-b552-4e46-8715-70fa52700805") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 18:05:25.444500 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:25.444457 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d977d3f-700c-41a7-b570-34b267cf97cf-original-pull-secret\") pod \"global-pull-secret-syncer-nhn86\" (UID: \"3d977d3f-700c-41a7-b570-34b267cf97cf\") " pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:25.444671 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:25.444643 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 18:05:25.444738 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:25.444720 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d977d3f-700c-41a7-b570-34b267cf97cf-original-pull-secret podName:3d977d3f-700c-41a7-b570-34b267cf97cf nodeName:}" failed. No retries permitted until 2026-07-24 18:05:41.444700981 +0000 UTC m=+34.182892049 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d977d3f-700c-41a7-b570-34b267cf97cf-original-pull-secret") pod "global-pull-secret-syncer-nhn86" (UID: "3d977d3f-700c-41a7-b570-34b267cf97cf") : object "kube-system"/"original-pull-secret" not registered Jul 24 18:05:25.545385 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:25.545348 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps6f9\" (UniqueName: \"kubernetes.io/projected/346e9e7f-16c1-4b99-b339-c88ea048ba64-kube-api-access-ps6f9\") pod \"network-check-target-7bf8g\" (UID: \"346e9e7f-16c1-4b99-b339-c88ea048ba64\") " pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:25.545538 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:25.545519 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 18:05:25.545538 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:25.545539 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 18:05:25.545674 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:25.545549 2562 projected.go:196] Error preparing data for projected volume kube-api-access-ps6f9 for pod openshift-network-diagnostics/network-check-target-7bf8g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 18:05:25.545674 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:25.545607 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/346e9e7f-16c1-4b99-b339-c88ea048ba64-kube-api-access-ps6f9 podName:346e9e7f-16c1-4b99-b339-c88ea048ba64 nodeName:}" failed. No retries permitted until 2026-07-24 18:05:41.545588945 +0000 UTC m=+34.283779993 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ps6f9" (UniqueName: "kubernetes.io/projected/346e9e7f-16c1-4b99-b339-c88ea048ba64-kube-api-access-ps6f9") pod "network-check-target-7bf8g" (UID: "346e9e7f-16c1-4b99-b339-c88ea048ba64") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 18:05:25.830610 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:25.830529 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:25.830776 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:25.830657 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bf8g" podUID="346e9e7f-16c1-4b99-b339-c88ea048ba64" Jul 24 18:05:26.829834 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:26.829801 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:26.830250 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:26.829801 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:26.830250 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:26.829912 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrwkd" podUID="aa3e62c3-b552-4e46-8715-70fa52700805" Jul 24 18:05:26.830250 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:26.830014 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhn86" podUID="3d977d3f-700c-41a7-b570-34b267cf97cf" Jul 24 18:05:27.830678 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:27.830637 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:27.831126 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:27.830768 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bf8g" podUID="346e9e7f-16c1-4b99-b339-c88ea048ba64" Jul 24 18:05:28.830448 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:28.830416 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:28.830588 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:28.830522 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrwkd" podUID="aa3e62c3-b552-4e46-8715-70fa52700805" Jul 24 18:05:28.830588 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:28.830577 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:28.830678 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:28.830660 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhn86" podUID="3d977d3f-700c-41a7-b570-34b267cf97cf" Jul 24 18:05:29.829966 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:29.829688 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:29.830523 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:29.830043 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bf8g" podUID="346e9e7f-16c1-4b99-b339-c88ea048ba64" Jul 24 18:05:29.960778 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:29.960675 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6" event={"ID":"21047180-3830-440c-84c7-0043c99a51f9","Type":"ContainerStarted","Data":"c21e22da232bea2145b8be638ab7f59868d50cd9db15898288b4fdfefe43f601"} Jul 24 18:05:29.964782 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:29.964752 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6q2bl_61177079-7b8e-4730-b13b-6d49c72e9ac8/ovn-acl-logging/0.log" Jul 24 18:05:29.965150 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:29.965128 2562 generic.go:356] "Generic (PLEG): container finished" podID="61177079-7b8e-4730-b13b-6d49c72e9ac8" containerID="23ac3f2b24e6254b4ef528fc901c1021cebc194cef21ac927cde7898f1436e12" exitCode=1 Jul 24 18:05:29.965267 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:29.965211 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" event={"ID":"61177079-7b8e-4730-b13b-6d49c72e9ac8","Type":"ContainerStarted","Data":"3f7b5f3136993b1556233bc8f65952e305550c1d5e71d79d644991b7e5115dbe"} Jul 24 18:05:29.965499 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:29.965477 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" event={"ID":"61177079-7b8e-4730-b13b-6d49c72e9ac8","Type":"ContainerStarted","Data":"b04ac9489d20df9f3b74eea3996f4c0d8910c11a2b37c152bd9e8ce180a67fd8"} Jul 24 18:05:29.965595 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:29.965541 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" event={"ID":"61177079-7b8e-4730-b13b-6d49c72e9ac8","Type":"ContainerStarted","Data":"5cabf2efc2febfbdaf0b9af3aee1df69d82b636507a5eccdd50c8e48341dfd13"} Jul 24 18:05:29.965645 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:29.965591 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" event={"ID":"61177079-7b8e-4730-b13b-6d49c72e9ac8","Type":"ContainerStarted","Data":"3ca714729ddff494d7ab527bbbd1e14461d34568b14eb3fbed30469c2700c851"} Jul 24 18:05:29.965698 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:29.965643 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" event={"ID":"61177079-7b8e-4730-b13b-6d49c72e9ac8","Type":"ContainerDied","Data":"23ac3f2b24e6254b4ef528fc901c1021cebc194cef21ac927cde7898f1436e12"} Jul 24 18:05:29.965742 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:29.965695 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" event={"ID":"61177079-7b8e-4730-b13b-6d49c72e9ac8","Type":"ContainerStarted","Data":"0eec6da4f6d921a7254a799bc8555daab315c3adb9eb6c1034583a63e5e9f12c"} Jul 24 18:05:29.967044 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:29.967023 2562 generic.go:356] "Generic (PLEG): container finished" podID="68a2426f-2fa7-448d-a3fb-682cc0a4cc84" containerID="4488b6c01ebc594d344b974e28aa736790ccd5b8d531d21276566b429d8282a8" exitCode=0 Jul 24 18:05:29.967166 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:29.967101 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbwjd" event={"ID":"68a2426f-2fa7-448d-a3fb-682cc0a4cc84","Type":"ContainerDied","Data":"4488b6c01ebc594d344b974e28aa736790ccd5b8d531d21276566b429d8282a8"} Jul 24 18:05:29.969230 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:29.969201 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t2s7k" event={"ID":"10eea99f-1962-47cc-9a25-5dffe9df4490","Type":"ContainerStarted","Data":"c8972643934737901e955e5dfd2675c0e786cd464966a066a54213214e43e3db"} Jul 24 18:05:29.971418 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:29.971371 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jd9x5" event={"ID":"26b225f1-0841-4c29-9cbb-ecd98b274a50","Type":"ContainerStarted","Data":"122aaed822b2a7cf5a98348ae476704d80da17bc91599d08f3ba529f7f712ebc"} Jul 24 18:05:29.973589 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:29.973081 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xhz5x" event={"ID":"58be88c8-ba61-4987-925c-7dfacc2a7170","Type":"ContainerStarted","Data":"a482d6c55e1eff070d7beb1e6d8702cee8c2a3def869c64f2cd5bbf6997167d6"} Jul 24 18:05:29.974789 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:29.974764 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" event={"ID":"6a57fff6-be4e-49eb-b89e-0b25c9f4474d","Type":"ContainerStarted","Data":"098f66e9178a4bd97d051e774f97925c72b5c9c8f977aa03947da69d2385588e"} Jul 24 18:05:29.976860 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:29.976835 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lghjd" event={"ID":"0ae345ba-357f-42e7-a9d8-9a969ac16761","Type":"ContainerStarted","Data":"decc7955d6cf344ea4413cdf7f3511fd2539120efe96257093df96f32065760f"} Jul 24 18:05:29.994684 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:29.994642 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal" podStartSLOduration=21.994629823 podStartE2EDuration="21.994629823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:05:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:05:12.939437425 +0000 UTC m=+5.677628497" watchObservedRunningTime="2026-07-24 18:05:29.994629823 +0000 UTC m=+22.732820891" Jul 24 18:05:30.012586 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:30.012550 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-t2s7k" podStartSLOduration=4.60542003 podStartE2EDuration="23.012533679s" totalImagesPullingTime="18.407113649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:05:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:05:30.012433672 +0000 UTC m=+22.750624742" watchObservedRunningTime="2026-07-24 18:05:30.012533679 +0000 UTC m=+22.750724750" Jul 24 18:05:30.030517 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:30.030479 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rl2gk" podStartSLOduration=4.634098078 podStartE2EDuration="23.030466191s" totalImagesPullingTime="18.396368113s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:05:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:05:30.030012987 +0000 UTC m=+22.768204059" watchObservedRunningTime="2026-07-24 18:05:30.030466191 +0000 UTC m=+22.768657261" Jul 24 18:05:30.046663 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:30.046622 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lghjd" podStartSLOduration=4.67695164 podStartE2EDuration="23.046608573s" totalImagesPullingTime="18.369656933s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:05:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:05:30.046408527 +0000 UTC m=+22.784599598" watchObservedRunningTime="2026-07-24 18:05:30.046608573 +0000 UTC m=+22.784799642" Jul 24 18:05:30.061820 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:30.061775 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jd9x5" podStartSLOduration=4.694269525 podStartE2EDuration="23.06176641s" totalImagesPullingTime="18.367496885s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:05:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:05:30.061491218 +0000 UTC m=+22.799682293" watchObservedRunningTime="2026-07-24 18:05:30.06176641 +0000 UTC m=+22.799957481" Jul 24 18:05:30.079298 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:30.079265 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xhz5x" podStartSLOduration=9.070336758 podStartE2EDuration="23.079253448s" totalImagesPullingTime="14.00891669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:05:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:05:30.077311019 +0000 UTC m=+22.815502088" watchObservedRunningTime="2026-07-24 18:05:30.079253448 +0000 UTC m=+22.817444518" Jul 24 18:05:30.700166 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:30.700144 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 24 18:05:30.829611 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:30.829528 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:30.829611 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:30.829566 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:30.829818 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:30.829665 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhn86" podUID="3d977d3f-700c-41a7-b570-34b267cf97cf" Jul 24 18:05:30.829818 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:30.829767 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrwkd" podUID="aa3e62c3-b552-4e46-8715-70fa52700805" Jul 24 18:05:30.981688 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:30.981647 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6" event={"ID":"21047180-3830-440c-84c7-0043c99a51f9","Type":"ContainerStarted","Data":"a3144a513e9f296ccda63ece84722a61b60041f1ac7ac78b4077cf0c2d11afcb"} Jul 24 18:05:30.983376 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:30.983336 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zhwpj" event={"ID":"0f618324-186e-432d-bbdb-40e7439e3550","Type":"ContainerStarted","Data":"a8088ea3eca3c672bc0fec177ab384f901be64d68006df6d7fabcb2aa99d53ad"} Jul 24 18:05:31.008666 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:31.008612 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zhwpj" podStartSLOduration=5.646131141 podStartE2EDuration="24.008592622s" totalImagesPullingTime="18.362461481s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:05:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:05:31.008157276 +0000 UTC m=+23.746348346" watchObservedRunningTime="2026-07-24 18:05:31.008592622 +0000 UTC m=+23.746783693" Jul 24 18:05:31.677726 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:31.677616 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T18:05:30.700161598Z","UUID":"0a4847a6-1a04-4758-ba7f-23dcd5f869a2","Handler":null,"Name":"","Endpoint":""} Jul 24 18:05:31.679312 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:31.679291 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 24 18:05:31.679471 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:31.679349 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 24 18:05:31.831715 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:31.831691 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:31.831840 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:31.831809 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bf8g" podUID="346e9e7f-16c1-4b99-b339-c88ea048ba64" Jul 24 18:05:31.988852 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:31.988793 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6" event={"ID":"21047180-3830-440c-84c7-0043c99a51f9","Type":"ContainerStarted","Data":"4460d6147e88b4b8e07a170128000c56386285c3f8a8a8341d54bbb0c5ed21e4"} Jul 24 18:05:32.010189 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:32.010143 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwmx6" podStartSLOduration=4.488723224 podStartE2EDuration="25.010122886s" totalImagesPullingTime="20.521399662s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:05:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:05:32.009806455 +0000 UTC m=+24.747997528" watchObservedRunningTime="2026-07-24 18:05:32.010122886 +0000 UTC m=+24.748313980" Jul 24 18:05:32.830450 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:32.830418 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:32.830635 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:32.830535 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhn86" podUID="3d977d3f-700c-41a7-b570-34b267cf97cf" Jul 24 18:05:32.830635 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:32.830599 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:32.830794 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:32.830773 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrwkd" podUID="aa3e62c3-b552-4e46-8715-70fa52700805" Jul 24 18:05:32.994573 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:32.994548 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6q2bl_61177079-7b8e-4730-b13b-6d49c72e9ac8/ovn-acl-logging/0.log" Jul 24 18:05:32.995257 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:32.995224 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" event={"ID":"61177079-7b8e-4730-b13b-6d49c72e9ac8","Type":"ContainerStarted","Data":"bf8cf41442e9b8b97144b6e3dc3d742b8c2cf27fb7156f050cebd96ef2008017"} Jul 24 18:05:33.830128 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:33.829910 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:33.830332 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:33.830249 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bf8g" podUID="346e9e7f-16c1-4b99-b339-c88ea048ba64" Jul 24 18:05:34.047665 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:34.047638 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xhz5x" Jul 24 18:05:34.048268 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:34.048243 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xhz5x" Jul 24 18:05:34.829677 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:34.829652 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:34.829807 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:34.829784 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhn86" podUID="3d977d3f-700c-41a7-b570-34b267cf97cf" Jul 24 18:05:34.829881 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:34.829827 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:34.829950 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:34.829932 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrwkd" podUID="aa3e62c3-b552-4e46-8715-70fa52700805" Jul 24 18:05:35.002644 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:35.002482 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6q2bl_61177079-7b8e-4730-b13b-6d49c72e9ac8/ovn-acl-logging/0.log" Jul 24 18:05:35.003041 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:35.002999 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" event={"ID":"61177079-7b8e-4730-b13b-6d49c72e9ac8","Type":"ContainerStarted","Data":"0686791c25597f9843db98f8bb9aedc742ac0fa6057c8b640f7b30fe15b9d4ec"} Jul 24 18:05:35.003260 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:35.003234 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:35.003514 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:35.003492 2562 scope.go:117] "RemoveContainer" containerID="23ac3f2b24e6254b4ef528fc901c1021cebc194cef21ac927cde7898f1436e12" Jul 24 18:05:35.005092 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:35.005065 2562 generic.go:356] "Generic (PLEG): container finished" podID="68a2426f-2fa7-448d-a3fb-682cc0a4cc84" containerID="c7d9da22b6421199f759b664c87be5636be9fc890db691942c3d2eb7e906ae61" exitCode=0 Jul 24 18:05:35.005204 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:35.005099 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbwjd" event={"ID":"68a2426f-2fa7-448d-a3fb-682cc0a4cc84","Type":"ContainerDied","Data":"c7d9da22b6421199f759b664c87be5636be9fc890db691942c3d2eb7e906ae61"} Jul 24 18:05:35.005481 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:35.005456 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xhz5x" Jul 24 18:05:35.005900 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:35.005884 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xhz5x" Jul 24 18:05:35.022070 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:35.022052 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:35.830480 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:35.830439 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:35.831267 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:35.830563 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bf8g" podUID="346e9e7f-16c1-4b99-b339-c88ea048ba64" Jul 24 18:05:36.013454 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:36.013293 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6q2bl_61177079-7b8e-4730-b13b-6d49c72e9ac8/ovn-acl-logging/0.log" Jul 24 18:05:36.014077 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:36.014029 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" event={"ID":"61177079-7b8e-4730-b13b-6d49c72e9ac8","Type":"ContainerStarted","Data":"2edfac252233dd8fca52133ccafce9fa72ed3ac0b8abe2d4d02d869b1d5dd51d"} Jul 24 18:05:36.015278 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:36.015252 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:36.019336 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:36.015926 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:36.025783 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:36.025745 2562 generic.go:356] "Generic (PLEG): container finished" podID="68a2426f-2fa7-448d-a3fb-682cc0a4cc84" containerID="a16895fff618ebc91369505d9aebb3bec1917c3e74cb0b4329e6d3a24c0e895d" exitCode=0 Jul 24 18:05:36.026818 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:36.026705 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbwjd" event={"ID":"68a2426f-2fa7-448d-a3fb-682cc0a4cc84","Type":"ContainerDied","Data":"a16895fff618ebc91369505d9aebb3bec1917c3e74cb0b4329e6d3a24c0e895d"} Jul 24 18:05:36.046395 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:36.046370 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:05:36.052163 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:36.052118 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" podStartSLOduration=10.595575942 podStartE2EDuration="29.052102581s" totalImagesPullingTime="18.456526639s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:05:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:05:36.051986112 +0000 UTC m=+28.790177183" watchObservedRunningTime="2026-07-24 18:05:36.052102581 +0000 UTC m=+28.790293651" Jul 24 18:05:36.794671 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:36.794636 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nhn86"] Jul 24 18:05:36.794818 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:36.794774 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:36.794915 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:36.794896 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhn86" podUID="3d977d3f-700c-41a7-b570-34b267cf97cf" Jul 24 18:05:36.795568 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:36.795542 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7bf8g"] Jul 24 18:05:36.795711 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:36.795637 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:36.795763 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:36.795720 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bf8g" podUID="346e9e7f-16c1-4b99-b339-c88ea048ba64" Jul 24 18:05:36.800106 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:36.797596 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lrwkd"] Jul 24 18:05:36.800106 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:36.797774 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:36.800106 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:36.797917 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrwkd" podUID="aa3e62c3-b552-4e46-8715-70fa52700805" Jul 24 18:05:37.030647 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:37.030614 2562 generic.go:356] "Generic (PLEG): container finished" podID="68a2426f-2fa7-448d-a3fb-682cc0a4cc84" containerID="d05b2f7218c56a04dd04ba8cfe1f8e95461172588659a1e700da452cede47397" exitCode=0 Jul 24 18:05:37.031075 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:37.030698 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbwjd" event={"ID":"68a2426f-2fa7-448d-a3fb-682cc0a4cc84","Type":"ContainerDied","Data":"d05b2f7218c56a04dd04ba8cfe1f8e95461172588659a1e700da452cede47397"} Jul 24 18:05:38.830628 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:38.830152 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:38.830628 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:38.830289 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bf8g" podUID="346e9e7f-16c1-4b99-b339-c88ea048ba64" Jul 24 18:05:38.830628 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:38.830536 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:38.831218 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:38.830652 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrwkd" podUID="aa3e62c3-b552-4e46-8715-70fa52700805" Jul 24 18:05:38.831218 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:38.830536 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:38.831218 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:38.830749 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhn86" podUID="3d977d3f-700c-41a7-b570-34b267cf97cf" Jul 24 18:05:40.098156 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:40.098130 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lghjd_0ae345ba-357f-42e7-a9d8-9a969ac16761/dns-node-resolver/0.log" Jul 24 18:05:40.830060 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:40.830014 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:40.830060 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:40.830061 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:40.830300 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:40.830062 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:40.830300 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:40.830162 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhn86" podUID="3d977d3f-700c-41a7-b570-34b267cf97cf" Jul 24 18:05:40.830427 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:40.830336 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrwkd" podUID="aa3e62c3-b552-4e46-8715-70fa52700805" Jul 24 18:05:40.830469 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:40.830416 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bf8g" podUID="346e9e7f-16c1-4b99-b339-c88ea048ba64" Jul 24 18:05:41.062894 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:41.062866 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jd9x5_26b225f1-0841-4c29-9cbb-ecd98b274a50/node-ca/0.log" Jul 24 18:05:41.355985 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:41.355956 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa3e62c3-b552-4e46-8715-70fa52700805-metrics-certs\") pod \"network-metrics-daemon-lrwkd\" (UID: \"aa3e62c3-b552-4e46-8715-70fa52700805\") " pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:41.356529 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:41.356075 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 18:05:41.356529 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:41.356138 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa3e62c3-b552-4e46-8715-70fa52700805-metrics-certs podName:aa3e62c3-b552-4e46-8715-70fa52700805 nodeName:}" failed. No retries permitted until 2026-07-24 18:06:13.356122122 +0000 UTC m=+66.094313184 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa3e62c3-b552-4e46-8715-70fa52700805-metrics-certs") pod "network-metrics-daemon-lrwkd" (UID: "aa3e62c3-b552-4e46-8715-70fa52700805") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 18:05:41.457054 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:41.457007 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d977d3f-700c-41a7-b570-34b267cf97cf-original-pull-secret\") pod \"global-pull-secret-syncer-nhn86\" (UID: \"3d977d3f-700c-41a7-b570-34b267cf97cf\") " pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:41.457244 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:41.457171 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 18:05:41.457244 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:41.457240 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d977d3f-700c-41a7-b570-34b267cf97cf-original-pull-secret podName:3d977d3f-700c-41a7-b570-34b267cf97cf nodeName:}" failed. No retries permitted until 2026-07-24 18:06:13.457222425 +0000 UTC m=+66.195413486 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d977d3f-700c-41a7-b570-34b267cf97cf-original-pull-secret") pod "global-pull-secret-syncer-nhn86" (UID: "3d977d3f-700c-41a7-b570-34b267cf97cf") : object "kube-system"/"original-pull-secret" not registered Jul 24 18:05:41.558007 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:41.557970 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps6f9\" (UniqueName: \"kubernetes.io/projected/346e9e7f-16c1-4b99-b339-c88ea048ba64-kube-api-access-ps6f9\") pod \"network-check-target-7bf8g\" (UID: \"346e9e7f-16c1-4b99-b339-c88ea048ba64\") " pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:41.558194 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:41.558169 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 18:05:41.558256 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:41.558196 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 18:05:41.558256 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:41.558209 2562 projected.go:196] Error preparing data for projected volume kube-api-access-ps6f9 for pod openshift-network-diagnostics/network-check-target-7bf8g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 18:05:41.558386 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:41.558274 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/346e9e7f-16c1-4b99-b339-c88ea048ba64-kube-api-access-ps6f9 podName:346e9e7f-16c1-4b99-b339-c88ea048ba64 nodeName:}" failed. No retries permitted until 2026-07-24 18:06:13.558255665 +0000 UTC m=+66.296446726 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ps6f9" (UniqueName: "kubernetes.io/projected/346e9e7f-16c1-4b99-b339-c88ea048ba64-kube-api-access-ps6f9") pod "network-check-target-7bf8g" (UID: "346e9e7f-16c1-4b99-b339-c88ea048ba64") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 18:05:42.829518 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:42.829485 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:42.830246 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:42.829485 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:42.830246 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:42.829596 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bf8g" podUID="346e9e7f-16c1-4b99-b339-c88ea048ba64" Jul 24 18:05:42.830246 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:42.829491 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:42.830246 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:42.829672 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrwkd" podUID="aa3e62c3-b552-4e46-8715-70fa52700805" Jul 24 18:05:42.830246 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:42.829748 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhn86" podUID="3d977d3f-700c-41a7-b570-34b267cf97cf" Jul 24 18:05:43.046339 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:43.046285 2562 generic.go:356] "Generic (PLEG): container finished" podID="68a2426f-2fa7-448d-a3fb-682cc0a4cc84" containerID="a097989bd5269e683a9c6d325097bc3502e18d235190c372acefecf46b0cc38b" exitCode=0 Jul 24 18:05:43.046339 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:43.046341 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbwjd" event={"ID":"68a2426f-2fa7-448d-a3fb-682cc0a4cc84","Type":"ContainerDied","Data":"a097989bd5269e683a9c6d325097bc3502e18d235190c372acefecf46b0cc38b"} Jul 24 18:05:44.051087 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:44.051053 2562 generic.go:356] "Generic (PLEG): container finished" podID="68a2426f-2fa7-448d-a3fb-682cc0a4cc84" containerID="5f7030139791817557550c64640d1ef0936fc868afa889f0ea10f4994e9fdd43" exitCode=0 Jul 24 18:05:44.051087 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:44.051092 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbwjd" event={"ID":"68a2426f-2fa7-448d-a3fb-682cc0a4cc84","Type":"ContainerDied","Data":"5f7030139791817557550c64640d1ef0936fc868afa889f0ea10f4994e9fdd43"} Jul 24 18:05:44.829871 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:44.829835 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:44.830059 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:44.829951 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:44.830137 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:44.830072 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrwkd" podUID="aa3e62c3-b552-4e46-8715-70fa52700805" Jul 24 18:05:44.830137 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:44.829954 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bf8g" podUID="346e9e7f-16c1-4b99-b339-c88ea048ba64" Jul 24 18:05:44.830137 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:44.829958 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:44.830291 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:44.830176 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhn86" podUID="3d977d3f-700c-41a7-b570-34b267cf97cf" Jul 24 18:05:45.057484 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:45.057276 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbwjd" event={"ID":"68a2426f-2fa7-448d-a3fb-682cc0a4cc84","Type":"ContainerStarted","Data":"7941b4fe04ad3e290df3b4e85bdaf093896a8a507d415ea06963cd46aa7985cb"} Jul 24 18:05:45.086071 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:45.085952 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qbwjd" podStartSLOduration=8.721462079 podStartE2EDuration="38.085938564s" totalImagesPullingTime="29.364476485s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:05:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:05:45.085603602 +0000 UTC m=+37.823794673" watchObservedRunningTime="2026-07-24 18:05:45.085938564 +0000 UTC m=+37.824129634" Jul 24 18:05:46.830411 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:46.830381 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:46.830872 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:46.830381 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:46.830872 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:46.830495 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrwkd" podUID="aa3e62c3-b552-4e46-8715-70fa52700805" Jul 24 18:05:46.830872 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:46.830386 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:46.830872 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:46.830578 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bf8g" podUID="346e9e7f-16c1-4b99-b339-c88ea048ba64" Jul 24 18:05:46.830872 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:46.830680 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhn86" podUID="3d977d3f-700c-41a7-b570-34b267cf97cf" Jul 24 18:05:48.829539 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:48.829501 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:48.830001 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:48.829606 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:48.830001 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:48.829617 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:48.830001 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:48.829614 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bf8g" podUID="346e9e7f-16c1-4b99-b339-c88ea048ba64" Jul 24 18:05:48.830001 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:48.829697 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrwkd" podUID="aa3e62c3-b552-4e46-8715-70fa52700805" Jul 24 18:05:48.830001 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:48.829752 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhn86" podUID="3d977d3f-700c-41a7-b570-34b267cf97cf" Jul 24 18:05:50.830163 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:50.830128 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:50.830163 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:50.830164 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:50.830596 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:50.830230 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bf8g" podUID="346e9e7f-16c1-4b99-b339-c88ea048ba64" Jul 24 18:05:50.830596 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:50.830279 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:50.830596 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:50.830378 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhn86" podUID="3d977d3f-700c-41a7-b570-34b267cf97cf" Jul 24 18:05:50.830596 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:50.830426 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrwkd" podUID="aa3e62c3-b552-4e46-8715-70fa52700805" Jul 24 18:05:52.830416 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:52.830379 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:52.830788 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:52.830379 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:52.830788 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:52.830490 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhn86" podUID="3d977d3f-700c-41a7-b570-34b267cf97cf" Jul 24 18:05:52.830788 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:52.830393 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:52.830788 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:52.830570 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrwkd" podUID="aa3e62c3-b552-4e46-8715-70fa52700805" Jul 24 18:05:52.830788 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:52.830651 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bf8g" podUID="346e9e7f-16c1-4b99-b339-c88ea048ba64" Jul 24 18:05:54.830511 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:54.830471 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:54.830511 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:54.830491 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:54.830511 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:54.830517 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:54.831002 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:54.830592 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bf8g" podUID="346e9e7f-16c1-4b99-b339-c88ea048ba64" Jul 24 18:05:54.831002 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:54.830656 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrwkd" podUID="aa3e62c3-b552-4e46-8715-70fa52700805" Jul 24 18:05:54.831002 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:54.830728 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhn86" podUID="3d977d3f-700c-41a7-b570-34b267cf97cf" Jul 24 18:05:56.830373 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:56.830341 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:56.830785 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:56.830341 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:56.830785 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:56.830439 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bf8g" podUID="346e9e7f-16c1-4b99-b339-c88ea048ba64" Jul 24 18:05:56.830785 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:56.830528 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrwkd" podUID="aa3e62c3-b552-4e46-8715-70fa52700805" Jul 24 18:05:56.830785 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:56.830341 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:56.830785 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:56.830606 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhn86" podUID="3d977d3f-700c-41a7-b570-34b267cf97cf" Jul 24 18:05:58.829844 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:58.829809 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:05:58.830362 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:58.829805 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:05:58.830362 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:58.829908 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhn86" podUID="3d977d3f-700c-41a7-b570-34b267cf97cf" Jul 24 18:05:58.830362 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:58.830009 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bf8g" podUID="346e9e7f-16c1-4b99-b339-c88ea048ba64" Jul 24 18:05:58.830362 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:05:58.829806 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:05:58.830362 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:05:58.830118 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrwkd" podUID="aa3e62c3-b552-4e46-8715-70fa52700805" Jul 24 18:06:00.830517 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:00.830482 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:06:00.831052 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:00.830526 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:06:00.831052 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:00.830582 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:06:00.831052 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:06:00.830598 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bf8g" podUID="346e9e7f-16c1-4b99-b339-c88ea048ba64" Jul 24 18:06:00.831052 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:06:00.830651 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhn86" podUID="3d977d3f-700c-41a7-b570-34b267cf97cf" Jul 24 18:06:00.831052 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:06:00.830754 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrwkd" podUID="aa3e62c3-b552-4e46-8715-70fa52700805" Jul 24 18:06:02.060166 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.060088 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeReady" Jul 24 18:06:02.060562 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.060216 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 24 18:06:02.115357 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.115300 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xjhjb"] Jul 24 18:06:02.116893 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.116878 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xjhjb" Jul 24 18:06:02.119837 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.119816 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p887p\"" Jul 24 18:06:02.120273 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.120257 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 24 18:06:02.120743 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.120722 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 24 18:06:02.120843 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.120746 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 24 18:06:02.121760 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.121741 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-td5fj"] Jul 24 18:06:02.124506 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.124486 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-td5fj" Jul 24 18:06:02.127534 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.127509 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 24 18:06:02.127630 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.127566 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 24 18:06:02.127693 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.127646 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lr88b\"" Jul 24 18:06:02.128130 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.128116 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 24 18:06:02.128187 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.128119 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 24 18:06:02.139088 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.139062 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xjhjb"] Jul 24 18:06:02.142447 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.142424 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-td5fj"] Jul 24 18:06:02.165782 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.165750 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rc4ks"] Jul 24 18:06:02.167470 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.167454 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rc4ks" Jul 24 18:06:02.169892 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.169864 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 24 18:06:02.169892 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.169871 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wthhp\"" Jul 24 18:06:02.170060 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.169976 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 24 18:06:02.180978 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.180944 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rc4ks"] Jul 24 18:06:02.213862 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.213821 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aa3470d5-513d-474b-a1c1-c8459be4d4ee-config-volume\") pod \"dns-default-rc4ks\" (UID: \"aa3470d5-513d-474b-a1c1-c8459be4d4ee\") " pod="openshift-dns/dns-default-rc4ks" Jul 24 18:06:02.213862 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.213866 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v855q\" (UniqueName: \"kubernetes.io/projected/4ef1c039-6192-42b6-aab6-b387cc44abcc-kube-api-access-v855q\") pod \"ingress-canary-xjhjb\" (UID: \"4ef1c039-6192-42b6-aab6-b387cc44abcc\") " pod="openshift-ingress-canary/ingress-canary-xjhjb" Jul 24 18:06:02.214110 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.213902 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa3470d5-513d-474b-a1c1-c8459be4d4ee-metrics-tls\") pod \"dns-default-rc4ks\" (UID: \"aa3470d5-513d-474b-a1c1-c8459be4d4ee\") " pod="openshift-dns/dns-default-rc4ks" Jul 24 18:06:02.214110 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.213923 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgghl\" (UniqueName: \"kubernetes.io/projected/aa3470d5-513d-474b-a1c1-c8459be4d4ee-kube-api-access-lgghl\") pod \"dns-default-rc4ks\" (UID: \"aa3470d5-513d-474b-a1c1-c8459be4d4ee\") " pod="openshift-dns/dns-default-rc4ks" Jul 24 18:06:02.214110 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.213948 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ef1c039-6192-42b6-aab6-b387cc44abcc-cert\") pod \"ingress-canary-xjhjb\" (UID: \"4ef1c039-6192-42b6-aab6-b387cc44abcc\") " pod="openshift-ingress-canary/ingress-canary-xjhjb" Jul 24 18:06:02.214110 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.213967 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09867250-f235-4228-b475-56ec2680e164-crio-socket\") pod \"insights-runtime-extractor-td5fj\" (UID: \"09867250-f235-4228-b475-56ec2680e164\") " pod="openshift-insights/insights-runtime-extractor-td5fj" Jul 24 18:06:02.214110 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.213992 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09867250-f235-4228-b475-56ec2680e164-data-volume\") pod \"insights-runtime-extractor-td5fj\" (UID: \"09867250-f235-4228-b475-56ec2680e164\") " pod="openshift-insights/insights-runtime-extractor-td5fj" Jul 24 18:06:02.214110 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.214025 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa3470d5-513d-474b-a1c1-c8459be4d4ee-tmp-dir\") pod \"dns-default-rc4ks\" (UID: \"aa3470d5-513d-474b-a1c1-c8459be4d4ee\") " pod="openshift-dns/dns-default-rc4ks" Jul 24 18:06:02.214110 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.214104 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rcc2\" (UniqueName: \"kubernetes.io/projected/09867250-f235-4228-b475-56ec2680e164-kube-api-access-7rcc2\") pod \"insights-runtime-extractor-td5fj\" (UID: \"09867250-f235-4228-b475-56ec2680e164\") " pod="openshift-insights/insights-runtime-extractor-td5fj" Jul 24 18:06:02.214365 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.214131 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09867250-f235-4228-b475-56ec2680e164-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-td5fj\" (UID: \"09867250-f235-4228-b475-56ec2680e164\") " pod="openshift-insights/insights-runtime-extractor-td5fj" Jul 24 18:06:02.214365 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.214169 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09867250-f235-4228-b475-56ec2680e164-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-td5fj\" (UID: \"09867250-f235-4228-b475-56ec2680e164\") " pod="openshift-insights/insights-runtime-extractor-td5fj" Jul 24 18:06:02.314868 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.314773 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09867250-f235-4228-b475-56ec2680e164-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-td5fj\" (UID: \"09867250-f235-4228-b475-56ec2680e164\") " pod="openshift-insights/insights-runtime-extractor-td5fj" Jul 24 18:06:02.314868 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.314808 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aa3470d5-513d-474b-a1c1-c8459be4d4ee-config-volume\") pod \"dns-default-rc4ks\" (UID: \"aa3470d5-513d-474b-a1c1-c8459be4d4ee\") " pod="openshift-dns/dns-default-rc4ks" Jul 24 18:06:02.314868 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.314827 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v855q\" (UniqueName: \"kubernetes.io/projected/4ef1c039-6192-42b6-aab6-b387cc44abcc-kube-api-access-v855q\") pod \"ingress-canary-xjhjb\" (UID: \"4ef1c039-6192-42b6-aab6-b387cc44abcc\") " pod="openshift-ingress-canary/ingress-canary-xjhjb" Jul 24 18:06:02.314868 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.314854 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa3470d5-513d-474b-a1c1-c8459be4d4ee-metrics-tls\") pod \"dns-default-rc4ks\" (UID: \"aa3470d5-513d-474b-a1c1-c8459be4d4ee\") " pod="openshift-dns/dns-default-rc4ks" Jul 24 18:06:02.314868 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.314869 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgghl\" (UniqueName: \"kubernetes.io/projected/aa3470d5-513d-474b-a1c1-c8459be4d4ee-kube-api-access-lgghl\") pod \"dns-default-rc4ks\" (UID: \"aa3470d5-513d-474b-a1c1-c8459be4d4ee\") " pod="openshift-dns/dns-default-rc4ks" Jul 24 18:06:02.315258 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.314884 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ef1c039-6192-42b6-aab6-b387cc44abcc-cert\") pod \"ingress-canary-xjhjb\" (UID: \"4ef1c039-6192-42b6-aab6-b387cc44abcc\") " pod="openshift-ingress-canary/ingress-canary-xjhjb" Jul 24 18:06:02.315258 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.314905 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09867250-f235-4228-b475-56ec2680e164-crio-socket\") pod \"insights-runtime-extractor-td5fj\" (UID: \"09867250-f235-4228-b475-56ec2680e164\") " pod="openshift-insights/insights-runtime-extractor-td5fj" Jul 24 18:06:02.315258 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.314931 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09867250-f235-4228-b475-56ec2680e164-data-volume\") pod \"insights-runtime-extractor-td5fj\" (UID: \"09867250-f235-4228-b475-56ec2680e164\") " pod="openshift-insights/insights-runtime-extractor-td5fj" Jul 24 18:06:02.315258 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.314967 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa3470d5-513d-474b-a1c1-c8459be4d4ee-tmp-dir\") pod \"dns-default-rc4ks\" (UID: \"aa3470d5-513d-474b-a1c1-c8459be4d4ee\") " pod="openshift-dns/dns-default-rc4ks" Jul 24 18:06:02.315258 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.314992 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09867250-f235-4228-b475-56ec2680e164-crio-socket\") pod \"insights-runtime-extractor-td5fj\" (UID: \"09867250-f235-4228-b475-56ec2680e164\") " pod="openshift-insights/insights-runtime-extractor-td5fj" Jul 24 18:06:02.315258 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.315016 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rcc2\" (UniqueName: \"kubernetes.io/projected/09867250-f235-4228-b475-56ec2680e164-kube-api-access-7rcc2\") pod \"insights-runtime-extractor-td5fj\" (UID: \"09867250-f235-4228-b475-56ec2680e164\") " pod="openshift-insights/insights-runtime-extractor-td5fj" Jul 24 18:06:02.315258 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.315047 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09867250-f235-4228-b475-56ec2680e164-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-td5fj\" (UID: \"09867250-f235-4228-b475-56ec2680e164\") " pod="openshift-insights/insights-runtime-extractor-td5fj" Jul 24 18:06:02.315630 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.315308 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09867250-f235-4228-b475-56ec2680e164-data-volume\") pod \"insights-runtime-extractor-td5fj\" (UID: \"09867250-f235-4228-b475-56ec2680e164\") " pod="openshift-insights/insights-runtime-extractor-td5fj" Jul 24 18:06:02.315630 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.315432 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa3470d5-513d-474b-a1c1-c8459be4d4ee-tmp-dir\") pod \"dns-default-rc4ks\" (UID: \"aa3470d5-513d-474b-a1c1-c8459be4d4ee\") " pod="openshift-dns/dns-default-rc4ks" Jul 24 18:06:02.315630 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.315563 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aa3470d5-513d-474b-a1c1-c8459be4d4ee-config-volume\") pod \"dns-default-rc4ks\" (UID: \"aa3470d5-513d-474b-a1c1-c8459be4d4ee\") " pod="openshift-dns/dns-default-rc4ks" Jul 24 18:06:02.315813 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.315791 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09867250-f235-4228-b475-56ec2680e164-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-td5fj\" (UID: \"09867250-f235-4228-b475-56ec2680e164\") " pod="openshift-insights/insights-runtime-extractor-td5fj" Jul 24 18:06:02.319184 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.319163 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09867250-f235-4228-b475-56ec2680e164-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-td5fj\" (UID: \"09867250-f235-4228-b475-56ec2680e164\") " pod="openshift-insights/insights-runtime-extractor-td5fj" Jul 24 18:06:02.319311 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.319210 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa3470d5-513d-474b-a1c1-c8459be4d4ee-metrics-tls\") pod \"dns-default-rc4ks\" (UID: \"aa3470d5-513d-474b-a1c1-c8459be4d4ee\") " pod="openshift-dns/dns-default-rc4ks" Jul 24 18:06:02.319311 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.319268 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ef1c039-6192-42b6-aab6-b387cc44abcc-cert\") pod \"ingress-canary-xjhjb\" (UID: \"4ef1c039-6192-42b6-aab6-b387cc44abcc\") " pod="openshift-ingress-canary/ingress-canary-xjhjb" Jul 24 18:06:02.324124 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.324097 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgghl\" (UniqueName: \"kubernetes.io/projected/aa3470d5-513d-474b-a1c1-c8459be4d4ee-kube-api-access-lgghl\") pod \"dns-default-rc4ks\" (UID: \"aa3470d5-513d-474b-a1c1-c8459be4d4ee\") " pod="openshift-dns/dns-default-rc4ks" Jul 24 18:06:02.324295 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.324203 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rcc2\" (UniqueName: \"kubernetes.io/projected/09867250-f235-4228-b475-56ec2680e164-kube-api-access-7rcc2\") pod \"insights-runtime-extractor-td5fj\" (UID: \"09867250-f235-4228-b475-56ec2680e164\") " pod="openshift-insights/insights-runtime-extractor-td5fj" Jul 24 18:06:02.324295 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.324258 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v855q\" (UniqueName: \"kubernetes.io/projected/4ef1c039-6192-42b6-aab6-b387cc44abcc-kube-api-access-v855q\") pod \"ingress-canary-xjhjb\" (UID: \"4ef1c039-6192-42b6-aab6-b387cc44abcc\") " pod="openshift-ingress-canary/ingress-canary-xjhjb" Jul 24 18:06:02.426403 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.426361 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xjhjb" Jul 24 18:06:02.432845 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.432824 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-td5fj" Jul 24 18:06:02.476676 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.476643 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rc4ks" Jul 24 18:06:02.592507 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.592469 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-td5fj"] Jul 24 18:06:02.599376 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:06:02.597378 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09867250_f235_4228_b475_56ec2680e164.slice/crio-1220e03f04c3b0ac14c447a5fdc0344dfea4b0f269c06703e6cb325918beecb8 WatchSource:0}: Error finding container 1220e03f04c3b0ac14c447a5fdc0344dfea4b0f269c06703e6cb325918beecb8: Status 404 returned error can't find the container with id 1220e03f04c3b0ac14c447a5fdc0344dfea4b0f269c06703e6cb325918beecb8 Jul 24 18:06:02.599799 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.599378 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xjhjb"] Jul 24 18:06:02.605563 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:06:02.605537 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ef1c039_6192_42b6_aab6_b387cc44abcc.slice/crio-24c7d51d4bdbbcb9082c216ef1991e7feabb1d1dc9cc0b2510958ddaeaea11f2 WatchSource:0}: Error finding container 24c7d51d4bdbbcb9082c216ef1991e7feabb1d1dc9cc0b2510958ddaeaea11f2: Status 404 returned error can't find the container with id 24c7d51d4bdbbcb9082c216ef1991e7feabb1d1dc9cc0b2510958ddaeaea11f2 Jul 24 18:06:02.628389 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.628350 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rc4ks"] Jul 24 18:06:02.631220 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:06:02.631195 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa3470d5_513d_474b_a1c1_c8459be4d4ee.slice/crio-92195b6d82d41426df0d5a7a31f31c39d4299379e441a8e7f2660aaeccebb7cf WatchSource:0}: Error finding container 92195b6d82d41426df0d5a7a31f31c39d4299379e441a8e7f2660aaeccebb7cf: Status 404 returned error can't find the container with id 92195b6d82d41426df0d5a7a31f31c39d4299379e441a8e7f2660aaeccebb7cf Jul 24 18:06:02.829923 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.829820 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:06:02.829923 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.829823 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:06:02.830154 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.829955 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:06:02.833771 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.833618 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vzml8\"" Jul 24 18:06:02.833771 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.833640 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 18:06:02.833771 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.833647 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 18:06:02.833771 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.833667 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 18:06:02.833771 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.833670 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bflkk\"" Jul 24 18:06:02.833771 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:02.833743 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 18:06:03.100126 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:03.100036 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-td5fj" event={"ID":"09867250-f235-4228-b475-56ec2680e164","Type":"ContainerStarted","Data":"1220e03f04c3b0ac14c447a5fdc0344dfea4b0f269c06703e6cb325918beecb8"} Jul 24 18:06:03.101614 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:03.101527 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xjhjb" event={"ID":"4ef1c039-6192-42b6-aab6-b387cc44abcc","Type":"ContainerStarted","Data":"24c7d51d4bdbbcb9082c216ef1991e7feabb1d1dc9cc0b2510958ddaeaea11f2"} Jul 24 18:06:03.104153 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:03.104076 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rc4ks" event={"ID":"aa3470d5-513d-474b-a1c1-c8459be4d4ee","Type":"ContainerStarted","Data":"92195b6d82d41426df0d5a7a31f31c39d4299379e441a8e7f2660aaeccebb7cf"} Jul 24 18:06:03.729174 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:03.729138 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-47dkz"] Jul 24 18:06:03.731781 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:03.731756 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-47dkz" Jul 24 18:06:03.734970 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:03.734949 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-wz6d4\"" Jul 24 18:06:03.735530 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:03.735505 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 24 18:06:03.743522 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:03.743496 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-47dkz"] Jul 24 18:06:03.827872 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:03.827837 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/365db518-0bfc-47cb-930d-8f104c3eee53-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-47dkz\" (UID: \"365db518-0bfc-47cb-930d-8f104c3eee53\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-47dkz" Jul 24 18:06:03.928432 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:03.928399 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/365db518-0bfc-47cb-930d-8f104c3eee53-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-47dkz\" (UID: \"365db518-0bfc-47cb-930d-8f104c3eee53\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-47dkz" Jul 24 18:06:03.928609 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:06:03.928562 2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 24 18:06:03.928661 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:06:03.928644 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365db518-0bfc-47cb-930d-8f104c3eee53-tls-certificates podName:365db518-0bfc-47cb-930d-8f104c3eee53 nodeName:}" failed. No retries permitted until 2026-07-24 18:06:04.428623708 +0000 UTC m=+57.166814770 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/365db518-0bfc-47cb-930d-8f104c3eee53-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-47dkz" (UID: "365db518-0bfc-47cb-930d-8f104c3eee53") : secret "prometheus-operator-admission-webhook-tls" not found Jul 24 18:06:04.433134 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:04.433091 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/365db518-0bfc-47cb-930d-8f104c3eee53-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-47dkz\" (UID: \"365db518-0bfc-47cb-930d-8f104c3eee53\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-47dkz" Jul 24 18:06:04.437402 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:04.437369 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/365db518-0bfc-47cb-930d-8f104c3eee53-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-47dkz\" (UID: \"365db518-0bfc-47cb-930d-8f104c3eee53\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-47dkz" Jul 24 18:06:04.647452 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:04.647415 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-47dkz" Jul 24 18:06:07.767338 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:07.767288 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-47dkz"] Jul 24 18:06:07.961477 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:06:07.961421 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod365db518_0bfc_47cb_930d_8f104c3eee53.slice/crio-120526d5242c7224f279ff2a5a80e54b285edd8c0f9fc2209c8f6b7b5b5e28fe WatchSource:0}: Error finding container 120526d5242c7224f279ff2a5a80e54b285edd8c0f9fc2209c8f6b7b5b5e28fe: Status 404 returned error can't find the container with id 120526d5242c7224f279ff2a5a80e54b285edd8c0f9fc2209c8f6b7b5b5e28fe Jul 24 18:06:08.044520 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:08.044488 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6q2bl" Jul 24 18:06:08.117717 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:08.117675 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-47dkz" event={"ID":"365db518-0bfc-47cb-930d-8f104c3eee53","Type":"ContainerStarted","Data":"120526d5242c7224f279ff2a5a80e54b285edd8c0f9fc2209c8f6b7b5b5e28fe"} Jul 24 18:06:09.130179 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.130119 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-td5fj" event={"ID":"09867250-f235-4228-b475-56ec2680e164","Type":"ContainerStarted","Data":"a4f38cd8294c508918113000ea517bbe33a7b83e197fd82e075d98457ea961d2"} Jul 24 18:06:09.133369 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.133282 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-47dkz" event={"ID":"365db518-0bfc-47cb-930d-8f104c3eee53","Type":"ContainerStarted","Data":"352448934d76b23b62f2086022d0dbed7c7e63a6feb00fcb8ab580c0f8d11a16"} Jul 24 18:06:09.133893 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.133871 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-47dkz" Jul 24 18:06:09.136155 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.135726 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xjhjb" event={"ID":"4ef1c039-6192-42b6-aab6-b387cc44abcc","Type":"ContainerStarted","Data":"aadcfaaac758960d104fb74a93a18fbcd85d9838cfe62d671ef1ef1462e3bb2e"} Jul 24 18:06:09.140488 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.140131 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rc4ks" event={"ID":"aa3470d5-513d-474b-a1c1-c8459be4d4ee","Type":"ContainerStarted","Data":"3a5d33086d410aa336eeab10cfe36e06359c254c8530f746b1a3ec5cd88d5148"} Jul 24 18:06:09.140488 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.140179 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rc4ks" event={"ID":"aa3470d5-513d-474b-a1c1-c8459be4d4ee","Type":"ContainerStarted","Data":"a53c8a39bfe122be00fdbf8f347c5a602b919f08c4cdbdda50da2819d033cc33"} Jul 24 18:06:09.140488 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.140298 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rc4ks" Jul 24 18:06:09.140858 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.140829 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-47dkz" Jul 24 18:06:09.152066 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.152011 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-47dkz" podStartSLOduration=5.101175403 podStartE2EDuration="6.15199446s" totalImagesPullingTime="1.050819057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:06:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:06:09.150513962 +0000 UTC m=+61.888705033" watchObservedRunningTime="2026-07-24 18:06:09.15199446 +0000 UTC m=+61.890185531" Jul 24 18:06:09.190682 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.189959 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rc4ks" podStartSLOduration=1.86320072 podStartE2EDuration="7.189939968s" totalImagesPullingTime="5.326739248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:06:09.189277199 +0000 UTC m=+61.927468269" watchObservedRunningTime="2026-07-24 18:06:09.189939968 +0000 UTC m=+61.928131041" Jul 24 18:06:09.210785 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.210620 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xjhjb" podStartSLOduration=1.529729951 podStartE2EDuration="7.210598836s" totalImagesPullingTime="5.680868885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:06:09.208784996 +0000 UTC m=+61.946976066" watchObservedRunningTime="2026-07-24 18:06:09.210598836 +0000 UTC m=+61.948789907" Jul 24 18:06:09.806795 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.806761 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-tjm8v"] Jul 24 18:06:09.808653 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.808630 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-tjm8v" Jul 24 18:06:09.811440 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.811416 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 24 18:06:09.811574 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.811497 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 24 18:06:09.811574 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.811508 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-srhj7\"" Jul 24 18:06:09.811672 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.811424 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 24 18:06:09.811672 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.811645 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 24 18:06:09.811887 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.811868 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 24 18:06:09.820637 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.820610 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-tjm8v"] Jul 24 18:06:09.878895 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.878853 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-tjm8v\" (UID: \"9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-tjm8v" Jul 24 18:06:09.879091 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.878922 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-tjm8v\" (UID: \"9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-tjm8v" Jul 24 18:06:09.879091 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.879009 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-tjm8v\" (UID: \"9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-tjm8v" Jul 24 18:06:09.879091 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.879070 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfckh\" (UniqueName: \"kubernetes.io/projected/9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d-kube-api-access-sfckh\") pod \"prometheus-operator-84d69f794d-tjm8v\" (UID: \"9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-tjm8v" Jul 24 18:06:09.979785 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.979736 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-tjm8v\" (UID: \"9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-tjm8v" Jul 24 18:06:09.979977 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.979806 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-tjm8v\" (UID: \"9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-tjm8v" Jul 24 18:06:09.979977 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.979857 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfckh\" (UniqueName: \"kubernetes.io/projected/9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d-kube-api-access-sfckh\") pod \"prometheus-operator-84d69f794d-tjm8v\" (UID: \"9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-tjm8v" Jul 24 18:06:09.979977 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.979901 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-tjm8v\" (UID: \"9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-tjm8v" Jul 24 18:06:09.979977 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:06:09.979968 2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 24 18:06:09.980140 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:06:09.980053 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d-prometheus-operator-tls podName:9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d nodeName:}" failed. No retries permitted until 2026-07-24 18:06:10.480033364 +0000 UTC m=+63.218224435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-tjm8v" (UID: "9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d") : secret "prometheus-operator-tls" not found Jul 24 18:06:09.980608 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.980580 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-tjm8v\" (UID: \"9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-tjm8v" Jul 24 18:06:09.982595 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.982572 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-tjm8v\" (UID: \"9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-tjm8v" Jul 24 18:06:09.991079 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:09.991053 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfckh\" (UniqueName: \"kubernetes.io/projected/9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d-kube-api-access-sfckh\") pod \"prometheus-operator-84d69f794d-tjm8v\" (UID: \"9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-tjm8v" Jul 24 18:06:10.485092 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:10.485061 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-tjm8v\" (UID: \"9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-tjm8v" Jul 24 18:06:10.487813 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:10.487785 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-tjm8v\" (UID: \"9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-tjm8v" Jul 24 18:06:10.719748 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:10.719706 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-tjm8v" Jul 24 18:06:12.088456 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:12.088421 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-tjm8v"] Jul 24 18:06:12.091657 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:06:12.091627 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df4a6ad_f2fd_4d1c_bbea_7bbe97526c4d.slice/crio-8497e749b0f7be8f0387b0548c59374eeb70959480671c1e309ea18943ebfb6f WatchSource:0}: Error finding container 8497e749b0f7be8f0387b0548c59374eeb70959480671c1e309ea18943ebfb6f: Status 404 returned error can't find the container with id 8497e749b0f7be8f0387b0548c59374eeb70959480671c1e309ea18943ebfb6f Jul 24 18:06:12.151806 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:12.151771 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-td5fj" event={"ID":"09867250-f235-4228-b475-56ec2680e164","Type":"ContainerStarted","Data":"941696a6203a082a373cfba3e278369a5ce1a571a79ab0944a798d83f2c5ec87"} Jul 24 18:06:12.152888 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:12.152864 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-tjm8v" event={"ID":"9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d","Type":"ContainerStarted","Data":"8497e749b0f7be8f0387b0548c59374eeb70959480671c1e309ea18943ebfb6f"} Jul 24 18:06:13.409575 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:13.409538 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa3e62c3-b552-4e46-8715-70fa52700805-metrics-certs\") pod \"network-metrics-daemon-lrwkd\" (UID: \"aa3e62c3-b552-4e46-8715-70fa52700805\") " pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:06:13.412226 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:13.412193 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 18:06:13.423395 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:13.423370 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa3e62c3-b552-4e46-8715-70fa52700805-metrics-certs\") pod \"network-metrics-daemon-lrwkd\" (UID: \"aa3e62c3-b552-4e46-8715-70fa52700805\") " pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:06:13.510665 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:13.510628 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d977d3f-700c-41a7-b570-34b267cf97cf-original-pull-secret\") pod \"global-pull-secret-syncer-nhn86\" (UID: \"3d977d3f-700c-41a7-b570-34b267cf97cf\") " pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:06:13.513370 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:13.513342 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 18:06:13.524538 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:13.524513 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d977d3f-700c-41a7-b570-34b267cf97cf-original-pull-secret\") pod \"global-pull-secret-syncer-nhn86\" (UID: \"3d977d3f-700c-41a7-b570-34b267cf97cf\") " pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:06:13.611376 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:13.611313 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps6f9\" (UniqueName: \"kubernetes.io/projected/346e9e7f-16c1-4b99-b339-c88ea048ba64-kube-api-access-ps6f9\") pod \"network-check-target-7bf8g\" (UID: \"346e9e7f-16c1-4b99-b339-c88ea048ba64\") " pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:06:13.614307 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:13.614279 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 18:06:13.623887 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:13.623865 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 18:06:13.635075 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:13.635042 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps6f9\" (UniqueName: \"kubernetes.io/projected/346e9e7f-16c1-4b99-b339-c88ea048ba64-kube-api-access-ps6f9\") pod \"network-check-target-7bf8g\" (UID: \"346e9e7f-16c1-4b99-b339-c88ea048ba64\") " pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:06:13.642270 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:13.642218 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bflkk\"" Jul 24 18:06:13.646437 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:13.646409 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhn86" Jul 24 18:06:13.650810 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:13.650790 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:06:13.653568 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:13.653378 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vzml8\"" Jul 24 18:06:13.661256 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:13.661197 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrwkd" Jul 24 18:06:13.937853 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:13.937791 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lrwkd"] Jul 24 18:06:13.940630 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:06:13.940608 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa3e62c3_b552_4e46_8715_70fa52700805.slice/crio-738d8375dfb840d81e9a5fd6857a8109f3f2074fdb4d6bce4abb45e8a52b9b44 WatchSource:0}: Error finding container 738d8375dfb840d81e9a5fd6857a8109f3f2074fdb4d6bce4abb45e8a52b9b44: Status 404 returned error can't find the container with id 738d8375dfb840d81e9a5fd6857a8109f3f2074fdb4d6bce4abb45e8a52b9b44 Jul 24 18:06:13.955624 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:13.955599 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7bf8g"] Jul 24 18:06:13.958261 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:06:13.958230 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod346e9e7f_16c1_4b99_b339_c88ea048ba64.slice/crio-9022e2530db8774fb3e86ab8ba49fe149c2f6cb9e7d2ac276bb3f2863b87d840 WatchSource:0}: Error finding container 9022e2530db8774fb3e86ab8ba49fe149c2f6cb9e7d2ac276bb3f2863b87d840: Status 404 returned error can't find the container with id 9022e2530db8774fb3e86ab8ba49fe149c2f6cb9e7d2ac276bb3f2863b87d840 Jul 24 18:06:13.967698 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:13.967677 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nhn86"] Jul 24 18:06:14.141339 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:06:14.141291 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d977d3f_700c_41a7_b570_34b267cf97cf.slice/crio-3a2f5304d459561aea73d1bd3a34280ab724a5c40e0337df5a92d1316390284e WatchSource:0}: Error finding container 3a2f5304d459561aea73d1bd3a34280ab724a5c40e0337df5a92d1316390284e: Status 404 returned error can't find the container with id 3a2f5304d459561aea73d1bd3a34280ab724a5c40e0337df5a92d1316390284e Jul 24 18:06:14.160670 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:14.160642 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lrwkd" event={"ID":"aa3e62c3-b552-4e46-8715-70fa52700805","Type":"ContainerStarted","Data":"738d8375dfb840d81e9a5fd6857a8109f3f2074fdb4d6bce4abb45e8a52b9b44"} Jul 24 18:06:14.161675 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:14.161652 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nhn86" event={"ID":"3d977d3f-700c-41a7-b570-34b267cf97cf","Type":"ContainerStarted","Data":"3a2f5304d459561aea73d1bd3a34280ab724a5c40e0337df5a92d1316390284e"} Jul 24 18:06:14.162762 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:14.162721 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7bf8g" event={"ID":"346e9e7f-16c1-4b99-b339-c88ea048ba64","Type":"ContainerStarted","Data":"9022e2530db8774fb3e86ab8ba49fe149c2f6cb9e7d2ac276bb3f2863b87d840"} Jul 24 18:06:16.176270 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:16.175706 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-td5fj" event={"ID":"09867250-f235-4228-b475-56ec2680e164","Type":"ContainerStarted","Data":"499d41992adaabd85244a92a56fe75d45cf24252bda7b7c58aa6bee495cd62d9"} Jul 24 18:06:16.178631 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:16.178603 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-tjm8v" event={"ID":"9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d","Type":"ContainerStarted","Data":"0917c15e60d9b4262a30ffa2186689886b8b78cdd31e1625c33a80811fae6cce"} Jul 24 18:06:16.178741 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:16.178659 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-tjm8v" event={"ID":"9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d","Type":"ContainerStarted","Data":"44ef8a3ba5fbd4ee7499dd2a1b1fc65e61c9aa3c855d55ba564c3d9b533bcc0b"} Jul 24 18:06:16.197171 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:16.197079 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-td5fj" podStartSLOduration=1.116024367 podStartE2EDuration="14.19705907s" totalImagesPullingTime="13.081034703s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:06:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:06:16.195077935 +0000 UTC m=+68.933269008" watchObservedRunningTime="2026-07-24 18:06:16.19705907 +0000 UTC m=+68.935250142" Jul 24 18:06:16.214461 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:16.214419 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-tjm8v" podStartSLOduration=3.506885093 podStartE2EDuration="7.214400372s" totalImagesPullingTime="3.707515279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:06:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:06:16.21354122 +0000 UTC m=+68.951732290" watchObservedRunningTime="2026-07-24 18:06:16.214400372 +0000 UTC m=+68.952591444" Jul 24 18:06:17.185350 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:17.184963 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lrwkd" event={"ID":"aa3e62c3-b552-4e46-8715-70fa52700805","Type":"ContainerStarted","Data":"3ff4684571e764bf48cacf59f4a4640ec412ef71f16328f7f80d76ca2600659f"} Jul 24 18:06:17.185350 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:17.185033 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lrwkd" event={"ID":"aa3e62c3-b552-4e46-8715-70fa52700805","Type":"ContainerStarted","Data":"d70ef9d99c5e4497f2f2793c14f2efd12d71d8427c0ed152e2e22b03e5f608b2"} Jul 24 18:06:17.206245 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:17.206192 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lrwkd" podStartSLOduration=67.539098455 podStartE2EDuration="1m10.20617029s" totalImagesPullingTime="2.667071835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:05:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:06:17.205260455 +0000 UTC m=+69.943451528" watchObservedRunningTime="2026-07-24 18:06:17.20617029 +0000 UTC m=+69.944361362" Jul 24 18:06:18.403336 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.403275 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-dflvt"] Jul 24 18:06:18.405614 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.405593 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dflvt" Jul 24 18:06:18.412034 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.412010 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 24 18:06:18.412198 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.412072 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-gkpdm\"" Jul 24 18:06:18.412288 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.412210 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 24 18:06:18.434073 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.434029 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-nxvct"] Jul 24 18:06:18.436215 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.436193 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nxvct" Jul 24 18:06:18.439903 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.439879 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 24 18:06:18.440411 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.440391 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 24 18:06:18.440510 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.440450 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 24 18:06:18.440967 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.440950 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dfntj\"" Jul 24 18:06:18.451692 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.451674 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-dflvt"] Jul 24 18:06:18.454925 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.454895 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcnbh\" (UniqueName: \"kubernetes.io/projected/c58bddfc-aa3e-48e7-b809-25ed39fb7ba0-kube-api-access-vcnbh\") pod \"openshift-state-metrics-b8f49f5c6-dflvt\" (UID: \"c58bddfc-aa3e-48e7-b809-25ed39fb7ba0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dflvt" Jul 24 18:06:18.455036 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.454939 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c58bddfc-aa3e-48e7-b809-25ed39fb7ba0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-dflvt\" (UID: \"c58bddfc-aa3e-48e7-b809-25ed39fb7ba0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dflvt" Jul 24 18:06:18.455036 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.455008 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c58bddfc-aa3e-48e7-b809-25ed39fb7ba0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-dflvt\" (UID: \"c58bddfc-aa3e-48e7-b809-25ed39fb7ba0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dflvt" Jul 24 18:06:18.455137 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.455064 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c58bddfc-aa3e-48e7-b809-25ed39fb7ba0-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-dflvt\" (UID: \"c58bddfc-aa3e-48e7-b809-25ed39fb7ba0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dflvt" Jul 24 18:06:18.470742 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.470708 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-nxvct"] Jul 24 18:06:18.528308 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.528273 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-q7fqj"] Jul 24 18:06:18.530464 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.530442 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:18.533347 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.533158 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 24 18:06:18.533347 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.533190 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 24 18:06:18.533347 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.533210 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 24 18:06:18.533347 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.533251 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qh2jt\"" Jul 24 18:06:18.555864 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.555834 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcnbh\" (UniqueName: \"kubernetes.io/projected/c58bddfc-aa3e-48e7-b809-25ed39fb7ba0-kube-api-access-vcnbh\") pod \"openshift-state-metrics-b8f49f5c6-dflvt\" (UID: \"c58bddfc-aa3e-48e7-b809-25ed39fb7ba0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dflvt" Jul 24 18:06:18.556005 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.555877 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c58bddfc-aa3e-48e7-b809-25ed39fb7ba0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-dflvt\" (UID: \"c58bddfc-aa3e-48e7-b809-25ed39fb7ba0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dflvt" Jul 24 18:06:18.556005 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.555913 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-nxvct\" (UID: \"0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nxvct" Jul 24 18:06:18.556005 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.555940 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-nxvct\" (UID: \"0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nxvct" Jul 24 18:06:18.556005 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.555971 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c58bddfc-aa3e-48e7-b809-25ed39fb7ba0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-dflvt\" (UID: \"c58bddfc-aa3e-48e7-b809-25ed39fb7ba0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dflvt" Jul 24 18:06:18.556233 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.556009 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c58bddfc-aa3e-48e7-b809-25ed39fb7ba0-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-dflvt\" (UID: \"c58bddfc-aa3e-48e7-b809-25ed39fb7ba0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dflvt" Jul 24 18:06:18.556233 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.556037 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-nxvct\" (UID: \"0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nxvct" Jul 24 18:06:18.556233 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.556092 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-nxvct\" (UID: \"0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nxvct" Jul 24 18:06:18.556233 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.556109 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-nxvct\" (UID: \"0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nxvct" Jul 24 18:06:18.556233 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.556142 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b85bf\" (UniqueName: \"kubernetes.io/projected/0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004-kube-api-access-b85bf\") pod \"kube-state-metrics-56d9f944b4-nxvct\" (UID: \"0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nxvct" Jul 24 18:06:18.556233 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:06:18.556224 2562 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 24 18:06:18.556592 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:06:18.556285 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c58bddfc-aa3e-48e7-b809-25ed39fb7ba0-openshift-state-metrics-tls podName:c58bddfc-aa3e-48e7-b809-25ed39fb7ba0 nodeName:}" failed. No retries permitted until 2026-07-24 18:06:19.056269407 +0000 UTC m=+71.794460456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c58bddfc-aa3e-48e7-b809-25ed39fb7ba0-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-dflvt" (UID: "c58bddfc-aa3e-48e7-b809-25ed39fb7ba0") : secret "openshift-state-metrics-tls" not found Jul 24 18:06:18.556849 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.556819 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c58bddfc-aa3e-48e7-b809-25ed39fb7ba0-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-dflvt\" (UID: \"c58bddfc-aa3e-48e7-b809-25ed39fb7ba0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dflvt" Jul 24 18:06:18.559232 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.559209 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c58bddfc-aa3e-48e7-b809-25ed39fb7ba0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-dflvt\" (UID: \"c58bddfc-aa3e-48e7-b809-25ed39fb7ba0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dflvt" Jul 24 18:06:18.576030 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.575996 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcnbh\" (UniqueName: \"kubernetes.io/projected/c58bddfc-aa3e-48e7-b809-25ed39fb7ba0-kube-api-access-vcnbh\") pod \"openshift-state-metrics-b8f49f5c6-dflvt\" (UID: \"c58bddfc-aa3e-48e7-b809-25ed39fb7ba0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dflvt" Jul 24 18:06:18.657472 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.657392 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5457c0c0-5c92-4844-9bbc-cb6e1c7b9958-metrics-client-ca\") pod \"node-exporter-q7fqj\" (UID: \"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958\") " pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:18.657472 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.657444 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-nxvct\" (UID: \"0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nxvct" Jul 24 18:06:18.657679 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.657572 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5457c0c0-5c92-4844-9bbc-cb6e1c7b9958-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q7fqj\" (UID: \"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958\") " pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:18.657679 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.657648 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5457c0c0-5c92-4844-9bbc-cb6e1c7b9958-node-exporter-wtmp\") pod \"node-exporter-q7fqj\" (UID: \"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958\") " pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:18.657679 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.657669 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5457c0c0-5c92-4844-9bbc-cb6e1c7b9958-node-exporter-textfile\") pod \"node-exporter-q7fqj\" (UID: \"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958\") " pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:18.657798 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.657688 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5457c0c0-5c92-4844-9bbc-cb6e1c7b9958-node-exporter-tls\") pod \"node-exporter-q7fqj\" (UID: \"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958\") " pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:18.657798 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.657703 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g8h7\" (UniqueName: \"kubernetes.io/projected/5457c0c0-5c92-4844-9bbc-cb6e1c7b9958-kube-api-access-4g8h7\") pod \"node-exporter-q7fqj\" (UID: \"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958\") " pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:18.657798 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.657742 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-nxvct\" (UID: \"0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nxvct" Jul 24 18:06:18.657798 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.657762 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-nxvct\" (UID: \"0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nxvct" Jul 24 18:06:18.657960 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.657808 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-nxvct\" (UID: \"0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nxvct" Jul 24 18:06:18.657960 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.657863 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5457c0c0-5c92-4844-9bbc-cb6e1c7b9958-root\") pod \"node-exporter-q7fqj\" (UID: \"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958\") " pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:18.657960 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.657905 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-nxvct\" (UID: \"0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nxvct" Jul 24 18:06:18.657960 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.657934 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5457c0c0-5c92-4844-9bbc-cb6e1c7b9958-node-exporter-accelerators-collector-config\") pod \"node-exporter-q7fqj\" (UID: \"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958\") " pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:18.658143 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.657964 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5457c0c0-5c92-4844-9bbc-cb6e1c7b9958-sys\") pod \"node-exporter-q7fqj\" (UID: \"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958\") " pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:18.658143 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.657987 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b85bf\" (UniqueName: \"kubernetes.io/projected/0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004-kube-api-access-b85bf\") pod \"kube-state-metrics-56d9f944b4-nxvct\" (UID: \"0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nxvct" Jul 24 18:06:18.658143 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.658124 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-nxvct\" (UID: \"0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nxvct" Jul 24 18:06:18.658581 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.658541 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-nxvct\" (UID: \"0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nxvct" Jul 24 18:06:18.658811 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.658785 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-nxvct\" (UID: \"0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nxvct" Jul 24 18:06:18.660499 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.660479 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-nxvct\" (UID: \"0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nxvct" Jul 24 18:06:18.660726 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.660703 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-nxvct\" (UID: \"0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nxvct" Jul 24 18:06:18.674069 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.674041 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b85bf\" (UniqueName: \"kubernetes.io/projected/0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004-kube-api-access-b85bf\") pod \"kube-state-metrics-56d9f944b4-nxvct\" (UID: \"0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nxvct" Jul 24 18:06:18.747426 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.747388 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nxvct" Jul 24 18:06:18.759410 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.759383 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5457c0c0-5c92-4844-9bbc-cb6e1c7b9958-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q7fqj\" (UID: \"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958\") " pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:18.759549 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.759426 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5457c0c0-5c92-4844-9bbc-cb6e1c7b9958-node-exporter-wtmp\") pod \"node-exporter-q7fqj\" (UID: \"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958\") " pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:18.759549 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.759454 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5457c0c0-5c92-4844-9bbc-cb6e1c7b9958-node-exporter-textfile\") pod \"node-exporter-q7fqj\" (UID: \"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958\") " pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:18.759549 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.759477 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5457c0c0-5c92-4844-9bbc-cb6e1c7b9958-node-exporter-tls\") pod \"node-exporter-q7fqj\" (UID: \"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958\") " pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:18.759549 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.759502 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g8h7\" (UniqueName: \"kubernetes.io/projected/5457c0c0-5c92-4844-9bbc-cb6e1c7b9958-kube-api-access-4g8h7\") pod \"node-exporter-q7fqj\" (UID: \"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958\") " pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:18.759726 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.759555 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5457c0c0-5c92-4844-9bbc-cb6e1c7b9958-root\") pod \"node-exporter-q7fqj\" (UID: \"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958\") " pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:18.759726 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.759597 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5457c0c0-5c92-4844-9bbc-cb6e1c7b9958-node-exporter-accelerators-collector-config\") pod \"node-exporter-q7fqj\" (UID: \"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958\") " pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:18.759726 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.759618 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5457c0c0-5c92-4844-9bbc-cb6e1c7b9958-sys\") pod \"node-exporter-q7fqj\" (UID: \"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958\") " pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:18.759726 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.759604 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5457c0c0-5c92-4844-9bbc-cb6e1c7b9958-node-exporter-wtmp\") pod \"node-exporter-q7fqj\" (UID: \"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958\") " pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:18.759726 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.759647 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5457c0c0-5c92-4844-9bbc-cb6e1c7b9958-metrics-client-ca\") pod \"node-exporter-q7fqj\" (UID: \"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958\") " pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:18.759892 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.759761 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5457c0c0-5c92-4844-9bbc-cb6e1c7b9958-node-exporter-textfile\") pod \"node-exporter-q7fqj\" (UID: \"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958\") " pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:18.759892 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.759831 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5457c0c0-5c92-4844-9bbc-cb6e1c7b9958-sys\") pod \"node-exporter-q7fqj\" (UID: \"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958\") " pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:18.759892 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.759845 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5457c0c0-5c92-4844-9bbc-cb6e1c7b9958-root\") pod \"node-exporter-q7fqj\" (UID: \"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958\") " pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:18.760363 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.760342 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5457c0c0-5c92-4844-9bbc-cb6e1c7b9958-metrics-client-ca\") pod \"node-exporter-q7fqj\" (UID: \"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958\") " pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:18.760513 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.760485 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5457c0c0-5c92-4844-9bbc-cb6e1c7b9958-node-exporter-accelerators-collector-config\") pod \"node-exporter-q7fqj\" (UID: \"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958\") " pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:18.762564 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.762542 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5457c0c0-5c92-4844-9bbc-cb6e1c7b9958-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q7fqj\" (UID: \"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958\") " pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:18.762655 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.762615 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5457c0c0-5c92-4844-9bbc-cb6e1c7b9958-node-exporter-tls\") pod \"node-exporter-q7fqj\" (UID: \"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958\") " pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:18.769467 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.769441 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g8h7\" (UniqueName: \"kubernetes.io/projected/5457c0c0-5c92-4844-9bbc-cb6e1c7b9958-kube-api-access-4g8h7\") pod \"node-exporter-q7fqj\" (UID: \"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958\") " pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:18.840671 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:18.840634 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q7fqj" Jul 24 18:06:19.062714 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.062622 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c58bddfc-aa3e-48e7-b809-25ed39fb7ba0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-dflvt\" (UID: \"c58bddfc-aa3e-48e7-b809-25ed39fb7ba0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dflvt" Jul 24 18:06:19.065461 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.065427 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c58bddfc-aa3e-48e7-b809-25ed39fb7ba0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-dflvt\" (UID: \"c58bddfc-aa3e-48e7-b809-25ed39fb7ba0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dflvt" Jul 24 18:06:19.146867 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.146839 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rc4ks" Jul 24 18:06:19.316825 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.316743 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dflvt" Jul 24 18:06:19.376268 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.376230 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 18:06:19.378769 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.378747 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.382080 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.381843 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 24 18:06:19.382080 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.381856 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 24 18:06:19.382080 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.381889 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 24 18:06:19.382352 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.382192 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 24 18:06:19.382352 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.382265 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 24 18:06:19.382352 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.382347 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 24 18:06:19.382502 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.382354 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 24 18:06:19.382502 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.382484 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 24 18:06:19.382585 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.382567 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 24 18:06:19.382687 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.382644 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pmdt9\"" Jul 24 18:06:19.401901 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.401785 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 18:06:19.466079 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.466041 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/176e7b50-a386-41c3-a442-badf23eb9fd1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.466079 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.466081 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/176e7b50-a386-41c3-a442-badf23eb9fd1-config-out\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.466540 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.466106 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-config-volume\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.466540 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.466126 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.466540 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.466141 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/176e7b50-a386-41c3-a442-badf23eb9fd1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.466540 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.466158 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/176e7b50-a386-41c3-a442-badf23eb9fd1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.466540 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.466173 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bfv7\" (UniqueName: \"kubernetes.io/projected/176e7b50-a386-41c3-a442-badf23eb9fd1-kube-api-access-8bfv7\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.466540 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.466194 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-web-config\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.466540 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.466232 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.466540 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.466259 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.466540 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.466275 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/176e7b50-a386-41c3-a442-badf23eb9fd1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.466540 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.466299 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.466540 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.466354 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.567701 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.567619 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-config-volume\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.567701 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.567662 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.567701 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.567694 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/176e7b50-a386-41c3-a442-badf23eb9fd1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.567996 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.567721 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/176e7b50-a386-41c3-a442-badf23eb9fd1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.567996 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.567786 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bfv7\" (UniqueName: \"kubernetes.io/projected/176e7b50-a386-41c3-a442-badf23eb9fd1-kube-api-access-8bfv7\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.567996 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.567812 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-web-config\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.567996 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.567847 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.567996 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.567884 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.567996 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.567908 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/176e7b50-a386-41c3-a442-badf23eb9fd1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.567996 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.567993 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.568311 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.568060 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.568311 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.568109 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/176e7b50-a386-41c3-a442-badf23eb9fd1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.568311 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.568133 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/176e7b50-a386-41c3-a442-badf23eb9fd1-config-out\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.569528 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:06:19.568705 2562 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 24 18:06:19.569528 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:06:19.568790 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-secret-alertmanager-main-tls podName:176e7b50-a386-41c3-a442-badf23eb9fd1 nodeName:}" failed. No retries permitted until 2026-07-24 18:06:20.068766177 +0000 UTC m=+72.806957243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "176e7b50-a386-41c3-a442-badf23eb9fd1") : secret "alertmanager-main-tls" not found Jul 24 18:06:19.569528 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.569461 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/176e7b50-a386-41c3-a442-badf23eb9fd1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.569528 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.569472 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/176e7b50-a386-41c3-a442-badf23eb9fd1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.569528 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.569467 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/176e7b50-a386-41c3-a442-badf23eb9fd1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.572707 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.572685 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.572800 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.572690 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.572858 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.572835 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-web-config\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.572923 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.572878 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/176e7b50-a386-41c3-a442-badf23eb9fd1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.573257 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.573231 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.573366 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.573297 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/176e7b50-a386-41c3-a442-badf23eb9fd1-config-out\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.573658 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.573634 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.575166 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.575137 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-config-volume\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:19.579926 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:19.579903 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bfv7\" (UniqueName: \"kubernetes.io/projected/176e7b50-a386-41c3-a442-badf23eb9fd1-kube-api-access-8bfv7\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:20.073583 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:20.073543 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:20.076602 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:20.076565 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:20.146772 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:06:20.146741 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5457c0c0_5c92_4844_9bbc_cb6e1c7b9958.slice/crio-f4a46e435f9c0a013c8c7496dbd14f0f1fbbac3d30f5aa74d1b4978c247d8457 WatchSource:0}: Error finding container f4a46e435f9c0a013c8c7496dbd14f0f1fbbac3d30f5aa74d1b4978c247d8457: Status 404 returned error can't find the container with id f4a46e435f9c0a013c8c7496dbd14f0f1fbbac3d30f5aa74d1b4978c247d8457 Jul 24 18:06:20.197813 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:20.197690 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q7fqj" event={"ID":"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958","Type":"ContainerStarted","Data":"f4a46e435f9c0a013c8c7496dbd14f0f1fbbac3d30f5aa74d1b4978c247d8457"} Jul 24 18:06:20.289981 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:20.289954 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:06:20.304125 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:20.304100 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-nxvct"] Jul 24 18:06:20.306662 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:06:20.306634 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dc3c657_5aeb_4e9c_ad9c_2ed06ccee004.slice/crio-6af760cf393b1a381689cf1095389b95e24412b54df66216906eb0e71aaf2356 WatchSource:0}: Error finding container 6af760cf393b1a381689cf1095389b95e24412b54df66216906eb0e71aaf2356: Status 404 returned error can't find the container with id 6af760cf393b1a381689cf1095389b95e24412b54df66216906eb0e71aaf2356 Jul 24 18:06:20.325070 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:20.324997 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-dflvt"] Jul 24 18:06:20.327423 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:06:20.327378 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc58bddfc_aa3e_48e7_b809_25ed39fb7ba0.slice/crio-2537229a10dcd39884cc2cfeea581beb2ea968d792e33f7b33cffe9a0ecdfc14 WatchSource:0}: Error finding container 2537229a10dcd39884cc2cfeea581beb2ea968d792e33f7b33cffe9a0ecdfc14: Status 404 returned error can't find the container with id 2537229a10dcd39884cc2cfeea581beb2ea968d792e33f7b33cffe9a0ecdfc14 Jul 24 18:06:20.457035 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:20.457005 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 18:06:20.459521 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:06:20.459494 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod176e7b50_a386_41c3_a442_badf23eb9fd1.slice/crio-e32be4d72e75bad11d6330dcf47969169f8685065d39e4b4702861f135e5dd61 WatchSource:0}: Error finding container e32be4d72e75bad11d6330dcf47969169f8685065d39e4b4702861f135e5dd61: Status 404 returned error can't find the container with id e32be4d72e75bad11d6330dcf47969169f8685065d39e4b4702861f135e5dd61 Jul 24 18:06:21.203485 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.203441 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nhn86" event={"ID":"3d977d3f-700c-41a7-b570-34b267cf97cf","Type":"ContainerStarted","Data":"58495e0517136796b80e089d24b35f182b32f340add03f0f0ea228cf5cb1b899"} Jul 24 18:06:21.204894 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.204810 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"176e7b50-a386-41c3-a442-badf23eb9fd1","Type":"ContainerStarted","Data":"e32be4d72e75bad11d6330dcf47969169f8685065d39e4b4702861f135e5dd61"} Jul 24 18:06:21.207466 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.207441 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dflvt" event={"ID":"c58bddfc-aa3e-48e7-b809-25ed39fb7ba0","Type":"ContainerStarted","Data":"dea4c6010fdeaea373a60b73d9f25e8d4ee309fb6d7c054408fe92b0e8cc6c3e"} Jul 24 18:06:21.207552 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.207488 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dflvt" event={"ID":"c58bddfc-aa3e-48e7-b809-25ed39fb7ba0","Type":"ContainerStarted","Data":"f2fae3babfbd776f51951892302bd9fbe9111345590b5df08126831beff7e0ee"} Jul 24 18:06:21.207552 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.207507 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dflvt" event={"ID":"c58bddfc-aa3e-48e7-b809-25ed39fb7ba0","Type":"ContainerStarted","Data":"2537229a10dcd39884cc2cfeea581beb2ea968d792e33f7b33cffe9a0ecdfc14"} Jul 24 18:06:21.209163 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.209139 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7bf8g" event={"ID":"346e9e7f-16c1-4b99-b339-c88ea048ba64","Type":"ContainerStarted","Data":"4d24ddd2bccc75d69e5b2439e8f9a48b3b229b2f83e5633193a9d21af9309da9"} Jul 24 18:06:21.209276 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.209201 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:06:21.210547 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.210486 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nxvct" event={"ID":"0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004","Type":"ContainerStarted","Data":"6af760cf393b1a381689cf1095389b95e24412b54df66216906eb0e71aaf2356"} Jul 24 18:06:21.242555 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.242478 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nhn86" podStartSLOduration=68.228167818 podStartE2EDuration="1m14.242455847s" totalImagesPullingTime="6.014288029s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:05:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:06:21.221929201 +0000 UTC m=+73.960120274" watchObservedRunningTime="2026-07-24 18:06:21.242455847 +0000 UTC m=+73.980646918" Jul 24 18:06:21.242782 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.242747 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7bf8g" podStartSLOduration=68.054373122 podStartE2EDuration="1m14.242736813s" totalImagesPullingTime="6.188363691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:05:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:06:21.241203323 +0000 UTC m=+73.979394397" watchObservedRunningTime="2026-07-24 18:06:21.242736813 +0000 UTC m=+73.980927883" Jul 24 18:06:21.367133 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.367101 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-856c4f7576-5jqvt"] Jul 24 18:06:21.371760 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.371731 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" Jul 24 18:06:21.374749 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.374725 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 24 18:06:21.374861 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.374839 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zb5bv\"" Jul 24 18:06:21.375057 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.375041 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-cckfsflpu880j\"" Jul 24 18:06:21.375142 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.375126 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 24 18:06:21.375219 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.375045 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 24 18:06:21.375382 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.375364 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 24 18:06:21.375630 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.375613 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 24 18:06:21.384633 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.384611 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-856c4f7576-5jqvt"] Jul 24 18:06:21.488412 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.488296 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5739ca6a-b4a5-4691-8945-79ea0e1b3261-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-856c4f7576-5jqvt\" (UID: \"5739ca6a-b4a5-4691-8945-79ea0e1b3261\") " pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" Jul 24 18:06:21.488412 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.488363 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5739ca6a-b4a5-4691-8945-79ea0e1b3261-metrics-client-ca\") pod \"thanos-querier-856c4f7576-5jqvt\" (UID: \"5739ca6a-b4a5-4691-8945-79ea0e1b3261\") " pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" Jul 24 18:06:21.488412 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.488389 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r44qn\" (UniqueName: \"kubernetes.io/projected/5739ca6a-b4a5-4691-8945-79ea0e1b3261-kube-api-access-r44qn\") pod \"thanos-querier-856c4f7576-5jqvt\" (UID: \"5739ca6a-b4a5-4691-8945-79ea0e1b3261\") " pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" Jul 24 18:06:21.488675 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.488423 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5739ca6a-b4a5-4691-8945-79ea0e1b3261-secret-grpc-tls\") pod \"thanos-querier-856c4f7576-5jqvt\" (UID: \"5739ca6a-b4a5-4691-8945-79ea0e1b3261\") " pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" Jul 24 18:06:21.488675 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.488447 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5739ca6a-b4a5-4691-8945-79ea0e1b3261-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-856c4f7576-5jqvt\" (UID: \"5739ca6a-b4a5-4691-8945-79ea0e1b3261\") " pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" Jul 24 18:06:21.488675 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.488475 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5739ca6a-b4a5-4691-8945-79ea0e1b3261-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-856c4f7576-5jqvt\" (UID: \"5739ca6a-b4a5-4691-8945-79ea0e1b3261\") " pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" Jul 24 18:06:21.488675 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.488540 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5739ca6a-b4a5-4691-8945-79ea0e1b3261-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-856c4f7576-5jqvt\" (UID: \"5739ca6a-b4a5-4691-8945-79ea0e1b3261\") " pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" Jul 24 18:06:21.488675 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.488589 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5739ca6a-b4a5-4691-8945-79ea0e1b3261-secret-thanos-querier-tls\") pod \"thanos-querier-856c4f7576-5jqvt\" (UID: \"5739ca6a-b4a5-4691-8945-79ea0e1b3261\") " pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" Jul 24 18:06:21.590069 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.590011 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5739ca6a-b4a5-4691-8945-79ea0e1b3261-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-856c4f7576-5jqvt\" (UID: \"5739ca6a-b4a5-4691-8945-79ea0e1b3261\") " pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" Jul 24 18:06:21.590216 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.590082 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5739ca6a-b4a5-4691-8945-79ea0e1b3261-metrics-client-ca\") pod \"thanos-querier-856c4f7576-5jqvt\" (UID: \"5739ca6a-b4a5-4691-8945-79ea0e1b3261\") " pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" Jul 24 18:06:21.590216 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.590118 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r44qn\" (UniqueName: \"kubernetes.io/projected/5739ca6a-b4a5-4691-8945-79ea0e1b3261-kube-api-access-r44qn\") pod \"thanos-querier-856c4f7576-5jqvt\" (UID: \"5739ca6a-b4a5-4691-8945-79ea0e1b3261\") " pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" Jul 24 18:06:21.590216 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.590153 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5739ca6a-b4a5-4691-8945-79ea0e1b3261-secret-grpc-tls\") pod \"thanos-querier-856c4f7576-5jqvt\" (UID: \"5739ca6a-b4a5-4691-8945-79ea0e1b3261\") " pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" Jul 24 18:06:21.590216 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.590187 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5739ca6a-b4a5-4691-8945-79ea0e1b3261-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-856c4f7576-5jqvt\" (UID: \"5739ca6a-b4a5-4691-8945-79ea0e1b3261\") " pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" Jul 24 18:06:21.590464 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.590213 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5739ca6a-b4a5-4691-8945-79ea0e1b3261-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-856c4f7576-5jqvt\" (UID: \"5739ca6a-b4a5-4691-8945-79ea0e1b3261\") " pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" Jul 24 18:06:21.590464 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.590245 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5739ca6a-b4a5-4691-8945-79ea0e1b3261-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-856c4f7576-5jqvt\" (UID: \"5739ca6a-b4a5-4691-8945-79ea0e1b3261\") " pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" Jul 24 18:06:21.590464 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.590279 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5739ca6a-b4a5-4691-8945-79ea0e1b3261-secret-thanos-querier-tls\") pod \"thanos-querier-856c4f7576-5jqvt\" (UID: \"5739ca6a-b4a5-4691-8945-79ea0e1b3261\") " pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" Jul 24 18:06:21.591025 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.590919 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5739ca6a-b4a5-4691-8945-79ea0e1b3261-metrics-client-ca\") pod \"thanos-querier-856c4f7576-5jqvt\" (UID: \"5739ca6a-b4a5-4691-8945-79ea0e1b3261\") " pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" Jul 24 18:06:21.593045 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.592997 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5739ca6a-b4a5-4691-8945-79ea0e1b3261-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-856c4f7576-5jqvt\" (UID: \"5739ca6a-b4a5-4691-8945-79ea0e1b3261\") " pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" Jul 24 18:06:21.593313 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.593285 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5739ca6a-b4a5-4691-8945-79ea0e1b3261-secret-grpc-tls\") pod \"thanos-querier-856c4f7576-5jqvt\" (UID: \"5739ca6a-b4a5-4691-8945-79ea0e1b3261\") " pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" Jul 24 18:06:21.593600 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.593573 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5739ca6a-b4a5-4691-8945-79ea0e1b3261-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-856c4f7576-5jqvt\" (UID: \"5739ca6a-b4a5-4691-8945-79ea0e1b3261\") " pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" Jul 24 18:06:21.593733 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.593711 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5739ca6a-b4a5-4691-8945-79ea0e1b3261-secret-thanos-querier-tls\") pod \"thanos-querier-856c4f7576-5jqvt\" (UID: \"5739ca6a-b4a5-4691-8945-79ea0e1b3261\") " pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" Jul 24 18:06:21.593934 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.593910 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5739ca6a-b4a5-4691-8945-79ea0e1b3261-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-856c4f7576-5jqvt\" (UID: \"5739ca6a-b4a5-4691-8945-79ea0e1b3261\") " pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" Jul 24 18:06:21.593989 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.593917 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5739ca6a-b4a5-4691-8945-79ea0e1b3261-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-856c4f7576-5jqvt\" (UID: \"5739ca6a-b4a5-4691-8945-79ea0e1b3261\") " pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" Jul 24 18:06:21.600234 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.600210 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r44qn\" (UniqueName: \"kubernetes.io/projected/5739ca6a-b4a5-4691-8945-79ea0e1b3261-kube-api-access-r44qn\") pod \"thanos-querier-856c4f7576-5jqvt\" (UID: \"5739ca6a-b4a5-4691-8945-79ea0e1b3261\") " pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" Jul 24 18:06:21.688903 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:21.688868 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" Jul 24 18:06:22.096267 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:22.096238 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-856c4f7576-5jqvt"] Jul 24 18:06:22.120307 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:06:22.120272 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5739ca6a_b4a5_4691_8945_79ea0e1b3261.slice/crio-92aa53b1670c798402105b3c5e16a32ae81c828634bc902fa6b3941cb06428e7 WatchSource:0}: Error finding container 92aa53b1670c798402105b3c5e16a32ae81c828634bc902fa6b3941cb06428e7: Status 404 returned error can't find the container with id 92aa53b1670c798402105b3c5e16a32ae81c828634bc902fa6b3941cb06428e7 Jul 24 18:06:22.216860 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:22.216830 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" event={"ID":"5739ca6a-b4a5-4691-8945-79ea0e1b3261","Type":"ContainerStarted","Data":"92aa53b1670c798402105b3c5e16a32ae81c828634bc902fa6b3941cb06428e7"} Jul 24 18:06:22.219846 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:22.219817 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nxvct" event={"ID":"0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004","Type":"ContainerStarted","Data":"95d758653b5d9ff80b67bb47e487c3f0ca92a4ccbfc1eccc5855bb84833e0b21"} Jul 24 18:06:22.219985 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:22.219870 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nxvct" event={"ID":"0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004","Type":"ContainerStarted","Data":"7b47559b305ba53ef0a77a3ee531c9e14c46af802f62e4581c125d67e1a3cb98"} Jul 24 18:06:22.221981 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:22.221951 2562 generic.go:356] "Generic (PLEG): container finished" podID="5457c0c0-5c92-4844-9bbc-cb6e1c7b9958" containerID="0ebafad5b19f165c3a61e15419e6272f7d446f90ec2bf9a38bc7485bc27ab7f2" exitCode=0 Jul 24 18:06:22.222090 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:22.222033 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q7fqj" event={"ID":"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958","Type":"ContainerDied","Data":"0ebafad5b19f165c3a61e15419e6272f7d446f90ec2bf9a38bc7485bc27ab7f2"} Jul 24 18:06:22.224850 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:22.224822 2562 generic.go:356] "Generic (PLEG): container finished" podID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerID="c4cfd32ea77e15afe8d061e9739f5a37a940f7954adfd2b22332c977850bb183" exitCode=0 Jul 24 18:06:22.225515 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:22.225474 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"176e7b50-a386-41c3-a442-badf23eb9fd1","Type":"ContainerDied","Data":"c4cfd32ea77e15afe8d061e9739f5a37a940f7954adfd2b22332c977850bb183"} Jul 24 18:06:22.994510 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:22.994417 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-59df6df7c6-57nbt"] Jul 24 18:06:22.997641 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:22.997614 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" Jul 24 18:06:23.000628 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.000601 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 24 18:06:23.001271 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.001239 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 24 18:06:23.001666 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.001643 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3sqgdavoukf08\"" Jul 24 18:06:23.002028 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.002009 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 24 18:06:23.002389 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.002370 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 24 18:06:23.002624 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.002610 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-tjqd5\"" Jul 24 18:06:23.012934 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.012870 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-59df6df7c6-57nbt"] Jul 24 18:06:23.044029 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.043992 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-m5tmn"] Jul 24 18:06:23.047642 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.047619 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-m5tmn" Jul 24 18:06:23.051189 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.051169 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 24 18:06:23.051377 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.051205 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-zgcbq\"" Jul 24 18:06:23.060700 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.060672 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-m5tmn"] Jul 24 18:06:23.106773 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.106678 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f486deb5-6625-4433-b4ee-6c48b6b92ad5-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-m5tmn\" (UID: \"f486deb5-6625-4433-b4ee-6c48b6b92ad5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-m5tmn" Jul 24 18:06:23.106995 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.106792 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pnvb\" (UniqueName: \"kubernetes.io/projected/f486deb5-6625-4433-b4ee-6c48b6b92ad5-kube-api-access-7pnvb\") pod \"monitoring-plugin-68b7fc9574-m5tmn\" (UID: \"f486deb5-6625-4433-b4ee-6c48b6b92ad5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-m5tmn" Jul 24 18:06:23.106995 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.106890 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/88cfeea6-c3ed-4356-9ea8-27e367db3d79-audit-log\") pod \"metrics-server-59df6df7c6-57nbt\" (UID: \"88cfeea6-c3ed-4356-9ea8-27e367db3d79\") " pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" Jul 24 18:06:23.106995 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.106926 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88cfeea6-c3ed-4356-9ea8-27e367db3d79-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59df6df7c6-57nbt\" (UID: \"88cfeea6-c3ed-4356-9ea8-27e367db3d79\") " pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" Jul 24 18:06:23.106995 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.106960 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/88cfeea6-c3ed-4356-9ea8-27e367db3d79-metrics-server-audit-profiles\") pod \"metrics-server-59df6df7c6-57nbt\" (UID: \"88cfeea6-c3ed-4356-9ea8-27e367db3d79\") " pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" Jul 24 18:06:23.107194 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.107035 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/88cfeea6-c3ed-4356-9ea8-27e367db3d79-secret-metrics-server-tls\") pod \"metrics-server-59df6df7c6-57nbt\" (UID: \"88cfeea6-c3ed-4356-9ea8-27e367db3d79\") " pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" Jul 24 18:06:23.107194 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.107082 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/88cfeea6-c3ed-4356-9ea8-27e367db3d79-secret-metrics-server-client-certs\") pod \"metrics-server-59df6df7c6-57nbt\" (UID: \"88cfeea6-c3ed-4356-9ea8-27e367db3d79\") " pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" Jul 24 18:06:23.107194 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.107114 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88cfeea6-c3ed-4356-9ea8-27e367db3d79-client-ca-bundle\") pod \"metrics-server-59df6df7c6-57nbt\" (UID: \"88cfeea6-c3ed-4356-9ea8-27e367db3d79\") " pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" Jul 24 18:06:23.107194 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.107141 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghb5r\" (UniqueName: \"kubernetes.io/projected/88cfeea6-c3ed-4356-9ea8-27e367db3d79-kube-api-access-ghb5r\") pod \"metrics-server-59df6df7c6-57nbt\" (UID: \"88cfeea6-c3ed-4356-9ea8-27e367db3d79\") " pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" Jul 24 18:06:23.208389 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.208352 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/88cfeea6-c3ed-4356-9ea8-27e367db3d79-secret-metrics-server-tls\") pod \"metrics-server-59df6df7c6-57nbt\" (UID: \"88cfeea6-c3ed-4356-9ea8-27e367db3d79\") " pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" Jul 24 18:06:23.208564 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.208414 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/88cfeea6-c3ed-4356-9ea8-27e367db3d79-secret-metrics-server-client-certs\") pod \"metrics-server-59df6df7c6-57nbt\" (UID: \"88cfeea6-c3ed-4356-9ea8-27e367db3d79\") " pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" Jul 24 18:06:23.208564 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.208448 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88cfeea6-c3ed-4356-9ea8-27e367db3d79-client-ca-bundle\") pod \"metrics-server-59df6df7c6-57nbt\" (UID: \"88cfeea6-c3ed-4356-9ea8-27e367db3d79\") " pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" Jul 24 18:06:23.208564 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.208474 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghb5r\" (UniqueName: \"kubernetes.io/projected/88cfeea6-c3ed-4356-9ea8-27e367db3d79-kube-api-access-ghb5r\") pod \"metrics-server-59df6df7c6-57nbt\" (UID: \"88cfeea6-c3ed-4356-9ea8-27e367db3d79\") " pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" Jul 24 18:06:23.208564 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.208512 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f486deb5-6625-4433-b4ee-6c48b6b92ad5-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-m5tmn\" (UID: \"f486deb5-6625-4433-b4ee-6c48b6b92ad5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-m5tmn" Jul 24 18:06:23.208564 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.208556 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pnvb\" (UniqueName: \"kubernetes.io/projected/f486deb5-6625-4433-b4ee-6c48b6b92ad5-kube-api-access-7pnvb\") pod \"monitoring-plugin-68b7fc9574-m5tmn\" (UID: \"f486deb5-6625-4433-b4ee-6c48b6b92ad5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-m5tmn" Jul 24 18:06:23.208837 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.208596 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/88cfeea6-c3ed-4356-9ea8-27e367db3d79-audit-log\") pod \"metrics-server-59df6df7c6-57nbt\" (UID: \"88cfeea6-c3ed-4356-9ea8-27e367db3d79\") " pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" Jul 24 18:06:23.208837 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.208620 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88cfeea6-c3ed-4356-9ea8-27e367db3d79-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59df6df7c6-57nbt\" (UID: \"88cfeea6-c3ed-4356-9ea8-27e367db3d79\") " pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" Jul 24 18:06:23.208837 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.208647 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/88cfeea6-c3ed-4356-9ea8-27e367db3d79-metrics-server-audit-profiles\") pod \"metrics-server-59df6df7c6-57nbt\" (UID: \"88cfeea6-c3ed-4356-9ea8-27e367db3d79\") " pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" Jul 24 18:06:23.209004 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:06:23.208956 2562 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 24 18:06:23.209063 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:06:23.209040 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f486deb5-6625-4433-b4ee-6c48b6b92ad5-monitoring-plugin-cert podName:f486deb5-6625-4433-b4ee-6c48b6b92ad5 nodeName:}" failed. No retries permitted until 2026-07-24 18:06:23.709018916 +0000 UTC m=+76.447209963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/f486deb5-6625-4433-b4ee-6c48b6b92ad5-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-m5tmn" (UID: "f486deb5-6625-4433-b4ee-6c48b6b92ad5") : secret "monitoring-plugin-cert" not found Jul 24 18:06:23.209441 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.209410 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/88cfeea6-c3ed-4356-9ea8-27e367db3d79-audit-log\") pod \"metrics-server-59df6df7c6-57nbt\" (UID: \"88cfeea6-c3ed-4356-9ea8-27e367db3d79\") " pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" Jul 24 18:06:23.209646 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.209620 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/88cfeea6-c3ed-4356-9ea8-27e367db3d79-metrics-server-audit-profiles\") pod \"metrics-server-59df6df7c6-57nbt\" (UID: \"88cfeea6-c3ed-4356-9ea8-27e367db3d79\") " pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" Jul 24 18:06:23.210031 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.209973 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88cfeea6-c3ed-4356-9ea8-27e367db3d79-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59df6df7c6-57nbt\" (UID: \"88cfeea6-c3ed-4356-9ea8-27e367db3d79\") " pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" Jul 24 18:06:23.211680 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.211655 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88cfeea6-c3ed-4356-9ea8-27e367db3d79-client-ca-bundle\") pod \"metrics-server-59df6df7c6-57nbt\" (UID: \"88cfeea6-c3ed-4356-9ea8-27e367db3d79\") " pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" Jul 24 18:06:23.212025 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.211998 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/88cfeea6-c3ed-4356-9ea8-27e367db3d79-secret-metrics-server-client-certs\") pod \"metrics-server-59df6df7c6-57nbt\" (UID: \"88cfeea6-c3ed-4356-9ea8-27e367db3d79\") " pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" Jul 24 18:06:23.212118 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.212077 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/88cfeea6-c3ed-4356-9ea8-27e367db3d79-secret-metrics-server-tls\") pod \"metrics-server-59df6df7c6-57nbt\" (UID: \"88cfeea6-c3ed-4356-9ea8-27e367db3d79\") " pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" Jul 24 18:06:23.220670 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.220640 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pnvb\" (UniqueName: \"kubernetes.io/projected/f486deb5-6625-4433-b4ee-6c48b6b92ad5-kube-api-access-7pnvb\") pod \"monitoring-plugin-68b7fc9574-m5tmn\" (UID: \"f486deb5-6625-4433-b4ee-6c48b6b92ad5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-m5tmn" Jul 24 18:06:23.221093 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.220920 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghb5r\" (UniqueName: \"kubernetes.io/projected/88cfeea6-c3ed-4356-9ea8-27e367db3d79-kube-api-access-ghb5r\") pod \"metrics-server-59df6df7c6-57nbt\" (UID: \"88cfeea6-c3ed-4356-9ea8-27e367db3d79\") " pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" Jul 24 18:06:23.239219 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.239180 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q7fqj" event={"ID":"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958","Type":"ContainerStarted","Data":"c00b28432b6011cabe97e18745956e546975dbfb6cdf1b2fddabaaaa063023ae"} Jul 24 18:06:23.239560 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.239529 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q7fqj" event={"ID":"5457c0c0-5c92-4844-9bbc-cb6e1c7b9958","Type":"ContainerStarted","Data":"3d9a4b6b22c61f7fb94b9b6e39ca9d72e7466b3fb68b0d5eb01241e2d2c726c3"} Jul 24 18:06:23.243268 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.243234 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dflvt" event={"ID":"c58bddfc-aa3e-48e7-b809-25ed39fb7ba0","Type":"ContainerStarted","Data":"7f0ca25d52cae642d2ff5d3c362c7e636abbe5dc45db2e83f349320c66098810"} Jul 24 18:06:23.246549 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.246468 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nxvct" event={"ID":"0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004","Type":"ContainerStarted","Data":"b334811468078405d14eb6bf380b9c4b0f64b78101e48d926c4b944deb3310ec"} Jul 24 18:06:23.260859 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.260792 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-q7fqj" podStartSLOduration=3.354767996 podStartE2EDuration="5.260771929s" totalImagesPullingTime="1.783950108s" totalInitContainerRuntime="122.053825ms" isStatefulPod=true podCreationTimestamp="2026-07-24 18:06:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:06:23.259958528 +0000 UTC m=+75.998149622" watchObservedRunningTime="2026-07-24 18:06:23.260771929 +0000 UTC m=+75.998963001" Jul 24 18:06:23.290021 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.289964 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dflvt" podStartSLOduration=3.137020132 podStartE2EDuration="5.289944485s" totalImagesPullingTime="2.152924353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:06:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:06:23.288759295 +0000 UTC m=+76.026950366" watchObservedRunningTime="2026-07-24 18:06:23.289944485 +0000 UTC m=+76.028135555" Jul 24 18:06:23.312541 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.312513 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" Jul 24 18:06:23.312541 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.312508 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-nxvct" podStartSLOduration=3.688836471 podStartE2EDuration="5.312491255s" totalImagesPullingTime="1.623654784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:06:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:06:23.311575925 +0000 UTC m=+76.049766995" watchObservedRunningTime="2026-07-24 18:06:23.312491255 +0000 UTC m=+76.050682325" Jul 24 18:06:23.601020 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.599496 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-8zzk7"] Jul 24 18:06:23.604278 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.604245 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-8zzk7" Jul 24 18:06:23.606941 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.606919 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 24 18:06:23.607056 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.607009 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-l7gct\"" Jul 24 18:06:23.607132 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.606919 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 24 18:06:23.618370 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.618340 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-8zzk7"] Jul 24 18:06:23.714307 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.714272 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f486deb5-6625-4433-b4ee-6c48b6b92ad5-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-m5tmn\" (UID: \"f486deb5-6625-4433-b4ee-6c48b6b92ad5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-m5tmn" Jul 24 18:06:23.714503 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.714440 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b2n6\" (UniqueName: \"kubernetes.io/projected/31bc003f-f191-4b12-ae44-df58a9c96407-kube-api-access-8b2n6\") pod \"downloads-7c97dc4555-8zzk7\" (UID: \"31bc003f-f191-4b12-ae44-df58a9c96407\") " pod="openshift-console/downloads-7c97dc4555-8zzk7" Jul 24 18:06:23.716897 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.716876 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f486deb5-6625-4433-b4ee-6c48b6b92ad5-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-m5tmn\" (UID: \"f486deb5-6625-4433-b4ee-6c48b6b92ad5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-m5tmn" Jul 24 18:06:23.815153 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.815117 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b2n6\" (UniqueName: \"kubernetes.io/projected/31bc003f-f191-4b12-ae44-df58a9c96407-kube-api-access-8b2n6\") pod \"downloads-7c97dc4555-8zzk7\" (UID: \"31bc003f-f191-4b12-ae44-df58a9c96407\") " pod="openshift-console/downloads-7c97dc4555-8zzk7" Jul 24 18:06:23.829067 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.829038 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b2n6\" (UniqueName: \"kubernetes.io/projected/31bc003f-f191-4b12-ae44-df58a9c96407-kube-api-access-8b2n6\") pod \"downloads-7c97dc4555-8zzk7\" (UID: \"31bc003f-f191-4b12-ae44-df58a9c96407\") " pod="openshift-console/downloads-7c97dc4555-8zzk7" Jul 24 18:06:23.838678 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.838606 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd"] Jul 24 18:06:23.842461 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.842438 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" Jul 24 18:06:23.844975 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.844955 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 24 18:06:23.845648 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.845267 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-scm6n\"" Jul 24 18:06:23.846160 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.846142 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 24 18:06:23.846514 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.846391 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 24 18:06:23.846514 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.846394 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 24 18:06:23.846514 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.846447 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 24 18:06:23.855918 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.855728 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 24 18:06:23.858466 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.858400 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-59df6df7c6-57nbt"] Jul 24 18:06:23.861838 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.861818 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd"] Jul 24 18:06:23.862089 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:06:23.862069 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88cfeea6_c3ed_4356_9ea8_27e367db3d79.slice/crio-dea05b978178f87d495927e4369bfa5577a2cf62388033510fb12713a959cfe7 WatchSource:0}: Error finding container dea05b978178f87d495927e4369bfa5577a2cf62388033510fb12713a959cfe7: Status 404 returned error can't find the container with id dea05b978178f87d495927e4369bfa5577a2cf62388033510fb12713a959cfe7 Jul 24 18:06:23.915260 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.915235 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-8zzk7" Jul 24 18:06:23.915588 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.915569 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/84314924-ebfe-4633-ba6a-2f3354f5502f-federate-client-tls\") pod \"telemeter-client-7d6d8c8bb6-r9xrd\" (UID: \"84314924-ebfe-4633-ba6a-2f3354f5502f\") " pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" Jul 24 18:06:23.915665 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.915617 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84314924-ebfe-4633-ba6a-2f3354f5502f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d6d8c8bb6-r9xrd\" (UID: \"84314924-ebfe-4633-ba6a-2f3354f5502f\") " pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" Jul 24 18:06:23.915665 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.915659 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/84314924-ebfe-4633-ba6a-2f3354f5502f-telemeter-client-tls\") pod \"telemeter-client-7d6d8c8bb6-r9xrd\" (UID: \"84314924-ebfe-4633-ba6a-2f3354f5502f\") " pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" Jul 24 18:06:23.915752 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.915708 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84314924-ebfe-4633-ba6a-2f3354f5502f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d6d8c8bb6-r9xrd\" (UID: \"84314924-ebfe-4633-ba6a-2f3354f5502f\") " pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" Jul 24 18:06:23.915752 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.915735 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhl2m\" (UniqueName: \"kubernetes.io/projected/84314924-ebfe-4633-ba6a-2f3354f5502f-kube-api-access-xhl2m\") pod \"telemeter-client-7d6d8c8bb6-r9xrd\" (UID: \"84314924-ebfe-4633-ba6a-2f3354f5502f\") " pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" Jul 24 18:06:23.915815 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.915773 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/84314924-ebfe-4633-ba6a-2f3354f5502f-secret-telemeter-client\") pod \"telemeter-client-7d6d8c8bb6-r9xrd\" (UID: \"84314924-ebfe-4633-ba6a-2f3354f5502f\") " pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" Jul 24 18:06:23.915815 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.915794 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84314924-ebfe-4633-ba6a-2f3354f5502f-metrics-client-ca\") pod \"telemeter-client-7d6d8c8bb6-r9xrd\" (UID: \"84314924-ebfe-4633-ba6a-2f3354f5502f\") " pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" Jul 24 18:06:23.915879 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.915815 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84314924-ebfe-4633-ba6a-2f3354f5502f-serving-certs-ca-bundle\") pod \"telemeter-client-7d6d8c8bb6-r9xrd\" (UID: \"84314924-ebfe-4633-ba6a-2f3354f5502f\") " pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" Jul 24 18:06:23.959871 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:23.959840 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-m5tmn" Jul 24 18:06:24.017657 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.016696 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84314924-ebfe-4633-ba6a-2f3354f5502f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d6d8c8bb6-r9xrd\" (UID: \"84314924-ebfe-4633-ba6a-2f3354f5502f\") " pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" Jul 24 18:06:24.017657 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.016743 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhl2m\" (UniqueName: \"kubernetes.io/projected/84314924-ebfe-4633-ba6a-2f3354f5502f-kube-api-access-xhl2m\") pod \"telemeter-client-7d6d8c8bb6-r9xrd\" (UID: \"84314924-ebfe-4633-ba6a-2f3354f5502f\") " pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" Jul 24 18:06:24.017657 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.016776 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/84314924-ebfe-4633-ba6a-2f3354f5502f-secret-telemeter-client\") pod \"telemeter-client-7d6d8c8bb6-r9xrd\" (UID: \"84314924-ebfe-4633-ba6a-2f3354f5502f\") " pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" Jul 24 18:06:24.017657 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.016804 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84314924-ebfe-4633-ba6a-2f3354f5502f-metrics-client-ca\") pod \"telemeter-client-7d6d8c8bb6-r9xrd\" (UID: \"84314924-ebfe-4633-ba6a-2f3354f5502f\") " pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" Jul 24 18:06:24.017657 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.016839 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84314924-ebfe-4633-ba6a-2f3354f5502f-serving-certs-ca-bundle\") pod \"telemeter-client-7d6d8c8bb6-r9xrd\" (UID: \"84314924-ebfe-4633-ba6a-2f3354f5502f\") " pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" Jul 24 18:06:24.017657 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.016924 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/84314924-ebfe-4633-ba6a-2f3354f5502f-federate-client-tls\") pod \"telemeter-client-7d6d8c8bb6-r9xrd\" (UID: \"84314924-ebfe-4633-ba6a-2f3354f5502f\") " pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" Jul 24 18:06:24.017657 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.016963 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84314924-ebfe-4633-ba6a-2f3354f5502f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d6d8c8bb6-r9xrd\" (UID: \"84314924-ebfe-4633-ba6a-2f3354f5502f\") " pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" Jul 24 18:06:24.018808 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.018384 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/84314924-ebfe-4633-ba6a-2f3354f5502f-telemeter-client-tls\") pod \"telemeter-client-7d6d8c8bb6-r9xrd\" (UID: \"84314924-ebfe-4633-ba6a-2f3354f5502f\") " pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" Jul 24 18:06:24.020340 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.019405 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84314924-ebfe-4633-ba6a-2f3354f5502f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d6d8c8bb6-r9xrd\" (UID: \"84314924-ebfe-4633-ba6a-2f3354f5502f\") " pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" Jul 24 18:06:24.020340 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.020006 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84314924-ebfe-4633-ba6a-2f3354f5502f-metrics-client-ca\") pod \"telemeter-client-7d6d8c8bb6-r9xrd\" (UID: \"84314924-ebfe-4633-ba6a-2f3354f5502f\") " pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" Jul 24 18:06:24.021189 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.021137 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84314924-ebfe-4633-ba6a-2f3354f5502f-serving-certs-ca-bundle\") pod \"telemeter-client-7d6d8c8bb6-r9xrd\" (UID: \"84314924-ebfe-4633-ba6a-2f3354f5502f\") " pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" Jul 24 18:06:24.023895 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.023840 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/84314924-ebfe-4633-ba6a-2f3354f5502f-federate-client-tls\") pod \"telemeter-client-7d6d8c8bb6-r9xrd\" (UID: \"84314924-ebfe-4633-ba6a-2f3354f5502f\") " pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" Jul 24 18:06:24.024569 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.024368 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/84314924-ebfe-4633-ba6a-2f3354f5502f-telemeter-client-tls\") pod \"telemeter-client-7d6d8c8bb6-r9xrd\" (UID: \"84314924-ebfe-4633-ba6a-2f3354f5502f\") " pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" Jul 24 18:06:24.024569 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.024523 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84314924-ebfe-4633-ba6a-2f3354f5502f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d6d8c8bb6-r9xrd\" (UID: \"84314924-ebfe-4633-ba6a-2f3354f5502f\") " pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" Jul 24 18:06:24.028689 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.028636 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/84314924-ebfe-4633-ba6a-2f3354f5502f-secret-telemeter-client\") pod \"telemeter-client-7d6d8c8bb6-r9xrd\" (UID: \"84314924-ebfe-4633-ba6a-2f3354f5502f\") " pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" Jul 24 18:06:24.039432 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.039382 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhl2m\" (UniqueName: \"kubernetes.io/projected/84314924-ebfe-4633-ba6a-2f3354f5502f-kube-api-access-xhl2m\") pod \"telemeter-client-7d6d8c8bb6-r9xrd\" (UID: \"84314924-ebfe-4633-ba6a-2f3354f5502f\") " pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" Jul 24 18:06:24.080738 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.080702 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-8zzk7"] Jul 24 18:06:24.085553 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:06:24.085526 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31bc003f_f191_4b12_ae44_df58a9c96407.slice/crio-7d73b8803e3b57053f5a1aa58d4aaaf8eaabc318aa31183e6670fa14e5e0eaa1 WatchSource:0}: Error finding container 7d73b8803e3b57053f5a1aa58d4aaaf8eaabc318aa31183e6670fa14e5e0eaa1: Status 404 returned error can't find the container with id 7d73b8803e3b57053f5a1aa58d4aaaf8eaabc318aa31183e6670fa14e5e0eaa1 Jul 24 18:06:24.137248 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.136077 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-m5tmn"] Jul 24 18:06:24.155025 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.155002 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" Jul 24 18:06:24.251809 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.251767 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-8zzk7" event={"ID":"31bc003f-f191-4b12-ae44-df58a9c96407","Type":"ContainerStarted","Data":"7d73b8803e3b57053f5a1aa58d4aaaf8eaabc318aa31183e6670fa14e5e0eaa1"} Jul 24 18:06:24.255594 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.255390 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"176e7b50-a386-41c3-a442-badf23eb9fd1","Type":"ContainerStarted","Data":"ba4824c74d595b6d96ac6cc219cd9af58fcdd30b1cd35e9f5dc590fc28225022"} Jul 24 18:06:24.255594 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.255466 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"176e7b50-a386-41c3-a442-badf23eb9fd1","Type":"ContainerStarted","Data":"846c9863eea1f16a571df24aebf9534572e8bf422575afec7e7a26da67ae6867"} Jul 24 18:06:24.255594 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.255499 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"176e7b50-a386-41c3-a442-badf23eb9fd1","Type":"ContainerStarted","Data":"93a1b757a811d8c609489dd9d3013c4ee1ece97a73737ecdbb3a1591e90a1e5a"} Jul 24 18:06:24.255594 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.255526 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"176e7b50-a386-41c3-a442-badf23eb9fd1","Type":"ContainerStarted","Data":"cf5c5b5d6f6d8d72b4b904765a8aa5d1f4cac50e0b815125e07e026f3da0d14e"} Jul 24 18:06:24.255594 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.255559 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"176e7b50-a386-41c3-a442-badf23eb9fd1","Type":"ContainerStarted","Data":"06a04c9c970540a983d7cd5727a16117b20afac537174e6fccf13352f02bcac9"} Jul 24 18:06:24.256790 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.256747 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" event={"ID":"88cfeea6-c3ed-4356-9ea8-27e367db3d79","Type":"ContainerStarted","Data":"dea05b978178f87d495927e4369bfa5577a2cf62388033510fb12713a959cfe7"} Jul 24 18:06:24.656663 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.656623 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 18:06:24.664851 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.664820 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.668708 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.668681 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 24 18:06:24.668864 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.668822 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 24 18:06:24.669176 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.669012 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8f0h52ijeoct4\"" Jul 24 18:06:24.669561 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.669538 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 24 18:06:24.669663 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.669646 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 24 18:06:24.669834 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.669819 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 24 18:06:24.669902 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.669888 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 24 18:06:24.670023 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.670010 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 24 18:06:24.670166 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.670152 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 24 18:06:24.670375 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.670359 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 24 18:06:24.670417 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.670392 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 24 18:06:24.670707 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.670684 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 24 18:06:24.670806 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.670793 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bhfdh\"" Jul 24 18:06:24.670929 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.670912 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 24 18:06:24.671333 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.671294 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 24 18:06:24.674897 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.674734 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 24 18:06:24.680988 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.680960 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 18:06:24.741042 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:06:24.741004 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf486deb5_6625_4433_b4ee_6c48b6b92ad5.slice/crio-a6ced84a9a91f4161cfe39d039c402a2e27cf0d6be79573e967610ccade03a29 WatchSource:0}: Error finding container a6ced84a9a91f4161cfe39d039c402a2e27cf0d6be79573e967610ccade03a29: Status 404 returned error can't find the container with id a6ced84a9a91f4161cfe39d039c402a2e27cf0d6be79573e967610ccade03a29 Jul 24 18:06:24.828396 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.828367 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.828514 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.828413 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.828514 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.828441 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.828514 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.828489 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fwcs\" (UniqueName: \"kubernetes.io/projected/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-kube-api-access-2fwcs\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.828674 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.828616 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-config-out\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.828674 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.828651 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.828764 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.828676 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.828764 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.828699 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.828764 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.828724 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.828764 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.828750 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.828924 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.828772 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.828924 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.828797 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.828924 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.828822 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.828924 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.828848 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.828924 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.828902 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-web-config\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.829143 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.828932 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.829143 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.828958 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.829143 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.829004 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-config\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.829143 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.829029 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.829143 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.829052 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.898296 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.898187 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd"] Jul 24 18:06:24.930680 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.929681 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-web-config\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.930680 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.929733 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.930680 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.929759 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.930680 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.929798 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-config\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.930680 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.929825 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.930680 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.929847 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.930680 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.929892 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.930680 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.929914 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.930680 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.929971 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.930680 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.929996 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fwcs\" (UniqueName: \"kubernetes.io/projected/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-kube-api-access-2fwcs\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.930680 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.930075 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-config-out\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.930680 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.930105 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.930680 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.930129 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.930680 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.930157 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.930680 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.930186 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.930680 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.930216 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.930680 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.930242 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.931609 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.930266 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.931609 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.930292 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.931609 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.930338 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.931609 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.930655 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.932026 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.932001 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.932804 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.932501 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.937028 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.934835 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.937028 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.935760 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.937028 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.935985 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.937028 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.936369 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.937028 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.936555 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.937475 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.937242 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-config\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.937548 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.937471 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.937945 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.937902 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.939804 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.939780 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-config-out\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.940134 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.940093 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.940505 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.940485 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-web-config\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.941019 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.940989 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.941556 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.941429 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.941556 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.941503 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.942459 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.942414 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.943951 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.943850 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.944727 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.944711 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fwcs\" (UniqueName: \"kubernetes.io/projected/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-kube-api-access-2fwcs\") pod \"prometheus-k8s-0\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:24.982062 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:24.981830 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:25.233739 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:25.233649 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 18:06:25.244048 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:06:25.243990 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4e95306_f3e9_488e_8e6a_d2fb05814b5e.slice/crio-a0f5d2b6e3747fd8e24d681d9107d90b48d4bd57280810ab37d000beac1640bc WatchSource:0}: Error finding container a0f5d2b6e3747fd8e24d681d9107d90b48d4bd57280810ab37d000beac1640bc: Status 404 returned error can't find the container with id a0f5d2b6e3747fd8e24d681d9107d90b48d4bd57280810ab37d000beac1640bc Jul 24 18:06:25.284457 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:25.284295 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4e95306-f3e9-488e-8e6a-d2fb05814b5e","Type":"ContainerStarted","Data":"a0f5d2b6e3747fd8e24d681d9107d90b48d4bd57280810ab37d000beac1640bc"} Jul 24 18:06:25.287528 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:25.287431 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-m5tmn" event={"ID":"f486deb5-6625-4433-b4ee-6c48b6b92ad5","Type":"ContainerStarted","Data":"a6ced84a9a91f4161cfe39d039c402a2e27cf0d6be79573e967610ccade03a29"} Jul 24 18:06:25.292127 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:25.291950 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" event={"ID":"5739ca6a-b4a5-4691-8945-79ea0e1b3261","Type":"ContainerStarted","Data":"51ed2de46def047113feb7f4b27ca75dac26ec966ed1edb18a399ac075922cc1"} Jul 24 18:06:25.292127 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:25.292018 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" event={"ID":"5739ca6a-b4a5-4691-8945-79ea0e1b3261","Type":"ContainerStarted","Data":"ca2bc87f95642e3b6b66979f22c293bf942ae43ae5e1fd7d1db0f7cd3cf5c104"} Jul 24 18:06:25.292127 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:25.292060 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" event={"ID":"5739ca6a-b4a5-4691-8945-79ea0e1b3261","Type":"ContainerStarted","Data":"d26cd34ea7779658cd7c9ab5fba973c645180fc164782c32eeb7ecd2859fb0f4"} Jul 24 18:06:25.302146 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:25.302058 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" event={"ID":"84314924-ebfe-4633-ba6a-2f3354f5502f","Type":"ContainerStarted","Data":"80bbbc20dfa9233694f537a29caf65577e4a057f05a4687150853a1ab3a72cac"} Jul 24 18:06:26.313167 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:26.313088 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"176e7b50-a386-41c3-a442-badf23eb9fd1","Type":"ContainerStarted","Data":"d3194e46f2b77b05a7227fc4aed8501fd024e9ddb394de7afbab561929caebeb"} Jul 24 18:06:26.318256 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:26.318216 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" event={"ID":"5739ca6a-b4a5-4691-8945-79ea0e1b3261","Type":"ContainerStarted","Data":"4c7c91ef124306c55d2c6463ffc8cccffceb0233d19197adfb32172a001b9395"} Jul 24 18:06:26.318406 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:26.318293 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" event={"ID":"5739ca6a-b4a5-4691-8945-79ea0e1b3261","Type":"ContainerStarted","Data":"5e14e44051fc0d052ea3559c4144922243220c33236b7686ba761cecb87eeded"} Jul 24 18:06:26.318406 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:26.318360 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" event={"ID":"5739ca6a-b4a5-4691-8945-79ea0e1b3261","Type":"ContainerStarted","Data":"5866e3ba78dadb95c7aeedf857520653d1fbba3ef14f106ab05bdebab0c2ad66"} Jul 24 18:06:26.319134 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:26.319099 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" Jul 24 18:06:26.324153 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:26.323460 2562 generic.go:356] "Generic (PLEG): container finished" podID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerID="3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534" exitCode=0 Jul 24 18:06:26.324153 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:26.323523 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4e95306-f3e9-488e-8e6a-d2fb05814b5e","Type":"ContainerDied","Data":"3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534"} Jul 24 18:06:26.349794 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:26.349067 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.8489146869999997 podStartE2EDuration="7.349043417s" totalImagesPullingTime="4.470064942s" totalInitContainerRuntime="30.063788ms" isStatefulPod=false podCreationTimestamp="2026-07-24 18:06:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:06:26.345571581 +0000 UTC m=+79.083762653" watchObservedRunningTime="2026-07-24 18:06:26.349043417 +0000 UTC m=+79.087234495" Jul 24 18:06:26.410299 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:26.409857 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" podStartSLOduration=2.184584965 podStartE2EDuration="5.409832392s" totalImagesPullingTime="3.225247427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:06:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:06:26.408134755 +0000 UTC m=+79.146325837" watchObservedRunningTime="2026-07-24 18:06:26.409832392 +0000 UTC m=+79.148023472" Jul 24 18:06:28.335273 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:28.335228 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-m5tmn" event={"ID":"f486deb5-6625-4433-b4ee-6c48b6b92ad5","Type":"ContainerStarted","Data":"6d19974473853171278ccfa80e59bf57441f71cb4cdfa316fa5372a39fe8d33a"} Jul 24 18:06:28.335749 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:28.335366 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-m5tmn" Jul 24 18:06:28.337703 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:28.337674 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" event={"ID":"84314924-ebfe-4633-ba6a-2f3354f5502f","Type":"ContainerStarted","Data":"030c5ebf7a8ca4e46598e0ab468a6e32675cdd0b2d97a86afda7e869a1f46a46"} Jul 24 18:06:28.337824 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:28.337733 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" event={"ID":"84314924-ebfe-4633-ba6a-2f3354f5502f","Type":"ContainerStarted","Data":"a801a9f8d332926935977c110f50bbaf1024eb8e8703668f37db1e1cad3fb7f5"} Jul 24 18:06:28.337824 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:28.337761 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" event={"ID":"84314924-ebfe-4633-ba6a-2f3354f5502f","Type":"ContainerStarted","Data":"ad34e38e4aa1545ebec62f2e47fe97360491b95c16d40f55f7539403038e5f77"} Jul 24 18:06:28.340418 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:28.340392 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" event={"ID":"88cfeea6-c3ed-4356-9ea8-27e367db3d79","Type":"ContainerStarted","Data":"7a8cf24230ee344f4a324d785db8f50d8ffef12c21ffad7af7bc8106ccd3f59f"} Jul 24 18:06:28.341817 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:28.341793 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-m5tmn" Jul 24 18:06:28.355099 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:28.355043 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-m5tmn" podStartSLOduration=2.480302071 podStartE2EDuration="5.355023037s" totalImagesPullingTime="2.874720966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:06:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:06:28.354170593 +0000 UTC m=+81.092361655" watchObservedRunningTime="2026-07-24 18:06:28.355023037 +0000 UTC m=+81.093214107" Jul 24 18:06:28.403313 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:28.402589 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7d6d8c8bb6-r9xrd" podStartSLOduration=2.695368175 podStartE2EDuration="5.402570557s" totalImagesPullingTime="2.707202382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:06:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:06:28.40166956 +0000 UTC m=+81.139860633" watchObservedRunningTime="2026-07-24 18:06:28.402570557 +0000 UTC m=+81.140761628" Jul 24 18:06:28.444384 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:28.444299 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" podStartSLOduration=2.692883247 podStartE2EDuration="6.444282586s" totalImagesPullingTime="3.751399339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:06:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:06:28.443986163 +0000 UTC m=+81.182177233" watchObservedRunningTime="2026-07-24 18:06:28.444282586 +0000 UTC m=+81.182473655" Jul 24 18:06:32.365104 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:32.365057 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4e95306-f3e9-488e-8e6a-d2fb05814b5e","Type":"ContainerStarted","Data":"f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78"} Jul 24 18:06:32.365606 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:32.365146 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4e95306-f3e9-488e-8e6a-d2fb05814b5e","Type":"ContainerStarted","Data":"5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75"} Jul 24 18:06:32.365606 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:32.365186 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4e95306-f3e9-488e-8e6a-d2fb05814b5e","Type":"ContainerStarted","Data":"a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51"} Jul 24 18:06:32.365606 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:32.365226 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4e95306-f3e9-488e-8e6a-d2fb05814b5e","Type":"ContainerStarted","Data":"166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3"} Jul 24 18:06:32.365606 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:32.365260 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4e95306-f3e9-488e-8e6a-d2fb05814b5e","Type":"ContainerStarted","Data":"ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2"} Jul 24 18:06:32.365606 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:32.365285 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4e95306-f3e9-488e-8e6a-d2fb05814b5e","Type":"ContainerStarted","Data":"1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d"} Jul 24 18:06:32.400218 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:32.400155 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.473272454 podStartE2EDuration="8.400132973s" totalImagesPullingTime="4.893826425s" totalInitContainerRuntime="33.034094ms" isStatefulPod=false podCreationTimestamp="2026-07-24 18:06:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:06:32.396918714 +0000 UTC m=+85.135109785" watchObservedRunningTime="2026-07-24 18:06:32.400132973 +0000 UTC m=+85.138324042" Jul 24 18:06:33.347443 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:33.347414 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-856c4f7576-5jqvt" Jul 24 18:06:34.982767 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:34.982727 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:06:43.313423 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:43.313398 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" Jul 24 18:06:43.313745 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:43.313482 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" Jul 24 18:06:43.434854 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:43.434821 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-8zzk7" event={"ID":"31bc003f-f191-4b12-ae44-df58a9c96407","Type":"ContainerStarted","Data":"043cb1ed46e5625ef4c80cfce2300aaaac6e4cbbee069f4ac8ce275e41ed4678"} Jul 24 18:06:43.435044 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:43.434981 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-8zzk7" Jul 24 18:06:43.436052 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:43.436025 2562 patch_prober.go:28] interesting pod/downloads-7c97dc4555-8zzk7 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.17:8080/\": dial tcp 10.134.0.17:8080: connect: connection refused" start-of-body= Jul 24 18:06:43.436149 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:43.436088 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7c97dc4555-8zzk7" podUID="31bc003f-f191-4b12-ae44-df58a9c96407" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.17:8080/\": dial tcp 10.134.0.17:8080: connect: connection refused" Jul 24 18:06:44.454803 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:44.454769 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-8zzk7" Jul 24 18:06:44.476815 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:44.476753 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-8zzk7" podStartSLOduration=2.350034291 podStartE2EDuration="21.476731913s" totalImagesPullingTime="19.126697622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:06:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:06:43.453467148 +0000 UTC m=+96.191658218" watchObservedRunningTime="2026-07-24 18:06:44.476731913 +0000 UTC m=+97.214922984" Jul 24 18:06:52.228789 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:52.228755 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7bf8g" Jul 24 18:06:53.649797 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:06:53.649767 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xjhjb_4ef1c039-6192-42b6-aab6-b387cc44abcc/serve-healthcheck-canary/0.log" Jul 24 18:07:03.318185 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:03.318154 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" Jul 24 18:07:03.322099 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:03.322081 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-59df6df7c6-57nbt" Jul 24 18:07:24.982219 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:24.982175 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:25.037144 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:25.037118 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:25.634582 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:25.634552 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:38.850835 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:38.850798 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 18:07:38.851385 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:38.851084 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerName="alertmanager" containerID="cri-o://06a04c9c970540a983d7cd5727a16117b20afac537174e6fccf13352f02bcac9" gracePeriod=120 Jul 24 18:07:38.851385 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:38.851163 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerName="kube-rbac-proxy-metric" containerID="cri-o://ba4824c74d595b6d96ac6cc219cd9af58fcdd30b1cd35e9f5dc590fc28225022" gracePeriod=120 Jul 24 18:07:38.851385 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:38.851213 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerName="kube-rbac-proxy" containerID="cri-o://846c9863eea1f16a571df24aebf9534572e8bf422575afec7e7a26da67ae6867" gracePeriod=120 Jul 24 18:07:38.851385 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:38.851226 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerName="prom-label-proxy" containerID="cri-o://d3194e46f2b77b05a7227fc4aed8501fd024e9ddb394de7afbab561929caebeb" gracePeriod=120 Jul 24 18:07:38.851385 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:38.851175 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerName="kube-rbac-proxy-web" containerID="cri-o://93a1b757a811d8c609489dd9d3013c4ee1ece97a73737ecdbb3a1591e90a1e5a" gracePeriod=120 Jul 24 18:07:38.851385 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:38.851215 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerName="config-reloader" containerID="cri-o://cf5c5b5d6f6d8d72b4b904765a8aa5d1f4cac50e0b815125e07e026f3da0d14e" gracePeriod=120 Jul 24 18:07:39.677750 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:39.677717 2562 generic.go:356] "Generic (PLEG): container finished" podID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerID="d3194e46f2b77b05a7227fc4aed8501fd024e9ddb394de7afbab561929caebeb" exitCode=0 Jul 24 18:07:39.677750 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:39.677742 2562 generic.go:356] "Generic (PLEG): container finished" podID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerID="846c9863eea1f16a571df24aebf9534572e8bf422575afec7e7a26da67ae6867" exitCode=0 Jul 24 18:07:39.677750 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:39.677748 2562 generic.go:356] "Generic (PLEG): container finished" podID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerID="cf5c5b5d6f6d8d72b4b904765a8aa5d1f4cac50e0b815125e07e026f3da0d14e" exitCode=0 Jul 24 18:07:39.677750 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:39.677753 2562 generic.go:356] "Generic (PLEG): container finished" podID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerID="06a04c9c970540a983d7cd5727a16117b20afac537174e6fccf13352f02bcac9" exitCode=0 Jul 24 18:07:39.678022 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:39.677773 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"176e7b50-a386-41c3-a442-badf23eb9fd1","Type":"ContainerDied","Data":"d3194e46f2b77b05a7227fc4aed8501fd024e9ddb394de7afbab561929caebeb"} Jul 24 18:07:39.678022 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:39.677826 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"176e7b50-a386-41c3-a442-badf23eb9fd1","Type":"ContainerDied","Data":"846c9863eea1f16a571df24aebf9534572e8bf422575afec7e7a26da67ae6867"} Jul 24 18:07:39.678022 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:39.677852 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"176e7b50-a386-41c3-a442-badf23eb9fd1","Type":"ContainerDied","Data":"cf5c5b5d6f6d8d72b4b904765a8aa5d1f4cac50e0b815125e07e026f3da0d14e"} Jul 24 18:07:39.678022 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:39.677876 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"176e7b50-a386-41c3-a442-badf23eb9fd1","Type":"ContainerDied","Data":"06a04c9c970540a983d7cd5727a16117b20afac537174e6fccf13352f02bcac9"} Jul 24 18:07:40.100370 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.100348 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.265105 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.265014 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/176e7b50-a386-41c3-a442-badf23eb9fd1-config-out\") pod \"176e7b50-a386-41c3-a442-badf23eb9fd1\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " Jul 24 18:07:40.265105 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.265059 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/176e7b50-a386-41c3-a442-badf23eb9fd1-alertmanager-trusted-ca-bundle\") pod \"176e7b50-a386-41c3-a442-badf23eb9fd1\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " Jul 24 18:07:40.265105 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.265095 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bfv7\" (UniqueName: \"kubernetes.io/projected/176e7b50-a386-41c3-a442-badf23eb9fd1-kube-api-access-8bfv7\") pod \"176e7b50-a386-41c3-a442-badf23eb9fd1\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " Jul 24 18:07:40.265414 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.265131 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-secret-alertmanager-kube-rbac-proxy-web\") pod \"176e7b50-a386-41c3-a442-badf23eb9fd1\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " Jul 24 18:07:40.265414 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.265161 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-cluster-tls-config\") pod \"176e7b50-a386-41c3-a442-badf23eb9fd1\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " Jul 24 18:07:40.265414 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.265187 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/176e7b50-a386-41c3-a442-badf23eb9fd1-tls-assets\") pod \"176e7b50-a386-41c3-a442-badf23eb9fd1\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " Jul 24 18:07:40.265414 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.265223 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/176e7b50-a386-41c3-a442-badf23eb9fd1-alertmanager-main-db\") pod \"176e7b50-a386-41c3-a442-badf23eb9fd1\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " Jul 24 18:07:40.265620 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.265417 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-secret-alertmanager-main-tls\") pod \"176e7b50-a386-41c3-a442-badf23eb9fd1\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " Jul 24 18:07:40.265620 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.265455 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/176e7b50-a386-41c3-a442-badf23eb9fd1-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "176e7b50-a386-41c3-a442-badf23eb9fd1" (UID: "176e7b50-a386-41c3-a442-badf23eb9fd1"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 18:07:40.265620 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.265563 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/176e7b50-a386-41c3-a442-badf23eb9fd1-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "176e7b50-a386-41c3-a442-badf23eb9fd1" (UID: "176e7b50-a386-41c3-a442-badf23eb9fd1"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 18:07:40.265620 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.265574 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/176e7b50-a386-41c3-a442-badf23eb9fd1-metrics-client-ca\") pod \"176e7b50-a386-41c3-a442-badf23eb9fd1\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " Jul 24 18:07:40.265620 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.265615 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"176e7b50-a386-41c3-a442-badf23eb9fd1\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " Jul 24 18:07:40.266022 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.265649 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-web-config\") pod \"176e7b50-a386-41c3-a442-badf23eb9fd1\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " Jul 24 18:07:40.266022 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.265684 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-secret-alertmanager-kube-rbac-proxy\") pod \"176e7b50-a386-41c3-a442-badf23eb9fd1\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " Jul 24 18:07:40.266022 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.265720 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-config-volume\") pod \"176e7b50-a386-41c3-a442-badf23eb9fd1\" (UID: \"176e7b50-a386-41c3-a442-badf23eb9fd1\") " Jul 24 18:07:40.268361 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.268303 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/176e7b50-a386-41c3-a442-badf23eb9fd1-config-out" (OuterVolumeSpecName: "config-out") pod "176e7b50-a386-41c3-a442-badf23eb9fd1" (UID: "176e7b50-a386-41c3-a442-badf23eb9fd1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 18:07:40.268361 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.268311 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "176e7b50-a386-41c3-a442-badf23eb9fd1" (UID: "176e7b50-a386-41c3-a442-badf23eb9fd1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 18:07:40.268749 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.268729 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/176e7b50-a386-41c3-a442-badf23eb9fd1-config-out\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:40.268788 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.268761 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/176e7b50-a386-41c3-a442-badf23eb9fd1-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:40.268788 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.268778 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:40.268848 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.268802 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/176e7b50-a386-41c3-a442-badf23eb9fd1-alertmanager-main-db\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:40.269685 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.269650 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/176e7b50-a386-41c3-a442-badf23eb9fd1-kube-api-access-8bfv7" (OuterVolumeSpecName: "kube-api-access-8bfv7") pod "176e7b50-a386-41c3-a442-badf23eb9fd1" (UID: "176e7b50-a386-41c3-a442-badf23eb9fd1"). InnerVolumeSpecName "kube-api-access-8bfv7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 18:07:40.270132 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.270102 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "176e7b50-a386-41c3-a442-badf23eb9fd1" (UID: "176e7b50-a386-41c3-a442-badf23eb9fd1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 18:07:40.270511 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.270476 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/176e7b50-a386-41c3-a442-badf23eb9fd1-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "176e7b50-a386-41c3-a442-badf23eb9fd1" (UID: "176e7b50-a386-41c3-a442-badf23eb9fd1"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 18:07:40.270769 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.270721 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/176e7b50-a386-41c3-a442-badf23eb9fd1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "176e7b50-a386-41c3-a442-badf23eb9fd1" (UID: "176e7b50-a386-41c3-a442-badf23eb9fd1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 18:07:40.272964 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.272050 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "176e7b50-a386-41c3-a442-badf23eb9fd1" (UID: "176e7b50-a386-41c3-a442-badf23eb9fd1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 18:07:40.272964 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.272835 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "176e7b50-a386-41c3-a442-badf23eb9fd1" (UID: "176e7b50-a386-41c3-a442-badf23eb9fd1"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 18:07:40.275158 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.273961 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-config-volume" (OuterVolumeSpecName: "config-volume") pod "176e7b50-a386-41c3-a442-badf23eb9fd1" (UID: "176e7b50-a386-41c3-a442-badf23eb9fd1"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 18:07:40.275623 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.275598 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "176e7b50-a386-41c3-a442-badf23eb9fd1" (UID: "176e7b50-a386-41c3-a442-badf23eb9fd1"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 18:07:40.283720 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.283696 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-web-config" (OuterVolumeSpecName: "web-config") pod "176e7b50-a386-41c3-a442-badf23eb9fd1" (UID: "176e7b50-a386-41c3-a442-badf23eb9fd1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 18:07:40.369948 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.369902 2562 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/176e7b50-a386-41c3-a442-badf23eb9fd1-metrics-client-ca\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:40.369948 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.369938 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:40.369948 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.369950 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-web-config\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:40.370201 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.369960 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:40.370201 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.369971 2562 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-config-volume\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:40.370201 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.369979 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bfv7\" (UniqueName: \"kubernetes.io/projected/176e7b50-a386-41c3-a442-badf23eb9fd1-kube-api-access-8bfv7\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:40.370201 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.369988 2562 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-cluster-tls-config\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:40.370201 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.369996 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/176e7b50-a386-41c3-a442-badf23eb9fd1-tls-assets\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:40.370201 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.370003 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/176e7b50-a386-41c3-a442-badf23eb9fd1-secret-alertmanager-main-tls\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:40.684241 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.684200 2562 generic.go:356] "Generic (PLEG): container finished" podID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerID="ba4824c74d595b6d96ac6cc219cd9af58fcdd30b1cd35e9f5dc590fc28225022" exitCode=0 Jul 24 18:07:40.684241 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.684234 2562 generic.go:356] "Generic (PLEG): container finished" podID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerID="93a1b757a811d8c609489dd9d3013c4ee1ece97a73737ecdbb3a1591e90a1e5a" exitCode=0 Jul 24 18:07:40.684464 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.684266 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"176e7b50-a386-41c3-a442-badf23eb9fd1","Type":"ContainerDied","Data":"ba4824c74d595b6d96ac6cc219cd9af58fcdd30b1cd35e9f5dc590fc28225022"} Jul 24 18:07:40.684464 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.684311 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.684464 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.684397 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"176e7b50-a386-41c3-a442-badf23eb9fd1","Type":"ContainerDied","Data":"93a1b757a811d8c609489dd9d3013c4ee1ece97a73737ecdbb3a1591e90a1e5a"} Jul 24 18:07:40.684464 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.684427 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"176e7b50-a386-41c3-a442-badf23eb9fd1","Type":"ContainerDied","Data":"e32be4d72e75bad11d6330dcf47969169f8685065d39e4b4702861f135e5dd61"} Jul 24 18:07:40.684464 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.684459 2562 scope.go:117] "RemoveContainer" containerID="d3194e46f2b77b05a7227fc4aed8501fd024e9ddb394de7afbab561929caebeb" Jul 24 18:07:40.693238 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.693219 2562 scope.go:117] "RemoveContainer" containerID="ba4824c74d595b6d96ac6cc219cd9af58fcdd30b1cd35e9f5dc590fc28225022" Jul 24 18:07:40.701186 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.701168 2562 scope.go:117] "RemoveContainer" containerID="846c9863eea1f16a571df24aebf9534572e8bf422575afec7e7a26da67ae6867" Jul 24 18:07:40.709587 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.709558 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 18:07:40.710479 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.710368 2562 scope.go:117] "RemoveContainer" containerID="93a1b757a811d8c609489dd9d3013c4ee1ece97a73737ecdbb3a1591e90a1e5a" Jul 24 18:07:40.716957 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.716929 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 18:07:40.719181 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.719164 2562 scope.go:117] "RemoveContainer" containerID="cf5c5b5d6f6d8d72b4b904765a8aa5d1f4cac50e0b815125e07e026f3da0d14e" Jul 24 18:07:40.726605 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.726584 2562 scope.go:117] "RemoveContainer" containerID="06a04c9c970540a983d7cd5727a16117b20afac537174e6fccf13352f02bcac9" Jul 24 18:07:40.733798 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.733781 2562 scope.go:117] "RemoveContainer" containerID="c4cfd32ea77e15afe8d061e9739f5a37a940f7954adfd2b22332c977850bb183" Jul 24 18:07:40.742698 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.742675 2562 scope.go:117] "RemoveContainer" containerID="d3194e46f2b77b05a7227fc4aed8501fd024e9ddb394de7afbab561929caebeb" Jul 24 18:07:40.743159 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:07:40.743130 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3194e46f2b77b05a7227fc4aed8501fd024e9ddb394de7afbab561929caebeb\": container with ID starting with d3194e46f2b77b05a7227fc4aed8501fd024e9ddb394de7afbab561929caebeb not found: ID does not exist" containerID="d3194e46f2b77b05a7227fc4aed8501fd024e9ddb394de7afbab561929caebeb" Jul 24 18:07:40.743245 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.743170 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3194e46f2b77b05a7227fc4aed8501fd024e9ddb394de7afbab561929caebeb"} err="failed to get container status \"d3194e46f2b77b05a7227fc4aed8501fd024e9ddb394de7afbab561929caebeb\": rpc error: code = NotFound desc = could not find container \"d3194e46f2b77b05a7227fc4aed8501fd024e9ddb394de7afbab561929caebeb\": container with ID starting with d3194e46f2b77b05a7227fc4aed8501fd024e9ddb394de7afbab561929caebeb not found: ID does not exist" Jul 24 18:07:40.743245 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.743212 2562 scope.go:117] "RemoveContainer" containerID="ba4824c74d595b6d96ac6cc219cd9af58fcdd30b1cd35e9f5dc590fc28225022" Jul 24 18:07:40.743508 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:07:40.743492 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba4824c74d595b6d96ac6cc219cd9af58fcdd30b1cd35e9f5dc590fc28225022\": container with ID starting with ba4824c74d595b6d96ac6cc219cd9af58fcdd30b1cd35e9f5dc590fc28225022 not found: ID does not exist" containerID="ba4824c74d595b6d96ac6cc219cd9af58fcdd30b1cd35e9f5dc590fc28225022" Jul 24 18:07:40.743558 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.743516 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba4824c74d595b6d96ac6cc219cd9af58fcdd30b1cd35e9f5dc590fc28225022"} err="failed to get container status \"ba4824c74d595b6d96ac6cc219cd9af58fcdd30b1cd35e9f5dc590fc28225022\": rpc error: code = NotFound desc = could not find container \"ba4824c74d595b6d96ac6cc219cd9af58fcdd30b1cd35e9f5dc590fc28225022\": container with ID starting with ba4824c74d595b6d96ac6cc219cd9af58fcdd30b1cd35e9f5dc590fc28225022 not found: ID does not exist" Jul 24 18:07:40.743558 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.743530 2562 scope.go:117] "RemoveContainer" containerID="846c9863eea1f16a571df24aebf9534572e8bf422575afec7e7a26da67ae6867" Jul 24 18:07:40.743776 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:07:40.743758 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"846c9863eea1f16a571df24aebf9534572e8bf422575afec7e7a26da67ae6867\": container with ID starting with 846c9863eea1f16a571df24aebf9534572e8bf422575afec7e7a26da67ae6867 not found: ID does not exist" containerID="846c9863eea1f16a571df24aebf9534572e8bf422575afec7e7a26da67ae6867" Jul 24 18:07:40.743825 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.743779 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"846c9863eea1f16a571df24aebf9534572e8bf422575afec7e7a26da67ae6867"} err="failed to get container status \"846c9863eea1f16a571df24aebf9534572e8bf422575afec7e7a26da67ae6867\": rpc error: code = NotFound desc = could not find container \"846c9863eea1f16a571df24aebf9534572e8bf422575afec7e7a26da67ae6867\": container with ID starting with 846c9863eea1f16a571df24aebf9534572e8bf422575afec7e7a26da67ae6867 not found: ID does not exist" Jul 24 18:07:40.743825 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.743793 2562 scope.go:117] "RemoveContainer" containerID="93a1b757a811d8c609489dd9d3013c4ee1ece97a73737ecdbb3a1591e90a1e5a" Jul 24 18:07:40.744029 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:07:40.744010 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93a1b757a811d8c609489dd9d3013c4ee1ece97a73737ecdbb3a1591e90a1e5a\": container with ID starting with 93a1b757a811d8c609489dd9d3013c4ee1ece97a73737ecdbb3a1591e90a1e5a not found: ID does not exist" containerID="93a1b757a811d8c609489dd9d3013c4ee1ece97a73737ecdbb3a1591e90a1e5a" Jul 24 18:07:40.744067 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.744048 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93a1b757a811d8c609489dd9d3013c4ee1ece97a73737ecdbb3a1591e90a1e5a"} err="failed to get container status \"93a1b757a811d8c609489dd9d3013c4ee1ece97a73737ecdbb3a1591e90a1e5a\": rpc error: code = NotFound desc = could not find container \"93a1b757a811d8c609489dd9d3013c4ee1ece97a73737ecdbb3a1591e90a1e5a\": container with ID starting with 93a1b757a811d8c609489dd9d3013c4ee1ece97a73737ecdbb3a1591e90a1e5a not found: ID does not exist" Jul 24 18:07:40.744067 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.744065 2562 scope.go:117] "RemoveContainer" containerID="cf5c5b5d6f6d8d72b4b904765a8aa5d1f4cac50e0b815125e07e026f3da0d14e" Jul 24 18:07:40.744296 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:07:40.744282 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf5c5b5d6f6d8d72b4b904765a8aa5d1f4cac50e0b815125e07e026f3da0d14e\": container with ID starting with cf5c5b5d6f6d8d72b4b904765a8aa5d1f4cac50e0b815125e07e026f3da0d14e not found: ID does not exist" containerID="cf5c5b5d6f6d8d72b4b904765a8aa5d1f4cac50e0b815125e07e026f3da0d14e" Jul 24 18:07:40.744354 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.744300 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf5c5b5d6f6d8d72b4b904765a8aa5d1f4cac50e0b815125e07e026f3da0d14e"} err="failed to get container status \"cf5c5b5d6f6d8d72b4b904765a8aa5d1f4cac50e0b815125e07e026f3da0d14e\": rpc error: code = NotFound desc = could not find container \"cf5c5b5d6f6d8d72b4b904765a8aa5d1f4cac50e0b815125e07e026f3da0d14e\": container with ID starting with cf5c5b5d6f6d8d72b4b904765a8aa5d1f4cac50e0b815125e07e026f3da0d14e not found: ID does not exist" Jul 24 18:07:40.744354 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.744312 2562 scope.go:117] "RemoveContainer" containerID="06a04c9c970540a983d7cd5727a16117b20afac537174e6fccf13352f02bcac9" Jul 24 18:07:40.744530 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:07:40.744512 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06a04c9c970540a983d7cd5727a16117b20afac537174e6fccf13352f02bcac9\": container with ID starting with 06a04c9c970540a983d7cd5727a16117b20afac537174e6fccf13352f02bcac9 not found: ID does not exist" containerID="06a04c9c970540a983d7cd5727a16117b20afac537174e6fccf13352f02bcac9" Jul 24 18:07:40.744566 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.744534 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06a04c9c970540a983d7cd5727a16117b20afac537174e6fccf13352f02bcac9"} err="failed to get container status \"06a04c9c970540a983d7cd5727a16117b20afac537174e6fccf13352f02bcac9\": rpc error: code = NotFound desc = could not find container \"06a04c9c970540a983d7cd5727a16117b20afac537174e6fccf13352f02bcac9\": container with ID starting with 06a04c9c970540a983d7cd5727a16117b20afac537174e6fccf13352f02bcac9 not found: ID does not exist" Jul 24 18:07:40.744566 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.744545 2562 scope.go:117] "RemoveContainer" containerID="c4cfd32ea77e15afe8d061e9739f5a37a940f7954adfd2b22332c977850bb183" Jul 24 18:07:40.744727 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:07:40.744713 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4cfd32ea77e15afe8d061e9739f5a37a940f7954adfd2b22332c977850bb183\": container with ID starting with c4cfd32ea77e15afe8d061e9739f5a37a940f7954adfd2b22332c977850bb183 not found: ID does not exist" containerID="c4cfd32ea77e15afe8d061e9739f5a37a940f7954adfd2b22332c977850bb183" Jul 24 18:07:40.744763 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.744731 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4cfd32ea77e15afe8d061e9739f5a37a940f7954adfd2b22332c977850bb183"} err="failed to get container status \"c4cfd32ea77e15afe8d061e9739f5a37a940f7954adfd2b22332c977850bb183\": rpc error: code = NotFound desc = could not find container \"c4cfd32ea77e15afe8d061e9739f5a37a940f7954adfd2b22332c977850bb183\": container with ID starting with c4cfd32ea77e15afe8d061e9739f5a37a940f7954adfd2b22332c977850bb183 not found: ID does not exist" Jul 24 18:07:40.744763 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.744742 2562 scope.go:117] "RemoveContainer" containerID="d3194e46f2b77b05a7227fc4aed8501fd024e9ddb394de7afbab561929caebeb" Jul 24 18:07:40.744922 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.744904 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3194e46f2b77b05a7227fc4aed8501fd024e9ddb394de7afbab561929caebeb"} err="failed to get container status \"d3194e46f2b77b05a7227fc4aed8501fd024e9ddb394de7afbab561929caebeb\": rpc error: code = NotFound desc = could not find container \"d3194e46f2b77b05a7227fc4aed8501fd024e9ddb394de7afbab561929caebeb\": container with ID starting with d3194e46f2b77b05a7227fc4aed8501fd024e9ddb394de7afbab561929caebeb not found: ID does not exist" Jul 24 18:07:40.744963 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.744923 2562 scope.go:117] "RemoveContainer" containerID="ba4824c74d595b6d96ac6cc219cd9af58fcdd30b1cd35e9f5dc590fc28225022" Jul 24 18:07:40.745108 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.745094 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba4824c74d595b6d96ac6cc219cd9af58fcdd30b1cd35e9f5dc590fc28225022"} err="failed to get container status \"ba4824c74d595b6d96ac6cc219cd9af58fcdd30b1cd35e9f5dc590fc28225022\": rpc error: code = NotFound desc = could not find container \"ba4824c74d595b6d96ac6cc219cd9af58fcdd30b1cd35e9f5dc590fc28225022\": container with ID starting with ba4824c74d595b6d96ac6cc219cd9af58fcdd30b1cd35e9f5dc590fc28225022 not found: ID does not exist" Jul 24 18:07:40.745149 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.745109 2562 scope.go:117] "RemoveContainer" containerID="846c9863eea1f16a571df24aebf9534572e8bf422575afec7e7a26da67ae6867" Jul 24 18:07:40.745287 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.745272 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"846c9863eea1f16a571df24aebf9534572e8bf422575afec7e7a26da67ae6867"} err="failed to get container status \"846c9863eea1f16a571df24aebf9534572e8bf422575afec7e7a26da67ae6867\": rpc error: code = NotFound desc = could not find container \"846c9863eea1f16a571df24aebf9534572e8bf422575afec7e7a26da67ae6867\": container with ID starting with 846c9863eea1f16a571df24aebf9534572e8bf422575afec7e7a26da67ae6867 not found: ID does not exist" Jul 24 18:07:40.745348 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.745287 2562 scope.go:117] "RemoveContainer" containerID="93a1b757a811d8c609489dd9d3013c4ee1ece97a73737ecdbb3a1591e90a1e5a" Jul 24 18:07:40.745482 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.745464 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93a1b757a811d8c609489dd9d3013c4ee1ece97a73737ecdbb3a1591e90a1e5a"} err="failed to get container status \"93a1b757a811d8c609489dd9d3013c4ee1ece97a73737ecdbb3a1591e90a1e5a\": rpc error: code = NotFound desc = could not find container \"93a1b757a811d8c609489dd9d3013c4ee1ece97a73737ecdbb3a1591e90a1e5a\": container with ID starting with 93a1b757a811d8c609489dd9d3013c4ee1ece97a73737ecdbb3a1591e90a1e5a not found: ID does not exist" Jul 24 18:07:40.745523 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.745482 2562 scope.go:117] "RemoveContainer" containerID="cf5c5b5d6f6d8d72b4b904765a8aa5d1f4cac50e0b815125e07e026f3da0d14e" Jul 24 18:07:40.745637 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.745619 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf5c5b5d6f6d8d72b4b904765a8aa5d1f4cac50e0b815125e07e026f3da0d14e"} err="failed to get container status \"cf5c5b5d6f6d8d72b4b904765a8aa5d1f4cac50e0b815125e07e026f3da0d14e\": rpc error: code = NotFound desc = could not find container \"cf5c5b5d6f6d8d72b4b904765a8aa5d1f4cac50e0b815125e07e026f3da0d14e\": container with ID starting with cf5c5b5d6f6d8d72b4b904765a8aa5d1f4cac50e0b815125e07e026f3da0d14e not found: ID does not exist" Jul 24 18:07:40.745676 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.745638 2562 scope.go:117] "RemoveContainer" containerID="06a04c9c970540a983d7cd5727a16117b20afac537174e6fccf13352f02bcac9" Jul 24 18:07:40.745808 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.745792 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06a04c9c970540a983d7cd5727a16117b20afac537174e6fccf13352f02bcac9"} err="failed to get container status \"06a04c9c970540a983d7cd5727a16117b20afac537174e6fccf13352f02bcac9\": rpc error: code = NotFound desc = could not find container \"06a04c9c970540a983d7cd5727a16117b20afac537174e6fccf13352f02bcac9\": container with ID starting with 06a04c9c970540a983d7cd5727a16117b20afac537174e6fccf13352f02bcac9 not found: ID does not exist" Jul 24 18:07:40.745808 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.745807 2562 scope.go:117] "RemoveContainer" containerID="c4cfd32ea77e15afe8d061e9739f5a37a940f7954adfd2b22332c977850bb183" Jul 24 18:07:40.745973 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.745958 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4cfd32ea77e15afe8d061e9739f5a37a940f7954adfd2b22332c977850bb183"} err="failed to get container status \"c4cfd32ea77e15afe8d061e9739f5a37a940f7954adfd2b22332c977850bb183\": rpc error: code = NotFound desc = could not find container \"c4cfd32ea77e15afe8d061e9739f5a37a940f7954adfd2b22332c977850bb183\": container with ID starting with c4cfd32ea77e15afe8d061e9739f5a37a940f7954adfd2b22332c977850bb183 not found: ID does not exist" Jul 24 18:07:40.748652 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.748626 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 18:07:40.748997 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.748981 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerName="kube-rbac-proxy-metric" Jul 24 18:07:40.748997 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.748999 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerName="kube-rbac-proxy-metric" Jul 24 18:07:40.748997 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.749008 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerName="prom-label-proxy" Jul 24 18:07:40.749126 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.749014 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerName="prom-label-proxy" Jul 24 18:07:40.749126 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.749032 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerName="kube-rbac-proxy-web" Jul 24 18:07:40.749126 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.749038 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerName="kube-rbac-proxy-web" Jul 24 18:07:40.749126 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.749045 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerName="kube-rbac-proxy" Jul 24 18:07:40.749126 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.749050 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerName="kube-rbac-proxy" Jul 24 18:07:40.749126 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.749058 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerName="init-config-reloader" Jul 24 18:07:40.749126 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.749063 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerName="init-config-reloader" Jul 24 18:07:40.749126 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.749073 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerName="config-reloader" Jul 24 18:07:40.749126 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.749078 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerName="config-reloader" Jul 24 18:07:40.749126 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.749085 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerName="alertmanager" Jul 24 18:07:40.749126 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.749090 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerName="alertmanager" Jul 24 18:07:40.749453 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.749136 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerName="prom-label-proxy" Jul 24 18:07:40.749453 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.749144 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerName="kube-rbac-proxy-web" Jul 24 18:07:40.749453 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.749150 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerName="config-reloader" Jul 24 18:07:40.749453 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.749155 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerName="kube-rbac-proxy" Jul 24 18:07:40.749453 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.749163 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerName="kube-rbac-proxy-metric" Jul 24 18:07:40.749453 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.749168 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="176e7b50-a386-41c3-a442-badf23eb9fd1" containerName="alertmanager" Jul 24 18:07:40.752580 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.752563 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.757585 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.757566 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 24 18:07:40.757689 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.757633 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 24 18:07:40.757776 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.757762 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 24 18:07:40.758391 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.758238 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 24 18:07:40.758391 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.758250 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 24 18:07:40.758391 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.758239 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 24 18:07:40.758391 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.758342 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 24 18:07:40.758652 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.758636 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pmdt9\"" Jul 24 18:07:40.758773 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.758759 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 24 18:07:40.765134 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.765113 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 24 18:07:40.774302 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.774278 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 18:07:40.874627 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.874591 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73911055-ade7-4718-9e5c-b3b81f3e0c31-web-config\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.874627 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.874627 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/73911055-ade7-4718-9e5c-b3b81f3e0c31-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.874840 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.874658 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/73911055-ade7-4718-9e5c-b3b81f3e0c31-config-volume\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.874840 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.874719 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73911055-ade7-4718-9e5c-b3b81f3e0c31-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.874840 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.874758 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/73911055-ade7-4718-9e5c-b3b81f3e0c31-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.874840 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.874780 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73911055-ade7-4718-9e5c-b3b81f3e0c31-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.874840 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.874811 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/73911055-ade7-4718-9e5c-b3b81f3e0c31-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.875005 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.874859 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/73911055-ade7-4718-9e5c-b3b81f3e0c31-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.875005 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.874887 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73911055-ade7-4718-9e5c-b3b81f3e0c31-config-out\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.875005 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.874919 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73911055-ade7-4718-9e5c-b3b81f3e0c31-tls-assets\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.875005 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.874940 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73911055-ade7-4718-9e5c-b3b81f3e0c31-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.875005 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.874963 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73911055-ade7-4718-9e5c-b3b81f3e0c31-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.875005 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.874988 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sbf8\" (UniqueName: \"kubernetes.io/projected/73911055-ade7-4718-9e5c-b3b81f3e0c31-kube-api-access-9sbf8\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.975492 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.975402 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/73911055-ade7-4718-9e5c-b3b81f3e0c31-config-volume\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.975492 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.975443 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73911055-ade7-4718-9e5c-b3b81f3e0c31-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.975492 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.975488 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/73911055-ade7-4718-9e5c-b3b81f3e0c31-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.975792 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.975620 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73911055-ade7-4718-9e5c-b3b81f3e0c31-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.975792 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.975683 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/73911055-ade7-4718-9e5c-b3b81f3e0c31-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.975792 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.975742 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/73911055-ade7-4718-9e5c-b3b81f3e0c31-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.975792 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.975773 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73911055-ade7-4718-9e5c-b3b81f3e0c31-config-out\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.975998 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.975818 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73911055-ade7-4718-9e5c-b3b81f3e0c31-tls-assets\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.975998 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.975863 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73911055-ade7-4718-9e5c-b3b81f3e0c31-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.975998 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.975890 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73911055-ade7-4718-9e5c-b3b81f3e0c31-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.975998 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.975923 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sbf8\" (UniqueName: \"kubernetes.io/projected/73911055-ade7-4718-9e5c-b3b81f3e0c31-kube-api-access-9sbf8\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.975998 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.975995 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73911055-ade7-4718-9e5c-b3b81f3e0c31-web-config\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.976240 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.976021 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/73911055-ade7-4718-9e5c-b3b81f3e0c31-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.976240 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.976045 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/73911055-ade7-4718-9e5c-b3b81f3e0c31-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.977887 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.977562 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73911055-ade7-4718-9e5c-b3b81f3e0c31-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.979149 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.978917 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73911055-ade7-4718-9e5c-b3b81f3e0c31-config-out\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.979149 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.978926 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73911055-ade7-4718-9e5c-b3b81f3e0c31-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.979149 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.978921 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/73911055-ade7-4718-9e5c-b3b81f3e0c31-config-volume\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.979149 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.979099 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/73911055-ade7-4718-9e5c-b3b81f3e0c31-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.979149 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.979109 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/73911055-ade7-4718-9e5c-b3b81f3e0c31-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.979683 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.979298 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73911055-ade7-4718-9e5c-b3b81f3e0c31-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.979683 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.979634 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73911055-ade7-4718-9e5c-b3b81f3e0c31-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.979807 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.979676 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73911055-ade7-4718-9e5c-b3b81f3e0c31-web-config\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.980307 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.980280 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/73911055-ade7-4718-9e5c-b3b81f3e0c31-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.981009 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.980989 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73911055-ade7-4718-9e5c-b3b81f3e0c31-tls-assets\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:40.985049 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:40.985030 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sbf8\" (UniqueName: \"kubernetes.io/projected/73911055-ade7-4718-9e5c-b3b81f3e0c31-kube-api-access-9sbf8\") pod \"alertmanager-main-0\" (UID: \"73911055-ade7-4718-9e5c-b3b81f3e0c31\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:41.062859 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:41.062823 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 18:07:41.208111 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:41.208077 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 18:07:41.213335 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:07:41.213290 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73911055_ade7_4718_9e5c_b3b81f3e0c31.slice/crio-a504c70f99d184b854a9eae2859635cb6ababb91e78c53caf02b7e80de0191c0 WatchSource:0}: Error finding container a504c70f99d184b854a9eae2859635cb6ababb91e78c53caf02b7e80de0191c0: Status 404 returned error can't find the container with id a504c70f99d184b854a9eae2859635cb6ababb91e78c53caf02b7e80de0191c0 Jul 24 18:07:41.690505 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:41.690470 2562 generic.go:356] "Generic (PLEG): container finished" podID="73911055-ade7-4718-9e5c-b3b81f3e0c31" containerID="be8041df02099678112e41a6cc03677f96aa7745468cf55e7602f2c766e702e3" exitCode=0 Jul 24 18:07:41.690692 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:41.690563 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73911055-ade7-4718-9e5c-b3b81f3e0c31","Type":"ContainerDied","Data":"be8041df02099678112e41a6cc03677f96aa7745468cf55e7602f2c766e702e3"} Jul 24 18:07:41.690692 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:41.690631 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73911055-ade7-4718-9e5c-b3b81f3e0c31","Type":"ContainerStarted","Data":"a504c70f99d184b854a9eae2859635cb6ababb91e78c53caf02b7e80de0191c0"} Jul 24 18:07:41.835164 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:41.835133 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="176e7b50-a386-41c3-a442-badf23eb9fd1" path="/var/lib/kubelet/pods/176e7b50-a386-41c3-a442-badf23eb9fd1/volumes" Jul 24 18:07:42.701373 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:42.701339 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73911055-ade7-4718-9e5c-b3b81f3e0c31","Type":"ContainerStarted","Data":"2e2c840407cc7340324446233ae56f3559dbb4e3b38f8d0134daee1583714e09"} Jul 24 18:07:42.701722 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:42.701424 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73911055-ade7-4718-9e5c-b3b81f3e0c31","Type":"ContainerStarted","Data":"8d41d001151d412f9d9ab7e1bc6893889806dab38a48aa6b9f680199d0eda549"} Jul 24 18:07:42.701722 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:42.701449 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73911055-ade7-4718-9e5c-b3b81f3e0c31","Type":"ContainerStarted","Data":"fe4f5f44556daa25b9ff2ef2d874d90d805ed59be7aa96109adaea4342228df8"} Jul 24 18:07:42.701722 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:42.701474 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73911055-ade7-4718-9e5c-b3b81f3e0c31","Type":"ContainerStarted","Data":"48563f1057d8a17911109b071a18329f9697fe32fd6afbda199f19fdde4e9621"} Jul 24 18:07:42.701722 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:42.701497 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73911055-ade7-4718-9e5c-b3b81f3e0c31","Type":"ContainerStarted","Data":"5c9d5d36da59d87d14c7edeb24ad987194f9f7193f7fb2f545144933706b5de7"} Jul 24 18:07:42.701722 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:42.701518 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73911055-ade7-4718-9e5c-b3b81f3e0c31","Type":"ContainerStarted","Data":"e4e3be89d65a6fc9f44a22a410297104dfae387d52d3ccd0bde0786973512977"} Jul 24 18:07:42.735184 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:42.735134 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.719593755 podStartE2EDuration="2.735118073s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.524318ms" isStatefulPod=false podCreationTimestamp="2026-07-24 18:07:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:07:42.732523713 +0000 UTC m=+155.470714797" watchObservedRunningTime="2026-07-24 18:07:42.735118073 +0000 UTC m=+155.473309143" Jul 24 18:07:43.113196 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.113112 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 18:07:43.113531 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.113498 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerName="prometheus" containerID="cri-o://1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d" gracePeriod=600 Jul 24 18:07:43.113531 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.113511 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerName="kube-rbac-proxy" containerID="cri-o://5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75" gracePeriod=600 Jul 24 18:07:43.113696 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.113546 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerName="kube-rbac-proxy-web" containerID="cri-o://a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51" gracePeriod=600 Jul 24 18:07:43.113696 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.113558 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerName="config-reloader" containerID="cri-o://ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2" gracePeriod=600 Jul 24 18:07:43.113696 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.113567 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerName="thanos-sidecar" containerID="cri-o://166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3" gracePeriod=600 Jul 24 18:07:43.113696 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.113658 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78" gracePeriod=600 Jul 24 18:07:43.363193 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.363165 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:43.501364 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.501303 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-metrics-client-certs\") pod \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " Jul 24 18:07:43.501364 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.501367 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-k8s-db\") pod \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " Jul 24 18:07:43.501605 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.501386 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-config-out\") pod \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " Jul 24 18:07:43.501605 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.501403 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-k8s-rulefiles-2\") pod \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " Jul 24 18:07:43.501605 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.501423 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-k8s-rulefiles-1\") pod \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " Jul 24 18:07:43.501605 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.501442 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-kube-rbac-proxy\") pod \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " Jul 24 18:07:43.501605 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.501465 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-configmap-kubelet-serving-ca-bundle\") pod \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " Jul 24 18:07:43.501605 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.501481 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-prometheus-k8s-tls\") pod \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " Jul 24 18:07:43.501605 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.501516 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " Jul 24 18:07:43.501605 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.501550 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " Jul 24 18:07:43.501605 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.501582 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-config\") pod \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " Jul 24 18:07:43.501605 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.501604 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-web-config\") pod \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " Jul 24 18:07:43.502106 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.501632 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-k8s-rulefiles-0\") pod \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " Jul 24 18:07:43.502106 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.501662 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-tls-assets\") pod \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " Jul 24 18:07:43.502106 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.501685 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-configmap-metrics-client-ca\") pod \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " Jul 24 18:07:43.502106 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.501755 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-configmap-serving-certs-ca-bundle\") pod \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " Jul 24 18:07:43.502106 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.501769 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "c4e95306-f3e9-488e-8e6a-d2fb05814b5e" (UID: "c4e95306-f3e9-488e-8e6a-d2fb05814b5e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 18:07:43.502106 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.501791 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "c4e95306-f3e9-488e-8e6a-d2fb05814b5e" (UID: "c4e95306-f3e9-488e-8e6a-d2fb05814b5e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 18:07:43.502106 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.501812 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-grpc-tls\") pod \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " Jul 24 18:07:43.502106 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.501855 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2fwcs\" (UniqueName: \"kubernetes.io/projected/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-kube-api-access-2fwcs\") pod \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " Jul 24 18:07:43.502106 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.501859 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "c4e95306-f3e9-488e-8e6a-d2fb05814b5e" (UID: "c4e95306-f3e9-488e-8e6a-d2fb05814b5e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 18:07:43.502106 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.501881 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-trusted-ca-bundle\") pod \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " Jul 24 18:07:43.502106 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.501906 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-thanos-prometheus-http-client-file\") pod \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\" (UID: \"c4e95306-f3e9-488e-8e6a-d2fb05814b5e\") " Jul 24 18:07:43.502837 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.502277 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "c4e95306-f3e9-488e-8e6a-d2fb05814b5e" (UID: "c4e95306-f3e9-488e-8e6a-d2fb05814b5e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 18:07:43.502837 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.502337 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:43.502837 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.502459 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:43.502837 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.502475 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:43.503096 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.502897 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "c4e95306-f3e9-488e-8e6a-d2fb05814b5e" (UID: "c4e95306-f3e9-488e-8e6a-d2fb05814b5e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 18:07:43.503449 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.503342 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "c4e95306-f3e9-488e-8e6a-d2fb05814b5e" (UID: "c4e95306-f3e9-488e-8e6a-d2fb05814b5e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 18:07:43.503449 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.503415 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "c4e95306-f3e9-488e-8e6a-d2fb05814b5e" (UID: "c4e95306-f3e9-488e-8e6a-d2fb05814b5e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 18:07:43.505388 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.505361 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "c4e95306-f3e9-488e-8e6a-d2fb05814b5e" (UID: "c4e95306-f3e9-488e-8e6a-d2fb05814b5e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 18:07:43.505486 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.505406 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "c4e95306-f3e9-488e-8e6a-d2fb05814b5e" (UID: "c4e95306-f3e9-488e-8e6a-d2fb05814b5e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 18:07:43.505486 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.505431 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-config-out" (OuterVolumeSpecName: "config-out") pod "c4e95306-f3e9-488e-8e6a-d2fb05814b5e" (UID: "c4e95306-f3e9-488e-8e6a-d2fb05814b5e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 18:07:43.505598 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.505494 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "c4e95306-f3e9-488e-8e6a-d2fb05814b5e" (UID: "c4e95306-f3e9-488e-8e6a-d2fb05814b5e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 18:07:43.505598 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.505514 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "c4e95306-f3e9-488e-8e6a-d2fb05814b5e" (UID: "c4e95306-f3e9-488e-8e6a-d2fb05814b5e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 18:07:43.506299 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.506274 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "c4e95306-f3e9-488e-8e6a-d2fb05814b5e" (UID: "c4e95306-f3e9-488e-8e6a-d2fb05814b5e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 18:07:43.506418 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.506341 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "c4e95306-f3e9-488e-8e6a-d2fb05814b5e" (UID: "c4e95306-f3e9-488e-8e6a-d2fb05814b5e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 18:07:43.506541 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.506510 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "c4e95306-f3e9-488e-8e6a-d2fb05814b5e" (UID: "c4e95306-f3e9-488e-8e6a-d2fb05814b5e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 18:07:43.506823 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.506799 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "c4e95306-f3e9-488e-8e6a-d2fb05814b5e" (UID: "c4e95306-f3e9-488e-8e6a-d2fb05814b5e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 18:07:43.507126 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.507109 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-config" (OuterVolumeSpecName: "config") pod "c4e95306-f3e9-488e-8e6a-d2fb05814b5e" (UID: "c4e95306-f3e9-488e-8e6a-d2fb05814b5e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 18:07:43.507795 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.507776 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c4e95306-f3e9-488e-8e6a-d2fb05814b5e" (UID: "c4e95306-f3e9-488e-8e6a-d2fb05814b5e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 18:07:43.507940 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.507915 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-kube-api-access-2fwcs" (OuterVolumeSpecName: "kube-api-access-2fwcs") pod "c4e95306-f3e9-488e-8e6a-d2fb05814b5e" (UID: "c4e95306-f3e9-488e-8e6a-d2fb05814b5e"). InnerVolumeSpecName "kube-api-access-2fwcs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 18:07:43.516726 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.516704 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-web-config" (OuterVolumeSpecName: "web-config") pod "c4e95306-f3e9-488e-8e6a-d2fb05814b5e" (UID: "c4e95306-f3e9-488e-8e6a-d2fb05814b5e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 18:07:43.602849 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.602818 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-k8s-db\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:43.602849 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.602845 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-config-out\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:43.602849 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.602854 2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-kube-rbac-proxy\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:43.603118 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.602863 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:43.603118 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.602872 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:43.603118 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.602882 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:43.603118 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.602890 2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-config\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:43.603118 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.602898 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-web-config\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:43.603118 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.602906 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:43.603118 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.602914 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-tls-assets\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:43.603118 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.602924 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-configmap-metrics-client-ca\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:43.603118 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.602931 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:43.603118 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.602940 2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-grpc-tls\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:43.603118 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.602948 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fwcs\" (UniqueName: \"kubernetes.io/projected/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-kube-api-access-2fwcs\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:43.603118 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.602956 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:43.603118 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.602964 2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:43.603118 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.602974 2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c4e95306-f3e9-488e-8e6a-d2fb05814b5e-secret-metrics-client-certs\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jul 24 18:07:43.708673 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.708642 2562 generic.go:356] "Generic (PLEG): container finished" podID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerID="f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78" exitCode=0 Jul 24 18:07:43.708673 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.708666 2562 generic.go:356] "Generic (PLEG): container finished" podID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerID="5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75" exitCode=0 Jul 24 18:07:43.708673 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.708672 2562 generic.go:356] "Generic (PLEG): container finished" podID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerID="a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51" exitCode=0 Jul 24 18:07:43.708673 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.708679 2562 generic.go:356] "Generic (PLEG): container finished" podID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerID="166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3" exitCode=0 Jul 24 18:07:43.708673 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.708684 2562 generic.go:356] "Generic (PLEG): container finished" podID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerID="ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2" exitCode=0 Jul 24 18:07:43.709245 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.708689 2562 generic.go:356] "Generic (PLEG): container finished" podID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerID="1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d" exitCode=0 Jul 24 18:07:43.709245 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.708718 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:43.709245 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.708722 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4e95306-f3e9-488e-8e6a-d2fb05814b5e","Type":"ContainerDied","Data":"f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78"} Jul 24 18:07:43.709245 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.708788 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4e95306-f3e9-488e-8e6a-d2fb05814b5e","Type":"ContainerDied","Data":"5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75"} Jul 24 18:07:43.709245 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.708816 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4e95306-f3e9-488e-8e6a-d2fb05814b5e","Type":"ContainerDied","Data":"a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51"} Jul 24 18:07:43.709245 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.708841 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4e95306-f3e9-488e-8e6a-d2fb05814b5e","Type":"ContainerDied","Data":"166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3"} Jul 24 18:07:43.709245 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.708860 2562 scope.go:117] "RemoveContainer" containerID="f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78" Jul 24 18:07:43.709245 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.708864 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4e95306-f3e9-488e-8e6a-d2fb05814b5e","Type":"ContainerDied","Data":"ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2"} Jul 24 18:07:43.709245 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.708982 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4e95306-f3e9-488e-8e6a-d2fb05814b5e","Type":"ContainerDied","Data":"1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d"} Jul 24 18:07:43.709245 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.709012 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4e95306-f3e9-488e-8e6a-d2fb05814b5e","Type":"ContainerDied","Data":"a0f5d2b6e3747fd8e24d681d9107d90b48d4bd57280810ab37d000beac1640bc"} Jul 24 18:07:43.717855 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.717836 2562 scope.go:117] "RemoveContainer" containerID="5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75" Jul 24 18:07:43.725487 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.725470 2562 scope.go:117] "RemoveContainer" containerID="a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51" Jul 24 18:07:43.732775 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.732668 2562 scope.go:117] "RemoveContainer" containerID="166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3" Jul 24 18:07:43.734996 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.734978 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 18:07:43.740538 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.740512 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 18:07:43.740828 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.740815 2562 scope.go:117] "RemoveContainer" containerID="ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2" Jul 24 18:07:43.747924 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.747908 2562 scope.go:117] "RemoveContainer" containerID="1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d" Jul 24 18:07:43.755192 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.755175 2562 scope.go:117] "RemoveContainer" containerID="3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534" Jul 24 18:07:43.762228 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.762212 2562 scope.go:117] "RemoveContainer" containerID="f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78" Jul 24 18:07:43.762589 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:07:43.762570 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78\": container with ID starting with f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78 not found: ID does not exist" containerID="f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78" Jul 24 18:07:43.762642 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.762598 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78"} err="failed to get container status \"f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78\": rpc error: code = NotFound desc = could not find container \"f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78\": container with ID starting with f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78 not found: ID does not exist" Jul 24 18:07:43.762642 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.762617 2562 scope.go:117] "RemoveContainer" containerID="5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75" Jul 24 18:07:43.762901 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:07:43.762874 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75\": container with ID starting with 5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75 not found: ID does not exist" containerID="5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75" Jul 24 18:07:43.762954 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.762907 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75"} err="failed to get container status \"5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75\": rpc error: code = NotFound desc = could not find container \"5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75\": container with ID starting with 5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75 not found: ID does not exist" Jul 24 18:07:43.762954 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.762925 2562 scope.go:117] "RemoveContainer" containerID="a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51" Jul 24 18:07:43.763143 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:07:43.763125 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51\": container with ID starting with a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51 not found: ID does not exist" containerID="a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51" Jul 24 18:07:43.763233 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.763146 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51"} err="failed to get container status \"a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51\": rpc error: code = NotFound desc = could not find container \"a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51\": container with ID starting with a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51 not found: ID does not exist" Jul 24 18:07:43.763233 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.763159 2562 scope.go:117] "RemoveContainer" containerID="166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3" Jul 24 18:07:43.763535 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:07:43.763514 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3\": container with ID starting with 166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3 not found: ID does not exist" containerID="166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3" Jul 24 18:07:43.763600 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.763569 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3"} err="failed to get container status \"166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3\": rpc error: code = NotFound desc = could not find container \"166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3\": container with ID starting with 166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3 not found: ID does not exist" Jul 24 18:07:43.763600 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.763590 2562 scope.go:117] "RemoveContainer" containerID="ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2" Jul 24 18:07:43.763867 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:07:43.763847 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2\": container with ID starting with ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2 not found: ID does not exist" containerID="ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2" Jul 24 18:07:43.763921 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.763871 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2"} err="failed to get container status \"ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2\": rpc error: code = NotFound desc = could not find container \"ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2\": container with ID starting with ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2 not found: ID does not exist" Jul 24 18:07:43.763921 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.763883 2562 scope.go:117] "RemoveContainer" containerID="1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d" Jul 24 18:07:43.764113 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:07:43.764095 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d\": container with ID starting with 1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d not found: ID does not exist" containerID="1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d" Jul 24 18:07:43.764155 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.764120 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d"} err="failed to get container status \"1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d\": rpc error: code = NotFound desc = could not find container \"1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d\": container with ID starting with 1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d not found: ID does not exist" Jul 24 18:07:43.764155 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.764134 2562 scope.go:117] "RemoveContainer" containerID="3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534" Jul 24 18:07:43.764359 ip-10-0-128-233 kubenswrapper[2562]: E0724 18:07:43.764344 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534\": container with ID starting with 3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534 not found: ID does not exist" containerID="3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534" Jul 24 18:07:43.764418 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.764362 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534"} err="failed to get container status \"3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534\": rpc error: code = NotFound desc = could not find container \"3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534\": container with ID starting with 3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534 not found: ID does not exist" Jul 24 18:07:43.764418 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.764374 2562 scope.go:117] "RemoveContainer" containerID="f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78" Jul 24 18:07:43.764613 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.764591 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78"} err="failed to get container status \"f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78\": rpc error: code = NotFound desc = could not find container \"f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78\": container with ID starting with f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78 not found: ID does not exist" Jul 24 18:07:43.764679 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.764617 2562 scope.go:117] "RemoveContainer" containerID="5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75" Jul 24 18:07:43.764887 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.764866 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75"} err="failed to get container status \"5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75\": rpc error: code = NotFound desc = could not find container \"5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75\": container with ID starting with 5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75 not found: ID does not exist" Jul 24 18:07:43.764887 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.764885 2562 scope.go:117] "RemoveContainer" containerID="a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51" Jul 24 18:07:43.765208 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.765190 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51"} err="failed to get container status \"a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51\": rpc error: code = NotFound desc = could not find container \"a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51\": container with ID starting with a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51 not found: ID does not exist" Jul 24 18:07:43.765260 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.765209 2562 scope.go:117] "RemoveContainer" containerID="166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3" Jul 24 18:07:43.765479 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.765457 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3"} err="failed to get container status \"166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3\": rpc error: code = NotFound desc = could not find container \"166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3\": container with ID starting with 166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3 not found: ID does not exist" Jul 24 18:07:43.765541 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.765480 2562 scope.go:117] "RemoveContainer" containerID="ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2" Jul 24 18:07:43.765735 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.765714 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2"} err="failed to get container status \"ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2\": rpc error: code = NotFound desc = could not find container \"ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2\": container with ID starting with ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2 not found: ID does not exist" Jul 24 18:07:43.765735 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.765734 2562 scope.go:117] "RemoveContainer" containerID="1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d" Jul 24 18:07:43.765966 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.765949 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d"} err="failed to get container status \"1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d\": rpc error: code = NotFound desc = could not find container \"1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d\": container with ID starting with 1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d not found: ID does not exist" Jul 24 18:07:43.766020 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.765966 2562 scope.go:117] "RemoveContainer" containerID="3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534" Jul 24 18:07:43.766200 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.766176 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534"} err="failed to get container status \"3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534\": rpc error: code = NotFound desc = could not find container \"3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534\": container with ID starting with 3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534 not found: ID does not exist" Jul 24 18:07:43.766253 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.766201 2562 scope.go:117] "RemoveContainer" containerID="f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78" Jul 24 18:07:43.766484 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.766465 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78"} err="failed to get container status \"f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78\": rpc error: code = NotFound desc = could not find container \"f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78\": container with ID starting with f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78 not found: ID does not exist" Jul 24 18:07:43.766533 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.766485 2562 scope.go:117] "RemoveContainer" containerID="5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75" Jul 24 18:07:43.766706 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.766684 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75"} err="failed to get container status \"5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75\": rpc error: code = NotFound desc = could not find container \"5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75\": container with ID starting with 5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75 not found: ID does not exist" Jul 24 18:07:43.766761 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.766708 2562 scope.go:117] "RemoveContainer" containerID="a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51" Jul 24 18:07:43.766910 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.766893 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51"} err="failed to get container status \"a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51\": rpc error: code = NotFound desc = could not find container \"a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51\": container with ID starting with a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51 not found: ID does not exist" Jul 24 18:07:43.766946 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.766910 2562 scope.go:117] "RemoveContainer" containerID="166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3" Jul 24 18:07:43.767104 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.767089 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3"} err="failed to get container status \"166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3\": rpc error: code = NotFound desc = could not find container \"166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3\": container with ID starting with 166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3 not found: ID does not exist" Jul 24 18:07:43.767141 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.767104 2562 scope.go:117] "RemoveContainer" containerID="ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2" Jul 24 18:07:43.767383 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.767364 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2"} err="failed to get container status \"ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2\": rpc error: code = NotFound desc = could not find container \"ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2\": container with ID starting with ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2 not found: ID does not exist" Jul 24 18:07:43.767429 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.767384 2562 scope.go:117] "RemoveContainer" containerID="1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d" Jul 24 18:07:43.767622 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.767605 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d"} err="failed to get container status \"1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d\": rpc error: code = NotFound desc = could not find container \"1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d\": container with ID starting with 1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d not found: ID does not exist" Jul 24 18:07:43.767664 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.767623 2562 scope.go:117] "RemoveContainer" containerID="3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534" Jul 24 18:07:43.767833 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.767816 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534"} err="failed to get container status \"3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534\": rpc error: code = NotFound desc = could not find container \"3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534\": container with ID starting with 3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534 not found: ID does not exist" Jul 24 18:07:43.767878 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.767835 2562 scope.go:117] "RemoveContainer" containerID="f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78" Jul 24 18:07:43.768032 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.768016 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78"} err="failed to get container status \"f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78\": rpc error: code = NotFound desc = could not find container \"f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78\": container with ID starting with f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78 not found: ID does not exist" Jul 24 18:07:43.768076 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.768032 2562 scope.go:117] "RemoveContainer" containerID="5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75" Jul 24 18:07:43.768256 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.768239 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75"} err="failed to get container status \"5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75\": rpc error: code = NotFound desc = could not find container \"5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75\": container with ID starting with 5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75 not found: ID does not exist" Jul 24 18:07:43.768307 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.768258 2562 scope.go:117] "RemoveContainer" containerID="a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51" Jul 24 18:07:43.768495 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.768473 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51"} err="failed to get container status \"a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51\": rpc error: code = NotFound desc = could not find container \"a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51\": container with ID starting with a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51 not found: ID does not exist" Jul 24 18:07:43.768546 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.768496 2562 scope.go:117] "RemoveContainer" containerID="166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3" Jul 24 18:07:43.768714 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.768698 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3"} err="failed to get container status \"166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3\": rpc error: code = NotFound desc = could not find container \"166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3\": container with ID starting with 166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3 not found: ID does not exist" Jul 24 18:07:43.768752 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.768715 2562 scope.go:117] "RemoveContainer" containerID="ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2" Jul 24 18:07:43.768932 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.768917 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2"} err="failed to get container status \"ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2\": rpc error: code = NotFound desc = could not find container \"ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2\": container with ID starting with ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2 not found: ID does not exist" Jul 24 18:07:43.768979 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.768932 2562 scope.go:117] "RemoveContainer" containerID="1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d" Jul 24 18:07:43.769152 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.769133 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d"} err="failed to get container status \"1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d\": rpc error: code = NotFound desc = could not find container \"1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d\": container with ID starting with 1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d not found: ID does not exist" Jul 24 18:07:43.769198 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.769154 2562 scope.go:117] "RemoveContainer" containerID="3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534" Jul 24 18:07:43.769369 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.769353 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534"} err="failed to get container status \"3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534\": rpc error: code = NotFound desc = could not find container \"3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534\": container with ID starting with 3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534 not found: ID does not exist" Jul 24 18:07:43.769413 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.769370 2562 scope.go:117] "RemoveContainer" containerID="f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78" Jul 24 18:07:43.769598 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.769582 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78"} err="failed to get container status \"f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78\": rpc error: code = NotFound desc = could not find container \"f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78\": container with ID starting with f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78 not found: ID does not exist" Jul 24 18:07:43.769647 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.769599 2562 scope.go:117] "RemoveContainer" containerID="5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75" Jul 24 18:07:43.769792 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.769777 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75"} err="failed to get container status \"5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75\": rpc error: code = NotFound desc = could not find container \"5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75\": container with ID starting with 5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75 not found: ID does not exist" Jul 24 18:07:43.769830 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.769793 2562 scope.go:117] "RemoveContainer" containerID="a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51" Jul 24 18:07:43.769974 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.769957 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51"} err="failed to get container status \"a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51\": rpc error: code = NotFound desc = could not find container \"a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51\": container with ID starting with a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51 not found: ID does not exist" Jul 24 18:07:43.769974 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.769973 2562 scope.go:117] "RemoveContainer" containerID="166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3" Jul 24 18:07:43.770173 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.770157 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3"} err="failed to get container status \"166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3\": rpc error: code = NotFound desc = could not find container \"166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3\": container with ID starting with 166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3 not found: ID does not exist" Jul 24 18:07:43.770173 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.770172 2562 scope.go:117] "RemoveContainer" containerID="ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2" Jul 24 18:07:43.770399 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.770380 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2"} err="failed to get container status \"ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2\": rpc error: code = NotFound desc = could not find container \"ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2\": container with ID starting with ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2 not found: ID does not exist" Jul 24 18:07:43.770452 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.770399 2562 scope.go:117] "RemoveContainer" containerID="1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d" Jul 24 18:07:43.770593 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.770579 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d"} err="failed to get container status \"1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d\": rpc error: code = NotFound desc = could not find container \"1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d\": container with ID starting with 1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d not found: ID does not exist" Jul 24 18:07:43.770641 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.770593 2562 scope.go:117] "RemoveContainer" containerID="3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534" Jul 24 18:07:43.770784 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.770767 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534"} err="failed to get container status \"3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534\": rpc error: code = NotFound desc = could not find container \"3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534\": container with ID starting with 3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534 not found: ID does not exist" Jul 24 18:07:43.770823 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.770786 2562 scope.go:117] "RemoveContainer" containerID="f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78" Jul 24 18:07:43.770977 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.770962 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78"} err="failed to get container status \"f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78\": rpc error: code = NotFound desc = could not find container \"f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78\": container with ID starting with f426d02c07ede3d796bc056250bcb90089b3a4d11096e5d6754dc529b4132c78 not found: ID does not exist" Jul 24 18:07:43.771023 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.770978 2562 scope.go:117] "RemoveContainer" containerID="5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75" Jul 24 18:07:43.771206 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.771189 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75"} err="failed to get container status \"5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75\": rpc error: code = NotFound desc = could not find container \"5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75\": container with ID starting with 5d25a174ee1bf82a3d33f46242c8675239636cc94708c4b5f99bbd6778609c75 not found: ID does not exist" Jul 24 18:07:43.771251 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.771207 2562 scope.go:117] "RemoveContainer" containerID="a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51" Jul 24 18:07:43.771436 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.771400 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51"} err="failed to get container status \"a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51\": rpc error: code = NotFound desc = could not find container \"a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51\": container with ID starting with a3c04bbca350d081c62fb96ad7c7457811161d3ea786a4dbdd37f92515e9ad51 not found: ID does not exist" Jul 24 18:07:43.771436 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.771427 2562 scope.go:117] "RemoveContainer" containerID="166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3" Jul 24 18:07:43.771645 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.771626 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3"} err="failed to get container status \"166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3\": rpc error: code = NotFound desc = could not find container \"166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3\": container with ID starting with 166765c781ac973b619c72b660c8cc5115f97fa8cae87d3eb579afe246af71c3 not found: ID does not exist" Jul 24 18:07:43.771688 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.771649 2562 scope.go:117] "RemoveContainer" containerID="ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2" Jul 24 18:07:43.771900 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.771883 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2"} err="failed to get container status \"ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2\": rpc error: code = NotFound desc = could not find container \"ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2\": container with ID starting with ebfd07c0ce6ed3c24e9992e23433cc3bc52d27bfbc2c68b53021139bbec1f1a2 not found: ID does not exist" Jul 24 18:07:43.771946 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.771901 2562 scope.go:117] "RemoveContainer" containerID="1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d" Jul 24 18:07:43.772118 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.772099 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d"} err="failed to get container status \"1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d\": rpc error: code = NotFound desc = could not find container \"1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d\": container with ID starting with 1b4620882643b155812ecb50fee28c83895875152f33037fb0b44be6ce6f9d4d not found: ID does not exist" Jul 24 18:07:43.772164 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.772119 2562 scope.go:117] "RemoveContainer" containerID="3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534" Jul 24 18:07:43.772332 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.772303 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534"} err="failed to get container status \"3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534\": rpc error: code = NotFound desc = could not find container \"3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534\": container with ID starting with 3b114c7864ee4c78487aa89b78162ba972fc7b5acfad196201113b4ae7699534 not found: ID does not exist" Jul 24 18:07:43.774734 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.774713 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 18:07:43.775073 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.775058 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerName="init-config-reloader" Jul 24 18:07:43.775143 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.775076 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerName="init-config-reloader" Jul 24 18:07:43.775143 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.775088 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerName="kube-rbac-proxy-web" Jul 24 18:07:43.775143 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.775096 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerName="kube-rbac-proxy-web" Jul 24 18:07:43.775143 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.775118 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerName="kube-rbac-proxy-thanos" Jul 24 18:07:43.775143 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.775127 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerName="kube-rbac-proxy-thanos" Jul 24 18:07:43.775143 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.775142 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerName="thanos-sidecar" Jul 24 18:07:43.775483 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.775151 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerName="thanos-sidecar" Jul 24 18:07:43.775483 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.775168 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerName="prometheus" Jul 24 18:07:43.775483 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.775176 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerName="prometheus" Jul 24 18:07:43.775483 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.775185 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerName="kube-rbac-proxy" Jul 24 18:07:43.775483 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.775195 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerName="kube-rbac-proxy" Jul 24 18:07:43.775483 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.775208 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerName="config-reloader" Jul 24 18:07:43.775483 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.775216 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerName="config-reloader" Jul 24 18:07:43.775483 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.775287 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerName="thanos-sidecar" Jul 24 18:07:43.775483 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.775300 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerName="kube-rbac-proxy-web" Jul 24 18:07:43.775483 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.775312 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerName="config-reloader" Jul 24 18:07:43.775483 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.775341 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerName="kube-rbac-proxy-thanos" Jul 24 18:07:43.775483 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.775352 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerName="prometheus" Jul 24 18:07:43.775483 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.775360 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" containerName="kube-rbac-proxy" Jul 24 18:07:43.780031 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.780012 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:43.783061 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.783043 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 24 18:07:43.783169 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.783070 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 24 18:07:43.783575 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.783556 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 24 18:07:43.783915 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.783897 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 24 18:07:43.784015 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.783947 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bhfdh\"" Jul 24 18:07:43.784075 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.784021 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 24 18:07:43.784075 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.784029 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 24 18:07:43.784193 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.784174 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 24 18:07:43.784361 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.784274 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 24 18:07:43.784361 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.784344 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 24 18:07:43.784361 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.784356 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 24 18:07:43.784716 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.784702 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 24 18:07:43.784916 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.784900 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 24 18:07:43.784985 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.784975 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8f0h52ijeoct4\"" Jul 24 18:07:43.799182 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.798868 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 18:07:43.799625 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.799602 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 24 18:07:43.800708 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.800688 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 24 18:07:43.835509 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.835478 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4e95306-f3e9-488e-8e6a-d2fb05814b5e" path="/var/lib/kubelet/pods/c4e95306-f3e9-488e-8e6a-d2fb05814b5e/volumes" Jul 24 18:07:43.905303 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.905266 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:43.905486 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.905342 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-config-out\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:43.905486 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.905385 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:43.905486 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.905430 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-web-config\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:43.905645 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.905516 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:43.905645 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.905564 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:43.905645 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.905596 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:43.905645 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.905623 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:43.905803 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.905664 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:43.905803 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.905694 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:43.905803 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.905720 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:43.905803 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.905749 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:43.905803 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.905774 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:43.906030 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.905805 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:43.906030 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.905820 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:43.906030 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.905836 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-config\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:43.906030 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.905850 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:43.906030 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.905885 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:43.906030 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.905920 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:43.906030 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:43.905970 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6w66\" (UniqueName: \"kubernetes.io/projected/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-kube-api-access-w6w66\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.007382 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.007288 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.007382 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.007352 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.007382 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.007370 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.007664 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.007401 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.007664 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.007419 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.007664 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.007440 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.007664 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.007462 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.007664 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.007483 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.007664 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.007521 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.007664 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.007536 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.007664 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.007563 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-config\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.007664 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.007587 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.007664 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.007650 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.008211 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.007676 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.008211 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.007702 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6w66\" (UniqueName: \"kubernetes.io/projected/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-kube-api-access-w6w66\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.008211 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.007766 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.008211 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.007851 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-config-out\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.008211 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.007875 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.008211 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.007901 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-web-config\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.008211 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.007935 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.008211 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.008195 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.008732 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.008596 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.009567 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.009538 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.010310 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.010292 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.010896 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.010864 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.011208 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.010940 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.011208 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.011120 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-config-out\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.011208 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.011148 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.011410 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.011290 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.011578 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.011556 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.011832 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.011805 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.012598 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.012400 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.012598 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.012530 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.012598 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.012560 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.012898 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.012865 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.013020 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.012999 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-config\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.013941 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.013920 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.014133 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.014118 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-web-config\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.014742 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.014725 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.017672 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.017656 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6w66\" (UniqueName: \"kubernetes.io/projected/c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5-kube-api-access-w6w66\") pod \"prometheus-k8s-0\" (UID: \"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.090369 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.090311 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:07:44.238005 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.237973 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 18:07:44.242162 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:07:44.242124 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2ca5714_024f_4ffd_acf0_8c4e1aedb3f5.slice/crio-2e9a77f02f771b1737c347cb7952cecbbebcad7ccc7c7c02a607cd4f36bf3ca1 WatchSource:0}: Error finding container 2e9a77f02f771b1737c347cb7952cecbbebcad7ccc7c7c02a607cd4f36bf3ca1: Status 404 returned error can't find the container with id 2e9a77f02f771b1737c347cb7952cecbbebcad7ccc7c7c02a607cd4f36bf3ca1 Jul 24 18:07:44.716117 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.716089 2562 generic.go:356] "Generic (PLEG): container finished" podID="c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5" containerID="f7914d7e7477f481504c413c4d97c8ed69ec05b9b18c87ff3f30b5318eb5bb62" exitCode=0 Jul 24 18:07:44.716117 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.716123 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5","Type":"ContainerDied","Data":"f7914d7e7477f481504c413c4d97c8ed69ec05b9b18c87ff3f30b5318eb5bb62"} Jul 24 18:07:44.716681 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:44.716177 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5","Type":"ContainerStarted","Data":"2e9a77f02f771b1737c347cb7952cecbbebcad7ccc7c7c02a607cd4f36bf3ca1"} Jul 24 18:07:45.725304 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:45.725265 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5","Type":"ContainerStarted","Data":"7398a750846513892953f3a87eb10a5ff41f51b70f12ff125fca5d0062b8d1e9"} Jul 24 18:07:45.725721 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:45.725381 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5","Type":"ContainerStarted","Data":"29e64690f690f9672b3b5df049068a60783bfe1795855fb76f4ce1a2ea6c8aae"} Jul 24 18:07:45.725721 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:45.725410 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5","Type":"ContainerStarted","Data":"448ef154b7711ea1dde2daa94088646d32def000a79248815b559d62625a0c3e"} Jul 24 18:07:45.725721 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:45.725433 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5","Type":"ContainerStarted","Data":"c467c0557ca7a6400e63a99eac9fb43e707d3407b45117d6f2f393d9c7062565"} Jul 24 18:07:45.725721 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:45.725458 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5","Type":"ContainerStarted","Data":"f1c410885fa3a817f492a662cece61409aff190af6c3674c8465bcb241fe7bd1"} Jul 24 18:07:45.725721 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:45.725480 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5","Type":"ContainerStarted","Data":"7ea40c3478bf5914671b558eb94e38b5279baca1760bb867d13db297246a510c"} Jul 24 18:07:45.759456 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:45.759403 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.740861733 podStartE2EDuration="2.759385884s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.524151ms" isStatefulPod=false podCreationTimestamp="2026-07-24 18:07:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:07:45.756137617 +0000 UTC m=+158.494328704" watchObservedRunningTime="2026-07-24 18:07:45.759385884 +0000 UTC m=+158.497576954" Jul 24 18:07:49.090745 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:07:49.090692 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:08:44.091279 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:08:44.091230 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:08:44.107393 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:08:44.107366 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:08:44.988701 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:08:44.988669 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:08:59.058536 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:08:59.058507 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nhn86_3d977d3f-700c-41a7-b570-34b267cf97cf/global-pull-secret-syncer/0.log" Jul 24 18:08:59.213313 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:08:59.213279 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xhz5x_58be88c8-ba61-4987-925c-7dfacc2a7170/konnectivity-agent/0.log" Jul 24 18:08:59.240426 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:08:59.240400 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-233.ec2.internal_e5af1d32bcd4dadeb92279281a901285/haproxy/0.log" Jul 24 18:09:02.872050 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:02.872019 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73911055-ade7-4718-9e5c-b3b81f3e0c31/alertmanager/0.log" Jul 24 18:09:02.913845 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:02.913819 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73911055-ade7-4718-9e5c-b3b81f3e0c31/config-reloader/0.log" Jul 24 18:09:02.947523 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:02.947496 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73911055-ade7-4718-9e5c-b3b81f3e0c31/kube-rbac-proxy-web/0.log" Jul 24 18:09:02.980957 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:02.980925 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73911055-ade7-4718-9e5c-b3b81f3e0c31/kube-rbac-proxy/0.log" Jul 24 18:09:03.009428 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:03.009388 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73911055-ade7-4718-9e5c-b3b81f3e0c31/kube-rbac-proxy-metric/0.log" Jul 24 18:09:03.046203 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:03.046168 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73911055-ade7-4718-9e5c-b3b81f3e0c31/prom-label-proxy/0.log" Jul 24 18:09:03.076818 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:03.076791 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73911055-ade7-4718-9e5c-b3b81f3e0c31/init-config-reloader/0.log" Jul 24 18:09:03.159368 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:03.159264 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-nxvct_0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004/kube-state-metrics/0.log" Jul 24 18:09:03.185637 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:03.185613 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-nxvct_0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004/kube-rbac-proxy-main/0.log" Jul 24 18:09:03.215956 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:03.215926 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-nxvct_0dc3c657-5aeb-4e9c-ad9c-2ed06ccee004/kube-rbac-proxy-self/0.log" Jul 24 18:09:03.250424 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:03.250399 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-59df6df7c6-57nbt_88cfeea6-c3ed-4356-9ea8-27e367db3d79/metrics-server/0.log" Jul 24 18:09:03.282798 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:03.282773 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-m5tmn_f486deb5-6625-4433-b4ee-6c48b6b92ad5/monitoring-plugin/0.log" Jul 24 18:09:03.508422 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:03.508354 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q7fqj_5457c0c0-5c92-4844-9bbc-cb6e1c7b9958/node-exporter/0.log" Jul 24 18:09:03.533495 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:03.533472 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q7fqj_5457c0c0-5c92-4844-9bbc-cb6e1c7b9958/kube-rbac-proxy/0.log" Jul 24 18:09:03.554232 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:03.554209 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q7fqj_5457c0c0-5c92-4844-9bbc-cb6e1c7b9958/init-textfile/0.log" Jul 24 18:09:03.581214 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:03.581191 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-dflvt_c58bddfc-aa3e-48e7-b809-25ed39fb7ba0/kube-rbac-proxy-main/0.log" Jul 24 18:09:03.607129 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:03.607106 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-dflvt_c58bddfc-aa3e-48e7-b809-25ed39fb7ba0/kube-rbac-proxy-self/0.log" Jul 24 18:09:03.632585 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:03.632560 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-dflvt_c58bddfc-aa3e-48e7-b809-25ed39fb7ba0/openshift-state-metrics/0.log" Jul 24 18:09:03.673515 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:03.673489 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5/prometheus/0.log" Jul 24 18:09:03.703180 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:03.703153 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5/config-reloader/0.log" Jul 24 18:09:03.731516 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:03.731493 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5/thanos-sidecar/0.log" Jul 24 18:09:03.761043 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:03.760975 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5/kube-rbac-proxy-web/0.log" Jul 24 18:09:03.793419 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:03.793395 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5/kube-rbac-proxy/0.log" Jul 24 18:09:03.821344 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:03.821298 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5/kube-rbac-proxy-thanos/0.log" Jul 24 18:09:03.855758 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:03.855731 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c2ca5714-024f-4ffd-acf0-8c4e1aedb3f5/init-config-reloader/0.log" Jul 24 18:09:03.887651 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:03.887624 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-tjm8v_9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d/prometheus-operator/0.log" Jul 24 18:09:03.913229 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:03.913205 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-tjm8v_9df4a6ad-f2fd-4d1c-bbea-7bbe97526c4d/kube-rbac-proxy/0.log" Jul 24 18:09:03.946765 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:03.946745 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-47dkz_365db518-0bfc-47cb-930d-8f104c3eee53/prometheus-operator-admission-webhook/0.log" Jul 24 18:09:03.996696 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:03.996671 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d6d8c8bb6-r9xrd_84314924-ebfe-4633-ba6a-2f3354f5502f/telemeter-client/0.log" Jul 24 18:09:04.030252 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:04.030186 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d6d8c8bb6-r9xrd_84314924-ebfe-4633-ba6a-2f3354f5502f/reload/0.log" Jul 24 18:09:04.065447 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:04.065418 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d6d8c8bb6-r9xrd_84314924-ebfe-4633-ba6a-2f3354f5502f/kube-rbac-proxy/0.log" Jul 24 18:09:04.106021 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:04.105996 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-856c4f7576-5jqvt_5739ca6a-b4a5-4691-8945-79ea0e1b3261/thanos-query/0.log" Jul 24 18:09:04.142049 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:04.142019 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-856c4f7576-5jqvt_5739ca6a-b4a5-4691-8945-79ea0e1b3261/kube-rbac-proxy-web/0.log" Jul 24 18:09:04.190662 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:04.190634 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-856c4f7576-5jqvt_5739ca6a-b4a5-4691-8945-79ea0e1b3261/kube-rbac-proxy/0.log" Jul 24 18:09:04.249894 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:04.249869 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-856c4f7576-5jqvt_5739ca6a-b4a5-4691-8945-79ea0e1b3261/prom-label-proxy/0.log" Jul 24 18:09:04.346521 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:04.346481 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-856c4f7576-5jqvt_5739ca6a-b4a5-4691-8945-79ea0e1b3261/kube-rbac-proxy-rules/0.log" Jul 24 18:09:04.400126 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:04.400096 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-856c4f7576-5jqvt_5739ca6a-b4a5-4691-8945-79ea0e1b3261/kube-rbac-proxy-metrics/0.log" Jul 24 18:09:06.135825 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:06.135793 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8dpwl/perf-node-gather-daemonset-5rzhb"] Jul 24 18:09:06.138289 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:06.138263 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8dpwl/perf-node-gather-daemonset-5rzhb" Jul 24 18:09:06.141718 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:06.141701 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8dpwl\"/\"openshift-service-ca.crt\"" Jul 24 18:09:06.142019 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:06.141998 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8dpwl\"/\"default-dockercfg-cch55\"" Jul 24 18:09:06.142667 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:06.142649 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8dpwl\"/\"kube-root-ca.crt\"" Jul 24 18:09:06.155281 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:06.155257 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8dpwl/perf-node-gather-daemonset-5rzhb"] Jul 24 18:09:06.259509 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:06.259466 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d69865c6-c180-4730-b614-2e9400b5b993-proc\") pod \"perf-node-gather-daemonset-5rzhb\" (UID: \"d69865c6-c180-4730-b614-2e9400b5b993\") " pod="openshift-must-gather-8dpwl/perf-node-gather-daemonset-5rzhb" Jul 24 18:09:06.259690 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:06.259521 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d69865c6-c180-4730-b614-2e9400b5b993-lib-modules\") pod \"perf-node-gather-daemonset-5rzhb\" (UID: \"d69865c6-c180-4730-b614-2e9400b5b993\") " pod="openshift-must-gather-8dpwl/perf-node-gather-daemonset-5rzhb" Jul 24 18:09:06.259690 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:06.259622 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sjcm\" (UniqueName: \"kubernetes.io/projected/d69865c6-c180-4730-b614-2e9400b5b993-kube-api-access-5sjcm\") pod \"perf-node-gather-daemonset-5rzhb\" (UID: \"d69865c6-c180-4730-b614-2e9400b5b993\") " pod="openshift-must-gather-8dpwl/perf-node-gather-daemonset-5rzhb" Jul 24 18:09:06.259764 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:06.259691 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d69865c6-c180-4730-b614-2e9400b5b993-podres\") pod \"perf-node-gather-daemonset-5rzhb\" (UID: \"d69865c6-c180-4730-b614-2e9400b5b993\") " pod="openshift-must-gather-8dpwl/perf-node-gather-daemonset-5rzhb" Jul 24 18:09:06.259764 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:06.259720 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d69865c6-c180-4730-b614-2e9400b5b993-sys\") pod \"perf-node-gather-daemonset-5rzhb\" (UID: \"d69865c6-c180-4730-b614-2e9400b5b993\") " pod="openshift-must-gather-8dpwl/perf-node-gather-daemonset-5rzhb" Jul 24 18:09:06.360339 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:06.360283 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sjcm\" (UniqueName: \"kubernetes.io/projected/d69865c6-c180-4730-b614-2e9400b5b993-kube-api-access-5sjcm\") pod \"perf-node-gather-daemonset-5rzhb\" (UID: \"d69865c6-c180-4730-b614-2e9400b5b993\") " pod="openshift-must-gather-8dpwl/perf-node-gather-daemonset-5rzhb" Jul 24 18:09:06.360522 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:06.360351 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d69865c6-c180-4730-b614-2e9400b5b993-podres\") pod \"perf-node-gather-daemonset-5rzhb\" (UID: \"d69865c6-c180-4730-b614-2e9400b5b993\") " pod="openshift-must-gather-8dpwl/perf-node-gather-daemonset-5rzhb" Jul 24 18:09:06.360522 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:06.360370 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d69865c6-c180-4730-b614-2e9400b5b993-sys\") pod \"perf-node-gather-daemonset-5rzhb\" (UID: \"d69865c6-c180-4730-b614-2e9400b5b993\") " pod="openshift-must-gather-8dpwl/perf-node-gather-daemonset-5rzhb" Jul 24 18:09:06.360522 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:06.360403 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d69865c6-c180-4730-b614-2e9400b5b993-proc\") pod \"perf-node-gather-daemonset-5rzhb\" (UID: \"d69865c6-c180-4730-b614-2e9400b5b993\") " pod="openshift-must-gather-8dpwl/perf-node-gather-daemonset-5rzhb" Jul 24 18:09:06.360522 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:06.360424 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d69865c6-c180-4730-b614-2e9400b5b993-lib-modules\") pod \"perf-node-gather-daemonset-5rzhb\" (UID: \"d69865c6-c180-4730-b614-2e9400b5b993\") " pod="openshift-must-gather-8dpwl/perf-node-gather-daemonset-5rzhb" Jul 24 18:09:06.360522 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:06.360494 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d69865c6-c180-4730-b614-2e9400b5b993-sys\") pod \"perf-node-gather-daemonset-5rzhb\" (UID: \"d69865c6-c180-4730-b614-2e9400b5b993\") " pod="openshift-must-gather-8dpwl/perf-node-gather-daemonset-5rzhb" Jul 24 18:09:06.360707 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:06.360517 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d69865c6-c180-4730-b614-2e9400b5b993-proc\") pod \"perf-node-gather-daemonset-5rzhb\" (UID: \"d69865c6-c180-4730-b614-2e9400b5b993\") " pod="openshift-must-gather-8dpwl/perf-node-gather-daemonset-5rzhb" Jul 24 18:09:06.360707 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:06.360543 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d69865c6-c180-4730-b614-2e9400b5b993-lib-modules\") pod \"perf-node-gather-daemonset-5rzhb\" (UID: \"d69865c6-c180-4730-b614-2e9400b5b993\") " pod="openshift-must-gather-8dpwl/perf-node-gather-daemonset-5rzhb" Jul 24 18:09:06.360707 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:06.360552 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d69865c6-c180-4730-b614-2e9400b5b993-podres\") pod \"perf-node-gather-daemonset-5rzhb\" (UID: \"d69865c6-c180-4730-b614-2e9400b5b993\") " pod="openshift-must-gather-8dpwl/perf-node-gather-daemonset-5rzhb" Jul 24 18:09:06.368721 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:06.368687 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sjcm\" (UniqueName: \"kubernetes.io/projected/d69865c6-c180-4730-b614-2e9400b5b993-kube-api-access-5sjcm\") pod \"perf-node-gather-daemonset-5rzhb\" (UID: \"d69865c6-c180-4730-b614-2e9400b5b993\") " pod="openshift-must-gather-8dpwl/perf-node-gather-daemonset-5rzhb" Jul 24 18:09:06.428298 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:06.428218 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-8zzk7_31bc003f-f191-4b12-ae44-df58a9c96407/download-server/0.log" Jul 24 18:09:06.447668 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:06.447644 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8dpwl/perf-node-gather-daemonset-5rzhb" Jul 24 18:09:06.597819 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:06.597792 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8dpwl/perf-node-gather-daemonset-5rzhb"] Jul 24 18:09:06.600680 ip-10-0-128-233 kubenswrapper[2562]: W0724 18:09:06.600650 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd69865c6_c180_4730_b614_2e9400b5b993.slice/crio-762dff06bc30c2044ac76d65f1b1b431738a9edac4dd4581bf7b96294c2a9fc3 WatchSource:0}: Error finding container 762dff06bc30c2044ac76d65f1b1b431738a9edac4dd4581bf7b96294c2a9fc3: Status 404 returned error can't find the container with id 762dff06bc30c2044ac76d65f1b1b431738a9edac4dd4581bf7b96294c2a9fc3 Jul 24 18:09:07.062764 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:07.062728 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dpwl/perf-node-gather-daemonset-5rzhb" event={"ID":"d69865c6-c180-4730-b614-2e9400b5b993","Type":"ContainerStarted","Data":"3a2938f0844d52877466d72fa267b80a65260f326a8322da78d019e4a461e3b6"} Jul 24 18:09:07.062943 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:07.062795 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8dpwl/perf-node-gather-daemonset-5rzhb" Jul 24 18:09:07.062943 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:07.062821 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dpwl/perf-node-gather-daemonset-5rzhb" event={"ID":"d69865c6-c180-4730-b614-2e9400b5b993","Type":"ContainerStarted","Data":"762dff06bc30c2044ac76d65f1b1b431738a9edac4dd4581bf7b96294c2a9fc3"} Jul 24 18:09:07.099066 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:07.099016 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8dpwl/perf-node-gather-daemonset-5rzhb" podStartSLOduration=1.098999726 podStartE2EDuration="1.098999726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:09:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:09:07.098232654 +0000 UTC m=+239.836423725" watchObservedRunningTime="2026-07-24 18:09:07.098999726 +0000 UTC m=+239.837190807" Jul 24 18:09:07.664937 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:07.664908 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rc4ks_aa3470d5-513d-474b-a1c1-c8459be4d4ee/dns/0.log" Jul 24 18:09:07.686517 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:07.686481 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rc4ks_aa3470d5-513d-474b-a1c1-c8459be4d4ee/kube-rbac-proxy/0.log" Jul 24 18:09:07.827047 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:07.827013 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lghjd_0ae345ba-357f-42e7-a9d8-9a969ac16761/dns-node-resolver/0.log" Jul 24 18:09:08.295792 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:08.295767 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jd9x5_26b225f1-0841-4c29-9cbb-ecd98b274a50/node-ca/0.log" Jul 24 18:09:09.360394 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:09.360363 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xjhjb_4ef1c039-6192-42b6-aab6-b387cc44abcc/serve-healthcheck-canary/0.log" Jul 24 18:09:09.903303 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:09.903275 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-td5fj_09867250-f235-4228-b475-56ec2680e164/kube-rbac-proxy/0.log" Jul 24 18:09:09.933745 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:09.933718 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-td5fj_09867250-f235-4228-b475-56ec2680e164/exporter/0.log" Jul 24 18:09:09.954708 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:09.954680 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-td5fj_09867250-f235-4228-b475-56ec2680e164/extractor/0.log" Jul 24 18:09:13.077835 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:13.077799 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8dpwl/perf-node-gather-daemonset-5rzhb" Jul 24 18:09:15.398008 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:15.397979 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qbwjd_68a2426f-2fa7-448d-a3fb-682cc0a4cc84/kube-multus-additional-cni-plugins/0.log" Jul 24 18:09:15.421334 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:15.421297 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qbwjd_68a2426f-2fa7-448d-a3fb-682cc0a4cc84/egress-router-binary-copy/0.log" Jul 24 18:09:15.445333 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:15.445265 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qbwjd_68a2426f-2fa7-448d-a3fb-682cc0a4cc84/cni-plugins/0.log" Jul 24 18:09:15.483478 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:15.483456 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qbwjd_68a2426f-2fa7-448d-a3fb-682cc0a4cc84/bond-cni-plugin/0.log" Jul 24 18:09:15.510009 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:15.509978 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qbwjd_68a2426f-2fa7-448d-a3fb-682cc0a4cc84/routeoverride-cni/0.log" Jul 24 18:09:15.540097 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:15.540073 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qbwjd_68a2426f-2fa7-448d-a3fb-682cc0a4cc84/whereabouts-cni-bincopy/0.log" Jul 24 18:09:15.567231 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:15.567208 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qbwjd_68a2426f-2fa7-448d-a3fb-682cc0a4cc84/whereabouts-cni/0.log" Jul 24 18:09:15.835787 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:15.835761 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-t2s7k_10eea99f-1962-47cc-9a25-5dffe9df4490/kube-multus/0.log" Jul 24 18:09:16.034841 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:16.034808 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lrwkd_aa3e62c3-b552-4e46-8715-70fa52700805/network-metrics-daemon/0.log" Jul 24 18:09:16.078829 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:16.078763 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lrwkd_aa3e62c3-b552-4e46-8715-70fa52700805/kube-rbac-proxy/0.log" Jul 24 18:09:16.814228 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:16.814157 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6q2bl_61177079-7b8e-4730-b13b-6d49c72e9ac8/ovn-controller/0.log" Jul 24 18:09:16.835822 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:16.835794 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6q2bl_61177079-7b8e-4730-b13b-6d49c72e9ac8/ovn-acl-logging/1.log" Jul 24 18:09:16.835822 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:16.835806 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6q2bl_61177079-7b8e-4730-b13b-6d49c72e9ac8/ovn-acl-logging/0.log" Jul 24 18:09:16.857239 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:16.857211 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6q2bl_61177079-7b8e-4730-b13b-6d49c72e9ac8/kube-rbac-proxy-node/0.log" Jul 24 18:09:16.879091 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:16.879069 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6q2bl_61177079-7b8e-4730-b13b-6d49c72e9ac8/kube-rbac-proxy-ovn-metrics/0.log" Jul 24 18:09:16.901543 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:16.901516 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6q2bl_61177079-7b8e-4730-b13b-6d49c72e9ac8/northd/0.log" Jul 24 18:09:16.925140 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:16.925118 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6q2bl_61177079-7b8e-4730-b13b-6d49c72e9ac8/nbdb/0.log" Jul 24 18:09:16.946772 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:16.946755 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6q2bl_61177079-7b8e-4730-b13b-6d49c72e9ac8/sbdb/0.log" Jul 24 18:09:16.998163 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:16.998136 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6q2bl_61177079-7b8e-4730-b13b-6d49c72e9ac8/ovnkube-controller/0.log" Jul 24 18:09:18.478421 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:18.478387 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-7bf8g_346e9e7f-16c1-4b99-b339-c88ea048ba64/network-check-target-container/0.log" Jul 24 18:09:19.470159 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:19.470117 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-zhwpj_0f618324-186e-432d-bbdb-40e7439e3550/iptables-alerter/0.log" Jul 24 18:09:20.129943 ip-10-0-128-233 kubenswrapper[2562]: I0724 18:09:20.129916 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-rl2gk_6a57fff6-be4e-49eb-b89e-0b25c9f4474d/tuned/0.log"