Jul 08 17:55:55.935631 ip-10-0-128-234 systemd[1]: Starting Kubernetes Kubelet... Jul 08 17:55:56.364227 ip-10-0-128-234 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 17:55:56.364227 ip-10-0-128-234 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 17:55:56.364227 ip-10-0-128-234 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 17:55:56.364227 ip-10-0-128-234 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 17:55:56.364227 ip-10-0-128-234 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 17:55:56.366491 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.366397 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 17:55:56.373386 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373361 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:55:56.373386 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373382 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:55:56.373386 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373387 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:55:56.373386 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373392 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:55:56.373645 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373397 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:55:56.373645 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373404 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:55:56.373645 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373409 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:55:56.373645 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373413 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:55:56.373645 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373417 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:55:56.373645 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373421 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:55:56.373645 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373425 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:55:56.373645 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373429 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:55:56.373645 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373433 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:55:56.373645 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373437 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:55:56.373645 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373467 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:55:56.373645 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373473 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:55:56.373645 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373477 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:55:56.373645 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373482 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:55:56.373645 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373487 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:55:56.373645 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373491 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:55:56.373645 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373496 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:55:56.373645 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373500 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:55:56.373645 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373504 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:55:56.373645 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373508 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:55:56.374576 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373512 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:55:56.374576 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373518 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:55:56.374576 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373522 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:55:56.374576 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373527 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:55:56.374576 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373532 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:55:56.374576 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373537 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:55:56.374576 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373542 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:55:56.374576 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373547 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:55:56.374576 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373551 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:55:56.374576 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373556 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:55:56.374576 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373560 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:55:56.374576 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373565 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:55:56.374576 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373570 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:55:56.374576 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373576 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:55:56.374576 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373581 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:55:56.374576 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373586 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:55:56.374576 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373590 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:55:56.374576 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373595 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:55:56.374576 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373605 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:55:56.375096 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373612 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:55:56.375096 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373617 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:55:56.375096 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373622 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:55:56.375096 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373627 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:55:56.375096 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373632 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:55:56.375096 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373637 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:55:56.375096 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373641 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:55:56.375096 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373646 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:55:56.375096 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373651 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:55:56.375096 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373656 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:55:56.375096 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373660 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:55:56.375096 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373665 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:55:56.375096 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373669 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:55:56.375096 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373673 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:55:56.375096 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373678 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:55:56.375096 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373683 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:55:56.375096 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373687 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:55:56.375096 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373692 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:55:56.375096 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373696 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:55:56.375096 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373701 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:55:56.375663 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373705 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:55:56.375663 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373710 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:55:56.375663 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373714 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:55:56.375663 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373719 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:55:56.375663 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373727 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:55:56.375663 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373734 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:55:56.375663 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373740 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:55:56.375663 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373745 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:55:56.375663 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373750 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:55:56.375663 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373754 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:55:56.375663 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373759 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:55:56.375663 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373764 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:55:56.375663 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373768 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:55:56.375663 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373773 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:55:56.375663 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373778 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:55:56.375663 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373782 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:55:56.375663 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373787 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:55:56.375663 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373791 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:55:56.375663 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373796 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:55:56.375663 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373800 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:55:56.376177 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373809 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:55:56.376177 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373817 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:55:56.376177 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373825 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:55:56.376177 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373831 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:55:56.376177 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373835 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:55:56.376177 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373840 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:55:56.376177 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373844 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:55:56.376177 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373849 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:55:56.376177 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373853 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:55:56.376177 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373858 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:55:56.376177 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373862 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:55:56.376177 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373867 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:55:56.376177 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373872 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:55:56.376177 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373878 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:55:56.376177 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373883 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:55:56.376177 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.373887 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:55:56.376177 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376081 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:55:56.376177 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376091 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:55:56.376177 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376094 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:55:56.376177 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376098 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:55:56.376703 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376101 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:55:56.376703 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376105 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:55:56.376703 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376108 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:55:56.376703 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376110 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:55:56.376703 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376113 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:55:56.376703 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376116 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:55:56.376703 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376119 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:55:56.376703 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376121 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:55:56.376703 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376124 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:55:56.376703 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376127 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:55:56.376703 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376129 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:55:56.376703 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376132 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:55:56.376703 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376135 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:55:56.376703 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376139 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:55:56.376703 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376143 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:55:56.376703 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376146 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:55:56.376703 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376150 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:55:56.376703 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376154 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:55:56.376703 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376158 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:55:56.377217 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376161 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:55:56.377217 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376164 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:55:56.377217 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376167 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:55:56.377217 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376170 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:55:56.377217 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376173 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:55:56.377217 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376176 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:55:56.377217 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376179 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:55:56.377217 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376181 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:55:56.377217 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376185 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:55:56.377217 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376187 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:55:56.377217 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376190 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:55:56.377217 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376194 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:55:56.377217 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376197 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:55:56.377217 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376199 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:55:56.377217 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376202 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:55:56.377217 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376204 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:55:56.377217 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376207 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:55:56.377217 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376210 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:55:56.377217 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376215 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:55:56.377743 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376220 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:55:56.377743 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376224 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:55:56.377743 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376228 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:55:56.377743 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376231 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:55:56.377743 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376235 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:55:56.377743 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376237 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:55:56.377743 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376240 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:55:56.377743 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376244 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:55:56.377743 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376248 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:55:56.377743 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376263 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:55:56.377743 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376266 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:55:56.377743 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376269 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:55:56.377743 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376272 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:55:56.377743 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376276 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:55:56.377743 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376279 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:55:56.377743 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376282 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:55:56.377743 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376285 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:55:56.377743 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376289 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:55:56.377743 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376292 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:55:56.377743 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376295 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:55:56.378294 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376298 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:55:56.378294 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376301 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:55:56.378294 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376303 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:55:56.378294 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376306 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:55:56.378294 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376309 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:55:56.378294 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376311 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:55:56.378294 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376314 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:55:56.378294 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376317 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:55:56.378294 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376319 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:55:56.378294 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376322 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:55:56.378294 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376325 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:55:56.378294 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376328 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:55:56.378294 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376331 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:55:56.378294 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376333 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:55:56.378294 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376337 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:55:56.378294 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376340 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:55:56.378294 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376343 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:55:56.378294 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376346 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:55:56.378294 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376348 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:55:56.378294 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376353 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:55:56.378822 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376357 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:55:56.378822 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376362 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:55:56.378822 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376365 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:55:56.378822 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376368 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:55:56.378822 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376371 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:55:56.378822 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376374 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:55:56.378822 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376376 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:55:56.378822 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376379 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:55:56.378822 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376382 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:55:56.378822 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376385 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:55:56.378822 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376388 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:55:56.378822 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376390 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:55:56.378822 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376393 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:55:56.378822 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376396 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:55:56.378822 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376398 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:55:56.378822 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376401 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:55:56.378822 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376404 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:55:56.378822 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376825 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:55:56.378822 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376831 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:55:56.378822 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376834 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:55:56.379347 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376837 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:55:56.379347 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376840 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:55:56.379347 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376843 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:55:56.379347 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376846 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:55:56.379347 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376849 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:55:56.379347 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376854 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:55:56.379347 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376859 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:55:56.379347 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376862 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:55:56.379347 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376865 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:55:56.379347 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376868 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:55:56.379347 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376871 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:55:56.379347 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376874 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:55:56.379347 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376877 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:55:56.379347 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376880 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:55:56.379347 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376883 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:55:56.379347 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376886 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:55:56.379347 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376889 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:55:56.379347 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376892 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:55:56.379347 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376894 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:55:56.379347 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376897 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:55:56.379864 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376900 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:55:56.379864 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376902 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:55:56.379864 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376905 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:55:56.379864 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376908 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:55:56.379864 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376910 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:55:56.379864 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376913 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:55:56.379864 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376915 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:55:56.379864 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376918 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:55:56.379864 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376921 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:55:56.379864 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376923 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:55:56.379864 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376926 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:55:56.379864 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376929 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:55:56.379864 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376932 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:55:56.379864 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376936 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:55:56.379864 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376938 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:55:56.379864 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376941 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:55:56.379864 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376944 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:55:56.379864 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376947 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:55:56.379864 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376950 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:55:56.379864 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376952 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:55:56.380429 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376955 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:55:56.380429 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376958 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:55:56.380429 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376962 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:55:56.380429 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376965 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:55:56.380429 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376967 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:55:56.380429 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376970 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:55:56.380429 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376973 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:55:56.380429 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376975 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:55:56.380429 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376978 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:55:56.380429 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376981 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:55:56.380429 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376984 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:55:56.380429 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376986 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:55:56.380429 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376989 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:55:56.380429 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376991 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:55:56.380429 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376994 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:55:56.380429 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376997 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:55:56.380429 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.376999 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:55:56.380429 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377002 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:55:56.380429 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377005 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:55:56.380429 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377008 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:55:56.380941 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377010 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:55:56.380941 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377013 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:55:56.380941 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377016 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:55:56.380941 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377020 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:55:56.380941 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377024 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:55:56.380941 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377029 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:55:56.380941 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377033 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:55:56.380941 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377036 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:55:56.380941 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377038 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:55:56.380941 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377041 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:55:56.380941 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377044 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:55:56.380941 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377047 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:55:56.380941 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377049 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:55:56.380941 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377052 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:55:56.380941 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377055 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:55:56.380941 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377057 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:55:56.380941 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377061 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:55:56.380941 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377063 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:55:56.380941 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377066 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:55:56.381442 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377069 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:55:56.381442 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377072 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:55:56.381442 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377075 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:55:56.381442 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377078 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:55:56.381442 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377080 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:55:56.381442 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377083 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:55:56.381442 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377085 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:55:56.381442 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377088 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:55:56.381442 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377091 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:55:56.381442 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377093 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:55:56.381442 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377096 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:55:56.381442 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377098 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:55:56.381442 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377101 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:55:56.381442 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377104 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:55:56.381442 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377107 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:55:56.381442 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377109 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:55:56.381442 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377112 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:55:56.381442 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377190 2579 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 17:55:56.381442 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377198 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 17:55:56.381442 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377204 2579 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 17:55:56.381950 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377209 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 17:55:56.381950 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377213 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 17:55:56.381950 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377217 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 17:55:56.381950 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377222 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 17:55:56.381950 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377227 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 17:55:56.381950 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377230 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 17:55:56.381950 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377234 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 17:55:56.381950 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377238 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 17:55:56.381950 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377241 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 17:55:56.381950 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377244 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 17:55:56.381950 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377263 2579 flags.go:64] FLAG: --cgroup-root="" Jul 08 17:55:56.381950 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377268 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 17:55:56.381950 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377273 2579 flags.go:64] FLAG: --client-ca-file="" Jul 08 17:55:56.381950 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377279 2579 flags.go:64] FLAG: --cloud-provider="external" Jul 08 17:55:56.381950 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377283 2579 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 17:55:56.381950 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377288 2579 flags.go:64] FLAG: --cluster-domain="" Jul 08 17:55:56.381950 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377291 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 17:55:56.381950 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377294 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 17:55:56.381950 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377298 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 17:55:56.381950 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377301 2579 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 17:55:56.381950 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377305 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 17:55:56.381950 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377309 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 17:55:56.381950 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377312 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 17:55:56.382628 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377316 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 17:55:56.382628 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377319 2579 flags.go:64] FLAG: --contention-profiling="false" Jul 08 17:55:56.382628 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377322 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 17:55:56.382628 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377326 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 17:55:56.382628 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377330 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 17:55:56.382628 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377333 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 17:55:56.382628 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377338 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 17:55:56.382628 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377341 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 17:55:56.382628 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377345 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 17:55:56.382628 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377348 2579 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 17:55:56.382628 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377351 2579 flags.go:64] FLAG: --enable-server="true" Jul 08 17:55:56.382628 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377354 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 17:55:56.382628 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377359 2579 flags.go:64] FLAG: --event-burst="100" Jul 08 17:55:56.382628 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377362 2579 flags.go:64] FLAG: --event-qps="50" Jul 08 17:55:56.382628 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377366 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 17:55:56.382628 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377369 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 17:55:56.382628 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377372 2579 flags.go:64] FLAG: --eviction-hard="" Jul 08 17:55:56.382628 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377376 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 17:55:56.382628 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377379 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 17:55:56.382628 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377382 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 17:55:56.382628 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377385 2579 flags.go:64] FLAG: --eviction-soft="" Jul 08 17:55:56.382628 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377388 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 17:55:56.382628 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377391 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 17:55:56.382628 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377395 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 17:55:56.382628 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377398 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 17:55:56.383311 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377402 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 17:55:56.383311 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377405 2579 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 17:55:56.383311 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377408 2579 flags.go:64] FLAG: --feature-gates="" Jul 08 17:55:56.383311 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377411 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 17:55:56.383311 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377414 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 17:55:56.383311 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377418 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 17:55:56.383311 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377421 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 17:55:56.383311 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377425 2579 flags.go:64] FLAG: --healthz-port="10248" Jul 08 17:55:56.383311 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377428 2579 flags.go:64] FLAG: --help="false" Jul 08 17:55:56.383311 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377431 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-128-234.ec2.internal" Jul 08 17:55:56.383311 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377434 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 17:55:56.383311 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377437 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 17:55:56.383311 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377443 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 17:55:56.383311 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377447 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 17:55:56.383311 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377450 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 17:55:56.383311 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377454 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 17:55:56.383311 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377457 2579 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 17:55:56.383311 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377460 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 17:55:56.383311 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377463 2579 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 17:55:56.383311 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377466 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 17:55:56.383311 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377469 2579 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 17:55:56.383311 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377472 2579 flags.go:64] FLAG: --kube-reserved="" Jul 08 17:55:56.383311 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377475 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 17:55:56.383311 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377478 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 17:55:56.383936 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377482 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 17:55:56.383936 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377484 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 17:55:56.383936 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377488 2579 flags.go:64] FLAG: --lock-file="" Jul 08 17:55:56.383936 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377490 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 17:55:56.383936 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377493 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 17:55:56.383936 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377497 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 17:55:56.383936 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377503 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 17:55:56.383936 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377507 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 17:55:56.383936 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377510 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 17:55:56.383936 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377513 2579 flags.go:64] FLAG: --logging-format="text" Jul 08 17:55:56.383936 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377516 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 17:55:56.383936 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377519 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 17:55:56.383936 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377522 2579 flags.go:64] FLAG: --manifest-url="" Jul 08 17:55:56.383936 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377525 2579 flags.go:64] FLAG: --manifest-url-header="" Jul 08 17:55:56.383936 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377530 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 17:55:56.383936 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377533 2579 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 17:55:56.383936 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377537 2579 flags.go:64] FLAG: --max-pods="110" Jul 08 17:55:56.383936 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377540 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 17:55:56.383936 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377543 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 17:55:56.383936 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377547 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 17:55:56.383936 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377552 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 17:55:56.383936 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377555 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 17:55:56.383936 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377560 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 17:55:56.383936 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377563 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 17:55:56.383936 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377571 2579 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 17:55:56.384631 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377574 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 17:55:56.384631 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377578 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 17:55:56.384631 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377581 2579 flags.go:64] FLAG: --pod-cidr="" Jul 08 17:55:56.384631 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377584 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 17:55:56.384631 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377590 2579 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 17:55:56.384631 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377593 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 17:55:56.384631 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377596 2579 flags.go:64] FLAG: --pods-per-core="0" Jul 08 17:55:56.384631 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377599 2579 flags.go:64] FLAG: --port="10250" Jul 08 17:55:56.384631 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377602 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 17:55:56.384631 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377606 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03698d4bf6072aa51" Jul 08 17:55:56.384631 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377609 2579 flags.go:64] FLAG: --qos-reserved="" Jul 08 17:55:56.384631 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377612 2579 flags.go:64] FLAG: --read-only-port="10255" Jul 08 17:55:56.384631 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377615 2579 flags.go:64] FLAG: --register-node="true" Jul 08 17:55:56.384631 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377618 2579 flags.go:64] FLAG: --register-with-taints="" Jul 08 17:55:56.384631 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377622 2579 flags.go:64] FLAG: --registry-burst="10" Jul 08 17:55:56.384631 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377625 2579 flags.go:64] FLAG: --registry-qps="5" Jul 08 17:55:56.384631 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377628 2579 flags.go:64] FLAG: --reserved-cpus="" Jul 08 17:55:56.384631 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377631 2579 flags.go:64] FLAG: --reserved-memory="" Jul 08 17:55:56.384631 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377636 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 17:55:56.384631 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377639 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 17:55:56.384631 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377642 2579 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 17:55:56.384631 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377645 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 17:55:56.384631 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377656 2579 flags.go:64] FLAG: --runonce="false" Jul 08 17:55:56.384631 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377659 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 17:55:56.384631 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377663 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 17:55:56.385512 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377666 2579 flags.go:64] FLAG: --seccomp-default="false" Jul 08 17:55:56.385512 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377669 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 17:55:56.385512 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377672 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 17:55:56.385512 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377677 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 17:55:56.385512 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377682 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 17:55:56.385512 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377686 2579 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 17:55:56.385512 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377689 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 17:55:56.385512 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377692 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 17:55:56.385512 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377695 2579 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 17:55:56.385512 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377698 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 17:55:56.385512 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377701 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 17:55:56.385512 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377704 2579 flags.go:64] FLAG: --system-cgroups="" Jul 08 17:55:56.385512 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377707 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 17:55:56.385512 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377713 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 17:55:56.385512 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377716 2579 flags.go:64] FLAG: --tls-cert-file="" Jul 08 17:55:56.385512 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377719 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 17:55:56.385512 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377724 2579 flags.go:64] FLAG: --tls-min-version="" Jul 08 17:55:56.385512 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377727 2579 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 17:55:56.385512 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377730 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 17:55:56.385512 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377733 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 17:55:56.385512 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377736 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 17:55:56.385512 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377739 2579 flags.go:64] FLAG: --v="2" Jul 08 17:55:56.385512 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377743 2579 flags.go:64] FLAG: --version="false" Jul 08 17:55:56.385512 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377748 2579 flags.go:64] FLAG: --vmodule="" Jul 08 17:55:56.385512 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377752 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 17:55:56.386659 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.377756 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 17:55:56.386659 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377886 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:55:56.386659 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377891 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:55:56.386659 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377895 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:55:56.386659 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377898 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:55:56.386659 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377901 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:55:56.386659 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377904 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:55:56.386659 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377907 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:55:56.386659 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377910 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:55:56.386659 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377912 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:55:56.386659 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377917 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:55:56.386659 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377921 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:55:56.386659 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377924 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:55:56.386659 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377927 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:55:56.386659 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377930 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:55:56.386659 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377933 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:55:56.386659 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377936 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:55:56.386659 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377939 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:55:56.386659 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377941 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:55:56.386659 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377944 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:55:56.387573 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377947 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:55:56.387573 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377950 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:55:56.387573 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377953 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:55:56.387573 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377956 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:55:56.387573 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377958 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:55:56.387573 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377963 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:55:56.387573 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377967 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:55:56.387573 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377970 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:55:56.387573 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377972 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:55:56.387573 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377975 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:55:56.387573 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377978 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:55:56.387573 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377981 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:55:56.387573 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377984 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:55:56.387573 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377987 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:55:56.387573 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377991 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:55:56.387573 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377994 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:55:56.387573 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.377997 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:55:56.387573 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378000 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:55:56.387573 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378002 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:55:56.388089 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378005 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:55:56.388089 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378008 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:55:56.388089 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378010 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:55:56.388089 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378014 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:55:56.388089 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378019 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:55:56.388089 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378022 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:55:56.388089 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378024 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:55:56.388089 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378027 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:55:56.388089 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378030 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:55:56.388089 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378033 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:55:56.388089 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378036 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:55:56.388089 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378039 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:55:56.388089 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378042 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:55:56.388089 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378044 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:55:56.388089 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378047 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:55:56.388089 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378050 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:55:56.388089 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378052 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:55:56.388089 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378055 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:55:56.388089 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378058 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:55:56.388928 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378061 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:55:56.388928 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378063 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:55:56.388928 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378066 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:55:56.388928 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378068 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:55:56.388928 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378071 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:55:56.388928 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378074 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:55:56.388928 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378077 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:55:56.388928 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378080 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:55:56.388928 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378082 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:55:56.388928 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378085 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:55:56.388928 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378088 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:55:56.388928 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378090 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:55:56.388928 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378093 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:55:56.388928 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378096 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:55:56.388928 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378098 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:55:56.388928 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378101 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:55:56.388928 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378105 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:55:56.388928 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378109 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:55:56.388928 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378112 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:55:56.388928 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378115 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:55:56.389870 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378118 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:55:56.389870 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378121 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:55:56.389870 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378124 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:55:56.389870 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378127 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:55:56.389870 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378130 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:55:56.389870 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378132 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:55:56.389870 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378135 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:55:56.389870 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378138 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:55:56.389870 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378141 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:55:56.389870 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378143 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:55:56.389870 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378146 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:55:56.389870 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378149 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:55:56.389870 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378151 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:55:56.389870 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378154 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:55:56.389870 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378157 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:55:56.389870 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378160 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:55:56.389870 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378162 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:55:56.389870 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378165 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:55:56.389870 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378167 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:55:56.389870 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378174 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:55:56.390508 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378177 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:55:56.390508 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.378182 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:55:56.390508 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.379122 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 17:55:56.390508 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.387477 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 17:55:56.390508 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.387503 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 17:55:56.390508 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.388374 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 17:55:56.390508 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.388389 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 17:55:56.390508 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388489 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:55:56.390508 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388498 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:55:56.390508 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388505 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:55:56.390508 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388512 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:55:56.390508 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388519 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:55:56.390508 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388526 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:55:56.390508 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388532 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:55:56.391100 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388537 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:55:56.391100 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388542 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:55:56.391100 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388546 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:55:56.391100 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388551 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:55:56.391100 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388556 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:55:56.391100 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388561 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:55:56.391100 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388566 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:55:56.391100 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388571 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:55:56.391100 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388576 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:55:56.391100 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388580 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:55:56.391100 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388585 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:55:56.391100 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388590 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:55:56.391100 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388595 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:55:56.391100 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388600 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:55:56.391100 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388604 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:55:56.391100 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388609 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:55:56.391100 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388614 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:55:56.391100 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388618 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:55:56.391100 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388623 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:55:56.391100 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388628 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:55:56.392047 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388633 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:55:56.392047 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388637 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:55:56.392047 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388644 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:55:56.392047 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388649 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:55:56.392047 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388654 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:55:56.392047 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388658 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:55:56.392047 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388663 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:55:56.392047 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388668 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:55:56.392047 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388673 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:55:56.392047 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388677 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:55:56.392047 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388683 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:55:56.392047 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388687 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:55:56.392047 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388692 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:55:56.392047 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388696 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:55:56.392047 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388701 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:55:56.392047 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388705 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:55:56.392047 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388711 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:55:56.392047 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388716 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:55:56.392047 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388721 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:55:56.392047 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388726 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:55:56.392653 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388730 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:55:56.392653 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388735 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:55:56.392653 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388739 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:55:56.392653 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388744 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:55:56.392653 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388748 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:55:56.392653 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388753 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:55:56.392653 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388757 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:55:56.392653 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388762 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:55:56.392653 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388767 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:55:56.392653 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388771 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:55:56.392653 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388778 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:55:56.392653 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388784 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:55:56.392653 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388790 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:55:56.392653 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388795 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:55:56.392653 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388802 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:55:56.392653 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388808 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:55:56.392653 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388814 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:55:56.392653 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388819 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:55:56.392653 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388824 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:55:56.393348 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388829 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:55:56.393348 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388834 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:55:56.393348 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388841 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:55:56.393348 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388847 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:55:56.393348 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388852 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:55:56.393348 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388857 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:55:56.393348 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388862 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:55:56.393348 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388866 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:55:56.393348 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388871 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:55:56.393348 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388876 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:55:56.393348 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388880 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:55:56.393348 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388884 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:55:56.393348 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388889 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:55:56.393348 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388894 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:55:56.393348 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388899 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:55:56.393348 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388903 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:55:56.393348 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388907 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:55:56.393348 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388912 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:55:56.393348 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388917 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:55:56.393348 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388921 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:55:56.393888 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388926 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:55:56.393888 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388930 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:55:56.393888 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388934 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:55:56.393888 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388938 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:55:56.393888 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388942 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:55:56.393888 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388946 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:55:56.393888 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388950 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:55:56.393888 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388956 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:55:56.393888 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388960 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:55:56.393888 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388966 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:55:56.393888 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388971 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:55:56.393888 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388976 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:55:56.393888 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.388980 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:55:56.393888 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.388989 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 17:55:56.393888 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389208 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:55:56.394309 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389216 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:55:56.394309 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389222 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:55:56.394309 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389228 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:55:56.394309 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389235 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:55:56.394309 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389262 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:55:56.394309 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389271 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:55:56.394309 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389277 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:55:56.394309 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389283 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:55:56.394309 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389288 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:55:56.394309 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389293 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:55:56.394309 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389298 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:55:56.394309 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389302 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:55:56.394309 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389307 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:55:56.394309 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389311 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:55:56.394309 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389316 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:55:56.394309 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389320 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:55:56.394309 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389324 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:55:56.394309 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389329 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:55:56.394309 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389333 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:55:56.394861 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389337 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:55:56.394861 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389342 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:55:56.394861 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389347 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:55:56.394861 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389352 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:55:56.394861 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389356 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:55:56.394861 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389361 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:55:56.394861 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389366 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:55:56.394861 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389371 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:55:56.394861 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389377 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:55:56.394861 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389381 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:55:56.394861 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389386 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:55:56.394861 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389391 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:55:56.394861 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389395 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:55:56.394861 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389400 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:55:56.394861 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389405 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:55:56.394861 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389409 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:55:56.394861 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389413 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:55:56.394861 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389418 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:55:56.394861 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389423 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:55:56.394861 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389427 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:55:56.395542 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389432 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:55:56.395542 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389437 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:55:56.395542 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389441 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:55:56.395542 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389446 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:55:56.395542 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389450 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:55:56.395542 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389455 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:55:56.395542 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389460 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:55:56.395542 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389464 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:55:56.395542 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389468 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:55:56.395542 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389473 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:55:56.395542 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389477 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:55:56.395542 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389483 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:55:56.395542 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389488 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:55:56.395542 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389493 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:55:56.395542 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389498 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:55:56.395542 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389502 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:55:56.395542 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389507 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:55:56.395542 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389511 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:55:56.395542 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389516 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:55:56.395542 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389521 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:55:56.396068 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389525 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:55:56.396068 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389533 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:55:56.396068 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389538 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:55:56.396068 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389543 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:55:56.396068 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389547 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:55:56.396068 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389551 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:55:56.396068 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389556 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:55:56.396068 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389560 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:55:56.396068 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389565 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:55:56.396068 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389569 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:55:56.396068 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389573 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:55:56.396068 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389578 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:55:56.396068 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389583 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:55:56.396068 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389588 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:55:56.396068 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389592 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:55:56.396068 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389597 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:55:56.396068 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389601 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:55:56.396068 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389606 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:55:56.396068 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389610 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:55:56.396068 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389615 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:55:56.396618 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389619 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:55:56.396618 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389624 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:55:56.396618 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389628 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:55:56.396618 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389633 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:55:56.396618 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389637 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:55:56.396618 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389642 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:55:56.396618 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389647 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:55:56.396618 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389651 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:55:56.396618 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389656 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:55:56.396618 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389661 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:55:56.396618 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389666 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:55:56.396618 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389671 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:55:56.396618 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389675 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:55:56.396618 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389679 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:55:56.396618 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389685 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:55:56.396618 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389692 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:55:56.396618 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389698 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:55:56.396618 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389703 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:55:56.396618 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:56.389708 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:55:56.397102 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.389717 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 17:55:56.397102 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.389894 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 17:55:56.397102 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.392843 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 17:55:56.397102 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.394418 2579 server.go:1019] "Starting client certificate rotation" Jul 08 17:55:56.397102 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.394529 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 17:55:56.397102 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.394581 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 17:55:56.398113 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.398097 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 17:55:56.399784 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.399765 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 17:55:56.409941 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.409918 2579 log.go:25] "Validated CRI v1 runtime API" Jul 08 17:55:56.412097 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.412081 2579 log.go:25] "Validated CRI v1 image API" Jul 08 17:55:56.415321 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.415304 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 17:55:56.419303 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.419283 2579 fs.go:135] Filesystem UUIDs: map[09e4a3df-8d37-4d74-a86a-7ea91ed63fc5:/dev/nvme0n1p3 328cf421-9d58-4dd6-bd51-cbf2c1c7be3f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 08 17:55:56.419353 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.419303 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 17:55:56.425018 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.424892 2579 manager.go:216] Machine: {Timestamp:2026-07-08 17:55:56.423560798 +0000 UTC m=+0.363368228 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3118457 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20ac66b188a537612dfabed38fd654 SystemUUID:ec20ac66-b188-a537-612d-fabed38fd654 BootID:9f175f84-bd78-4892-9186-03902adc2e77 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a4:ee:39:f9:9f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a4:ee:39:f9:9f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:f3:ed:d8:2f:7c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 17:55:56.425018 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.425011 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 17:55:56.425149 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.425104 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 17:55:56.427366 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.427347 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 17:55:56.428739 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.428706 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 17:55:56.428894 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.428743 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-234.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 17:55:56.429617 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.429603 2579 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 17:55:56.429617 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.429619 2579 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 17:55:56.429707 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.429627 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 17:55:56.430905 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.430893 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 17:55:56.432720 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.432709 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 17:55:56.435993 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.435979 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 08 17:55:56.436129 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.436118 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 17:55:56.436178 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.436151 2579 kubelet.go:486] "Attempting to sync node with API server" Jul 08 17:55:56.436178 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.436163 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 17:55:56.436178 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.436174 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 17:55:56.436332 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.436185 2579 kubelet.go:398] "Adding apiserver pod source" Jul 08 17:55:56.436332 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.436194 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 17:55:56.436722 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.436709 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 17:55:56.436774 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.436737 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 17:55:56.438995 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.438975 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 17:55:56.440946 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.440932 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 17:55:56.441014 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.440964 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 17:55:56.442191 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.442179 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 17:55:56.442231 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.442197 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 17:55:56.442231 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.442203 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 17:55:56.442231 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.442209 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 17:55:56.442231 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.442220 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 17:55:56.442231 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.442226 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 17:55:56.442396 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.442234 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 17:55:56.442396 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.442240 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 17:55:56.442396 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.442259 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 17:55:56.442396 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.442265 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 17:55:56.442396 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.442274 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 17:55:56.442396 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.442280 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 17:55:56.443798 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.443782 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 17:55:56.443798 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.443794 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 17:55:56.447201 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.447184 2579 server.go:1268] "Started kubelet" Jul 08 17:55:56.447457 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.447434 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 17:55:56.448169 ip-10-0-128-234 systemd[1]: Started Kubernetes Kubelet. Jul 08 17:55:56.449119 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.449004 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 17:55:56.449119 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.449104 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 17:55:56.450386 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.450354 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 17:55:56.450469 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.450444 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-234.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 17:55:56.450518 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:56.450475 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-234.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 17:55:56.450904 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:56.450855 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 17:55:56.451433 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.451411 2579 server.go:310] "Adding debug handlers to kubelet server" Jul 08 17:55:56.454478 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:56.454447 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 17:55:56.459708 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:56.458702 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-234.ec2.internal.18c062235c17bed1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-234.ec2.internal,UID:ip-10-0-128-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-234.ec2.internal,},FirstTimestamp:2026-07-08 17:55:56.447153873 +0000 UTC m=+0.386961293,LastTimestamp:2026-07-08 17:55:56.447153873 +0000 UTC m=+0.386961293,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-234.ec2.internal,}" Jul 08 17:55:56.461077 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.461058 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 17:55:56.461077 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.461065 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 17:55:56.461227 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:56.461173 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found" Jul 08 17:55:56.461820 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.461751 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 17:55:56.461820 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.461752 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 17:55:56.461820 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.461782 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 17:55:56.462095 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.461970 2579 reconstruct.go:97] "Volume reconstruction finished" Jul 08 17:55:56.462095 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.461981 2579 reconciler.go:29] "Reconciler: start to sync state" Jul 08 17:55:56.462309 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.462227 2579 factory.go:55] Registering systemd factory Jul 08 17:55:56.462309 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.462291 2579 factory.go:223] Registration of the systemd container factory successfully Jul 08 17:55:56.462535 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.462523 2579 factory.go:153] Registering CRI-O factory Jul 08 17:55:56.462535 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.462536 2579 factory.go:223] Registration of the crio container factory successfully Jul 08 17:55:56.462626 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.462588 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 17:55:56.462626 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.462610 2579 factory.go:103] Registering Raw factory Jul 08 17:55:56.462626 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.462621 2579 manager.go:1196] Started watching for new ooms in manager Jul 08 17:55:56.467596 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.463349 2579 manager.go:349] Starting recovery of all containers Jul 08 17:55:56.467596 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:56.463380 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-234.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 17:55:56.467596 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:56.463449 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 17:55:56.475289 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.475150 2579 manager.go:354] Recovery completed Jul 08 17:55:56.476302 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.476231 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n22w5" Jul 08 17:55:56.480098 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.480079 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:55:56.482286 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.482270 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:55:56.482364 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.482306 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:55:56.482364 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.482318 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:55:56.482948 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.482924 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 17:55:56.482948 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.482942 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:55:56.483074 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.482945 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 17:55:56.483074 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.482978 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 08 17:55:56.483642 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.483627 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:55:56.483710 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.483652 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:55:56.483710 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.483662 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:55:56.484269 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.484253 2579 policy_none.go:49] "None policy: Start" Jul 08 17:55:56.484269 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.484269 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 17:55:56.484331 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.484280 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 17:55:56.484391 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.484378 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n22w5" Jul 08 17:55:56.485493 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.485481 2579 policy_none.go:47] "Start" Jul 08 17:55:56.522914 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.522893 2579 manager.go:337] "Starting Device Plugin manager" Jul 08 17:55:56.523042 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:56.522932 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 17:55:56.523042 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.522943 2579 server.go:87] "Starting device plugin registration server" Jul 08 17:55:56.523297 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.523282 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 17:55:56.523344 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.523300 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 17:55:56.523439 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.523413 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 17:55:56.523554 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.523526 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 17:55:56.523554 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.523537 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 17:55:56.524087 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:56.524068 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 17:55:56.524195 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:56.524125 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-234.ec2.internal\" not found" Jul 08 17:55:56.611429 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.611390 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 17:55:56.612879 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.612863 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 17:55:56.612963 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.612902 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 17:55:56.612963 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.612927 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 17:55:56.613067 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:56.612973 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 17:55:56.615800 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.615739 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:55:56.623868 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.623852 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:55:56.624784 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.624767 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:55:56.624890 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.624806 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:55:56.624890 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.624822 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:55:56.624890 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.624854 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-234.ec2.internal" Jul 08 17:55:56.634505 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.634473 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-234.ec2.internal" Jul 08 17:55:56.634505 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:56.634503 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-234.ec2.internal\": node \"ip-10-0-128-234.ec2.internal\" not found" Jul 08 17:55:56.657065 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:56.657028 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found" Jul 08 17:55:56.714769 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.714728 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal"] Jul 08 17:55:56.714930 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.714814 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:55:56.715933 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.715900 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:55:56.716044 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.715939 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:55:56.716044 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.715950 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:55:56.717580 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.717566 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:55:56.717757 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.717742 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal" Jul 08 17:55:56.717802 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.717775 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:55:56.718422 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.718401 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:55:56.718422 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.718421 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:55:56.718562 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.718432 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:55:56.718562 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.718444 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:55:56.718562 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.718446 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:55:56.718562 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.718546 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:55:56.719727 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.719711 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal" Jul 08 17:55:56.719779 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.719739 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:55:56.720466 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.720450 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:55:56.720466 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.720472 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:55:56.720592 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.720484 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:55:56.742113 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:56.742093 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-234.ec2.internal\" not found" node="ip-10-0-128-234.ec2.internal" Jul 08 17:55:56.747010 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:56.746992 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-234.ec2.internal\" not found" node="ip-10-0-128-234.ec2.internal" Jul 08 17:55:56.757107 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:56.757081 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found" Jul 08 17:55:56.764546 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.764516 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d3621fce897cec71d75ea532d62b7211-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal\" (UID: \"d3621fce897cec71d75ea532d62b7211\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal" Jul 08 17:55:56.764659 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.764548 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3621fce897cec71d75ea532d62b7211-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal\" (UID: \"d3621fce897cec71d75ea532d62b7211\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal" Jul 08 17:55:56.764659 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.764567 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1822161f850ef2b3317aaf5916b61399-config\") pod \"kube-apiserver-proxy-ip-10-0-128-234.ec2.internal\" (UID: \"1822161f850ef2b3317aaf5916b61399\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal" Jul 08 17:55:56.859663 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:56.859608 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found" Jul 08 17:55:56.865356 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.865326 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d3621fce897cec71d75ea532d62b7211-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal\" (UID: \"d3621fce897cec71d75ea532d62b7211\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal" Jul 08 17:55:56.865454 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.865362 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3621fce897cec71d75ea532d62b7211-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal\" (UID: \"d3621fce897cec71d75ea532d62b7211\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal" Jul 08 17:55:56.865454 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.865383 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1822161f850ef2b3317aaf5916b61399-config\") pod \"kube-apiserver-proxy-ip-10-0-128-234.ec2.internal\" (UID: \"1822161f850ef2b3317aaf5916b61399\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal" Jul 08 17:55:56.865524 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.865446 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3621fce897cec71d75ea532d62b7211-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal\" (UID: \"d3621fce897cec71d75ea532d62b7211\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal" Jul 08 17:55:56.865524 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.865482 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d3621fce897cec71d75ea532d62b7211-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal\" (UID: \"d3621fce897cec71d75ea532d62b7211\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal" Jul 08 17:55:56.865636 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:56.865511 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1822161f850ef2b3317aaf5916b61399-config\") pod \"kube-apiserver-proxy-ip-10-0-128-234.ec2.internal\" (UID: \"1822161f850ef2b3317aaf5916b61399\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal" Jul 08 17:55:56.960621 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:56.960527 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found" Jul 08 17:55:57.050258 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:57.050228 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal" Jul 08 17:55:57.051425 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:57.051406 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal" Jul 08 17:55:57.061304 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:57.061281 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found" Jul 08 17:55:57.166697 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:57.166641 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found" Jul 08 17:55:57.267934 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:57.267841 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found" Jul 08 17:55:57.354092 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:57.354063 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:55:57.367989 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:57.367950 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found" Jul 08 17:55:57.394742 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:57.394705 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 17:55:57.394905 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:57.394882 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 17:55:57.394947 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:57.394882 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 17:55:57.468240 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:57.468212 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found" Jul 08 17:55:57.486426 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:57.486383 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 17:50:56 +0000 UTC" deadline="2027-12-08 21:38:41.860931068 +0000 UTC" Jul 08 17:55:57.486426 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:57.486417 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12435h42m44.374516919s" Jul 08 17:55:57.564460 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:57.564383 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:55:57.568581 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:57.568561 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found" Jul 08 17:55:57.669640 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:57.669609 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found" Jul 08 17:55:57.698715 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:57.698691 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:55:57.762058 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:57.762020 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal" Jul 08 17:55:57.780490 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:57.780468 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 17:55:57.783089 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:57.783065 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal" Jul 08 17:55:57.792508 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:57.792484 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 17:55:57.812070 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:57.812041 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1822161f850ef2b3317aaf5916b61399.slice/crio-4c67078827d402269c203f9a74da21af4c4b7e18456fb3a429a0da81159fadec WatchSource:0}: Error finding container 4c67078827d402269c203f9a74da21af4c4b7e18456fb3a429a0da81159fadec: Status 404 returned error can't find the container with id 4c67078827d402269c203f9a74da21af4c4b7e18456fb3a429a0da81159fadec Jul 08 17:55:57.813772 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:57.813749 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3621fce897cec71d75ea532d62b7211.slice/crio-262e71f8ae47ce5f1dff7a372150dcbff5d01a39ab2d2afb6327b66c3fa07c1e WatchSource:0}: Error finding container 262e71f8ae47ce5f1dff7a372150dcbff5d01a39ab2d2afb6327b66c3fa07c1e: Status 404 returned error can't find the container with id 262e71f8ae47ce5f1dff7a372150dcbff5d01a39ab2d2afb6327b66c3fa07c1e Jul 08 17:55:57.819689 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:57.819631 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 17:55:58.237693 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.237605 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:55:58.440061 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.440033 2579 apiserver.go:52] "Watching apiserver" Jul 08 17:55:58.447401 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.447377 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 17:55:58.447724 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.447702 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-cxg6h","openshift-image-registry/node-ca-c2d4p","openshift-multus/multus-mrs6x","openshift-multus/network-metrics-daemon-mrv85","openshift-network-operator/iptables-alerter-xmvk2","kube-system/global-pull-secret-syncer-t6rk4","kube-system/konnectivity-agent-jnnhn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal","openshift-multus/multus-additional-cni-plugins-pc728","openshift-network-diagnostics/network-check-target-k678l","openshift-ovn-kubernetes/ovnkube-node-mqgcf","kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb","openshift-cluster-node-tuning-operator/tuned-ngmzd"] Jul 08 17:55:58.451246 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.451227 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jnnhn" Jul 08 17:55:58.453304 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.453288 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb" Jul 08 17:55:58.454381 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.454185 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 17:55:58.454381 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.454257 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2bpcg\"" Jul 08 17:55:58.454381 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.454357 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 17:55:58.456590 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.455871 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 17:55:58.456590 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.456066 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.457299 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.457271 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 17:55:58.457428 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.457390 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-k5hrq\"" Jul 08 17:55:58.457602 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.457588 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 17:55:58.458041 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.458022 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:55:58.458125 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:58.458094 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrv85" podUID="077db27a-abe8-4647-9b18-9d59458f3f9c" Jul 08 17:55:58.458320 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.458304 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 17:55:58.458589 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.458572 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 17:55:58.458901 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.458870 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fdtdf\"" Jul 08 17:55:58.459011 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.458869 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 17:55:58.459122 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.459103 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 17:55:58.460454 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.460439 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xmvk2" Jul 08 17:55:58.461858 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.461842 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 17:55:58.462654 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.462633 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.462744 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.462664 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:55:58.462800 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.462742 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lnntg\"" Jul 08 17:55:58.462800 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.462753 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 17:55:58.462897 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.462759 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 17:55:58.464778 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.464759 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9pjmx\"" Jul 08 17:55:58.464863 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.464787 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pc728" Jul 08 17:55:58.464991 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.464975 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 17:55:58.465311 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.465255 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:55:58.466928 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.466910 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4fs6p\"" Jul 08 17:55:58.467140 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.467124 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.467229 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.467161 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 17:55:58.467229 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.467165 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 17:55:58.469514 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.469498 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 17:55:58.469600 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.469505 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 17:55:58.469600 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.469543 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 17:55:58.469791 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.469772 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c2d4p" Jul 08 17:55:58.470739 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.470636 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c2vsw\"" Jul 08 17:55:58.470739 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.470670 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 17:55:58.470739 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.470710 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 17:55:58.470739 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.470725 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 17:55:58.472089 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.472067 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 17:55:58.472234 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.472143 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:55:58.472234 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:58.472221 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k678l" podUID="b3fffa77-4964-4e33-bb38-fd4483bbd32d" Jul 08 17:55:58.472353 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.472302 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 17:55:58.472432 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.472358 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zd5kp\"" Jul 08 17:55:58.472432 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.472412 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 17:55:58.473666 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.473647 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-cnibin\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.473744 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.473681 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-multus-socket-dir-parent\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.473744 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.473708 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-host-run-k8s-cni-cncf-io\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.473849 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.473761 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-hostroot\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.473849 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.473795 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-multus-conf-dir\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.473849 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.473818 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs\") pod \"network-metrics-daemon-mrv85\" (UID: \"077db27a-abe8-4647-9b18-9d59458f3f9c\") " pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:55:58.473991 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.473858 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-etc-kubernetes\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.473991 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.473884 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-run\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.473991 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.473930 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-multus-cni-dir\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.473991 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.473964 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-os-release\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.474165 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.473993 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-host-run-multus-certs\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.474165 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474026 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-etc-kubernetes\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.474165 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474059 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2bc2a50-5b6e-42d2-9e28-e6d60a176fd9-host-slash\") pod \"iptables-alerter-xmvk2\" (UID: \"a2bc2a50-5b6e-42d2-9e28-e6d60a176fd9\") " pod="openshift-network-operator/iptables-alerter-xmvk2" Jul 08 17:55:58.474165 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474089 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-sys\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.474165 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474105 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-var-lib-kubelet\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.474165 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474126 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ce759c61-5b1d-42d8-8dd8-509daa858910-kubelet-dir\") pod \"aws-ebs-csi-driver-node-87khb\" (UID: \"ce759c61-5b1d-42d8-8dd8-509daa858910\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb" Jul 08 17:55:58.474165 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474155 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-host-run-netns\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.474560 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474186 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-host-var-lib-cni-multus\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.474560 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474210 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-host-var-lib-kubelet\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.474560 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474224 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-etc-modprobe-d\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.474560 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474238 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-host\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.474560 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474254 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4rfb\" (UniqueName: \"kubernetes.io/projected/239c19ca-ad22-4864-b17c-feffccde78d9-kube-api-access-b4rfb\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.474560 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474281 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ce759c61-5b1d-42d8-8dd8-509daa858910-device-dir\") pod \"aws-ebs-csi-driver-node-87khb\" (UID: \"ce759c61-5b1d-42d8-8dd8-509daa858910\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb" Jul 08 17:55:58.474560 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474323 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k2xp\" (UniqueName: \"kubernetes.io/projected/01f209d5-dc76-42e1-a119-f9caaaee0961-kube-api-access-5k2xp\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.474560 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474380 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-etc-sysctl-d\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.474560 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474405 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/239c19ca-ad22-4864-b17c-feffccde78d9-etc-tuned\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.474560 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474443 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01f209d5-dc76-42e1-a119-f9caaaee0961-cni-binary-copy\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.474560 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474465 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-etc-systemd\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.474560 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474486 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/97b4b0ca-1889-469e-bb9e-c71b128caa10-konnectivity-ca\") pod \"konnectivity-agent-jnnhn\" (UID: \"97b4b0ca-1889-469e-bb9e-c71b128caa10\") " pod="kube-system/konnectivity-agent-jnnhn" Jul 08 17:55:58.474560 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474506 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cxg6h" Jul 08 17:55:58.474560 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474522 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ce759c61-5b1d-42d8-8dd8-509daa858910-sys-fs\") pod \"aws-ebs-csi-driver-node-87khb\" (UID: \"ce759c61-5b1d-42d8-8dd8-509daa858910\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb" Jul 08 17:55:58.475073 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474613 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-system-cni-dir\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.475073 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474645 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a2bc2a50-5b6e-42d2-9e28-e6d60a176fd9-iptables-alerter-script\") pod \"iptables-alerter-xmvk2\" (UID: \"a2bc2a50-5b6e-42d2-9e28-e6d60a176fd9\") " pod="openshift-network-operator/iptables-alerter-xmvk2" Jul 08 17:55:58.475073 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474668 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-etc-sysconfig\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.475073 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474688 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/239c19ca-ad22-4864-b17c-feffccde78d9-tmp\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.475073 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474710 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/97b4b0ca-1889-469e-bb9e-c71b128caa10-agent-certs\") pod \"konnectivity-agent-jnnhn\" (UID: \"97b4b0ca-1889-469e-bb9e-c71b128caa10\") " pod="kube-system/konnectivity-agent-jnnhn" Jul 08 17:55:58.475073 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474733 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ce759c61-5b1d-42d8-8dd8-509daa858910-socket-dir\") pod \"aws-ebs-csi-driver-node-87khb\" (UID: \"ce759c61-5b1d-42d8-8dd8-509daa858910\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb" Jul 08 17:55:58.475073 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474777 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn8nh\" (UniqueName: \"kubernetes.io/projected/077db27a-abe8-4647-9b18-9d59458f3f9c-kube-api-access-wn8nh\") pod \"network-metrics-daemon-mrv85\" (UID: \"077db27a-abe8-4647-9b18-9d59458f3f9c\") " pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:55:58.475073 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474811 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-lib-modules\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.475073 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474834 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ce759c61-5b1d-42d8-8dd8-509daa858910-registration-dir\") pod \"aws-ebs-csi-driver-node-87khb\" (UID: \"ce759c61-5b1d-42d8-8dd8-509daa858910\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb" Jul 08 17:55:58.475073 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474873 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ce759c61-5b1d-42d8-8dd8-509daa858910-etc-selinux\") pod \"aws-ebs-csi-driver-node-87khb\" (UID: \"ce759c61-5b1d-42d8-8dd8-509daa858910\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb" Jul 08 17:55:58.475073 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474926 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjk6n\" (UniqueName: \"kubernetes.io/projected/ce759c61-5b1d-42d8-8dd8-509daa858910-kube-api-access-mjk6n\") pod \"aws-ebs-csi-driver-node-87khb\" (UID: \"ce759c61-5b1d-42d8-8dd8-509daa858910\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb" Jul 08 17:55:58.475073 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474955 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-host-var-lib-cni-bin\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.475073 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.474977 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/01f209d5-dc76-42e1-a119-f9caaaee0961-multus-daemon-config\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.475073 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.475011 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4kkw\" (UniqueName: \"kubernetes.io/projected/a2bc2a50-5b6e-42d2-9e28-e6d60a176fd9-kube-api-access-s4kkw\") pod \"iptables-alerter-xmvk2\" (UID: \"a2bc2a50-5b6e-42d2-9e28-e6d60a176fd9\") " pod="openshift-network-operator/iptables-alerter-xmvk2" Jul 08 17:55:58.475073 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.475033 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-etc-sysctl-conf\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.475762 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.475742 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 17:55:58.476682 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.476667 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-q6c2t\"" Jul 08 17:55:58.476938 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.476918 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 17:55:58.476987 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.476961 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:55:58.477036 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:58.477005 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6rk4" podUID="34698452-3dd9-43df-a496-5971c144095b" Jul 08 17:55:58.477036 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.476959 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 17:55:58.494408 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.494391 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fztdq" Jul 08 17:55:58.502208 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.502191 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fztdq" Jul 08 17:55:58.563164 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.563131 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 17:55:58.575941 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.575907 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-etc-kubernetes\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.575941 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.575954 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-host-cni-bin\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.576215 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576011 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f628956a-833b-4922-8da3-9a95c252175e-ovn-node-metrics-cert\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.576215 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576047 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-etc-kubernetes\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.576215 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576057 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/088e9df1-9c28-430a-a67d-c8ac11e6564e-tmp-dir\") pod \"node-resolver-cxg6h\" (UID: \"088e9df1-9c28-430a-a67d-c8ac11e6564e\") " pod="openshift-dns/node-resolver-cxg6h" Jul 08 17:55:58.576215 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576127 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-os-release\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.576215 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576146 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-host-run-multus-certs\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.576215 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576205 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-etc-kubernetes\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.576526 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576235 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-host-cni-netd\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.576526 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576242 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-host-run-multus-certs\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.576526 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576254 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-os-release\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.576526 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576267 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-etc-kubernetes\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.576526 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576284 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f628956a-833b-4922-8da3-9a95c252175e-ovnkube-script-lib\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.576526 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576327 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/34698452-3dd9-43df-a496-5971c144095b-kubelet-config\") pod \"global-pull-secret-syncer-t6rk4\" (UID: \"34698452-3dd9-43df-a496-5971c144095b\") " pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:55:58.576526 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576362 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-host-var-lib-cni-multus\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.576526 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576388 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-host\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.576526 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576412 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-host-run-netns\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.576526 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576437 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/549e5f27-43e4-43b4-b0d9-a8dca67dea84-host\") pod \"node-ca-c2d4p\" (UID: \"549e5f27-43e4-43b4-b0d9-a8dca67dea84\") " pod="openshift-image-registry/node-ca-c2d4p" Jul 08 17:55:58.576526 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576444 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-host-var-lib-cni-multus\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.576526 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576467 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8a1adfb2-9a71-43a3-892f-41b2881f1fe8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pc728\" (UID: \"8a1adfb2-9a71-43a3-892f-41b2881f1fe8\") " pod="openshift-multus/multus-additional-cni-plugins-pc728" Jul 08 17:55:58.576526 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576497 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-etc-sysctl-d\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.576526 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576465 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-host\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.576526 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576530 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-host-kubelet\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.577296 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576567 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.577296 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576584 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f628956a-833b-4922-8da3-9a95c252175e-ovnkube-config\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.577296 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576604 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk2vb\" (UniqueName: \"kubernetes.io/projected/b3fffa77-4964-4e33-bb38-fd4483bbd32d-kube-api-access-zk2vb\") pod \"network-check-target-k678l\" (UID: \"b3fffa77-4964-4e33-bb38-fd4483bbd32d\") " pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:55:58.577296 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576632 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01f209d5-dc76-42e1-a119-f9caaaee0961-cni-binary-copy\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.577296 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576650 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-etc-sysctl-d\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.577296 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576656 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/97b4b0ca-1889-469e-bb9e-c71b128caa10-konnectivity-ca\") pod \"konnectivity-agent-jnnhn\" (UID: \"97b4b0ca-1889-469e-bb9e-c71b128caa10\") " pod="kube-system/konnectivity-agent-jnnhn" Jul 08 17:55:58.577296 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576699 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a1adfb2-9a71-43a3-892f-41b2881f1fe8-cnibin\") pod \"multus-additional-cni-plugins-pc728\" (UID: \"8a1adfb2-9a71-43a3-892f-41b2881f1fe8\") " pod="openshift-multus/multus-additional-cni-plugins-pc728" Jul 08 17:55:58.577296 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576721 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-system-cni-dir\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.577296 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576743 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a2bc2a50-5b6e-42d2-9e28-e6d60a176fd9-iptables-alerter-script\") pod \"iptables-alerter-xmvk2\" (UID: \"a2bc2a50-5b6e-42d2-9e28-e6d60a176fd9\") " pod="openshift-network-operator/iptables-alerter-xmvk2" Jul 08 17:55:58.577296 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576767 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-etc-sysconfig\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.577296 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576787 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/239c19ca-ad22-4864-b17c-feffccde78d9-tmp\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.577296 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576808 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/97b4b0ca-1889-469e-bb9e-c71b128caa10-agent-certs\") pod \"konnectivity-agent-jnnhn\" (UID: \"97b4b0ca-1889-469e-bb9e-c71b128caa10\") " pod="kube-system/konnectivity-agent-jnnhn" Jul 08 17:55:58.577296 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576833 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ce759c61-5b1d-42d8-8dd8-509daa858910-socket-dir\") pod \"aws-ebs-csi-driver-node-87khb\" (UID: \"ce759c61-5b1d-42d8-8dd8-509daa858910\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb" Jul 08 17:55:58.577296 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576856 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-host-slash\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.577296 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576882 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-host-run-ovn-kubernetes\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.577296 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576922 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn8nh\" (UniqueName: \"kubernetes.io/projected/077db27a-abe8-4647-9b18-9d59458f3f9c-kube-api-access-wn8nh\") pod \"network-metrics-daemon-mrv85\" (UID: \"077db27a-abe8-4647-9b18-9d59458f3f9c\") " pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:55:58.577296 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576945 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ce759c61-5b1d-42d8-8dd8-509daa858910-etc-selinux\") pod \"aws-ebs-csi-driver-node-87khb\" (UID: \"ce759c61-5b1d-42d8-8dd8-509daa858910\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb" Jul 08 17:55:58.578087 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576967 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/549e5f27-43e4-43b4-b0d9-a8dca67dea84-serviceca\") pod \"node-ca-c2d4p\" (UID: \"549e5f27-43e4-43b4-b0d9-a8dca67dea84\") " pod="openshift-image-registry/node-ca-c2d4p" Jul 08 17:55:58.578087 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.576990 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a1adfb2-9a71-43a3-892f-41b2881f1fe8-system-cni-dir\") pod \"multus-additional-cni-plugins-pc728\" (UID: \"8a1adfb2-9a71-43a3-892f-41b2881f1fe8\") " pod="openshift-multus/multus-additional-cni-plugins-pc728" Jul 08 17:55:58.578087 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577012 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a1adfb2-9a71-43a3-892f-41b2881f1fe8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pc728\" (UID: \"8a1adfb2-9a71-43a3-892f-41b2881f1fe8\") " pod="openshift-multus/multus-additional-cni-plugins-pc728" Jul 08 17:55:58.578087 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577035 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/088e9df1-9c28-430a-a67d-c8ac11e6564e-hosts-file\") pod \"node-resolver-cxg6h\" (UID: \"088e9df1-9c28-430a-a67d-c8ac11e6564e\") " pod="openshift-dns/node-resolver-cxg6h" Jul 08 17:55:58.578087 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577068 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-host-var-lib-cni-bin\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.578087 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577093 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/01f209d5-dc76-42e1-a119-f9caaaee0961-multus-daemon-config\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.578087 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577132 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4kkw\" (UniqueName: \"kubernetes.io/projected/a2bc2a50-5b6e-42d2-9e28-e6d60a176fd9-kube-api-access-s4kkw\") pod \"iptables-alerter-xmvk2\" (UID: \"a2bc2a50-5b6e-42d2-9e28-e6d60a176fd9\") " pod="openshift-network-operator/iptables-alerter-xmvk2" Jul 08 17:55:58.578087 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577157 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-etc-sysctl-conf\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.578087 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577219 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-systemd-units\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.578087 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577244 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-etc-openvswitch\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.578087 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577272 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-node-log\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.578087 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577295 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34698452-3dd9-43df-a496-5971c144095b-original-pull-secret\") pod \"global-pull-secret-syncer-t6rk4\" (UID: \"34698452-3dd9-43df-a496-5971c144095b\") " pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:55:58.578087 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577305 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01f209d5-dc76-42e1-a119-f9caaaee0961-cni-binary-copy\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.578087 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577338 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-multus-socket-dir-parent\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.578087 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577368 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs\") pod \"network-metrics-daemon-mrv85\" (UID: \"077db27a-abe8-4647-9b18-9d59458f3f9c\") " pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:55:58.578087 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577393 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-run\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.578087 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577415 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f628956a-833b-4922-8da3-9a95c252175e-env-overrides\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.578863 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577438 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ce759c61-5b1d-42d8-8dd8-509daa858910-socket-dir\") pod \"aws-ebs-csi-driver-node-87khb\" (UID: \"ce759c61-5b1d-42d8-8dd8-509daa858910\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb" Jul 08 17:55:58.578863 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577441 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ce759c61-5b1d-42d8-8dd8-509daa858910-sys-fs\") pod \"aws-ebs-csi-driver-node-87khb\" (UID: \"ce759c61-5b1d-42d8-8dd8-509daa858910\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb" Jul 08 17:55:58.578863 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577469 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-run-openvswitch\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.578863 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577608 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-system-cni-dir\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.578863 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577621 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ce759c61-5b1d-42d8-8dd8-509daa858910-sys-fs\") pod \"aws-ebs-csi-driver-node-87khb\" (UID: \"ce759c61-5b1d-42d8-8dd8-509daa858910\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb" Jul 08 17:55:58.578863 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577678 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-multus-cni-dir\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.578863 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577680 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-multus-socket-dir-parent\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.578863 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577716 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2bc2a50-5b6e-42d2-9e28-e6d60a176fd9-host-slash\") pod \"iptables-alerter-xmvk2\" (UID: \"a2bc2a50-5b6e-42d2-9e28-e6d60a176fd9\") " pod="openshift-network-operator/iptables-alerter-xmvk2" Jul 08 17:55:58.578863 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577757 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-sys\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.578863 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577775 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 17:55:58.578863 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577822 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-var-lib-kubelet\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.578863 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577337 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/97b4b0ca-1889-469e-bb9e-c71b128caa10-konnectivity-ca\") pod \"konnectivity-agent-jnnhn\" (UID: \"97b4b0ca-1889-469e-bb9e-c71b128caa10\") " pod="kube-system/konnectivity-agent-jnnhn" Jul 08 17:55:58.578863 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577843 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-multus-cni-dir\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.578863 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577850 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a2bc2a50-5b6e-42d2-9e28-e6d60a176fd9-iptables-alerter-script\") pod \"iptables-alerter-xmvk2\" (UID: \"a2bc2a50-5b6e-42d2-9e28-e6d60a176fd9\") " pod="openshift-network-operator/iptables-alerter-xmvk2" Jul 08 17:55:58.578863 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577908 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-etc-sysconfig\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.578863 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577943 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-sys\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.578863 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577979 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2bc2a50-5b6e-42d2-9e28-e6d60a176fd9-host-slash\") pod \"iptables-alerter-xmvk2\" (UID: \"a2bc2a50-5b6e-42d2-9e28-e6d60a176fd9\") " pod="openshift-network-operator/iptables-alerter-xmvk2" Jul 08 17:55:58.578863 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.578295 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-etc-sysctl-conf\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.579864 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.578312 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-host-var-lib-cni-bin\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.579864 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:58.578326 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:55:58.579864 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.578367 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-run\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.579864 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.578367 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/01f209d5-dc76-42e1-a119-f9caaaee0961-multus-daemon-config\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.579864 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.578405 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ce759c61-5b1d-42d8-8dd8-509daa858910-etc-selinux\") pod \"aws-ebs-csi-driver-node-87khb\" (UID: \"ce759c61-5b1d-42d8-8dd8-509daa858910\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb" Jul 08 17:55:58.579864 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.577784 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-var-lib-kubelet\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.579864 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:58.578470 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs podName:077db27a-abe8-4647-9b18-9d59458f3f9c nodeName:}" failed. No retries permitted until 2026-07-08 17:55:59.078443528 +0000 UTC m=+3.018250957 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs") pod "network-metrics-daemon-mrv85" (UID: "077db27a-abe8-4647-9b18-9d59458f3f9c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:55:58.579864 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.578616 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ce759c61-5b1d-42d8-8dd8-509daa858910-kubelet-dir\") pod \"aws-ebs-csi-driver-node-87khb\" (UID: \"ce759c61-5b1d-42d8-8dd8-509daa858910\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb" Jul 08 17:55:58.579864 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.578648 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-host-run-netns\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.579864 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.578674 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-host-var-lib-kubelet\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.579864 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.578704 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-etc-modprobe-d\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.579864 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.578732 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4rfb\" (UniqueName: \"kubernetes.io/projected/239c19ca-ad22-4864-b17c-feffccde78d9-kube-api-access-b4rfb\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.579864 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.578757 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ce759c61-5b1d-42d8-8dd8-509daa858910-device-dir\") pod \"aws-ebs-csi-driver-node-87khb\" (UID: \"ce759c61-5b1d-42d8-8dd8-509daa858910\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb" Jul 08 17:55:58.579864 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.578806 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-host-var-lib-kubelet\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.579864 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.578814 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ce759c61-5b1d-42d8-8dd8-509daa858910-device-dir\") pod \"aws-ebs-csi-driver-node-87khb\" (UID: \"ce759c61-5b1d-42d8-8dd8-509daa858910\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb" Jul 08 17:55:58.579864 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.578892 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ce759c61-5b1d-42d8-8dd8-509daa858910-kubelet-dir\") pod \"aws-ebs-csi-driver-node-87khb\" (UID: \"ce759c61-5b1d-42d8-8dd8-509daa858910\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb" Jul 08 17:55:58.579864 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.578907 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-etc-modprobe-d\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.580753 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.578923 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-256jj\" (UniqueName: \"kubernetes.io/projected/8a1adfb2-9a71-43a3-892f-41b2881f1fe8-kube-api-access-256jj\") pod \"multus-additional-cni-plugins-pc728\" (UID: \"8a1adfb2-9a71-43a3-892f-41b2881f1fe8\") " pod="openshift-multus/multus-additional-cni-plugins-pc728" Jul 08 17:55:58.580753 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.578947 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-host-run-netns\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.580753 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.578951 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/34698452-3dd9-43df-a496-5971c144095b-dbus\") pod \"global-pull-secret-syncer-t6rk4\" (UID: \"34698452-3dd9-43df-a496-5971c144095b\") " pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:55:58.580753 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.579063 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k2xp\" (UniqueName: \"kubernetes.io/projected/01f209d5-dc76-42e1-a119-f9caaaee0961-kube-api-access-5k2xp\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.580753 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.579107 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/239c19ca-ad22-4864-b17c-feffccde78d9-etc-tuned\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.580753 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.579142 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-run-systemd\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.580753 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.579187 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a1adfb2-9a71-43a3-892f-41b2881f1fe8-cni-binary-copy\") pod \"multus-additional-cni-plugins-pc728\" (UID: \"8a1adfb2-9a71-43a3-892f-41b2881f1fe8\") " pod="openshift-multus/multus-additional-cni-plugins-pc728" Jul 08 17:55:58.580753 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.579218 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-etc-systemd\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.580753 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.579245 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-var-lib-openvswitch\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.580753 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.579268 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-log-socket\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.580753 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.579291 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8a1adfb2-9a71-43a3-892f-41b2881f1fe8-os-release\") pod \"multus-additional-cni-plugins-pc728\" (UID: \"8a1adfb2-9a71-43a3-892f-41b2881f1fe8\") " pod="openshift-multus/multus-additional-cni-plugins-pc728" Jul 08 17:55:58.580753 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.579314 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t9ws\" (UniqueName: \"kubernetes.io/projected/f628956a-833b-4922-8da3-9a95c252175e-kube-api-access-9t9ws\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.580753 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.579339 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-lib-modules\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.580753 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.579365 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ce759c61-5b1d-42d8-8dd8-509daa858910-registration-dir\") pod \"aws-ebs-csi-driver-node-87khb\" (UID: \"ce759c61-5b1d-42d8-8dd8-509daa858910\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb" Jul 08 17:55:58.580753 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.579391 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjk6n\" (UniqueName: \"kubernetes.io/projected/ce759c61-5b1d-42d8-8dd8-509daa858910-kube-api-access-mjk6n\") pod \"aws-ebs-csi-driver-node-87khb\" (UID: \"ce759c61-5b1d-42d8-8dd8-509daa858910\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb" Jul 08 17:55:58.580753 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.579417 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgt6k\" (UniqueName: \"kubernetes.io/projected/088e9df1-9c28-430a-a67d-c8ac11e6564e-kube-api-access-kgt6k\") pod \"node-resolver-cxg6h\" (UID: \"088e9df1-9c28-430a-a67d-c8ac11e6564e\") " pod="openshift-dns/node-resolver-cxg6h" Jul 08 17:55:58.581590 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.579443 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-run-ovn\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.581590 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.579467 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv477\" (UniqueName: \"kubernetes.io/projected/549e5f27-43e4-43b4-b0d9-a8dca67dea84-kube-api-access-pv477\") pod \"node-ca-c2d4p\" (UID: \"549e5f27-43e4-43b4-b0d9-a8dca67dea84\") " pod="openshift-image-registry/node-ca-c2d4p" Jul 08 17:55:58.581590 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.579508 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8a1adfb2-9a71-43a3-892f-41b2881f1fe8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pc728\" (UID: \"8a1adfb2-9a71-43a3-892f-41b2881f1fe8\") " pod="openshift-multus/multus-additional-cni-plugins-pc728" Jul 08 17:55:58.581590 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.579540 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-cnibin\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.581590 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.579576 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-host-run-k8s-cni-cncf-io\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.581590 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.579601 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-hostroot\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.581590 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.579626 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-lib-modules\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.581590 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.579661 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-multus-conf-dir\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.581590 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.579682 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/239c19ca-ad22-4864-b17c-feffccde78d9-etc-systemd\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.581590 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.579716 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ce759c61-5b1d-42d8-8dd8-509daa858910-registration-dir\") pod \"aws-ebs-csi-driver-node-87khb\" (UID: \"ce759c61-5b1d-42d8-8dd8-509daa858910\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb" Jul 08 17:55:58.581590 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.579753 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-hostroot\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.581590 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.579752 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-host-run-k8s-cni-cncf-io\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.581590 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.579626 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-multus-conf-dir\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.581590 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.579937 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01f209d5-dc76-42e1-a119-f9caaaee0961-cnibin\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.582814 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.582340 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/239c19ca-ad22-4864-b17c-feffccde78d9-tmp\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.582814 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.582485 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/239c19ca-ad22-4864-b17c-feffccde78d9-etc-tuned\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.582814 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.582640 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/97b4b0ca-1889-469e-bb9e-c71b128caa10-agent-certs\") pod \"konnectivity-agent-jnnhn\" (UID: \"97b4b0ca-1889-469e-bb9e-c71b128caa10\") " pod="kube-system/konnectivity-agent-jnnhn" Jul 08 17:55:58.589432 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.589396 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn8nh\" (UniqueName: \"kubernetes.io/projected/077db27a-abe8-4647-9b18-9d59458f3f9c-kube-api-access-wn8nh\") pod \"network-metrics-daemon-mrv85\" (UID: \"077db27a-abe8-4647-9b18-9d59458f3f9c\") " pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:55:58.590363 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.590322 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4rfb\" (UniqueName: \"kubernetes.io/projected/239c19ca-ad22-4864-b17c-feffccde78d9-kube-api-access-b4rfb\") pod \"tuned-ngmzd\" (UID: \"239c19ca-ad22-4864-b17c-feffccde78d9\") " pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.590469 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.590443 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjk6n\" (UniqueName: \"kubernetes.io/projected/ce759c61-5b1d-42d8-8dd8-509daa858910-kube-api-access-mjk6n\") pod \"aws-ebs-csi-driver-node-87khb\" (UID: \"ce759c61-5b1d-42d8-8dd8-509daa858910\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb" Jul 08 17:55:58.590699 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.590656 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k2xp\" (UniqueName: \"kubernetes.io/projected/01f209d5-dc76-42e1-a119-f9caaaee0961-kube-api-access-5k2xp\") pod \"multus-mrs6x\" (UID: \"01f209d5-dc76-42e1-a119-f9caaaee0961\") " pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.590984 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.590963 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4kkw\" (UniqueName: \"kubernetes.io/projected/a2bc2a50-5b6e-42d2-9e28-e6d60a176fd9-kube-api-access-s4kkw\") pod \"iptables-alerter-xmvk2\" (UID: \"a2bc2a50-5b6e-42d2-9e28-e6d60a176fd9\") " pod="openshift-network-operator/iptables-alerter-xmvk2" Jul 08 17:55:58.619850 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.619796 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal" event={"ID":"d3621fce897cec71d75ea532d62b7211","Type":"ContainerStarted","Data":"262e71f8ae47ce5f1dff7a372150dcbff5d01a39ab2d2afb6327b66c3fa07c1e"} Jul 08 17:55:58.621216 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.621189 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal" event={"ID":"1822161f850ef2b3317aaf5916b61399","Type":"ContainerStarted","Data":"4c67078827d402269c203f9a74da21af4c4b7e18456fb3a429a0da81159fadec"} Jul 08 17:55:58.681017 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.680463 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-host-run-ovn-kubernetes\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.681017 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.680511 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/549e5f27-43e4-43b4-b0d9-a8dca67dea84-serviceca\") pod \"node-ca-c2d4p\" (UID: \"549e5f27-43e4-43b4-b0d9-a8dca67dea84\") " pod="openshift-image-registry/node-ca-c2d4p" Jul 08 17:55:58.681017 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.680537 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a1adfb2-9a71-43a3-892f-41b2881f1fe8-system-cni-dir\") pod \"multus-additional-cni-plugins-pc728\" (UID: \"8a1adfb2-9a71-43a3-892f-41b2881f1fe8\") " pod="openshift-multus/multus-additional-cni-plugins-pc728" Jul 08 17:55:58.681017 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.680558 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a1adfb2-9a71-43a3-892f-41b2881f1fe8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pc728\" (UID: \"8a1adfb2-9a71-43a3-892f-41b2881f1fe8\") " pod="openshift-multus/multus-additional-cni-plugins-pc728" Jul 08 17:55:58.681017 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.680583 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/088e9df1-9c28-430a-a67d-c8ac11e6564e-hosts-file\") pod \"node-resolver-cxg6h\" (UID: \"088e9df1-9c28-430a-a67d-c8ac11e6564e\") " pod="openshift-dns/node-resolver-cxg6h" Jul 08 17:55:58.681017 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.680611 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-systemd-units\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.681017 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.680635 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-etc-openvswitch\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.681017 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.680657 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-node-log\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.681017 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.680680 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34698452-3dd9-43df-a496-5971c144095b-original-pull-secret\") pod \"global-pull-secret-syncer-t6rk4\" (UID: \"34698452-3dd9-43df-a496-5971c144095b\") " pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:55:58.681017 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:58.680780 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:55:58.681017 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:58.680850 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34698452-3dd9-43df-a496-5971c144095b-original-pull-secret podName:34698452-3dd9-43df-a496-5971c144095b nodeName:}" failed. No retries permitted until 2026-07-08 17:55:59.180830373 +0000 UTC m=+3.120637795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34698452-3dd9-43df-a496-5971c144095b-original-pull-secret") pod "global-pull-secret-syncer-t6rk4" (UID: "34698452-3dd9-43df-a496-5971c144095b") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:55:58.681017 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.680877 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a1adfb2-9a71-43a3-892f-41b2881f1fe8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pc728\" (UID: \"8a1adfb2-9a71-43a3-892f-41b2881f1fe8\") " pod="openshift-multus/multus-additional-cni-plugins-pc728" Jul 08 17:55:58.681017 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.680912 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/088e9df1-9c28-430a-a67d-c8ac11e6564e-hosts-file\") pod \"node-resolver-cxg6h\" (UID: \"088e9df1-9c28-430a-a67d-c8ac11e6564e\") " pod="openshift-dns/node-resolver-cxg6h" Jul 08 17:55:58.681017 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.680947 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f628956a-833b-4922-8da3-9a95c252175e-env-overrides\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.681017 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.680955 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a1adfb2-9a71-43a3-892f-41b2881f1fe8-system-cni-dir\") pod \"multus-additional-cni-plugins-pc728\" (UID: \"8a1adfb2-9a71-43a3-892f-41b2881f1fe8\") " pod="openshift-multus/multus-additional-cni-plugins-pc728" Jul 08 17:55:58.681017 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.680974 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-run-openvswitch\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.681017 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681001 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-host-run-ovn-kubernetes\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.682060 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681007 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-256jj\" (UniqueName: \"kubernetes.io/projected/8a1adfb2-9a71-43a3-892f-41b2881f1fe8-kube-api-access-256jj\") pod \"multus-additional-cni-plugins-pc728\" (UID: \"8a1adfb2-9a71-43a3-892f-41b2881f1fe8\") " pod="openshift-multus/multus-additional-cni-plugins-pc728" Jul 08 17:55:58.682060 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681029 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/34698452-3dd9-43df-a496-5971c144095b-dbus\") pod \"global-pull-secret-syncer-t6rk4\" (UID: \"34698452-3dd9-43df-a496-5971c144095b\") " pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:55:58.682060 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681049 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-node-log\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.682060 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681053 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-run-systemd\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.682060 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681085 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-run-systemd\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.682060 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681089 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a1adfb2-9a71-43a3-892f-41b2881f1fe8-cni-binary-copy\") pod \"multus-additional-cni-plugins-pc728\" (UID: \"8a1adfb2-9a71-43a3-892f-41b2881f1fe8\") " pod="openshift-multus/multus-additional-cni-plugins-pc728" Jul 08 17:55:58.682060 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681116 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-var-lib-openvswitch\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.682060 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681138 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-log-socket\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.682060 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681162 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8a1adfb2-9a71-43a3-892f-41b2881f1fe8-os-release\") pod \"multus-additional-cni-plugins-pc728\" (UID: \"8a1adfb2-9a71-43a3-892f-41b2881f1fe8\") " pod="openshift-multus/multus-additional-cni-plugins-pc728" Jul 08 17:55:58.682060 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681202 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t9ws\" (UniqueName: \"kubernetes.io/projected/f628956a-833b-4922-8da3-9a95c252175e-kube-api-access-9t9ws\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.682060 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681211 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/549e5f27-43e4-43b4-b0d9-a8dca67dea84-serviceca\") pod \"node-ca-c2d4p\" (UID: \"549e5f27-43e4-43b4-b0d9-a8dca67dea84\") " pod="openshift-image-registry/node-ca-c2d4p" Jul 08 17:55:58.682060 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681276 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-systemd-units\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.682060 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681230 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgt6k\" (UniqueName: \"kubernetes.io/projected/088e9df1-9c28-430a-a67d-c8ac11e6564e-kube-api-access-kgt6k\") pod \"node-resolver-cxg6h\" (UID: \"088e9df1-9c28-430a-a67d-c8ac11e6564e\") " pod="openshift-dns/node-resolver-cxg6h" Jul 08 17:55:58.682060 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681319 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-etc-openvswitch\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.682060 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681326 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-run-ovn\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.682060 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681340 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-run-openvswitch\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.682060 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681358 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv477\" (UniqueName: \"kubernetes.io/projected/549e5f27-43e4-43b4-b0d9-a8dca67dea84-kube-api-access-pv477\") pod \"node-ca-c2d4p\" (UID: \"549e5f27-43e4-43b4-b0d9-a8dca67dea84\") " pod="openshift-image-registry/node-ca-c2d4p" Jul 08 17:55:58.682907 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681386 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8a1adfb2-9a71-43a3-892f-41b2881f1fe8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pc728\" (UID: \"8a1adfb2-9a71-43a3-892f-41b2881f1fe8\") " pod="openshift-multus/multus-additional-cni-plugins-pc728" Jul 08 17:55:58.682907 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681416 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-host-cni-bin\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.682907 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681423 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/34698452-3dd9-43df-a496-5971c144095b-dbus\") pod \"global-pull-secret-syncer-t6rk4\" (UID: \"34698452-3dd9-43df-a496-5971c144095b\") " pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:55:58.682907 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681439 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f628956a-833b-4922-8da3-9a95c252175e-ovn-node-metrics-cert\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.682907 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681463 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/088e9df1-9c28-430a-a67d-c8ac11e6564e-tmp-dir\") pod \"node-resolver-cxg6h\" (UID: \"088e9df1-9c28-430a-a67d-c8ac11e6564e\") " pod="openshift-dns/node-resolver-cxg6h" Jul 08 17:55:58.682907 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681466 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-log-socket\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.682907 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681493 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-host-cni-netd\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.682907 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681519 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f628956a-833b-4922-8da3-9a95c252175e-ovnkube-script-lib\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.682907 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681544 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/34698452-3dd9-43df-a496-5971c144095b-kubelet-config\") pod \"global-pull-secret-syncer-t6rk4\" (UID: \"34698452-3dd9-43df-a496-5971c144095b\") " pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:55:58.682907 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681551 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-host-cni-bin\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.682907 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681571 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-host-run-netns\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.682907 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681595 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/549e5f27-43e4-43b4-b0d9-a8dca67dea84-host\") pod \"node-ca-c2d4p\" (UID: \"549e5f27-43e4-43b4-b0d9-a8dca67dea84\") " pod="openshift-image-registry/node-ca-c2d4p" Jul 08 17:55:58.682907 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681605 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-run-ovn\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.682907 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681619 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8a1adfb2-9a71-43a3-892f-41b2881f1fe8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pc728\" (UID: \"8a1adfb2-9a71-43a3-892f-41b2881f1fe8\") " pod="openshift-multus/multus-additional-cni-plugins-pc728" Jul 08 17:55:58.682907 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681650 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-host-kubelet\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.682907 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681680 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.682907 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681707 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f628956a-833b-4922-8da3-9a95c252175e-ovnkube-config\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.683702 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681742 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk2vb\" (UniqueName: \"kubernetes.io/projected/b3fffa77-4964-4e33-bb38-fd4483bbd32d-kube-api-access-zk2vb\") pod \"network-check-target-k678l\" (UID: \"b3fffa77-4964-4e33-bb38-fd4483bbd32d\") " pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:55:58.683702 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681769 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a1adfb2-9a71-43a3-892f-41b2881f1fe8-cnibin\") pod \"multus-additional-cni-plugins-pc728\" (UID: \"8a1adfb2-9a71-43a3-892f-41b2881f1fe8\") " pod="openshift-multus/multus-additional-cni-plugins-pc728" Jul 08 17:55:58.683702 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681573 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8a1adfb2-9a71-43a3-892f-41b2881f1fe8-os-release\") pod \"multus-additional-cni-plugins-pc728\" (UID: \"8a1adfb2-9a71-43a3-892f-41b2881f1fe8\") " pod="openshift-multus/multus-additional-cni-plugins-pc728" Jul 08 17:55:58.683702 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681799 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-host-slash\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.683702 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681869 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-host-slash\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.683702 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681874 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a1adfb2-9a71-43a3-892f-41b2881f1fe8-cni-binary-copy\") pod \"multus-additional-cni-plugins-pc728\" (UID: \"8a1adfb2-9a71-43a3-892f-41b2881f1fe8\") " pod="openshift-multus/multus-additional-cni-plugins-pc728" Jul 08 17:55:58.683702 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681923 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/549e5f27-43e4-43b4-b0d9-a8dca67dea84-host\") pod \"node-ca-c2d4p\" (UID: \"549e5f27-43e4-43b4-b0d9-a8dca67dea84\") " pod="openshift-image-registry/node-ca-c2d4p" Jul 08 17:55:58.683702 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681923 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-host-cni-netd\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.683702 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.682064 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f628956a-833b-4922-8da3-9a95c252175e-env-overrides\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.683702 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.681518 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-var-lib-openvswitch\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.683702 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.682105 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8a1adfb2-9a71-43a3-892f-41b2881f1fe8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pc728\" (UID: \"8a1adfb2-9a71-43a3-892f-41b2881f1fe8\") " pod="openshift-multus/multus-additional-cni-plugins-pc728" Jul 08 17:55:58.683702 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.682156 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/34698452-3dd9-43df-a496-5971c144095b-kubelet-config\") pod \"global-pull-secret-syncer-t6rk4\" (UID: \"34698452-3dd9-43df-a496-5971c144095b\") " pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:55:58.683702 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.682215 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/088e9df1-9c28-430a-a67d-c8ac11e6564e-tmp-dir\") pod \"node-resolver-cxg6h\" (UID: \"088e9df1-9c28-430a-a67d-c8ac11e6564e\") " pod="openshift-dns/node-resolver-cxg6h" Jul 08 17:55:58.683702 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.682225 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-host-run-netns\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.683702 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.682270 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-host-kubelet\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.683702 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.682285 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f628956a-833b-4922-8da3-9a95c252175e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.683702 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.682340 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a1adfb2-9a71-43a3-892f-41b2881f1fe8-cnibin\") pod \"multus-additional-cni-plugins-pc728\" (UID: \"8a1adfb2-9a71-43a3-892f-41b2881f1fe8\") " pod="openshift-multus/multus-additional-cni-plugins-pc728" Jul 08 17:55:58.684552 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.682384 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8a1adfb2-9a71-43a3-892f-41b2881f1fe8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pc728\" (UID: \"8a1adfb2-9a71-43a3-892f-41b2881f1fe8\") " pod="openshift-multus/multus-additional-cni-plugins-pc728" Jul 08 17:55:58.684552 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.682601 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f628956a-833b-4922-8da3-9a95c252175e-ovnkube-config\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.684552 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.682605 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f628956a-833b-4922-8da3-9a95c252175e-ovnkube-script-lib\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.685076 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.685033 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f628956a-833b-4922-8da3-9a95c252175e-ovn-node-metrics-cert\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.692671 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:58.692404 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:55:58.692671 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:58.692423 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:55:58.692671 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:58.692436 2579 projected.go:196] Error preparing data for projected volume kube-api-access-zk2vb for pod openshift-network-diagnostics/network-check-target-k678l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:55:58.692671 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:58.692503 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3fffa77-4964-4e33-bb38-fd4483bbd32d-kube-api-access-zk2vb podName:b3fffa77-4964-4e33-bb38-fd4483bbd32d nodeName:}" failed. No retries permitted until 2026-07-08 17:55:59.19248574 +0000 UTC m=+3.132293162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zk2vb" (UniqueName: "kubernetes.io/projected/b3fffa77-4964-4e33-bb38-fd4483bbd32d-kube-api-access-zk2vb") pod "network-check-target-k678l" (UID: "b3fffa77-4964-4e33-bb38-fd4483bbd32d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:55:58.697084 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.697061 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t9ws\" (UniqueName: \"kubernetes.io/projected/f628956a-833b-4922-8da3-9a95c252175e-kube-api-access-9t9ws\") pod \"ovnkube-node-mqgcf\" (UID: \"f628956a-833b-4922-8da3-9a95c252175e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.697522 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.697502 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv477\" (UniqueName: \"kubernetes.io/projected/549e5f27-43e4-43b4-b0d9-a8dca67dea84-kube-api-access-pv477\") pod \"node-ca-c2d4p\" (UID: \"549e5f27-43e4-43b4-b0d9-a8dca67dea84\") " pod="openshift-image-registry/node-ca-c2d4p" Jul 08 17:55:58.698075 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.698012 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-256jj\" (UniqueName: \"kubernetes.io/projected/8a1adfb2-9a71-43a3-892f-41b2881f1fe8-kube-api-access-256jj\") pod \"multus-additional-cni-plugins-pc728\" (UID: \"8a1adfb2-9a71-43a3-892f-41b2881f1fe8\") " pod="openshift-multus/multus-additional-cni-plugins-pc728" Jul 08 17:55:58.699883 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.699840 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgt6k\" (UniqueName: \"kubernetes.io/projected/088e9df1-9c28-430a-a67d-c8ac11e6564e-kube-api-access-kgt6k\") pod \"node-resolver-cxg6h\" (UID: \"088e9df1-9c28-430a-a67d-c8ac11e6564e\") " pod="openshift-dns/node-resolver-cxg6h" Jul 08 17:55:58.762103 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.761930 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jnnhn" Jul 08 17:55:58.768518 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.768283 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb" Jul 08 17:55:58.775746 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.775565 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mrs6x" Jul 08 17:55:58.775963 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:58.775937 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97b4b0ca_1889_469e_bb9e_c71b128caa10.slice/crio-3f92a4cccb76a08fef3c3512afe30f44de796b71d756f1fc86aaf714c62faa33 WatchSource:0}: Error finding container 3f92a4cccb76a08fef3c3512afe30f44de796b71d756f1fc86aaf714c62faa33: Status 404 returned error can't find the container with id 3f92a4cccb76a08fef3c3512afe30f44de796b71d756f1fc86aaf714c62faa33 Jul 08 17:55:58.781100 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.780998 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xmvk2" Jul 08 17:55:58.781320 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:58.781298 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce759c61_5b1d_42d8_8dd8_509daa858910.slice/crio-811ea76b2e15847ad82e34e82123d847b5b45db9e071c313f64c70f736b1d5de WatchSource:0}: Error finding container 811ea76b2e15847ad82e34e82123d847b5b45db9e071c313f64c70f736b1d5de: Status 404 returned error can't find the container with id 811ea76b2e15847ad82e34e82123d847b5b45db9e071c313f64c70f736b1d5de Jul 08 17:55:58.785766 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.785746 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" Jul 08 17:55:58.786806 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:58.786783 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01f209d5_dc76_42e1_a119_f9caaaee0961.slice/crio-a99961b5f37f386b132dca3ef40841e4c275a98dfa9a83cb898f926870ab476e WatchSource:0}: Error finding container a99961b5f37f386b132dca3ef40841e4c275a98dfa9a83cb898f926870ab476e: Status 404 returned error can't find the container with id a99961b5f37f386b132dca3ef40841e4c275a98dfa9a83cb898f926870ab476e Jul 08 17:55:58.790930 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.790897 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pc728" Jul 08 17:55:58.792586 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:58.792565 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2bc2a50_5b6e_42d2_9e28_e6d60a176fd9.slice/crio-879b47795409220768d187d775c03813e03f1443e9c232970b0141035d814984 WatchSource:0}: Error finding container 879b47795409220768d187d775c03813e03f1443e9c232970b0141035d814984: Status 404 returned error can't find the container with id 879b47795409220768d187d775c03813e03f1443e9c232970b0141035d814984 Jul 08 17:55:58.796428 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:58.796396 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod239c19ca_ad22_4864_b17c_feffccde78d9.slice/crio-37d237f668535df84f27840db54ba01bb9bc2e16c56833b76352a29487da4838 WatchSource:0}: Error finding container 37d237f668535df84f27840db54ba01bb9bc2e16c56833b76352a29487da4838: Status 404 returned error can't find the container with id 37d237f668535df84f27840db54ba01bb9bc2e16c56833b76352a29487da4838 Jul 08 17:55:58.797947 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.797562 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:55:58.803397 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.803333 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c2d4p" Jul 08 17:55:58.807088 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:58.806523 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a1adfb2_9a71_43a3_892f_41b2881f1fe8.slice/crio-8f853f18aae510b897884468191dd52a79ff7891083415f1256704db02d2049f WatchSource:0}: Error finding container 8f853f18aae510b897884468191dd52a79ff7891083415f1256704db02d2049f: Status 404 returned error can't find the container with id 8f853f18aae510b897884468191dd52a79ff7891083415f1256704db02d2049f Jul 08 17:55:58.808456 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:58.808436 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cxg6h" Jul 08 17:55:58.809372 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:58.809339 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf628956a_833b_4922_8da3_9a95c252175e.slice/crio-990c72af8e1e94937114af5c4b5ad6f44070d5f5b2035721b03c7b1658745725 WatchSource:0}: Error finding container 990c72af8e1e94937114af5c4b5ad6f44070d5f5b2035721b03c7b1658745725: Status 404 returned error can't find the container with id 990c72af8e1e94937114af5c4b5ad6f44070d5f5b2035721b03c7b1658745725 Jul 08 17:55:58.818573 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:58.818546 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod549e5f27_43e4_43b4_b0d9_a8dca67dea84.slice/crio-325b49b74834e58c240c7964416adaa0acfd456114ff87d6ca361c0d6cec48eb WatchSource:0}: Error finding container 325b49b74834e58c240c7964416adaa0acfd456114ff87d6ca361c0d6cec48eb: Status 404 returned error can't find the container with id 325b49b74834e58c240c7964416adaa0acfd456114ff87d6ca361c0d6cec48eb Jul 08 17:55:58.822646 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:55:58.822621 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod088e9df1_9c28_430a_a67d_c8ac11e6564e.slice/crio-9f271311e4ee8b53c7585f82ef6c44ffb5464ee12bb91d227c3bfced1307bb5f WatchSource:0}: Error finding container 9f271311e4ee8b53c7585f82ef6c44ffb5464ee12bb91d227c3bfced1307bb5f: Status 404 returned error can't find the container with id 9f271311e4ee8b53c7585f82ef6c44ffb5464ee12bb91d227c3bfced1307bb5f Jul 08 17:55:59.084364 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:59.084280 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs\") pod \"network-metrics-daemon-mrv85\" (UID: \"077db27a-abe8-4647-9b18-9d59458f3f9c\") " pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:55:59.084533 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:59.084429 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:55:59.084533 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:59.084500 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs podName:077db27a-abe8-4647-9b18-9d59458f3f9c nodeName:}" failed. No retries permitted until 2026-07-08 17:56:00.084479583 +0000 UTC m=+4.024286992 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs") pod "network-metrics-daemon-mrv85" (UID: "077db27a-abe8-4647-9b18-9d59458f3f9c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:55:59.185093 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:59.185058 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34698452-3dd9-43df-a496-5971c144095b-original-pull-secret\") pod \"global-pull-secret-syncer-t6rk4\" (UID: \"34698452-3dd9-43df-a496-5971c144095b\") " pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:55:59.185326 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:59.185305 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:55:59.185403 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:59.185384 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34698452-3dd9-43df-a496-5971c144095b-original-pull-secret podName:34698452-3dd9-43df-a496-5971c144095b nodeName:}" failed. No retries permitted until 2026-07-08 17:56:00.185364121 +0000 UTC m=+4.125171540 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34698452-3dd9-43df-a496-5971c144095b-original-pull-secret") pod "global-pull-secret-syncer-t6rk4" (UID: "34698452-3dd9-43df-a496-5971c144095b") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:55:59.285836 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:59.285802 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk2vb\" (UniqueName: \"kubernetes.io/projected/b3fffa77-4964-4e33-bb38-fd4483bbd32d-kube-api-access-zk2vb\") pod \"network-check-target-k678l\" (UID: \"b3fffa77-4964-4e33-bb38-fd4483bbd32d\") " pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:55:59.286004 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:59.285989 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:55:59.286046 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:59.286009 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:55:59.286046 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:59.286022 2579 projected.go:196] Error preparing data for projected volume kube-api-access-zk2vb for pod openshift-network-diagnostics/network-check-target-k678l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:55:59.286122 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:55:59.286077 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3fffa77-4964-4e33-bb38-fd4483bbd32d-kube-api-access-zk2vb podName:b3fffa77-4964-4e33-bb38-fd4483bbd32d nodeName:}" failed. No retries permitted until 2026-07-08 17:56:00.286062572 +0000 UTC m=+4.225869997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zk2vb" (UniqueName: "kubernetes.io/projected/b3fffa77-4964-4e33-bb38-fd4483bbd32d-kube-api-access-zk2vb") pod "network-check-target-k678l" (UID: "b3fffa77-4964-4e33-bb38-fd4483bbd32d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:55:59.507548 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:59.507460 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 17:50:58 +0000 UTC" deadline="2028-01-18 00:45:27.941470356 +0000 UTC" Jul 08 17:55:59.507548 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:59.507497 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13398h49m28.433977393s" Jul 08 17:55:59.624057 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:59.624005 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cxg6h" event={"ID":"088e9df1-9c28-430a-a67d-c8ac11e6564e","Type":"ContainerStarted","Data":"9f271311e4ee8b53c7585f82ef6c44ffb5464ee12bb91d227c3bfced1307bb5f"} Jul 08 17:55:59.625425 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:59.625383 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pc728" event={"ID":"8a1adfb2-9a71-43a3-892f-41b2881f1fe8","Type":"ContainerStarted","Data":"8f853f18aae510b897884468191dd52a79ff7891083415f1256704db02d2049f"} Jul 08 17:55:59.626688 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:59.626648 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" event={"ID":"239c19ca-ad22-4864-b17c-feffccde78d9","Type":"ContainerStarted","Data":"37d237f668535df84f27840db54ba01bb9bc2e16c56833b76352a29487da4838"} Jul 08 17:55:59.627944 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:59.627918 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xmvk2" event={"ID":"a2bc2a50-5b6e-42d2-9e28-e6d60a176fd9","Type":"ContainerStarted","Data":"879b47795409220768d187d775c03813e03f1443e9c232970b0141035d814984"} Jul 08 17:55:59.629224 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:59.629163 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jnnhn" event={"ID":"97b4b0ca-1889-469e-bb9e-c71b128caa10","Type":"ContainerStarted","Data":"3f92a4cccb76a08fef3c3512afe30f44de796b71d756f1fc86aaf714c62faa33"} Jul 08 17:55:59.630372 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:59.630331 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c2d4p" event={"ID":"549e5f27-43e4-43b4-b0d9-a8dca67dea84","Type":"ContainerStarted","Data":"325b49b74834e58c240c7964416adaa0acfd456114ff87d6ca361c0d6cec48eb"} Jul 08 17:55:59.631635 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:59.631608 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" event={"ID":"f628956a-833b-4922-8da3-9a95c252175e","Type":"ContainerStarted","Data":"990c72af8e1e94937114af5c4b5ad6f44070d5f5b2035721b03c7b1658745725"} Jul 08 17:55:59.633087 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:59.633053 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mrs6x" event={"ID":"01f209d5-dc76-42e1-a119-f9caaaee0961","Type":"ContainerStarted","Data":"a99961b5f37f386b132dca3ef40841e4c275a98dfa9a83cb898f926870ab476e"} Jul 08 17:55:59.634469 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:55:59.634449 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb" event={"ID":"ce759c61-5b1d-42d8-8dd8-509daa858910","Type":"ContainerStarted","Data":"811ea76b2e15847ad82e34e82123d847b5b45db9e071c313f64c70f736b1d5de"} Jul 08 17:56:00.054931 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:00.054711 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:56:00.093293 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:00.093253 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs\") pod \"network-metrics-daemon-mrv85\" (UID: \"077db27a-abe8-4647-9b18-9d59458f3f9c\") " pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:56:00.093471 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:00.093418 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:56:00.093531 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:00.093499 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs podName:077db27a-abe8-4647-9b18-9d59458f3f9c nodeName:}" failed. No retries permitted until 2026-07-08 17:56:02.093478819 +0000 UTC m=+6.033286227 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs") pod "network-metrics-daemon-mrv85" (UID: "077db27a-abe8-4647-9b18-9d59458f3f9c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:56:00.194648 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:00.194613 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34698452-3dd9-43df-a496-5971c144095b-original-pull-secret\") pod \"global-pull-secret-syncer-t6rk4\" (UID: \"34698452-3dd9-43df-a496-5971c144095b\") " pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:56:00.194873 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:00.194798 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:56:00.194993 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:00.194874 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34698452-3dd9-43df-a496-5971c144095b-original-pull-secret podName:34698452-3dd9-43df-a496-5971c144095b nodeName:}" failed. No retries permitted until 2026-07-08 17:56:02.194855714 +0000 UTC m=+6.134663140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34698452-3dd9-43df-a496-5971c144095b-original-pull-secret") pod "global-pull-secret-syncer-t6rk4" (UID: "34698452-3dd9-43df-a496-5971c144095b") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:56:00.295167 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:00.295128 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk2vb\" (UniqueName: \"kubernetes.io/projected/b3fffa77-4964-4e33-bb38-fd4483bbd32d-kube-api-access-zk2vb\") pod \"network-check-target-k678l\" (UID: \"b3fffa77-4964-4e33-bb38-fd4483bbd32d\") " pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:56:00.295386 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:00.295367 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:56:00.295445 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:00.295393 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:56:00.295445 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:00.295406 2579 projected.go:196] Error preparing data for projected volume kube-api-access-zk2vb for pod openshift-network-diagnostics/network-check-target-k678l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:56:00.295557 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:00.295466 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3fffa77-4964-4e33-bb38-fd4483bbd32d-kube-api-access-zk2vb podName:b3fffa77-4964-4e33-bb38-fd4483bbd32d nodeName:}" failed. No retries permitted until 2026-07-08 17:56:02.295446911 +0000 UTC m=+6.235254338 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zk2vb" (UniqueName: "kubernetes.io/projected/b3fffa77-4964-4e33-bb38-fd4483bbd32d-kube-api-access-zk2vb") pod "network-check-target-k678l" (UID: "b3fffa77-4964-4e33-bb38-fd4483bbd32d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:56:00.508781 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:00.508621 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 17:50:58 +0000 UTC" deadline="2027-12-07 06:03:17.870429764 +0000 UTC" Jul 08 17:56:00.508781 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:00.508692 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12396h7m17.361769313s" Jul 08 17:56:00.616946 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:00.616042 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:56:00.616946 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:00.616287 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrv85" podUID="077db27a-abe8-4647-9b18-9d59458f3f9c" Jul 08 17:56:00.616946 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:00.616861 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:56:00.617239 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:00.616991 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6rk4" podUID="34698452-3dd9-43df-a496-5971c144095b" Jul 08 17:56:00.617239 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:00.617050 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:56:00.617239 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:00.617135 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k678l" podUID="b3fffa77-4964-4e33-bb38-fd4483bbd32d" Jul 08 17:56:02.112853 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:02.112613 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs\") pod \"network-metrics-daemon-mrv85\" (UID: \"077db27a-abe8-4647-9b18-9d59458f3f9c\") " pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:56:02.112853 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:02.112778 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:56:02.112853 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:02.112852 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs podName:077db27a-abe8-4647-9b18-9d59458f3f9c nodeName:}" failed. No retries permitted until 2026-07-08 17:56:06.112830833 +0000 UTC m=+10.052638242 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs") pod "network-metrics-daemon-mrv85" (UID: "077db27a-abe8-4647-9b18-9d59458f3f9c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:56:02.213297 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:02.213262 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34698452-3dd9-43df-a496-5971c144095b-original-pull-secret\") pod \"global-pull-secret-syncer-t6rk4\" (UID: \"34698452-3dd9-43df-a496-5971c144095b\") " pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:56:02.213453 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:02.213437 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:56:02.213520 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:02.213513 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34698452-3dd9-43df-a496-5971c144095b-original-pull-secret podName:34698452-3dd9-43df-a496-5971c144095b nodeName:}" failed. No retries permitted until 2026-07-08 17:56:06.213492748 +0000 UTC m=+10.153300174 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34698452-3dd9-43df-a496-5971c144095b-original-pull-secret") pod "global-pull-secret-syncer-t6rk4" (UID: "34698452-3dd9-43df-a496-5971c144095b") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:56:02.313856 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:02.313819 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk2vb\" (UniqueName: \"kubernetes.io/projected/b3fffa77-4964-4e33-bb38-fd4483bbd32d-kube-api-access-zk2vb\") pod \"network-check-target-k678l\" (UID: \"b3fffa77-4964-4e33-bb38-fd4483bbd32d\") " pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:56:02.314070 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:02.314015 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:56:02.314070 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:02.314044 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:56:02.314070 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:02.314058 2579 projected.go:196] Error preparing data for projected volume kube-api-access-zk2vb for pod openshift-network-diagnostics/network-check-target-k678l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:56:02.314252 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:02.314125 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3fffa77-4964-4e33-bb38-fd4483bbd32d-kube-api-access-zk2vb podName:b3fffa77-4964-4e33-bb38-fd4483bbd32d nodeName:}" failed. No retries permitted until 2026-07-08 17:56:06.314106815 +0000 UTC m=+10.253914241 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zk2vb" (UniqueName: "kubernetes.io/projected/b3fffa77-4964-4e33-bb38-fd4483bbd32d-kube-api-access-zk2vb") pod "network-check-target-k678l" (UID: "b3fffa77-4964-4e33-bb38-fd4483bbd32d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:56:02.614115 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:02.614090 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:56:02.614240 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:02.614091 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:56:02.614240 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:02.614205 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k678l" podUID="b3fffa77-4964-4e33-bb38-fd4483bbd32d" Jul 08 17:56:02.614351 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:02.614093 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:56:02.614351 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:02.614298 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrv85" podUID="077db27a-abe8-4647-9b18-9d59458f3f9c" Jul 08 17:56:02.614453 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:02.614381 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6rk4" podUID="34698452-3dd9-43df-a496-5971c144095b" Jul 08 17:56:04.613998 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:04.613906 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:56:04.613998 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:04.613936 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:56:04.614620 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:04.614043 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6rk4" podUID="34698452-3dd9-43df-a496-5971c144095b" Jul 08 17:56:04.614620 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:04.614153 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrv85" podUID="077db27a-abe8-4647-9b18-9d59458f3f9c" Jul 08 17:56:04.614620 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:04.614229 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:56:04.614620 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:04.614305 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k678l" podUID="b3fffa77-4964-4e33-bb38-fd4483bbd32d" Jul 08 17:56:05.649933 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:05.649601 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal" event={"ID":"1822161f850ef2b3317aaf5916b61399","Type":"ContainerStarted","Data":"6e3364033a3548a2b2578596b996edd777cae67716fdb03c6aee1b5047a439a4"} Jul 08 17:56:05.665492 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:05.665433 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal" podStartSLOduration=8.665419779 podStartE2EDuration="8.665419779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:55:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:56:05.665164758 +0000 UTC m=+9.604972186" watchObservedRunningTime="2026-07-08 17:56:05.665419779 +0000 UTC m=+9.605227206" Jul 08 17:56:06.147496 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:06.147462 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs\") pod \"network-metrics-daemon-mrv85\" (UID: \"077db27a-abe8-4647-9b18-9d59458f3f9c\") " pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:56:06.147638 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:06.147611 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:56:06.147702 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:06.147676 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs podName:077db27a-abe8-4647-9b18-9d59458f3f9c nodeName:}" failed. No retries permitted until 2026-07-08 17:56:14.147657506 +0000 UTC m=+18.087464912 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs") pod "network-metrics-daemon-mrv85" (UID: "077db27a-abe8-4647-9b18-9d59458f3f9c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:56:06.248039 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:06.247984 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34698452-3dd9-43df-a496-5971c144095b-original-pull-secret\") pod \"global-pull-secret-syncer-t6rk4\" (UID: \"34698452-3dd9-43df-a496-5971c144095b\") " pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:56:06.248207 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:06.248144 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:56:06.248287 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:06.248231 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34698452-3dd9-43df-a496-5971c144095b-original-pull-secret podName:34698452-3dd9-43df-a496-5971c144095b nodeName:}" failed. No retries permitted until 2026-07-08 17:56:14.248213675 +0000 UTC m=+18.188021081 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34698452-3dd9-43df-a496-5971c144095b-original-pull-secret") pod "global-pull-secret-syncer-t6rk4" (UID: "34698452-3dd9-43df-a496-5971c144095b") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:56:06.349611 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:06.348961 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk2vb\" (UniqueName: \"kubernetes.io/projected/b3fffa77-4964-4e33-bb38-fd4483bbd32d-kube-api-access-zk2vb\") pod \"network-check-target-k678l\" (UID: \"b3fffa77-4964-4e33-bb38-fd4483bbd32d\") " pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:56:06.349611 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:06.349165 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:56:06.349611 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:06.349199 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:56:06.349611 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:06.349212 2579 projected.go:196] Error preparing data for projected volume kube-api-access-zk2vb for pod openshift-network-diagnostics/network-check-target-k678l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:56:06.349611 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:06.349275 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3fffa77-4964-4e33-bb38-fd4483bbd32d-kube-api-access-zk2vb podName:b3fffa77-4964-4e33-bb38-fd4483bbd32d nodeName:}" failed. No retries permitted until 2026-07-08 17:56:14.349256092 +0000 UTC m=+18.289063517 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zk2vb" (UniqueName: "kubernetes.io/projected/b3fffa77-4964-4e33-bb38-fd4483bbd32d-kube-api-access-zk2vb") pod "network-check-target-k678l" (UID: "b3fffa77-4964-4e33-bb38-fd4483bbd32d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:56:06.614204 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:06.614066 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:56:06.614364 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:06.614200 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:56:06.614364 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:06.614269 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:56:06.614364 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:06.614336 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k678l" podUID="b3fffa77-4964-4e33-bb38-fd4483bbd32d" Jul 08 17:56:06.614535 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:06.614409 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrv85" podUID="077db27a-abe8-4647-9b18-9d59458f3f9c" Jul 08 17:56:06.614644 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:06.614605 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6rk4" podUID="34698452-3dd9-43df-a496-5971c144095b" Jul 08 17:56:06.656051 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:06.655922 2579 generic.go:356] "Generic (PLEG): container finished" podID="d3621fce897cec71d75ea532d62b7211" containerID="92c4746adf80bdf45a4e6f0e61b6af8688f2c4edf1f366f8c210815cfb0254d1" exitCode=0 Jul 08 17:56:06.656590 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:06.656054 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal" event={"ID":"d3621fce897cec71d75ea532d62b7211","Type":"ContainerDied","Data":"92c4746adf80bdf45a4e6f0e61b6af8688f2c4edf1f366f8c210815cfb0254d1"} Jul 08 17:56:06.659285 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:06.659233 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c2d4p" event={"ID":"549e5f27-43e4-43b4-b0d9-a8dca67dea84","Type":"ContainerStarted","Data":"6287b3ccd8ba7a53851a789b1b975e45acb6851225d3a257df4c259762c4c5f9"} Jul 08 17:56:06.661857 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:06.661821 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb" event={"ID":"ce759c61-5b1d-42d8-8dd8-509daa858910","Type":"ContainerStarted","Data":"b59dfdbb9e8930f57ab98c46f5cbefa30b67e606f423232efc3bc1104fb6d2ad"} Jul 08 17:56:06.663901 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:06.663877 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cxg6h" event={"ID":"088e9df1-9c28-430a-a67d-c8ac11e6564e","Type":"ContainerStarted","Data":"3df9c9e9df707c1bde914f6a019abee8b60c6c103adc2ff7cbe8770223afdc22"} Jul 08 17:56:06.666289 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:06.665923 2579 generic.go:356] "Generic (PLEG): container finished" podID="8a1adfb2-9a71-43a3-892f-41b2881f1fe8" containerID="3790fc88e469ec9c0f3e5ff330ebaca494d335c647cfeac1237bc790dddf1768" exitCode=0 Jul 08 17:56:06.666289 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:06.665996 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pc728" event={"ID":"8a1adfb2-9a71-43a3-892f-41b2881f1fe8","Type":"ContainerDied","Data":"3790fc88e469ec9c0f3e5ff330ebaca494d335c647cfeac1237bc790dddf1768"} Jul 08 17:56:06.668865 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:06.668811 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jnnhn" event={"ID":"97b4b0ca-1889-469e-bb9e-c71b128caa10","Type":"ContainerStarted","Data":"2234c3100c1c6381bf3859aa9d78e8e599d66f264ebe09c74f02cb37cb2bb233"} Jul 08 17:56:06.728440 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:06.728376 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-c2d4p" podStartSLOduration=4.300074622 podStartE2EDuration="10.728353281s" totalImagesPullingTime="6.428278659s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:55:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:56:06.712209621 +0000 UTC m=+10.652017051" watchObservedRunningTime="2026-07-08 17:56:06.728353281 +0000 UTC m=+10.668160709" Jul 08 17:56:06.745757 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:06.745468 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jnnhn" podStartSLOduration=4.282244048 podStartE2EDuration="10.745447878s" totalImagesPullingTime="6.46320383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:55:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:56:06.72928598 +0000 UTC m=+10.669093409" watchObservedRunningTime="2026-07-08 17:56:06.745447878 +0000 UTC m=+10.685255308" Jul 08 17:56:06.746190 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:06.746137 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cxg6h" podStartSLOduration=2.395638298 podStartE2EDuration="9.746122547s" totalImagesPullingTime="7.350484249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:55:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:56:06.745578723 +0000 UTC m=+10.685386152" watchObservedRunningTime="2026-07-08 17:56:06.746122547 +0000 UTC m=+10.685929976" Jul 08 17:56:07.672921 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:07.672875 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xmvk2" event={"ID":"a2bc2a50-5b6e-42d2-9e28-e6d60a176fd9","Type":"ContainerStarted","Data":"dce2cc7738056ca729d85ac553fffb64854aef92271878431bd4c76b33d60874"} Jul 08 17:56:07.675380 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:07.675349 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal" event={"ID":"d3621fce897cec71d75ea532d62b7211","Type":"ContainerStarted","Data":"49fd952c76a818d4747f11411f9492f3a8d48b4eb2f8e96f139b6cf163f583c1"} Jul 08 17:56:07.689227 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:07.689157 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xmvk2" podStartSLOduration=4.301386429 podStartE2EDuration="11.689135194s" totalImagesPullingTime="7.387748765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:55:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:56:07.688356064 +0000 UTC m=+11.628163492" watchObservedRunningTime="2026-07-08 17:56:07.689135194 +0000 UTC m=+11.628942620" Jul 08 17:56:07.703543 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:07.703493 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal" podStartSLOduration=10.703472543 podStartE2EDuration="10.703472543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:55:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:56:07.702716951 +0000 UTC m=+11.642524380" watchObservedRunningTime="2026-07-08 17:56:07.703472543 +0000 UTC m=+11.643279969" Jul 08 17:56:08.236113 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:08.236077 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jnnhn" Jul 08 17:56:08.236766 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:08.236721 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jnnhn" Jul 08 17:56:08.613680 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:08.613592 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:56:08.613856 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:08.613592 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:56:08.613856 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:08.613722 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k678l" podUID="b3fffa77-4964-4e33-bb38-fd4483bbd32d" Jul 08 17:56:08.613856 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:08.613736 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:56:08.613856 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:08.613797 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6rk4" podUID="34698452-3dd9-43df-a496-5971c144095b" Jul 08 17:56:08.614133 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:08.613873 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrv85" podUID="077db27a-abe8-4647-9b18-9d59458f3f9c" Jul 08 17:56:09.643238 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:09.643041 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 17:56:09.681769 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:09.681734 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb" event={"ID":"ce759c61-5b1d-42d8-8dd8-509daa858910","Type":"ContainerStarted","Data":"6a2347ef3a56ce5f701cf88513fc46f1864d6af641a8362501b2a5273f7f1909"} Jul 08 17:56:09.683272 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:09.683250 2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 17:56:09.683272 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:09.683262 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" event={"ID":"239c19ca-ad22-4864-b17c-feffccde78d9","Type":"ContainerStarted","Data":"afa77c772bd5e2595dda7b8af7de4b8ae9dfe8016fadd1664549a649b1b4648d"} Jul 08 17:56:09.700823 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:09.700729 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ngmzd" podStartSLOduration=2.971305024 podStartE2EDuration="13.700708273s" totalImagesPullingTime="10.729403249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:55:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:56:09.700144373 +0000 UTC m=+13.639951804" watchObservedRunningTime="2026-07-08 17:56:09.700708273 +0000 UTC m=+13.640515701" Jul 08 17:56:10.532978 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:10.532856 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T17:56:09.643235966Z","UUID":"c8399705-6ad2-499e-85e1-aa79d6239b17","Handler":null,"Name":"","Endpoint":""} Jul 08 17:56:10.534825 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:10.534528 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 17:56:10.534825 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:10.534572 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 17:56:10.613245 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:10.613201 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:56:10.613428 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:10.613359 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrv85" podUID="077db27a-abe8-4647-9b18-9d59458f3f9c" Jul 08 17:56:10.613592 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:10.613551 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:56:10.613686 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:10.613664 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k678l" podUID="b3fffa77-4964-4e33-bb38-fd4483bbd32d" Jul 08 17:56:10.613756 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:10.613720 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:56:10.613814 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:10.613793 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6rk4" podUID="34698452-3dd9-43df-a496-5971c144095b" Jul 08 17:56:11.689593 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:11.689543 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb" event={"ID":"ce759c61-5b1d-42d8-8dd8-509daa858910","Type":"ContainerStarted","Data":"0e82a4b58f713ba59abf2621790fe015d87ce59ed03629658d55459b1c19a86b"} Jul 08 17:56:11.715109 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:11.715063 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87khb" podStartSLOduration=4.789324233 podStartE2EDuration="15.715049924s" totalImagesPullingTime="10.925725691s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:55:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:56:11.714766544 +0000 UTC m=+15.654573972" watchObservedRunningTime="2026-07-08 17:56:11.715049924 +0000 UTC m=+15.654857350" Jul 08 17:56:12.614122 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:12.614090 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:56:12.614307 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:12.614244 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6rk4" podUID="34698452-3dd9-43df-a496-5971c144095b" Jul 08 17:56:12.614710 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:12.614689 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:56:12.614826 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:12.614804 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrv85" podUID="077db27a-abe8-4647-9b18-9d59458f3f9c" Jul 08 17:56:12.614962 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:12.614948 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:56:12.615047 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:12.615030 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k678l" podUID="b3fffa77-4964-4e33-bb38-fd4483bbd32d" Jul 08 17:56:14.212222 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:14.212184 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs\") pod \"network-metrics-daemon-mrv85\" (UID: \"077db27a-abe8-4647-9b18-9d59458f3f9c\") " pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:56:14.212772 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:14.212280 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:56:14.212772 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:14.212345 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs podName:077db27a-abe8-4647-9b18-9d59458f3f9c nodeName:}" failed. No retries permitted until 2026-07-08 17:56:30.212329857 +0000 UTC m=+34.152137263 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs") pod "network-metrics-daemon-mrv85" (UID: "077db27a-abe8-4647-9b18-9d59458f3f9c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:56:14.313447 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:14.313408 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34698452-3dd9-43df-a496-5971c144095b-original-pull-secret\") pod \"global-pull-secret-syncer-t6rk4\" (UID: \"34698452-3dd9-43df-a496-5971c144095b\") " pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:56:14.313612 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:14.313564 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:56:14.313659 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:14.313632 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34698452-3dd9-43df-a496-5971c144095b-original-pull-secret podName:34698452-3dd9-43df-a496-5971c144095b nodeName:}" failed. No retries permitted until 2026-07-08 17:56:30.313614021 +0000 UTC m=+34.253421431 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34698452-3dd9-43df-a496-5971c144095b-original-pull-secret") pod "global-pull-secret-syncer-t6rk4" (UID: "34698452-3dd9-43df-a496-5971c144095b") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:56:14.414506 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:14.414474 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk2vb\" (UniqueName: \"kubernetes.io/projected/b3fffa77-4964-4e33-bb38-fd4483bbd32d-kube-api-access-zk2vb\") pod \"network-check-target-k678l\" (UID: \"b3fffa77-4964-4e33-bb38-fd4483bbd32d\") " pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:56:14.414682 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:14.414656 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:56:14.414682 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:14.414675 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:56:14.414682 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:14.414684 2579 projected.go:196] Error preparing data for projected volume kube-api-access-zk2vb for pod openshift-network-diagnostics/network-check-target-k678l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:56:14.414809 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:14.414734 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3fffa77-4964-4e33-bb38-fd4483bbd32d-kube-api-access-zk2vb podName:b3fffa77-4964-4e33-bb38-fd4483bbd32d nodeName:}" failed. No retries permitted until 2026-07-08 17:56:30.41472016 +0000 UTC m=+34.354527565 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zk2vb" (UniqueName: "kubernetes.io/projected/b3fffa77-4964-4e33-bb38-fd4483bbd32d-kube-api-access-zk2vb") pod "network-check-target-k678l" (UID: "b3fffa77-4964-4e33-bb38-fd4483bbd32d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:56:14.613351 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:14.613264 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:56:14.613351 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:14.613280 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:56:14.613567 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:14.613397 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6rk4" podUID="34698452-3dd9-43df-a496-5971c144095b" Jul 08 17:56:14.613567 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:14.613481 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrv85" podUID="077db27a-abe8-4647-9b18-9d59458f3f9c" Jul 08 17:56:14.613567 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:14.613535 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:56:14.613725 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:14.613604 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k678l" podUID="b3fffa77-4964-4e33-bb38-fd4483bbd32d" Jul 08 17:56:16.614786 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:16.614752 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:56:16.615256 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:16.614835 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:56:16.615256 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:16.614852 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k678l" podUID="b3fffa77-4964-4e33-bb38-fd4483bbd32d" Jul 08 17:56:16.615256 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:16.614949 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrv85" podUID="077db27a-abe8-4647-9b18-9d59458f3f9c" Jul 08 17:56:16.615256 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:16.614961 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:56:16.615256 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:16.615053 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6rk4" podUID="34698452-3dd9-43df-a496-5971c144095b" Jul 08 17:56:18.613923 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:18.613887 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:56:18.614550 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:18.613887 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:56:18.614550 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:18.613895 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:56:18.614550 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:18.614055 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrv85" podUID="077db27a-abe8-4647-9b18-9d59458f3f9c" Jul 08 17:56:18.614550 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:18.614164 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6rk4" podUID="34698452-3dd9-43df-a496-5971c144095b" Jul 08 17:56:18.614550 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:18.614263 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k678l" podUID="b3fffa77-4964-4e33-bb38-fd4483bbd32d" Jul 08 17:56:20.613484 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:20.613437 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:56:20.614028 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:20.613448 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:56:20.614028 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:20.613575 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:56:20.614028 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:20.613570 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6rk4" podUID="34698452-3dd9-43df-a496-5971c144095b" Jul 08 17:56:20.614028 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:20.613681 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrv85" podUID="077db27a-abe8-4647-9b18-9d59458f3f9c" Jul 08 17:56:20.614028 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:20.613765 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k678l" podUID="b3fffa77-4964-4e33-bb38-fd4483bbd32d" Jul 08 17:56:22.613699 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:22.613494 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:56:22.614099 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:22.613569 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:56:22.614099 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:22.613819 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrv85" podUID="077db27a-abe8-4647-9b18-9d59458f3f9c" Jul 08 17:56:22.614099 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:22.613867 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k678l" podUID="b3fffa77-4964-4e33-bb38-fd4483bbd32d" Jul 08 17:56:22.614099 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:22.613646 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:56:22.614099 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:22.613967 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6rk4" podUID="34698452-3dd9-43df-a496-5971c144095b" Jul 08 17:56:22.716314 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:22.716282 2579 generic.go:356] "Generic (PLEG): container finished" podID="8a1adfb2-9a71-43a3-892f-41b2881f1fe8" containerID="f5bab4d77d2e70e7ad03d2a6626a5bf3a451448d5f4e1deffc3a0ef007f96ea2" exitCode=0 Jul 08 17:56:22.716483 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:22.716370 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pc728" event={"ID":"8a1adfb2-9a71-43a3-892f-41b2881f1fe8","Type":"ContainerDied","Data":"f5bab4d77d2e70e7ad03d2a6626a5bf3a451448d5f4e1deffc3a0ef007f96ea2"} Jul 08 17:56:22.718716 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:22.718675 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" event={"ID":"f628956a-833b-4922-8da3-9a95c252175e","Type":"ContainerStarted","Data":"bcc1b8c11c96deb4b139491915d03613711d3b8a2a8d1166e12f1cc514cf7baa"} Jul 08 17:56:22.718826 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:22.718750 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" event={"ID":"f628956a-833b-4922-8da3-9a95c252175e","Type":"ContainerStarted","Data":"4ff1f050d923bac8acc14a797c10ea8dd1f757a559c692b627d0c00d2d4336eb"} Jul 08 17:56:22.720139 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:22.720118 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mrs6x" event={"ID":"01f209d5-dc76-42e1-a119-f9caaaee0961","Type":"ContainerStarted","Data":"b30d51b3d252f131c8497dd22d71fb58c94fa3855eb03d045bc11c0f8c9eb03a"} Jul 08 17:56:22.760282 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:22.760062 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mrs6x" podStartSLOduration=3.085668595 podStartE2EDuration="26.760047012s" totalImagesPullingTime="23.674378417s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:55:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:56:22.75967428 +0000 UTC m=+26.699481708" watchObservedRunningTime="2026-07-08 17:56:22.760047012 +0000 UTC m=+26.699854439" Jul 08 17:56:23.724834 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:23.724802 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" event={"ID":"f628956a-833b-4922-8da3-9a95c252175e","Type":"ContainerStarted","Data":"3c8b36c78a66d78be328305841703d78eb22342eef7800fa4dff05b65215edd5"} Jul 08 17:56:23.725200 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:23.724904 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" event={"ID":"f628956a-833b-4922-8da3-9a95c252175e","Type":"ContainerStarted","Data":"a90a3baeb7e7ada0faedb72076ce116f7395f6aa4094039ad0abf6da478a7a4c"} Jul 08 17:56:23.725200 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:23.724934 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" event={"ID":"f628956a-833b-4922-8da3-9a95c252175e","Type":"ContainerStarted","Data":"343ffeefa1fb16229c169477ff6d9a3440f87402fcc2e559a265634868b9d798"} Jul 08 17:56:23.725200 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:23.724963 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" event={"ID":"f628956a-833b-4922-8da3-9a95c252175e","Type":"ContainerStarted","Data":"560600cbbbdca9c376df03ff500ef08c4e5a42a2f8c51955d7268e45d0ec6a27"} Jul 08 17:56:24.613371 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:24.613332 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:56:24.613525 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:24.613332 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:56:24.613525 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:24.613439 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6rk4" podUID="34698452-3dd9-43df-a496-5971c144095b" Jul 08 17:56:24.613525 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:24.613455 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:56:24.613525 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:24.613521 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k678l" podUID="b3fffa77-4964-4e33-bb38-fd4483bbd32d" Jul 08 17:56:24.613701 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:24.613616 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrv85" podUID="077db27a-abe8-4647-9b18-9d59458f3f9c" Jul 08 17:56:25.366247 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:25.366216 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jnnhn" Jul 08 17:56:25.366618 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:25.366358 2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 17:56:25.366802 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:25.366786 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jnnhn" Jul 08 17:56:25.730459 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:25.730428 2579 generic.go:356] "Generic (PLEG): container finished" podID="8a1adfb2-9a71-43a3-892f-41b2881f1fe8" containerID="cbdcdda928614be888ea517257d862ad126ad9be902df64b85b84655afd72cae" exitCode=0 Jul 08 17:56:25.730636 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:25.730521 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pc728" event={"ID":"8a1adfb2-9a71-43a3-892f-41b2881f1fe8","Type":"ContainerDied","Data":"cbdcdda928614be888ea517257d862ad126ad9be902df64b85b84655afd72cae"} Jul 08 17:56:25.733597 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:25.733575 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" event={"ID":"f628956a-833b-4922-8da3-9a95c252175e","Type":"ContainerStarted","Data":"4141459a78f494914f30c5343656197b97246d24583bd7b3b650dc26999f051e"} Jul 08 17:56:26.617502 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:26.617476 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:56:26.618042 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:26.617532 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:56:26.618042 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:26.617476 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:56:26.618042 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:26.617711 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k678l" podUID="b3fffa77-4964-4e33-bb38-fd4483bbd32d" Jul 08 17:56:26.618042 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:26.617838 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6rk4" podUID="34698452-3dd9-43df-a496-5971c144095b" Jul 08 17:56:26.618042 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:26.617912 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrv85" podUID="077db27a-abe8-4647-9b18-9d59458f3f9c" Jul 08 17:56:27.741369 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:27.741333 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" event={"ID":"f628956a-833b-4922-8da3-9a95c252175e","Type":"ContainerStarted","Data":"da568510b1ac22237824eac8db31c3dad0a4ca9d738484641dd4265273f1546e"} Jul 08 17:56:27.742316 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:27.741567 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:56:27.742316 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:27.742113 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:56:27.746867 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:27.746836 2579 generic.go:356] "Generic (PLEG): container finished" podID="8a1adfb2-9a71-43a3-892f-41b2881f1fe8" containerID="83e8b6eea2ca5555701fba716839c3850c6f285a5e98ade5191f2a7142921b61" exitCode=0 Jul 08 17:56:27.747108 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:27.746871 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pc728" event={"ID":"8a1adfb2-9a71-43a3-892f-41b2881f1fe8","Type":"ContainerDied","Data":"83e8b6eea2ca5555701fba716839c3850c6f285a5e98ade5191f2a7142921b61"} Jul 08 17:56:27.760099 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:27.760080 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:56:27.768805 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:27.768764 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" podStartSLOduration=8.089513224 podStartE2EDuration="31.768752127s" totalImagesPullingTime="23.679238903s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:55:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:56:27.768156687 +0000 UTC m=+31.707964113" watchObservedRunningTime="2026-07-08 17:56:27.768752127 +0000 UTC m=+31.708559554" Jul 08 17:56:28.613821 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:28.613584 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:56:28.614001 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:28.613589 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:56:28.614001 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:28.613925 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k678l" podUID="b3fffa77-4964-4e33-bb38-fd4483bbd32d" Jul 08 17:56:28.614001 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:28.613634 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:56:28.614162 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:28.614012 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrv85" podUID="077db27a-abe8-4647-9b18-9d59458f3f9c" Jul 08 17:56:28.614162 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:28.614081 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6rk4" podUID="34698452-3dd9-43df-a496-5971c144095b" Jul 08 17:56:28.750613 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:28.750583 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:56:28.767294 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:28.767267 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:56:29.032903 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:29.032874 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t6rk4"] Jul 08 17:56:29.033087 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:29.032989 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:56:29.033149 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:29.033078 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6rk4" podUID="34698452-3dd9-43df-a496-5971c144095b" Jul 08 17:56:29.036627 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:29.036503 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mrv85"] Jul 08 17:56:29.036627 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:29.036601 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:56:29.036812 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:29.036707 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrv85" podUID="077db27a-abe8-4647-9b18-9d59458f3f9c" Jul 08 17:56:29.038758 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:29.038734 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k678l"] Jul 08 17:56:29.038878 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:29.038814 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:56:29.038939 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:29.038889 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k678l" podUID="b3fffa77-4964-4e33-bb38-fd4483bbd32d" Jul 08 17:56:30.232442 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:30.232408 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs\") pod \"network-metrics-daemon-mrv85\" (UID: \"077db27a-abe8-4647-9b18-9d59458f3f9c\") " pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:56:30.232891 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:30.232573 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:56:30.232891 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:30.232641 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs podName:077db27a-abe8-4647-9b18-9d59458f3f9c nodeName:}" failed. No retries permitted until 2026-07-08 17:57:02.232622397 +0000 UTC m=+66.172429820 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs") pod "network-metrics-daemon-mrv85" (UID: "077db27a-abe8-4647-9b18-9d59458f3f9c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:56:30.333533 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:30.333491 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34698452-3dd9-43df-a496-5971c144095b-original-pull-secret\") pod \"global-pull-secret-syncer-t6rk4\" (UID: \"34698452-3dd9-43df-a496-5971c144095b\") " pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:56:30.333706 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:30.333640 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:56:30.333753 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:30.333712 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34698452-3dd9-43df-a496-5971c144095b-original-pull-secret podName:34698452-3dd9-43df-a496-5971c144095b nodeName:}" failed. No retries permitted until 2026-07-08 17:57:02.333695283 +0000 UTC m=+66.273502693 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34698452-3dd9-43df-a496-5971c144095b-original-pull-secret") pod "global-pull-secret-syncer-t6rk4" (UID: "34698452-3dd9-43df-a496-5971c144095b") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:56:30.433833 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:30.433793 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk2vb\" (UniqueName: \"kubernetes.io/projected/b3fffa77-4964-4e33-bb38-fd4483bbd32d-kube-api-access-zk2vb\") pod \"network-check-target-k678l\" (UID: \"b3fffa77-4964-4e33-bb38-fd4483bbd32d\") " pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:56:30.433973 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:30.433959 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:56:30.434042 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:30.433981 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:56:30.434042 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:30.433992 2579 projected.go:196] Error preparing data for projected volume kube-api-access-zk2vb for pod openshift-network-diagnostics/network-check-target-k678l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:56:30.434122 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:30.434044 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3fffa77-4964-4e33-bb38-fd4483bbd32d-kube-api-access-zk2vb podName:b3fffa77-4964-4e33-bb38-fd4483bbd32d nodeName:}" failed. No retries permitted until 2026-07-08 17:57:02.434031175 +0000 UTC m=+66.373838583 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zk2vb" (UniqueName: "kubernetes.io/projected/b3fffa77-4964-4e33-bb38-fd4483bbd32d-kube-api-access-zk2vb") pod "network-check-target-k678l" (UID: "b3fffa77-4964-4e33-bb38-fd4483bbd32d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:56:30.613377 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:30.613341 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:56:30.613377 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:30.613361 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:56:30.613629 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:30.613341 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:56:30.613629 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:30.613470 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k678l" podUID="b3fffa77-4964-4e33-bb38-fd4483bbd32d" Jul 08 17:56:30.613629 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:30.613521 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6rk4" podUID="34698452-3dd9-43df-a496-5971c144095b" Jul 08 17:56:30.613796 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:30.613631 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrv85" podUID="077db27a-abe8-4647-9b18-9d59458f3f9c" Jul 08 17:56:32.614156 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:32.614115 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:56:32.614156 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:32.614155 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:56:32.614730 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:32.614124 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:56:32.614730 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:32.614260 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k678l" podUID="b3fffa77-4964-4e33-bb38-fd4483bbd32d" Jul 08 17:56:32.614730 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:32.614354 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6rk4" podUID="34698452-3dd9-43df-a496-5971c144095b" Jul 08 17:56:32.614730 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:32.614454 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrv85" podUID="077db27a-abe8-4647-9b18-9d59458f3f9c" Jul 08 17:56:34.613728 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.613454 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:56:34.614169 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.613453 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:56:34.614169 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:34.613832 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k678l" podUID="b3fffa77-4964-4e33-bb38-fd4483bbd32d" Jul 08 17:56:34.614169 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.613469 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:56:34.614169 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:34.613874 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6rk4" podUID="34698452-3dd9-43df-a496-5971c144095b" Jul 08 17:56:34.614169 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:34.613983 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrv85" podUID="077db27a-abe8-4647-9b18-9d59458f3f9c" Jul 08 17:56:34.766044 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.765961 2579 generic.go:356] "Generic (PLEG): container finished" podID="8a1adfb2-9a71-43a3-892f-41b2881f1fe8" containerID="a91ea62867a52708f307db242090a43ee8a6d7ffd22ec19226fbdf1edba143ab" exitCode=0 Jul 08 17:56:34.766044 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.766034 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pc728" event={"ID":"8a1adfb2-9a71-43a3-892f-41b2881f1fe8","Type":"ContainerDied","Data":"a91ea62867a52708f307db242090a43ee8a6d7ffd22ec19226fbdf1edba143ab"} Jul 08 17:56:34.918745 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.918716 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeReady" Jul 08 17:56:34.918893 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.918881 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 17:56:34.955416 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.955388 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-mfl6x"] Jul 08 17:56:34.967977 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.967955 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57684fd7c6-5ns46"] Jul 08 17:56:34.968124 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.968080 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-mfl6x" Jul 08 17:56:34.970378 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.970354 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 08 17:56:34.970378 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.970372 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 08 17:56:34.970800 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.970776 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2kn4m\"" Jul 08 17:56:34.978346 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.978292 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-mfl6x"] Jul 08 17:56:34.978346 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.978328 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-p7gp6"] Jul 08 17:56:34.978522 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.978484 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:34.981340 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.981300 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 17:56:34.981469 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.981362 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qtmzb\"" Jul 08 17:56:34.981620 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.981606 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 17:56:34.981867 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.981853 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 17:56:34.986291 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.986265 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-phj4c"] Jul 08 17:56:34.986388 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.986364 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p7gp6" Jul 08 17:56:34.991159 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.991137 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 17:56:34.992169 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.991890 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jnwxk\"" Jul 08 17:56:34.992169 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.991947 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 17:56:34.992351 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.992335 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 17:56:34.994439 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.994413 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 17:56:34.996893 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.996871 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57684fd7c6-5ns46"] Jul 08 17:56:34.997010 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.996899 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p7gp6"] Jul 08 17:56:34.997010 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.996916 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-phj4c"] Jul 08 17:56:34.997010 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.996985 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-phj4c" Jul 08 17:56:34.999092 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.999068 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 17:56:34.999092 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.999081 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 17:56:34.999335 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:34.999320 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jfscm\"" Jul 08 17:56:35.070631 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.070598 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-mfl6x\" (UID: \"96b11027-4864-4174-8225-5a1f1f0ac9db\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mfl6x" Jul 08 17:56:35.070631 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.070635 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:35.070824 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.070662 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61e8dba2-955c-41e8-b903-e0e55d277ea4-image-registry-private-configuration\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:35.070824 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.070689 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/96b11027-4864-4174-8225-5a1f1f0ac9db-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-mfl6x\" (UID: \"96b11027-4864-4174-8225-5a1f1f0ac9db\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mfl6x" Jul 08 17:56:35.070824 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.070709 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz7fm\" (UniqueName: \"kubernetes.io/projected/e4ca3fa5-27eb-4a4e-834a-a2f3ae615d92-kube-api-access-kz7fm\") pod \"ingress-canary-p7gp6\" (UID: \"e4ca3fa5-27eb-4a4e-834a-a2f3ae615d92\") " pod="openshift-ingress-canary/ingress-canary-p7gp6" Jul 08 17:56:35.070824 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.070762 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61e8dba2-955c-41e8-b903-e0e55d277ea4-installation-pull-secrets\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:35.070824 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.070797 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-bound-sa-token\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:35.070992 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.070824 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4ca3fa5-27eb-4a4e-834a-a2f3ae615d92-cert\") pod \"ingress-canary-p7gp6\" (UID: \"e4ca3fa5-27eb-4a4e-834a-a2f3ae615d92\") " pod="openshift-ingress-canary/ingress-canary-p7gp6" Jul 08 17:56:35.070992 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.070851 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61e8dba2-955c-41e8-b903-e0e55d277ea4-trusted-ca\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:35.070992 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.070876 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-certificates\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:35.070992 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.070908 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pltrl\" (UniqueName: \"kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-kube-api-access-pltrl\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:35.070992 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.070948 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61e8dba2-955c-41e8-b903-e0e55d277ea4-ca-trust-extracted\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:35.171968 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.171929 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61e8dba2-955c-41e8-b903-e0e55d277ea4-ca-trust-extracted\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:35.171968 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.171967 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls\") pod \"dns-default-phj4c\" (UID: \"9da39558-d4cb-4ef1-90d8-44ad3f6b939c\") " pod="openshift-dns/dns-default-phj4c" Jul 08 17:56:35.172206 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.172009 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-config-volume\") pod \"dns-default-phj4c\" (UID: \"9da39558-d4cb-4ef1-90d8-44ad3f6b939c\") " pod="openshift-dns/dns-default-phj4c" Jul 08 17:56:35.172206 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.172037 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-mfl6x\" (UID: \"96b11027-4864-4174-8225-5a1f1f0ac9db\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mfl6x" Jul 08 17:56:35.172206 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.172059 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:35.172206 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.172076 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61e8dba2-955c-41e8-b903-e0e55d277ea4-image-registry-private-configuration\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:35.172206 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.172102 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/96b11027-4864-4174-8225-5a1f1f0ac9db-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-mfl6x\" (UID: \"96b11027-4864-4174-8225-5a1f1f0ac9db\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mfl6x" Jul 08 17:56:35.172206 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:35.172167 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 17:56:35.172487 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.172238 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz2kz\" (UniqueName: \"kubernetes.io/projected/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-kube-api-access-wz2kz\") pod \"dns-default-phj4c\" (UID: \"9da39558-d4cb-4ef1-90d8-44ad3f6b939c\") " pod="openshift-dns/dns-default-phj4c" Jul 08 17:56:35.172487 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:35.172251 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert podName:96b11027-4864-4174-8225-5a1f1f0ac9db nodeName:}" failed. No retries permitted until 2026-07-08 17:56:35.672234877 +0000 UTC m=+39.612042283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-mfl6x" (UID: "96b11027-4864-4174-8225-5a1f1f0ac9db") : secret "networking-console-plugin-cert" not found Jul 08 17:56:35.172487 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:35.172193 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:56:35.172487 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:35.172268 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57684fd7c6-5ns46: secret "image-registry-tls" not found Jul 08 17:56:35.172487 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:35.172300 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls podName:61e8dba2-955c-41e8-b903-e0e55d277ea4 nodeName:}" failed. No retries permitted until 2026-07-08 17:56:35.6722894 +0000 UTC m=+39.612096805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls") pod "image-registry-57684fd7c6-5ns46" (UID: "61e8dba2-955c-41e8-b903-e0e55d277ea4") : secret "image-registry-tls" not found Jul 08 17:56:35.172487 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.172287 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz7fm\" (UniqueName: \"kubernetes.io/projected/e4ca3fa5-27eb-4a4e-834a-a2f3ae615d92-kube-api-access-kz7fm\") pod \"ingress-canary-p7gp6\" (UID: \"e4ca3fa5-27eb-4a4e-834a-a2f3ae615d92\") " pod="openshift-ingress-canary/ingress-canary-p7gp6" Jul 08 17:56:35.172487 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.172345 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61e8dba2-955c-41e8-b903-e0e55d277ea4-installation-pull-secrets\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:35.172487 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.172388 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-bound-sa-token\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:35.172487 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.172411 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4ca3fa5-27eb-4a4e-834a-a2f3ae615d92-cert\") pod \"ingress-canary-p7gp6\" (UID: \"e4ca3fa5-27eb-4a4e-834a-a2f3ae615d92\") " pod="openshift-ingress-canary/ingress-canary-p7gp6" Jul 08 17:56:35.172487 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.172411 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61e8dba2-955c-41e8-b903-e0e55d277ea4-ca-trust-extracted\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:35.172487 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.172439 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61e8dba2-955c-41e8-b903-e0e55d277ea4-trusted-ca\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:35.172942 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.172599 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-certificates\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:35.172942 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.172672 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-tmp-dir\") pod \"dns-default-phj4c\" (UID: \"9da39558-d4cb-4ef1-90d8-44ad3f6b939c\") " pod="openshift-dns/dns-default-phj4c" Jul 08 17:56:35.172942 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.172727 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pltrl\" (UniqueName: \"kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-kube-api-access-pltrl\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:35.172942 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.172846 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/96b11027-4864-4174-8225-5a1f1f0ac9db-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-mfl6x\" (UID: \"96b11027-4864-4174-8225-5a1f1f0ac9db\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mfl6x" Jul 08 17:56:35.173223 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.173202 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-certificates\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:35.173632 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.173610 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61e8dba2-955c-41e8-b903-e0e55d277ea4-trusted-ca\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:35.176553 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.176523 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61e8dba2-955c-41e8-b903-e0e55d277ea4-image-registry-private-configuration\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:35.176553 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.176537 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61e8dba2-955c-41e8-b903-e0e55d277ea4-installation-pull-secrets\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:35.176717 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.176543 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4ca3fa5-27eb-4a4e-834a-a2f3ae615d92-cert\") pod \"ingress-canary-p7gp6\" (UID: \"e4ca3fa5-27eb-4a4e-834a-a2f3ae615d92\") " pod="openshift-ingress-canary/ingress-canary-p7gp6" Jul 08 17:56:35.182789 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.182769 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-bound-sa-token\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:35.183309 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.183294 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz7fm\" (UniqueName: \"kubernetes.io/projected/e4ca3fa5-27eb-4a4e-834a-a2f3ae615d92-kube-api-access-kz7fm\") pod \"ingress-canary-p7gp6\" (UID: \"e4ca3fa5-27eb-4a4e-834a-a2f3ae615d92\") " pod="openshift-ingress-canary/ingress-canary-p7gp6" Jul 08 17:56:35.183657 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.183640 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pltrl\" (UniqueName: \"kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-kube-api-access-pltrl\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:35.273434 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.273406 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz2kz\" (UniqueName: \"kubernetes.io/projected/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-kube-api-access-wz2kz\") pod \"dns-default-phj4c\" (UID: \"9da39558-d4cb-4ef1-90d8-44ad3f6b939c\") " pod="openshift-dns/dns-default-phj4c" Jul 08 17:56:35.273566 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.273452 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-tmp-dir\") pod \"dns-default-phj4c\" (UID: \"9da39558-d4cb-4ef1-90d8-44ad3f6b939c\") " pod="openshift-dns/dns-default-phj4c" Jul 08 17:56:35.273566 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.273487 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls\") pod \"dns-default-phj4c\" (UID: \"9da39558-d4cb-4ef1-90d8-44ad3f6b939c\") " pod="openshift-dns/dns-default-phj4c" Jul 08 17:56:35.273566 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.273521 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-config-volume\") pod \"dns-default-phj4c\" (UID: \"9da39558-d4cb-4ef1-90d8-44ad3f6b939c\") " pod="openshift-dns/dns-default-phj4c" Jul 08 17:56:35.273663 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:35.273634 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:56:35.273728 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:35.273717 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls podName:9da39558-d4cb-4ef1-90d8-44ad3f6b939c nodeName:}" failed. No retries permitted until 2026-07-08 17:56:35.773696523 +0000 UTC m=+39.713503933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls") pod "dns-default-phj4c" (UID: "9da39558-d4cb-4ef1-90d8-44ad3f6b939c") : secret "dns-default-metrics-tls" not found Jul 08 17:56:35.273844 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.273826 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-tmp-dir\") pod \"dns-default-phj4c\" (UID: \"9da39558-d4cb-4ef1-90d8-44ad3f6b939c\") " pod="openshift-dns/dns-default-phj4c" Jul 08 17:56:35.274146 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.274129 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-config-volume\") pod \"dns-default-phj4c\" (UID: \"9da39558-d4cb-4ef1-90d8-44ad3f6b939c\") " pod="openshift-dns/dns-default-phj4c" Jul 08 17:56:35.283925 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.283897 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz2kz\" (UniqueName: \"kubernetes.io/projected/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-kube-api-access-wz2kz\") pod \"dns-default-phj4c\" (UID: \"9da39558-d4cb-4ef1-90d8-44ad3f6b939c\") " pod="openshift-dns/dns-default-phj4c" Jul 08 17:56:35.311269 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.311243 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p7gp6" Jul 08 17:56:35.518044 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.518011 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p7gp6"] Jul 08 17:56:35.522345 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:56:35.522315 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4ca3fa5_27eb_4a4e_834a_a2f3ae615d92.slice/crio-3652b8fac7df51023ed444a6f3df3864b5519ab813da9b2511b43ac505a08a45 WatchSource:0}: Error finding container 3652b8fac7df51023ed444a6f3df3864b5519ab813da9b2511b43ac505a08a45: Status 404 returned error can't find the container with id 3652b8fac7df51023ed444a6f3df3864b5519ab813da9b2511b43ac505a08a45 Jul 08 17:56:35.677382 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.677295 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:35.678029 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.677392 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-mfl6x\" (UID: \"96b11027-4864-4174-8225-5a1f1f0ac9db\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mfl6x" Jul 08 17:56:35.678029 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:35.677453 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:56:35.678029 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:35.677473 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57684fd7c6-5ns46: secret "image-registry-tls" not found Jul 08 17:56:35.678029 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:35.677479 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 17:56:35.678029 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:35.677527 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls podName:61e8dba2-955c-41e8-b903-e0e55d277ea4 nodeName:}" failed. No retries permitted until 2026-07-08 17:56:36.677512652 +0000 UTC m=+40.617320057 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls") pod "image-registry-57684fd7c6-5ns46" (UID: "61e8dba2-955c-41e8-b903-e0e55d277ea4") : secret "image-registry-tls" not found Jul 08 17:56:35.678029 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:35.677543 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert podName:96b11027-4864-4174-8225-5a1f1f0ac9db nodeName:}" failed. No retries permitted until 2026-07-08 17:56:36.677534447 +0000 UTC m=+40.617341852 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-mfl6x" (UID: "96b11027-4864-4174-8225-5a1f1f0ac9db") : secret "networking-console-plugin-cert" not found Jul 08 17:56:35.772091 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.772060 2579 generic.go:356] "Generic (PLEG): container finished" podID="8a1adfb2-9a71-43a3-892f-41b2881f1fe8" containerID="8054ee7e7050d0b32405bb8a36acd56992b965bb479b231c6078313bf808563d" exitCode=0 Jul 08 17:56:35.772263 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.772139 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pc728" event={"ID":"8a1adfb2-9a71-43a3-892f-41b2881f1fe8","Type":"ContainerDied","Data":"8054ee7e7050d0b32405bb8a36acd56992b965bb479b231c6078313bf808563d"} Jul 08 17:56:35.773139 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.773118 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p7gp6" event={"ID":"e4ca3fa5-27eb-4a4e-834a-a2f3ae615d92","Type":"ContainerStarted","Data":"3652b8fac7df51023ed444a6f3df3864b5519ab813da9b2511b43ac505a08a45"} Jul 08 17:56:35.777807 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:35.777786 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls\") pod \"dns-default-phj4c\" (UID: \"9da39558-d4cb-4ef1-90d8-44ad3f6b939c\") " pod="openshift-dns/dns-default-phj4c" Jul 08 17:56:35.777945 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:35.777930 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:56:35.778019 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:35.777996 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls podName:9da39558-d4cb-4ef1-90d8-44ad3f6b939c nodeName:}" failed. No retries permitted until 2026-07-08 17:56:36.777976352 +0000 UTC m=+40.717783775 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls") pod "dns-default-phj4c" (UID: "9da39558-d4cb-4ef1-90d8-44ad3f6b939c") : secret "dns-default-metrics-tls" not found Jul 08 17:56:36.614218 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:36.614020 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:56:36.614417 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:36.614083 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:56:36.614417 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:36.614106 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:56:36.616964 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:36.616943 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 17:56:36.617921 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:36.617901 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f85p4\"" Jul 08 17:56:36.618016 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:36.617943 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 17:56:36.618016 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:36.617943 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5k7v7\"" Jul 08 17:56:36.618016 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:36.617993 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 17:56:36.618147 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:36.617993 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 17:56:36.684305 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:36.684265 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-mfl6x\" (UID: \"96b11027-4864-4174-8225-5a1f1f0ac9db\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mfl6x" Jul 08 17:56:36.684305 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:36.684303 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:36.684807 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:36.684451 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:56:36.684807 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:36.684474 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57684fd7c6-5ns46: secret "image-registry-tls" not found Jul 08 17:56:36.684807 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:36.684451 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 17:56:36.684807 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:36.684537 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls podName:61e8dba2-955c-41e8-b903-e0e55d277ea4 nodeName:}" failed. No retries permitted until 2026-07-08 17:56:38.684518259 +0000 UTC m=+42.624325667 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls") pod "image-registry-57684fd7c6-5ns46" (UID: "61e8dba2-955c-41e8-b903-e0e55d277ea4") : secret "image-registry-tls" not found Jul 08 17:56:36.684807 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:36.684594 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert podName:96b11027-4864-4174-8225-5a1f1f0ac9db nodeName:}" failed. No retries permitted until 2026-07-08 17:56:38.684578539 +0000 UTC m=+42.624385945 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-mfl6x" (UID: "96b11027-4864-4174-8225-5a1f1f0ac9db") : secret "networking-console-plugin-cert" not found Jul 08 17:56:36.779144 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:36.779110 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pc728" event={"ID":"8a1adfb2-9a71-43a3-892f-41b2881f1fe8","Type":"ContainerStarted","Data":"c6b2126d6a996b2172a14f79343c7c13bc67c0877a46a3df53724ede274e1197"} Jul 08 17:56:36.785065 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:36.785045 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls\") pod \"dns-default-phj4c\" (UID: \"9da39558-d4cb-4ef1-90d8-44ad3f6b939c\") " pod="openshift-dns/dns-default-phj4c" Jul 08 17:56:36.785243 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:36.785230 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:56:36.785301 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:36.785292 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls podName:9da39558-d4cb-4ef1-90d8-44ad3f6b939c nodeName:}" failed. No retries permitted until 2026-07-08 17:56:38.785273655 +0000 UTC m=+42.725081061 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls") pod "dns-default-phj4c" (UID: "9da39558-d4cb-4ef1-90d8-44ad3f6b939c") : secret "dns-default-metrics-tls" not found Jul 08 17:56:36.801238 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:36.801168 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pc728" podStartSLOduration=7.463140952 podStartE2EDuration="40.801154709s" totalImagesPullingTime="33.338013757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:55:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:56:36.800774373 +0000 UTC m=+40.740581800" watchObservedRunningTime="2026-07-08 17:56:36.801154709 +0000 UTC m=+40.740962136" Jul 08 17:56:38.701943 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:38.701900 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-mfl6x\" (UID: \"96b11027-4864-4174-8225-5a1f1f0ac9db\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mfl6x" Jul 08 17:56:38.701943 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:38.701944 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:38.702370 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:38.702077 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 17:56:38.702370 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:38.702088 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:56:38.702370 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:38.702100 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57684fd7c6-5ns46: secret "image-registry-tls" not found Jul 08 17:56:38.702370 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:38.702150 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls podName:61e8dba2-955c-41e8-b903-e0e55d277ea4 nodeName:}" failed. No retries permitted until 2026-07-08 17:56:42.702138054 +0000 UTC m=+46.641945458 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls") pod "image-registry-57684fd7c6-5ns46" (UID: "61e8dba2-955c-41e8-b903-e0e55d277ea4") : secret "image-registry-tls" not found Jul 08 17:56:38.702370 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:38.702163 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert podName:96b11027-4864-4174-8225-5a1f1f0ac9db nodeName:}" failed. No retries permitted until 2026-07-08 17:56:42.702156584 +0000 UTC m=+46.641963989 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-mfl6x" (UID: "96b11027-4864-4174-8225-5a1f1f0ac9db") : secret "networking-console-plugin-cert" not found Jul 08 17:56:38.802804 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:38.802767 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls\") pod \"dns-default-phj4c\" (UID: \"9da39558-d4cb-4ef1-90d8-44ad3f6b939c\") " pod="openshift-dns/dns-default-phj4c" Jul 08 17:56:38.802963 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:38.802920 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:56:38.803003 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:38.802982 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls podName:9da39558-d4cb-4ef1-90d8-44ad3f6b939c nodeName:}" failed. No retries permitted until 2026-07-08 17:56:42.80296696 +0000 UTC m=+46.742774365 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls") pod "dns-default-phj4c" (UID: "9da39558-d4cb-4ef1-90d8-44ad3f6b939c") : secret "dns-default-metrics-tls" not found Jul 08 17:56:39.788031 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:39.787990 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p7gp6" event={"ID":"e4ca3fa5-27eb-4a4e-834a-a2f3ae615d92","Type":"ContainerStarted","Data":"583b1eda83d81df67a3fd38157861a0a6edae2e54cf9c6e127beef590c652729"} Jul 08 17:56:39.808704 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:39.808644 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-p7gp6" podStartSLOduration=2.396631858 podStartE2EDuration="5.808630355s" totalImagesPullingTime="3.411998497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:56:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:56:39.80774421 +0000 UTC m=+43.747551661" watchObservedRunningTime="2026-07-08 17:56:39.808630355 +0000 UTC m=+43.748437779" Jul 08 17:56:42.731461 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:42.731264 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-mfl6x\" (UID: \"96b11027-4864-4174-8225-5a1f1f0ac9db\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mfl6x" Jul 08 17:56:42.731870 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:42.731475 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:42.731870 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:42.731418 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 17:56:42.731870 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:42.731588 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert podName:96b11027-4864-4174-8225-5a1f1f0ac9db nodeName:}" failed. No retries permitted until 2026-07-08 17:56:50.731571352 +0000 UTC m=+54.671378757 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-mfl6x" (UID: "96b11027-4864-4174-8225-5a1f1f0ac9db") : secret "networking-console-plugin-cert" not found Jul 08 17:56:42.731870 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:42.731593 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:56:42.731870 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:42.731604 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57684fd7c6-5ns46: secret "image-registry-tls" not found Jul 08 17:56:42.731870 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:42.731640 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls podName:61e8dba2-955c-41e8-b903-e0e55d277ea4 nodeName:}" failed. No retries permitted until 2026-07-08 17:56:50.731627946 +0000 UTC m=+54.671435351 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls") pod "image-registry-57684fd7c6-5ns46" (UID: "61e8dba2-955c-41e8-b903-e0e55d277ea4") : secret "image-registry-tls" not found Jul 08 17:56:42.832873 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:42.832823 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls\") pod \"dns-default-phj4c\" (UID: \"9da39558-d4cb-4ef1-90d8-44ad3f6b939c\") " pod="openshift-dns/dns-default-phj4c" Jul 08 17:56:42.833020 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:42.832964 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:56:42.833075 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:42.833025 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls podName:9da39558-d4cb-4ef1-90d8-44ad3f6b939c nodeName:}" failed. No retries permitted until 2026-07-08 17:56:50.833010435 +0000 UTC m=+54.772817841 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls") pod "dns-default-phj4c" (UID: "9da39558-d4cb-4ef1-90d8-44ad3f6b939c") : secret "dns-default-metrics-tls" not found Jul 08 17:56:50.789165 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:50.789113 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-mfl6x\" (UID: \"96b11027-4864-4174-8225-5a1f1f0ac9db\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mfl6x" Jul 08 17:56:50.789719 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:50.789170 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:56:50.789719 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:50.789294 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 17:56:50.789719 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:50.789320 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:56:50.789719 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:50.789331 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57684fd7c6-5ns46: secret "image-registry-tls" not found Jul 08 17:56:50.789719 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:50.789363 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert podName:96b11027-4864-4174-8225-5a1f1f0ac9db nodeName:}" failed. No retries permitted until 2026-07-08 17:57:06.789346971 +0000 UTC m=+70.729154377 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-mfl6x" (UID: "96b11027-4864-4174-8225-5a1f1f0ac9db") : secret "networking-console-plugin-cert" not found Jul 08 17:56:50.789719 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:50.789378 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls podName:61e8dba2-955c-41e8-b903-e0e55d277ea4 nodeName:}" failed. No retries permitted until 2026-07-08 17:57:06.789371582 +0000 UTC m=+70.729178986 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls") pod "image-registry-57684fd7c6-5ns46" (UID: "61e8dba2-955c-41e8-b903-e0e55d277ea4") : secret "image-registry-tls" not found Jul 08 17:56:50.889835 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:56:50.889800 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls\") pod \"dns-default-phj4c\" (UID: \"9da39558-d4cb-4ef1-90d8-44ad3f6b939c\") " pod="openshift-dns/dns-default-phj4c" Jul 08 17:56:50.890040 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:50.889966 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:56:50.890112 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:56:50.890044 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls podName:9da39558-d4cb-4ef1-90d8-44ad3f6b939c nodeName:}" failed. No retries permitted until 2026-07-08 17:57:06.890022863 +0000 UTC m=+70.829830267 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls") pod "dns-default-phj4c" (UID: "9da39558-d4cb-4ef1-90d8-44ad3f6b939c") : secret "dns-default-metrics-tls" not found Jul 08 17:57:00.764595 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:00.764566 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mqgcf" Jul 08 17:57:02.273076 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:02.273031 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs\") pod \"network-metrics-daemon-mrv85\" (UID: \"077db27a-abe8-4647-9b18-9d59458f3f9c\") " pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:57:02.275675 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:02.275657 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 17:57:02.284007 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:57:02.283985 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 17:57:02.284082 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:57:02.284071 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs podName:077db27a-abe8-4647-9b18-9d59458f3f9c nodeName:}" failed. No retries permitted until 2026-07-08 17:58:06.284054282 +0000 UTC m=+130.223861686 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs") pod "network-metrics-daemon-mrv85" (UID: "077db27a-abe8-4647-9b18-9d59458f3f9c") : secret "metrics-daemon-secret" not found Jul 08 17:57:02.373600 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:02.373568 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34698452-3dd9-43df-a496-5971c144095b-original-pull-secret\") pod \"global-pull-secret-syncer-t6rk4\" (UID: \"34698452-3dd9-43df-a496-5971c144095b\") " pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:57:02.376292 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:02.376275 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 17:57:02.388255 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:02.388224 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34698452-3dd9-43df-a496-5971c144095b-original-pull-secret\") pod \"global-pull-secret-syncer-t6rk4\" (UID: \"34698452-3dd9-43df-a496-5971c144095b\") " pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:57:02.435553 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:02.435521 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6rk4" Jul 08 17:57:02.474478 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:02.474441 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk2vb\" (UniqueName: \"kubernetes.io/projected/b3fffa77-4964-4e33-bb38-fd4483bbd32d-kube-api-access-zk2vb\") pod \"network-check-target-k678l\" (UID: \"b3fffa77-4964-4e33-bb38-fd4483bbd32d\") " pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:57:02.477476 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:02.477456 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 17:57:02.488035 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:02.487995 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 17:57:02.505764 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:02.505733 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk2vb\" (UniqueName: \"kubernetes.io/projected/b3fffa77-4964-4e33-bb38-fd4483bbd32d-kube-api-access-zk2vb\") pod \"network-check-target-k678l\" (UID: \"b3fffa77-4964-4e33-bb38-fd4483bbd32d\") " pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:57:02.582257 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:02.582222 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t6rk4"] Jul 08 17:57:02.585749 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:57:02.585723 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34698452_3dd9_43df_a496_5971c144095b.slice/crio-592940ca463b9edd14d27889e16bdd9debf01d988de9abd24fad9daa424ac092 WatchSource:0}: Error finding container 592940ca463b9edd14d27889e16bdd9debf01d988de9abd24fad9daa424ac092: Status 404 returned error can't find the container with id 592940ca463b9edd14d27889e16bdd9debf01d988de9abd24fad9daa424ac092 Jul 08 17:57:02.732937 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:02.732903 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f85p4\"" Jul 08 17:57:02.741164 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:02.741139 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:57:02.842545 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:02.842509 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t6rk4" event={"ID":"34698452-3dd9-43df-a496-5971c144095b","Type":"ContainerStarted","Data":"592940ca463b9edd14d27889e16bdd9debf01d988de9abd24fad9daa424ac092"} Jul 08 17:57:02.864895 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:02.864861 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k678l"] Jul 08 17:57:02.867542 ip-10-0-128-234 kubenswrapper[2579]: W0708 17:57:02.867519 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3fffa77_4964_4e33_bb38_fd4483bbd32d.slice/crio-a6b26a2dbd54a0bfbc192dfa47a7a558f5c86cea7914dda02e5b7a2f5623e132 WatchSource:0}: Error finding container a6b26a2dbd54a0bfbc192dfa47a7a558f5c86cea7914dda02e5b7a2f5623e132: Status 404 returned error can't find the container with id a6b26a2dbd54a0bfbc192dfa47a7a558f5c86cea7914dda02e5b7a2f5623e132 Jul 08 17:57:03.847204 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:03.847118 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k678l" event={"ID":"b3fffa77-4964-4e33-bb38-fd4483bbd32d","Type":"ContainerStarted","Data":"a6b26a2dbd54a0bfbc192dfa47a7a558f5c86cea7914dda02e5b7a2f5623e132"} Jul 08 17:57:06.807836 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:06.807796 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-mfl6x\" (UID: \"96b11027-4864-4174-8225-5a1f1f0ac9db\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mfl6x" Jul 08 17:57:06.808260 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:06.807847 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:57:06.808260 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:57:06.807968 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:57:06.808260 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:57:06.807987 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57684fd7c6-5ns46: secret "image-registry-tls" not found Jul 08 17:57:06.808260 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:57:06.807968 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 17:57:06.808260 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:57:06.808050 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls podName:61e8dba2-955c-41e8-b903-e0e55d277ea4 nodeName:}" failed. No retries permitted until 2026-07-08 17:57:38.808029889 +0000 UTC m=+102.747837293 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls") pod "image-registry-57684fd7c6-5ns46" (UID: "61e8dba2-955c-41e8-b903-e0e55d277ea4") : secret "image-registry-tls" not found Jul 08 17:57:06.808260 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:57:06.808066 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert podName:96b11027-4864-4174-8225-5a1f1f0ac9db nodeName:}" failed. No retries permitted until 2026-07-08 17:57:38.808059293 +0000 UTC m=+102.747866698 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-mfl6x" (UID: "96b11027-4864-4174-8225-5a1f1f0ac9db") : secret "networking-console-plugin-cert" not found Jul 08 17:57:06.908829 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:06.908774 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls\") pod \"dns-default-phj4c\" (UID: \"9da39558-d4cb-4ef1-90d8-44ad3f6b939c\") " pod="openshift-dns/dns-default-phj4c" Jul 08 17:57:06.909026 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:57:06.909013 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:57:06.909088 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:57:06.909065 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls podName:9da39558-d4cb-4ef1-90d8-44ad3f6b939c nodeName:}" failed. No retries permitted until 2026-07-08 17:57:38.909050982 +0000 UTC m=+102.848858388 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls") pod "dns-default-phj4c" (UID: "9da39558-d4cb-4ef1-90d8-44ad3f6b939c") : secret "dns-default-metrics-tls" not found Jul 08 17:57:09.862888 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:09.862844 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k678l" event={"ID":"b3fffa77-4964-4e33-bb38-fd4483bbd32d","Type":"ContainerStarted","Data":"21f1333fe7bf97179ea6707130bafb33ef8a27314e8e2ae7e226dad0aed234eb"} Jul 08 17:57:09.863313 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:09.862938 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:57:09.864314 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:09.864296 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t6rk4" event={"ID":"34698452-3dd9-43df-a496-5971c144095b","Type":"ContainerStarted","Data":"4a4c581f89d8d0eb41e2f5a8cd44ab155e50c7694ae8f43fdacf47b3a3cc3dad"} Jul 08 17:57:09.878441 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:09.878386 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-k678l" podStartSLOduration=67.790804291 podStartE2EDuration="1m13.878369736s" totalImagesPullingTime="6.087565445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:55:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:57:09.877676054 +0000 UTC m=+73.817483463" watchObservedRunningTime="2026-07-08 17:57:09.878369736 +0000 UTC m=+73.818177163" Jul 08 17:57:38.838400 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:38.838360 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-mfl6x\" (UID: \"96b11027-4864-4174-8225-5a1f1f0ac9db\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mfl6x" Jul 08 17:57:38.838400 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:38.838406 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:57:38.838874 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:57:38.838511 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:57:38.838874 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:57:38.838511 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 17:57:38.838874 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:57:38.838595 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert podName:96b11027-4864-4174-8225-5a1f1f0ac9db nodeName:}" failed. No retries permitted until 2026-07-08 17:58:42.838578938 +0000 UTC m=+166.778386343 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-mfl6x" (UID: "96b11027-4864-4174-8225-5a1f1f0ac9db") : secret "networking-console-plugin-cert" not found Jul 08 17:57:38.838874 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:57:38.838522 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57684fd7c6-5ns46: secret "image-registry-tls" not found Jul 08 17:57:38.838874 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:57:38.838652 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls podName:61e8dba2-955c-41e8-b903-e0e55d277ea4 nodeName:}" failed. No retries permitted until 2026-07-08 17:58:42.838640271 +0000 UTC m=+166.778447676 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls") pod "image-registry-57684fd7c6-5ns46" (UID: "61e8dba2-955c-41e8-b903-e0e55d277ea4") : secret "image-registry-tls" not found Jul 08 17:57:38.939200 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:38.939093 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls\") pod \"dns-default-phj4c\" (UID: \"9da39558-d4cb-4ef1-90d8-44ad3f6b939c\") " pod="openshift-dns/dns-default-phj4c" Jul 08 17:57:38.939346 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:57:38.939259 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:57:38.939346 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:57:38.939328 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls podName:9da39558-d4cb-4ef1-90d8-44ad3f6b939c nodeName:}" failed. No retries permitted until 2026-07-08 17:58:42.939313575 +0000 UTC m=+166.879120980 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls") pod "dns-default-phj4c" (UID: "9da39558-d4cb-4ef1-90d8-44ad3f6b939c") : secret "dns-default-metrics-tls" not found Jul 08 17:57:40.870110 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:40.870074 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-k678l" Jul 08 17:57:40.897429 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:57:40.897376 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-t6rk4" podStartSLOduration=97.516917148 podStartE2EDuration="1m43.897359453s" totalImagesPullingTime="6.380442305s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:55:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:57:09.89204488 +0000 UTC m=+73.831852321" watchObservedRunningTime="2026-07-08 17:57:40.897359453 +0000 UTC m=+104.837166879" Jul 08 17:58:06.336392 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:58:06.336338 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs\") pod \"network-metrics-daemon-mrv85\" (UID: \"077db27a-abe8-4647-9b18-9d59458f3f9c\") " pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 17:58:06.336844 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:58:06.336513 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 17:58:06.336844 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:58:06.336592 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs podName:077db27a-abe8-4647-9b18-9d59458f3f9c nodeName:}" failed. No retries permitted until 2026-07-08 18:00:08.336573171 +0000 UTC m=+252.276380591 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs") pod "network-metrics-daemon-mrv85" (UID: "077db27a-abe8-4647-9b18-9d59458f3f9c") : secret "metrics-daemon-secret" not found Jul 08 17:58:37.998574 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:58:37.998527 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-mfl6x" podUID="96b11027-4864-4174-8225-5a1f1f0ac9db" Jul 08 17:58:38.005720 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:58:38.005692 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" podUID="61e8dba2-955c-41e8-b903-e0e55d277ea4" Jul 08 17:58:38.015859 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:58:38.015835 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-phj4c" podUID="9da39558-d4cb-4ef1-90d8-44ad3f6b939c" Jul 08 17:58:38.067910 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:58:38.067885 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:58:38.068027 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:58:38.067885 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-mfl6x" Jul 08 17:58:39.623952 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:58:39.623906 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mrv85" podUID="077db27a-abe8-4647-9b18-9d59458f3f9c" Jul 08 17:58:42.900333 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:58:42.900282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-mfl6x\" (UID: \"96b11027-4864-4174-8225-5a1f1f0ac9db\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mfl6x" Jul 08 17:58:42.900333 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:58:42.900327 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 17:58:42.900765 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:58:42.900433 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:58:42.900765 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:58:42.900446 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57684fd7c6-5ns46: secret "image-registry-tls" not found Jul 08 17:58:42.900765 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:58:42.900492 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls podName:61e8dba2-955c-41e8-b903-e0e55d277ea4 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:44.900478171 +0000 UTC m=+288.840285590 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls") pod "image-registry-57684fd7c6-5ns46" (UID: "61e8dba2-955c-41e8-b903-e0e55d277ea4") : secret "image-registry-tls" not found Jul 08 17:58:42.900765 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:58:42.900433 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 17:58:42.900765 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:58:42.900565 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert podName:96b11027-4864-4174-8225-5a1f1f0ac9db nodeName:}" failed. No retries permitted until 2026-07-08 18:00:44.900552193 +0000 UTC m=+288.840359601 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-mfl6x" (UID: "96b11027-4864-4174-8225-5a1f1f0ac9db") : secret "networking-console-plugin-cert" not found Jul 08 17:58:43.001634 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:58:43.001590 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls\") pod \"dns-default-phj4c\" (UID: \"9da39558-d4cb-4ef1-90d8-44ad3f6b939c\") " pod="openshift-dns/dns-default-phj4c" Jul 08 17:58:43.001809 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:58:43.001740 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:58:43.001809 ip-10-0-128-234 kubenswrapper[2579]: E0708 17:58:43.001803 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls podName:9da39558-d4cb-4ef1-90d8-44ad3f6b939c nodeName:}" failed. No retries permitted until 2026-07-08 18:00:45.001788324 +0000 UTC m=+288.941595733 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls") pod "dns-default-phj4c" (UID: "9da39558-d4cb-4ef1-90d8-44ad3f6b939c") : secret "dns-default-metrics-tls" not found Jul 08 17:58:53.614154 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:58:53.614045 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-phj4c" Jul 08 17:58:54.613908 ip-10-0-128-234 kubenswrapper[2579]: I0708 17:58:54.613871 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 18:00:08.412831 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:08.412794 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs\") pod \"network-metrics-daemon-mrv85\" (UID: \"077db27a-abe8-4647-9b18-9d59458f3f9c\") " pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 18:00:08.413327 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:08.412947 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 18:00:08.413327 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:08.413029 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs podName:077db27a-abe8-4647-9b18-9d59458f3f9c nodeName:}" failed. No retries permitted until 2026-07-08 18:02:10.413008573 +0000 UTC m=+374.352815979 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs") pod "network-metrics-daemon-mrv85" (UID: "077db27a-abe8-4647-9b18-9d59458f3f9c") : secret "metrics-daemon-secret" not found Jul 08 18:00:27.723897 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.723857 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dnv2n"] Jul 08 18:00:27.725841 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.725819 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dnv2n" Jul 08 18:00:27.731865 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.731439 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 08 18:00:27.731865 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.731484 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:00:27.731865 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.731488 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 08 18:00:27.732221 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.732204 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dh4md\"" Jul 08 18:00:27.737992 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.737970 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8q89n"] Jul 08 18:00:27.739842 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.739826 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-k2gq9"] Jul 08 18:00:27.740000 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.739956 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8q89n" Jul 08 18:00:27.742342 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.742320 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-dbnrk"] Jul 08 18:00:27.742458 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.742440 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-k2gq9" Jul 08 18:00:27.744358 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.744337 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dnv2n"] Jul 08 18:00:27.744457 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.744432 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dbnrk" Jul 08 18:00:27.756059 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.756040 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 08 18:00:27.756235 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.756212 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 18:00:27.756351 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.756316 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 18:00:27.756351 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.756322 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 08 18:00:27.756351 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.756331 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7smgl\"" Jul 08 18:00:27.756614 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.756594 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 08 18:00:27.756712 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.756657 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:00:27.756712 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.756704 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-6fsm7\"" Jul 08 18:00:27.756823 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.756796 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 08 18:00:27.756887 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.756866 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 08 18:00:27.756974 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.756922 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-pvs6b\"" Jul 08 18:00:27.763755 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.763735 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-k2gq9"] Jul 08 18:00:27.773575 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.773545 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8q89n"] Jul 08 18:00:27.783916 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.783888 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-dbnrk"] Jul 08 18:00:27.833257 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.833227 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-fthbc"] Jul 08 18:00:27.835124 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.835109 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-fthbc" Jul 08 18:00:27.836643 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.836623 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-bp5bl"] Jul 08 18:00:27.838328 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.838313 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-59d7db58ff-wx86z"] Jul 08 18:00:27.838432 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.838419 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-bp5bl" Jul 08 18:00:27.839291 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.839269 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:00:27.839386 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.839358 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 08 18:00:27.839571 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.839553 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 08 18:00:27.839636 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.839581 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-mtrsp\"" Jul 08 18:00:27.839814 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.839801 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 08 18:00:27.840248 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.840229 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:27.841082 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.841062 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 18:00:27.841166 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.841068 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-q6ftp\"" Jul 08 18:00:27.842854 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.842833 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 18:00:27.842953 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.842853 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 08 18:00:27.844618 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.844571 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 08 18:00:27.844734 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.844627 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 08 18:00:27.844734 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.844656 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 08 18:00:27.844843 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.844804 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 08 18:00:27.844892 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.844805 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 08 18:00:27.844982 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.844967 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-sd7m6\"" Jul 08 18:00:27.845146 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.845132 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 18:00:27.845582 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.845565 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 18:00:27.852133 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.852117 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 08 18:00:27.852354 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.852336 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 08 18:00:27.857507 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.857485 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw7z2\" (UniqueName: \"kubernetes.io/projected/95031ded-dd92-46ed-96d8-0f0ec453c374-kube-api-access-nw7z2\") pod \"cluster-samples-operator-56fcf86bf-dnv2n\" (UID: \"95031ded-dd92-46ed-96d8-0f0ec453c374\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dnv2n" Jul 08 18:00:27.857595 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.857515 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2lwb\" (UniqueName: \"kubernetes.io/projected/af37eaef-0d57-4b20-8562-4c782bda5732-kube-api-access-c2lwb\") pod \"cluster-monitoring-operator-64786d9cbb-8q89n\" (UID: \"af37eaef-0d57-4b20-8562-4c782bda5732\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8q89n" Jul 08 18:00:27.857595 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.857560 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d978efe4-a0ee-46e0-838a-77ec2ffc352f-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-k2gq9\" (UID: \"d978efe4-a0ee-46e0-838a-77ec2ffc352f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-k2gq9" Jul 08 18:00:27.857595 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.857577 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d978efe4-a0ee-46e0-838a-77ec2ffc352f-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-k2gq9\" (UID: \"d978efe4-a0ee-46e0-838a-77ec2ffc352f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-k2gq9" Jul 08 18:00:27.857712 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.857597 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af37eaef-0d57-4b20-8562-4c782bda5732-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-8q89n\" (UID: \"af37eaef-0d57-4b20-8562-4c782bda5732\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8q89n" Jul 08 18:00:27.857712 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.857613 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spjtq\" (UniqueName: \"kubernetes.io/projected/2f44d2bf-8fe4-417f-9d1c-a7301d298135-kube-api-access-spjtq\") pod \"network-check-source-989f8b8dc-dbnrk\" (UID: \"2f44d2bf-8fe4-417f-9d1c-a7301d298135\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dbnrk" Jul 08 18:00:27.857712 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.857630 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/95031ded-dd92-46ed-96d8-0f0ec453c374-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-dnv2n\" (UID: \"95031ded-dd92-46ed-96d8-0f0ec453c374\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dnv2n" Jul 08 18:00:27.857712 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.857652 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xddfm\" (UniqueName: \"kubernetes.io/projected/d978efe4-a0ee-46e0-838a-77ec2ffc352f-kube-api-access-xddfm\") pod \"kube-storage-version-migrator-operator-846bf668f7-k2gq9\" (UID: \"d978efe4-a0ee-46e0-838a-77ec2ffc352f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-k2gq9" Jul 08 18:00:27.857712 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.857671 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/af37eaef-0d57-4b20-8562-4c782bda5732-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-8q89n\" (UID: \"af37eaef-0d57-4b20-8562-4c782bda5732\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8q89n" Jul 08 18:00:27.867896 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.867873 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-bp5bl"] Jul 08 18:00:27.876331 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.876311 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-59d7db58ff-wx86z"] Jul 08 18:00:27.877604 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.877585 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-fthbc"] Jul 08 18:00:27.958246 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.958211 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f43817dc-4c29-4408-987d-c7f86cfa07ce-serving-cert\") pod \"console-operator-68b757fb67-fthbc\" (UID: \"f43817dc-4c29-4408-987d-c7f86cfa07ce\") " pod="openshift-console-operator/console-operator-68b757fb67-fthbc" Jul 08 18:00:27.958538 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.958260 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/de99acf9-7a92-4681-b0b3-918c51c1dea5-snapshots\") pod \"insights-operator-5c847dcfc4-bp5bl\" (UID: \"de99acf9-7a92-4681-b0b3-918c51c1dea5\") " pod="openshift-insights/insights-operator-5c847dcfc4-bp5bl" Jul 08 18:00:27.958538 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.958309 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d978efe4-a0ee-46e0-838a-77ec2ffc352f-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-k2gq9\" (UID: \"d978efe4-a0ee-46e0-838a-77ec2ffc352f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-k2gq9" Jul 08 18:00:27.958538 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.958341 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de99acf9-7a92-4681-b0b3-918c51c1dea5-tmp\") pod \"insights-operator-5c847dcfc4-bp5bl\" (UID: \"de99acf9-7a92-4681-b0b3-918c51c1dea5\") " pod="openshift-insights/insights-operator-5c847dcfc4-bp5bl" Jul 08 18:00:27.958538 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.958367 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f43817dc-4c29-4408-987d-c7f86cfa07ce-config\") pod \"console-operator-68b757fb67-fthbc\" (UID: \"f43817dc-4c29-4408-987d-c7f86cfa07ce\") " pod="openshift-console-operator/console-operator-68b757fb67-fthbc" Jul 08 18:00:27.958538 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.958466 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af37eaef-0d57-4b20-8562-4c782bda5732-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-8q89n\" (UID: \"af37eaef-0d57-4b20-8562-4c782bda5732\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8q89n" Jul 08 18:00:27.958538 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.958498 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xddfm\" (UniqueName: \"kubernetes.io/projected/d978efe4-a0ee-46e0-838a-77ec2ffc352f-kube-api-access-xddfm\") pod \"kube-storage-version-migrator-operator-846bf668f7-k2gq9\" (UID: \"d978efe4-a0ee-46e0-838a-77ec2ffc352f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-k2gq9" Jul 08 18:00:27.958538 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.958523 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/af37eaef-0d57-4b20-8562-4c782bda5732-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-8q89n\" (UID: \"af37eaef-0d57-4b20-8562-4c782bda5732\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8q89n" Jul 08 18:00:27.958873 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.958552 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f43817dc-4c29-4408-987d-c7f86cfa07ce-trusted-ca\") pod \"console-operator-68b757fb67-fthbc\" (UID: \"f43817dc-4c29-4408-987d-c7f86cfa07ce\") " pod="openshift-console-operator/console-operator-68b757fb67-fthbc" Jul 08 18:00:27.958873 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.958578 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztfk5\" (UniqueName: \"kubernetes.io/projected/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-kube-api-access-ztfk5\") pod \"router-default-59d7db58ff-wx86z\" (UID: \"a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6\") " pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:27.958873 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.958603 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-default-certificate\") pod \"router-default-59d7db58ff-wx86z\" (UID: \"a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6\") " pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:27.958873 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:27.958615 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 18:00:27.958873 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:27.958685 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af37eaef-0d57-4b20-8562-4c782bda5732-cluster-monitoring-operator-tls podName:af37eaef-0d57-4b20-8562-4c782bda5732 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:28.458667886 +0000 UTC m=+272.398475291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af37eaef-0d57-4b20-8562-4c782bda5732-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-8q89n" (UID: "af37eaef-0d57-4b20-8562-4c782bda5732") : secret "cluster-monitoring-operator-tls" not found Jul 08 18:00:27.958873 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.958735 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de99acf9-7a92-4681-b0b3-918c51c1dea5-serving-cert\") pod \"insights-operator-5c847dcfc4-bp5bl\" (UID: \"de99acf9-7a92-4681-b0b3-918c51c1dea5\") " pod="openshift-insights/insights-operator-5c847dcfc4-bp5bl" Jul 08 18:00:27.958873 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.958792 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de99acf9-7a92-4681-b0b3-918c51c1dea5-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-bp5bl\" (UID: \"de99acf9-7a92-4681-b0b3-918c51c1dea5\") " pod="openshift-insights/insights-operator-5c847dcfc4-bp5bl" Jul 08 18:00:27.958873 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.958825 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw7z2\" (UniqueName: \"kubernetes.io/projected/95031ded-dd92-46ed-96d8-0f0ec453c374-kube-api-access-nw7z2\") pod \"cluster-samples-operator-56fcf86bf-dnv2n\" (UID: \"95031ded-dd92-46ed-96d8-0f0ec453c374\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dnv2n" Jul 08 18:00:27.958873 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.958870 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-metrics-certs\") pod \"router-default-59d7db58ff-wx86z\" (UID: \"a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6\") " pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:27.959299 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.958897 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fndnc\" (UniqueName: \"kubernetes.io/projected/f43817dc-4c29-4408-987d-c7f86cfa07ce-kube-api-access-fndnc\") pod \"console-operator-68b757fb67-fthbc\" (UID: \"f43817dc-4c29-4408-987d-c7f86cfa07ce\") " pod="openshift-console-operator/console-operator-68b757fb67-fthbc" Jul 08 18:00:27.959299 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.958950 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d978efe4-a0ee-46e0-838a-77ec2ffc352f-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-k2gq9\" (UID: \"d978efe4-a0ee-46e0-838a-77ec2ffc352f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-k2gq9" Jul 08 18:00:27.959299 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.958974 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spjtq\" (UniqueName: \"kubernetes.io/projected/2f44d2bf-8fe4-417f-9d1c-a7301d298135-kube-api-access-spjtq\") pod \"network-check-source-989f8b8dc-dbnrk\" (UID: \"2f44d2bf-8fe4-417f-9d1c-a7301d298135\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dbnrk" Jul 08 18:00:27.959299 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.958994 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-stats-auth\") pod \"router-default-59d7db58ff-wx86z\" (UID: \"a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6\") " pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:27.959299 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.959009 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r8mh\" (UniqueName: \"kubernetes.io/projected/de99acf9-7a92-4681-b0b3-918c51c1dea5-kube-api-access-6r8mh\") pod \"insights-operator-5c847dcfc4-bp5bl\" (UID: \"de99acf9-7a92-4681-b0b3-918c51c1dea5\") " pod="openshift-insights/insights-operator-5c847dcfc4-bp5bl" Jul 08 18:00:27.959299 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.959105 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/95031ded-dd92-46ed-96d8-0f0ec453c374-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-dnv2n\" (UID: \"95031ded-dd92-46ed-96d8-0f0ec453c374\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dnv2n" Jul 08 18:00:27.959299 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.959133 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-service-ca-bundle\") pod \"router-default-59d7db58ff-wx86z\" (UID: \"a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6\") " pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:27.959299 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.959160 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de99acf9-7a92-4681-b0b3-918c51c1dea5-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-bp5bl\" (UID: \"de99acf9-7a92-4681-b0b3-918c51c1dea5\") " pod="openshift-insights/insights-operator-5c847dcfc4-bp5bl" Jul 08 18:00:27.959299 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.959232 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2lwb\" (UniqueName: \"kubernetes.io/projected/af37eaef-0d57-4b20-8562-4c782bda5732-kube-api-access-c2lwb\") pod \"cluster-monitoring-operator-64786d9cbb-8q89n\" (UID: \"af37eaef-0d57-4b20-8562-4c782bda5732\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8q89n" Jul 08 18:00:27.959299 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.959253 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/af37eaef-0d57-4b20-8562-4c782bda5732-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-8q89n\" (UID: \"af37eaef-0d57-4b20-8562-4c782bda5732\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8q89n" Jul 08 18:00:27.959299 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:27.959284 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 18:00:27.959674 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:27.959366 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95031ded-dd92-46ed-96d8-0f0ec453c374-samples-operator-tls podName:95031ded-dd92-46ed-96d8-0f0ec453c374 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:28.459351758 +0000 UTC m=+272.399159168 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/95031ded-dd92-46ed-96d8-0f0ec453c374-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-dnv2n" (UID: "95031ded-dd92-46ed-96d8-0f0ec453c374") : secret "samples-operator-tls" not found Jul 08 18:00:27.959674 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.959460 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d978efe4-a0ee-46e0-838a-77ec2ffc352f-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-k2gq9\" (UID: \"d978efe4-a0ee-46e0-838a-77ec2ffc352f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-k2gq9" Jul 08 18:00:27.960605 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.960587 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d978efe4-a0ee-46e0-838a-77ec2ffc352f-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-k2gq9\" (UID: \"d978efe4-a0ee-46e0-838a-77ec2ffc352f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-k2gq9" Jul 08 18:00:27.971005 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.970978 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spjtq\" (UniqueName: \"kubernetes.io/projected/2f44d2bf-8fe4-417f-9d1c-a7301d298135-kube-api-access-spjtq\") pod \"network-check-source-989f8b8dc-dbnrk\" (UID: \"2f44d2bf-8fe4-417f-9d1c-a7301d298135\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dbnrk" Jul 08 18:00:27.971137 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.971097 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw7z2\" (UniqueName: \"kubernetes.io/projected/95031ded-dd92-46ed-96d8-0f0ec453c374-kube-api-access-nw7z2\") pod \"cluster-samples-operator-56fcf86bf-dnv2n\" (UID: \"95031ded-dd92-46ed-96d8-0f0ec453c374\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dnv2n" Jul 08 18:00:27.971715 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.971688 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2lwb\" (UniqueName: \"kubernetes.io/projected/af37eaef-0d57-4b20-8562-4c782bda5732-kube-api-access-c2lwb\") pod \"cluster-monitoring-operator-64786d9cbb-8q89n\" (UID: \"af37eaef-0d57-4b20-8562-4c782bda5732\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8q89n" Jul 08 18:00:27.971936 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:27.971917 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xddfm\" (UniqueName: \"kubernetes.io/projected/d978efe4-a0ee-46e0-838a-77ec2ffc352f-kube-api-access-xddfm\") pod \"kube-storage-version-migrator-operator-846bf668f7-k2gq9\" (UID: \"d978efe4-a0ee-46e0-838a-77ec2ffc352f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-k2gq9" Jul 08 18:00:28.056129 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.056098 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-k2gq9" Jul 08 18:00:28.060053 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.060035 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-service-ca-bundle\") pod \"router-default-59d7db58ff-wx86z\" (UID: \"a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6\") " pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:28.060120 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.060065 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de99acf9-7a92-4681-b0b3-918c51c1dea5-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-bp5bl\" (UID: \"de99acf9-7a92-4681-b0b3-918c51c1dea5\") " pod="openshift-insights/insights-operator-5c847dcfc4-bp5bl" Jul 08 18:00:28.060120 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.060100 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f43817dc-4c29-4408-987d-c7f86cfa07ce-serving-cert\") pod \"console-operator-68b757fb67-fthbc\" (UID: \"f43817dc-4c29-4408-987d-c7f86cfa07ce\") " pod="openshift-console-operator/console-operator-68b757fb67-fthbc" Jul 08 18:00:28.060243 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:28.060231 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-service-ca-bundle podName:a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:28.560213717 +0000 UTC m=+272.500021127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-service-ca-bundle") pod "router-default-59d7db58ff-wx86z" (UID: "a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6") : configmap references non-existent config key: service-ca.crt Jul 08 18:00:28.060312 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.060255 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/de99acf9-7a92-4681-b0b3-918c51c1dea5-snapshots\") pod \"insights-operator-5c847dcfc4-bp5bl\" (UID: \"de99acf9-7a92-4681-b0b3-918c51c1dea5\") " pod="openshift-insights/insights-operator-5c847dcfc4-bp5bl" Jul 08 18:00:28.060312 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.060280 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de99acf9-7a92-4681-b0b3-918c51c1dea5-tmp\") pod \"insights-operator-5c847dcfc4-bp5bl\" (UID: \"de99acf9-7a92-4681-b0b3-918c51c1dea5\") " pod="openshift-insights/insights-operator-5c847dcfc4-bp5bl" Jul 08 18:00:28.060312 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.060304 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f43817dc-4c29-4408-987d-c7f86cfa07ce-config\") pod \"console-operator-68b757fb67-fthbc\" (UID: \"f43817dc-4c29-4408-987d-c7f86cfa07ce\") " pod="openshift-console-operator/console-operator-68b757fb67-fthbc" Jul 08 18:00:28.060461 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.060350 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f43817dc-4c29-4408-987d-c7f86cfa07ce-trusted-ca\") pod \"console-operator-68b757fb67-fthbc\" (UID: \"f43817dc-4c29-4408-987d-c7f86cfa07ce\") " pod="openshift-console-operator/console-operator-68b757fb67-fthbc" Jul 08 18:00:28.060598 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.060568 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztfk5\" (UniqueName: \"kubernetes.io/projected/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-kube-api-access-ztfk5\") pod \"router-default-59d7db58ff-wx86z\" (UID: \"a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6\") " pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:28.060703 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.060687 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-default-certificate\") pod \"router-default-59d7db58ff-wx86z\" (UID: \"a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6\") " pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:28.060829 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.060812 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de99acf9-7a92-4681-b0b3-918c51c1dea5-serving-cert\") pod \"insights-operator-5c847dcfc4-bp5bl\" (UID: \"de99acf9-7a92-4681-b0b3-918c51c1dea5\") " pod="openshift-insights/insights-operator-5c847dcfc4-bp5bl" Jul 08 18:00:28.060950 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.060936 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de99acf9-7a92-4681-b0b3-918c51c1dea5-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-bp5bl\" (UID: \"de99acf9-7a92-4681-b0b3-918c51c1dea5\") " pod="openshift-insights/insights-operator-5c847dcfc4-bp5bl" Jul 08 18:00:28.061049 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.061035 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-metrics-certs\") pod \"router-default-59d7db58ff-wx86z\" (UID: \"a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6\") " pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:28.061134 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.060958 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/de99acf9-7a92-4681-b0b3-918c51c1dea5-snapshots\") pod \"insights-operator-5c847dcfc4-bp5bl\" (UID: \"de99acf9-7a92-4681-b0b3-918c51c1dea5\") " pod="openshift-insights/insights-operator-5c847dcfc4-bp5bl" Jul 08 18:00:28.061223 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.061105 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f43817dc-4c29-4408-987d-c7f86cfa07ce-config\") pod \"console-operator-68b757fb67-fthbc\" (UID: \"f43817dc-4c29-4408-987d-c7f86cfa07ce\") " pod="openshift-console-operator/console-operator-68b757fb67-fthbc" Jul 08 18:00:28.061223 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.061158 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de99acf9-7a92-4681-b0b3-918c51c1dea5-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-bp5bl\" (UID: \"de99acf9-7a92-4681-b0b3-918c51c1dea5\") " pod="openshift-insights/insights-operator-5c847dcfc4-bp5bl" Jul 08 18:00:28.061342 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.061234 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dbnrk" Jul 08 18:00:28.061342 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:28.061239 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 18:00:28.061342 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:28.061286 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-metrics-certs podName:a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:28.561268544 +0000 UTC m=+272.501075950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-metrics-certs") pod "router-default-59d7db58ff-wx86z" (UID: "a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6") : secret "router-metrics-certs-default" not found Jul 08 18:00:28.061568 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.060861 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de99acf9-7a92-4681-b0b3-918c51c1dea5-tmp\") pod \"insights-operator-5c847dcfc4-bp5bl\" (UID: \"de99acf9-7a92-4681-b0b3-918c51c1dea5\") " pod="openshift-insights/insights-operator-5c847dcfc4-bp5bl" Jul 08 18:00:28.061628 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.061573 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de99acf9-7a92-4681-b0b3-918c51c1dea5-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-bp5bl\" (UID: \"de99acf9-7a92-4681-b0b3-918c51c1dea5\") " pod="openshift-insights/insights-operator-5c847dcfc4-bp5bl" Jul 08 18:00:28.061709 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.061687 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fndnc\" (UniqueName: \"kubernetes.io/projected/f43817dc-4c29-4408-987d-c7f86cfa07ce-kube-api-access-fndnc\") pod \"console-operator-68b757fb67-fthbc\" (UID: \"f43817dc-4c29-4408-987d-c7f86cfa07ce\") " pod="openshift-console-operator/console-operator-68b757fb67-fthbc" Jul 08 18:00:28.061782 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.061766 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-stats-auth\") pod \"router-default-59d7db58ff-wx86z\" (UID: \"a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6\") " pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:28.061960 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.061940 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f43817dc-4c29-4408-987d-c7f86cfa07ce-trusted-ca\") pod \"console-operator-68b757fb67-fthbc\" (UID: \"f43817dc-4c29-4408-987d-c7f86cfa07ce\") " pod="openshift-console-operator/console-operator-68b757fb67-fthbc" Jul 08 18:00:28.062034 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.061954 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r8mh\" (UniqueName: \"kubernetes.io/projected/de99acf9-7a92-4681-b0b3-918c51c1dea5-kube-api-access-6r8mh\") pod \"insights-operator-5c847dcfc4-bp5bl\" (UID: \"de99acf9-7a92-4681-b0b3-918c51c1dea5\") " pod="openshift-insights/insights-operator-5c847dcfc4-bp5bl" Jul 08 18:00:28.062877 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.062852 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f43817dc-4c29-4408-987d-c7f86cfa07ce-serving-cert\") pod \"console-operator-68b757fb67-fthbc\" (UID: \"f43817dc-4c29-4408-987d-c7f86cfa07ce\") " pod="openshift-console-operator/console-operator-68b757fb67-fthbc" Jul 08 18:00:28.063485 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.063463 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de99acf9-7a92-4681-b0b3-918c51c1dea5-serving-cert\") pod \"insights-operator-5c847dcfc4-bp5bl\" (UID: \"de99acf9-7a92-4681-b0b3-918c51c1dea5\") " pod="openshift-insights/insights-operator-5c847dcfc4-bp5bl" Jul 08 18:00:28.063822 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.063680 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-default-certificate\") pod \"router-default-59d7db58ff-wx86z\" (UID: \"a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6\") " pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:28.064244 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.064224 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-stats-auth\") pod \"router-default-59d7db58ff-wx86z\" (UID: \"a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6\") " pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:28.070743 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.070719 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztfk5\" (UniqueName: \"kubernetes.io/projected/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-kube-api-access-ztfk5\") pod \"router-default-59d7db58ff-wx86z\" (UID: \"a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6\") " pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:28.070921 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.070899 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fndnc\" (UniqueName: \"kubernetes.io/projected/f43817dc-4c29-4408-987d-c7f86cfa07ce-kube-api-access-fndnc\") pod \"console-operator-68b757fb67-fthbc\" (UID: \"f43817dc-4c29-4408-987d-c7f86cfa07ce\") " pod="openshift-console-operator/console-operator-68b757fb67-fthbc" Jul 08 18:00:28.071007 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.070989 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r8mh\" (UniqueName: \"kubernetes.io/projected/de99acf9-7a92-4681-b0b3-918c51c1dea5-kube-api-access-6r8mh\") pod \"insights-operator-5c847dcfc4-bp5bl\" (UID: \"de99acf9-7a92-4681-b0b3-918c51c1dea5\") " pod="openshift-insights/insights-operator-5c847dcfc4-bp5bl" Jul 08 18:00:28.146772 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.146603 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-fthbc" Jul 08 18:00:28.152593 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.152570 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-bp5bl" Jul 08 18:00:28.188375 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.188345 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-k2gq9"] Jul 08 18:00:28.192859 ip-10-0-128-234 kubenswrapper[2579]: W0708 18:00:28.192820 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd978efe4_a0ee_46e0_838a_77ec2ffc352f.slice/crio-1e0210e91ced9f330f0caa14ccec107e450c594039a389bf5bb6793af92b89c4 WatchSource:0}: Error finding container 1e0210e91ced9f330f0caa14ccec107e450c594039a389bf5bb6793af92b89c4: Status 404 returned error can't find the container with id 1e0210e91ced9f330f0caa14ccec107e450c594039a389bf5bb6793af92b89c4 Jul 08 18:00:28.210589 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.210487 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-dbnrk"] Jul 08 18:00:28.219802 ip-10-0-128-234 kubenswrapper[2579]: W0708 18:00:28.219768 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f44d2bf_8fe4_417f_9d1c_a7301d298135.slice/crio-bab00b199ebce92dbff429ad715ec4d7e40ff7317d96cfec267813d0f035e3d1 WatchSource:0}: Error finding container bab00b199ebce92dbff429ad715ec4d7e40ff7317d96cfec267813d0f035e3d1: Status 404 returned error can't find the container with id bab00b199ebce92dbff429ad715ec4d7e40ff7317d96cfec267813d0f035e3d1 Jul 08 18:00:28.292462 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.292437 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-fthbc"] Jul 08 18:00:28.296153 ip-10-0-128-234 kubenswrapper[2579]: W0708 18:00:28.296130 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf43817dc_4c29_4408_987d_c7f86cfa07ce.slice/crio-fa8e0fb36a515a48b4a08b80828e5ce14ac3d8c1e67e2566364d66e46074ee54 WatchSource:0}: Error finding container fa8e0fb36a515a48b4a08b80828e5ce14ac3d8c1e67e2566364d66e46074ee54: Status 404 returned error can't find the container with id fa8e0fb36a515a48b4a08b80828e5ce14ac3d8c1e67e2566364d66e46074ee54 Jul 08 18:00:28.309960 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.309896 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-bp5bl"] Jul 08 18:00:28.313391 ip-10-0-128-234 kubenswrapper[2579]: W0708 18:00:28.313369 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde99acf9_7a92_4681_b0b3_918c51c1dea5.slice/crio-b8e9401c5d986a8563af3799adc6bbc824bdbac79d2540601b756e51f020e92f WatchSource:0}: Error finding container b8e9401c5d986a8563af3799adc6bbc824bdbac79d2540601b756e51f020e92f: Status 404 returned error can't find the container with id b8e9401c5d986a8563af3799adc6bbc824bdbac79d2540601b756e51f020e92f Jul 08 18:00:28.327425 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.327389 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-bp5bl" event={"ID":"de99acf9-7a92-4681-b0b3-918c51c1dea5","Type":"ContainerStarted","Data":"b8e9401c5d986a8563af3799adc6bbc824bdbac79d2540601b756e51f020e92f"} Jul 08 18:00:28.328918 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.328893 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dbnrk" event={"ID":"2f44d2bf-8fe4-417f-9d1c-a7301d298135","Type":"ContainerStarted","Data":"4d94ae5a0099e1c8adbec56c958225c501015a082ef06bcbe1e82cfdec8990ff"} Jul 08 18:00:28.329031 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.328944 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dbnrk" event={"ID":"2f44d2bf-8fe4-417f-9d1c-a7301d298135","Type":"ContainerStarted","Data":"bab00b199ebce92dbff429ad715ec4d7e40ff7317d96cfec267813d0f035e3d1"} Jul 08 18:00:28.330057 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.330036 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-fthbc" event={"ID":"f43817dc-4c29-4408-987d-c7f86cfa07ce","Type":"ContainerStarted","Data":"fa8e0fb36a515a48b4a08b80828e5ce14ac3d8c1e67e2566364d66e46074ee54"} Jul 08 18:00:28.331030 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.331010 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-k2gq9" event={"ID":"d978efe4-a0ee-46e0-838a-77ec2ffc352f","Type":"ContainerStarted","Data":"1e0210e91ced9f330f0caa14ccec107e450c594039a389bf5bb6793af92b89c4"} Jul 08 18:00:28.354153 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.354103 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dbnrk" podStartSLOduration=1.354088724 podStartE2EDuration="1.354088724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:00:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:00:28.353461786 +0000 UTC m=+272.293269215" watchObservedRunningTime="2026-07-08 18:00:28.354088724 +0000 UTC m=+272.293896150" Jul 08 18:00:28.465456 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.465417 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/95031ded-dd92-46ed-96d8-0f0ec453c374-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-dnv2n\" (UID: \"95031ded-dd92-46ed-96d8-0f0ec453c374\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dnv2n" Jul 08 18:00:28.465654 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.465492 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af37eaef-0d57-4b20-8562-4c782bda5732-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-8q89n\" (UID: \"af37eaef-0d57-4b20-8562-4c782bda5732\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8q89n" Jul 08 18:00:28.465654 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:28.465594 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 18:00:28.465654 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:28.465643 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 18:00:28.465802 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:28.465650 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af37eaef-0d57-4b20-8562-4c782bda5732-cluster-monitoring-operator-tls podName:af37eaef-0d57-4b20-8562-4c782bda5732 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:29.465636218 +0000 UTC m=+273.405443622 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af37eaef-0d57-4b20-8562-4c782bda5732-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-8q89n" (UID: "af37eaef-0d57-4b20-8562-4c782bda5732") : secret "cluster-monitoring-operator-tls" not found Jul 08 18:00:28.465802 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:28.465710 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95031ded-dd92-46ed-96d8-0f0ec453c374-samples-operator-tls podName:95031ded-dd92-46ed-96d8-0f0ec453c374 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:29.465691761 +0000 UTC m=+273.405499180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/95031ded-dd92-46ed-96d8-0f0ec453c374-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-dnv2n" (UID: "95031ded-dd92-46ed-96d8-0f0ec453c374") : secret "samples-operator-tls" not found Jul 08 18:00:28.566795 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.566706 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-metrics-certs\") pod \"router-default-59d7db58ff-wx86z\" (UID: \"a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6\") " pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:28.566795 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:28.566766 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-service-ca-bundle\") pod \"router-default-59d7db58ff-wx86z\" (UID: \"a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6\") " pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:28.566999 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:28.566851 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 18:00:28.566999 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:28.566881 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-service-ca-bundle podName:a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:29.566867971 +0000 UTC m=+273.506675376 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-service-ca-bundle") pod "router-default-59d7db58ff-wx86z" (UID: "a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6") : configmap references non-existent config key: service-ca.crt Jul 08 18:00:28.566999 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:28.566985 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-metrics-certs podName:a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:29.566973592 +0000 UTC m=+273.506780997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-metrics-certs") pod "router-default-59d7db58ff-wx86z" (UID: "a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6") : secret "router-metrics-certs-default" not found Jul 08 18:00:29.473576 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:29.473536 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af37eaef-0d57-4b20-8562-4c782bda5732-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-8q89n\" (UID: \"af37eaef-0d57-4b20-8562-4c782bda5732\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8q89n" Jul 08 18:00:29.473936 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:29.473686 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 18:00:29.473936 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:29.473705 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/95031ded-dd92-46ed-96d8-0f0ec453c374-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-dnv2n\" (UID: \"95031ded-dd92-46ed-96d8-0f0ec453c374\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dnv2n" Jul 08 18:00:29.473936 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:29.473747 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af37eaef-0d57-4b20-8562-4c782bda5732-cluster-monitoring-operator-tls podName:af37eaef-0d57-4b20-8562-4c782bda5732 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:31.473732089 +0000 UTC m=+275.413539494 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af37eaef-0d57-4b20-8562-4c782bda5732-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-8q89n" (UID: "af37eaef-0d57-4b20-8562-4c782bda5732") : secret "cluster-monitoring-operator-tls" not found Jul 08 18:00:29.473936 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:29.473815 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 18:00:29.473936 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:29.473864 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95031ded-dd92-46ed-96d8-0f0ec453c374-samples-operator-tls podName:95031ded-dd92-46ed-96d8-0f0ec453c374 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:31.47385342 +0000 UTC m=+275.413660825 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/95031ded-dd92-46ed-96d8-0f0ec453c374-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-dnv2n" (UID: "95031ded-dd92-46ed-96d8-0f0ec453c374") : secret "samples-operator-tls" not found Jul 08 18:00:29.574105 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:29.574068 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-metrics-certs\") pod \"router-default-59d7db58ff-wx86z\" (UID: \"a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6\") " pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:29.574272 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:29.574126 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-service-ca-bundle\") pod \"router-default-59d7db58ff-wx86z\" (UID: \"a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6\") " pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:29.574272 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:29.574244 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 18:00:29.574350 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:29.574281 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-service-ca-bundle podName:a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:31.57426781 +0000 UTC m=+275.514075215 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-service-ca-bundle") pod "router-default-59d7db58ff-wx86z" (UID: "a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6") : configmap references non-existent config key: service-ca.crt Jul 08 18:00:29.574350 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:29.574305 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-metrics-certs podName:a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:31.574290229 +0000 UTC m=+275.514097634 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-metrics-certs") pod "router-default-59d7db58ff-wx86z" (UID: "a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6") : secret "router-metrics-certs-default" not found Jul 08 18:00:31.489738 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:31.489698 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af37eaef-0d57-4b20-8562-4c782bda5732-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-8q89n\" (UID: \"af37eaef-0d57-4b20-8562-4c782bda5732\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8q89n" Jul 08 18:00:31.490145 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:31.489874 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 18:00:31.490145 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:31.489905 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/95031ded-dd92-46ed-96d8-0f0ec453c374-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-dnv2n\" (UID: \"95031ded-dd92-46ed-96d8-0f0ec453c374\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dnv2n" Jul 08 18:00:31.490145 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:31.489952 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af37eaef-0d57-4b20-8562-4c782bda5732-cluster-monitoring-operator-tls podName:af37eaef-0d57-4b20-8562-4c782bda5732 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:35.489931988 +0000 UTC m=+279.429739407 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af37eaef-0d57-4b20-8562-4c782bda5732-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-8q89n" (UID: "af37eaef-0d57-4b20-8562-4c782bda5732") : secret "cluster-monitoring-operator-tls" not found Jul 08 18:00:31.490145 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:31.490011 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 18:00:31.490145 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:31.490065 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95031ded-dd92-46ed-96d8-0f0ec453c374-samples-operator-tls podName:95031ded-dd92-46ed-96d8-0f0ec453c374 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:35.490046699 +0000 UTC m=+279.429854106 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/95031ded-dd92-46ed-96d8-0f0ec453c374-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-dnv2n" (UID: "95031ded-dd92-46ed-96d8-0f0ec453c374") : secret "samples-operator-tls" not found Jul 08 18:00:31.591084 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:31.591042 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-service-ca-bundle\") pod \"router-default-59d7db58ff-wx86z\" (UID: \"a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6\") " pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:31.591283 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:31.591238 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-service-ca-bundle podName:a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:35.591217676 +0000 UTC m=+279.531025081 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-service-ca-bundle") pod "router-default-59d7db58ff-wx86z" (UID: "a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6") : configmap references non-existent config key: service-ca.crt Jul 08 18:00:31.591360 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:31.591282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-metrics-certs\") pod \"router-default-59d7db58ff-wx86z\" (UID: \"a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6\") " pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:31.591411 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:31.591382 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 18:00:31.591463 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:31.591442 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-metrics-certs podName:a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:35.591424956 +0000 UTC m=+279.531232377 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-metrics-certs") pod "router-default-59d7db58ff-wx86z" (UID: "a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6") : secret "router-metrics-certs-default" not found Jul 08 18:00:32.342747 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:32.342716 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fthbc_f43817dc-4c29-4408-987d-c7f86cfa07ce/console-operator/0.log" Jul 08 18:00:32.342997 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:32.342767 2579 generic.go:356] "Generic (PLEG): container finished" podID="f43817dc-4c29-4408-987d-c7f86cfa07ce" containerID="18ae51a1bd3d0813b62225dbb3dde43d21101d442b6b56898ac081148e5de51e" exitCode=255 Jul 08 18:00:32.342997 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:32.342808 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-fthbc" event={"ID":"f43817dc-4c29-4408-987d-c7f86cfa07ce","Type":"ContainerDied","Data":"18ae51a1bd3d0813b62225dbb3dde43d21101d442b6b56898ac081148e5de51e"} Jul 08 18:00:32.343109 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:32.343080 2579 scope.go:117] "RemoveContainer" containerID="18ae51a1bd3d0813b62225dbb3dde43d21101d442b6b56898ac081148e5de51e" Jul 08 18:00:33.348065 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:33.348040 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fthbc_f43817dc-4c29-4408-987d-c7f86cfa07ce/console-operator/1.log" Jul 08 18:00:33.348614 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:33.348497 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fthbc_f43817dc-4c29-4408-987d-c7f86cfa07ce/console-operator/0.log" Jul 08 18:00:33.348614 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:33.348532 2579 generic.go:356] "Generic (PLEG): container finished" podID="f43817dc-4c29-4408-987d-c7f86cfa07ce" containerID="1be6f3af843cb354778673b61fbc938dd15cd63da062bbe2ff960d14b48d3d34" exitCode=255 Jul 08 18:00:33.348732 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:33.348622 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-fthbc" event={"ID":"f43817dc-4c29-4408-987d-c7f86cfa07ce","Type":"ContainerDied","Data":"1be6f3af843cb354778673b61fbc938dd15cd63da062bbe2ff960d14b48d3d34"} Jul 08 18:00:33.348732 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:33.348681 2579 scope.go:117] "RemoveContainer" containerID="18ae51a1bd3d0813b62225dbb3dde43d21101d442b6b56898ac081148e5de51e" Jul 08 18:00:33.348950 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:33.348927 2579 scope.go:117] "RemoveContainer" containerID="1be6f3af843cb354778673b61fbc938dd15cd63da062bbe2ff960d14b48d3d34" Jul 08 18:00:33.349190 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:33.349143 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-fthbc_openshift-console-operator(f43817dc-4c29-4408-987d-c7f86cfa07ce)\"" pod="openshift-console-operator/console-operator-68b757fb67-fthbc" podUID="f43817dc-4c29-4408-987d-c7f86cfa07ce" Jul 08 18:00:33.350515 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:33.350490 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-k2gq9" event={"ID":"d978efe4-a0ee-46e0-838a-77ec2ffc352f","Type":"ContainerStarted","Data":"079e9afae986c26fb60f19b584a34aab0d8c7aaaa715a513a160eaae589ec233"} Jul 08 18:00:33.351916 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:33.351897 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-bp5bl" event={"ID":"de99acf9-7a92-4681-b0b3-918c51c1dea5","Type":"ContainerStarted","Data":"efcd685d3034d0ee0a44b753e3f38044bfb0cbf7b70f8d6726e128d8e6b9de45"} Jul 08 18:00:33.384468 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:33.384401 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-k2gq9" podStartSLOduration=1.9054640360000001 podStartE2EDuration="6.384381832s" totalImagesPullingTime="4.478917796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:00:33.383649829 +0000 UTC m=+277.323457256" watchObservedRunningTime="2026-07-08 18:00:33.384381832 +0000 UTC m=+277.324189261" Jul 08 18:00:33.403274 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:33.403223 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-bp5bl" podStartSLOduration=2.044847065 podStartE2EDuration="6.403200927s" totalImagesPullingTime="4.358353862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:00:33.401862318 +0000 UTC m=+277.341669746" watchObservedRunningTime="2026-07-08 18:00:33.403200927 +0000 UTC m=+277.343008354" Jul 08 18:00:34.356919 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:34.356885 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fthbc_f43817dc-4c29-4408-987d-c7f86cfa07ce/console-operator/1.log" Jul 08 18:00:34.357378 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:34.357286 2579 scope.go:117] "RemoveContainer" containerID="1be6f3af843cb354778673b61fbc938dd15cd63da062bbe2ff960d14b48d3d34" Jul 08 18:00:34.357494 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:34.357473 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-fthbc_openshift-console-operator(f43817dc-4c29-4408-987d-c7f86cfa07ce)\"" pod="openshift-console-operator/console-operator-68b757fb67-fthbc" podUID="f43817dc-4c29-4408-987d-c7f86cfa07ce" Jul 08 18:00:34.652502 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:34.652430 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-db66r"] Jul 08 18:00:34.656440 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:34.656422 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-db66r" Jul 08 18:00:34.660563 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:34.660542 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 18:00:34.660743 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:34.660719 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s29zl\"" Jul 08 18:00:34.663617 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:34.663599 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 18:00:34.673091 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:34.673069 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-db66r"] Jul 08 18:00:34.728150 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:34.728122 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5b81533-a7d9-4a5e-9802-9912a8db6293-data-volume\") pod \"insights-runtime-extractor-db66r\" (UID: \"e5b81533-a7d9-4a5e-9802-9912a8db6293\") " pod="openshift-insights/insights-runtime-extractor-db66r" Jul 08 18:00:34.728327 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:34.728156 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5b81533-a7d9-4a5e-9802-9912a8db6293-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-db66r\" (UID: \"e5b81533-a7d9-4a5e-9802-9912a8db6293\") " pod="openshift-insights/insights-runtime-extractor-db66r" Jul 08 18:00:34.728327 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:34.728220 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8rfq\" (UniqueName: \"kubernetes.io/projected/e5b81533-a7d9-4a5e-9802-9912a8db6293-kube-api-access-x8rfq\") pod \"insights-runtime-extractor-db66r\" (UID: \"e5b81533-a7d9-4a5e-9802-9912a8db6293\") " pod="openshift-insights/insights-runtime-extractor-db66r" Jul 08 18:00:34.728327 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:34.728256 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e5b81533-a7d9-4a5e-9802-9912a8db6293-crio-socket\") pod \"insights-runtime-extractor-db66r\" (UID: \"e5b81533-a7d9-4a5e-9802-9912a8db6293\") " pod="openshift-insights/insights-runtime-extractor-db66r" Jul 08 18:00:34.728327 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:34.728320 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e5b81533-a7d9-4a5e-9802-9912a8db6293-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-db66r\" (UID: \"e5b81533-a7d9-4a5e-9802-9912a8db6293\") " pod="openshift-insights/insights-runtime-extractor-db66r" Jul 08 18:00:34.829302 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:34.829263 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e5b81533-a7d9-4a5e-9802-9912a8db6293-crio-socket\") pod \"insights-runtime-extractor-db66r\" (UID: \"e5b81533-a7d9-4a5e-9802-9912a8db6293\") " pod="openshift-insights/insights-runtime-extractor-db66r" Jul 08 18:00:34.829478 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:34.829328 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e5b81533-a7d9-4a5e-9802-9912a8db6293-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-db66r\" (UID: \"e5b81533-a7d9-4a5e-9802-9912a8db6293\") " pod="openshift-insights/insights-runtime-extractor-db66r" Jul 08 18:00:34.829478 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:34.829378 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5b81533-a7d9-4a5e-9802-9912a8db6293-data-volume\") pod \"insights-runtime-extractor-db66r\" (UID: \"e5b81533-a7d9-4a5e-9802-9912a8db6293\") " pod="openshift-insights/insights-runtime-extractor-db66r" Jul 08 18:00:34.829478 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:34.829398 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5b81533-a7d9-4a5e-9802-9912a8db6293-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-db66r\" (UID: \"e5b81533-a7d9-4a5e-9802-9912a8db6293\") " pod="openshift-insights/insights-runtime-extractor-db66r" Jul 08 18:00:34.829478 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:34.829406 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e5b81533-a7d9-4a5e-9802-9912a8db6293-crio-socket\") pod \"insights-runtime-extractor-db66r\" (UID: \"e5b81533-a7d9-4a5e-9802-9912a8db6293\") " pod="openshift-insights/insights-runtime-extractor-db66r" Jul 08 18:00:34.829478 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:34.829457 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8rfq\" (UniqueName: \"kubernetes.io/projected/e5b81533-a7d9-4a5e-9802-9912a8db6293-kube-api-access-x8rfq\") pod \"insights-runtime-extractor-db66r\" (UID: \"e5b81533-a7d9-4a5e-9802-9912a8db6293\") " pod="openshift-insights/insights-runtime-extractor-db66r" Jul 08 18:00:34.829699 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:34.829499 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 18:00:34.829699 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:34.829511 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:00:34.829699 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:34.829577 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5b81533-a7d9-4a5e-9802-9912a8db6293-insights-runtime-extractor-tls podName:e5b81533-a7d9-4a5e-9802-9912a8db6293 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:35.329558245 +0000 UTC m=+279.269365650 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e5b81533-a7d9-4a5e-9802-9912a8db6293-insights-runtime-extractor-tls") pod "insights-runtime-extractor-db66r" (UID: "e5b81533-a7d9-4a5e-9802-9912a8db6293") : secret "insights-runtime-extractor-tls" not found Jul 08 18:00:34.829699 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:34.829595 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e5b81533-a7d9-4a5e-9802-9912a8db6293-kube-rbac-proxy-cm podName:e5b81533-a7d9-4a5e-9802-9912a8db6293 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:35.329585415 +0000 UTC m=+279.269392826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e5b81533-a7d9-4a5e-9802-9912a8db6293-kube-rbac-proxy-cm") pod "insights-runtime-extractor-db66r" (UID: "e5b81533-a7d9-4a5e-9802-9912a8db6293") : configmap "kube-rbac-proxy" not found Jul 08 18:00:34.829938 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:34.829758 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5b81533-a7d9-4a5e-9802-9912a8db6293-data-volume\") pod \"insights-runtime-extractor-db66r\" (UID: \"e5b81533-a7d9-4a5e-9802-9912a8db6293\") " pod="openshift-insights/insights-runtime-extractor-db66r" Jul 08 18:00:34.838574 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:34.838539 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8rfq\" (UniqueName: \"kubernetes.io/projected/e5b81533-a7d9-4a5e-9802-9912a8db6293-kube-api-access-x8rfq\") pod \"insights-runtime-extractor-db66r\" (UID: \"e5b81533-a7d9-4a5e-9802-9912a8db6293\") " pod="openshift-insights/insights-runtime-extractor-db66r" Jul 08 18:00:35.335248 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:35.335203 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5b81533-a7d9-4a5e-9802-9912a8db6293-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-db66r\" (UID: \"e5b81533-a7d9-4a5e-9802-9912a8db6293\") " pod="openshift-insights/insights-runtime-extractor-db66r" Jul 08 18:00:35.335468 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:35.335320 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e5b81533-a7d9-4a5e-9802-9912a8db6293-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-db66r\" (UID: \"e5b81533-a7d9-4a5e-9802-9912a8db6293\") " pod="openshift-insights/insights-runtime-extractor-db66r" Jul 08 18:00:35.335468 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:35.335377 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:00:35.335468 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:35.335419 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 18:00:35.335745 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:35.335469 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5b81533-a7d9-4a5e-9802-9912a8db6293-insights-runtime-extractor-tls podName:e5b81533-a7d9-4a5e-9802-9912a8db6293 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:36.335448723 +0000 UTC m=+280.275256140 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e5b81533-a7d9-4a5e-9802-9912a8db6293-insights-runtime-extractor-tls") pod "insights-runtime-extractor-db66r" (UID: "e5b81533-a7d9-4a5e-9802-9912a8db6293") : secret "insights-runtime-extractor-tls" not found Jul 08 18:00:35.335745 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:35.335492 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e5b81533-a7d9-4a5e-9802-9912a8db6293-kube-rbac-proxy-cm podName:e5b81533-a7d9-4a5e-9802-9912a8db6293 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:36.335482349 +0000 UTC m=+280.275289754 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e5b81533-a7d9-4a5e-9802-9912a8db6293-kube-rbac-proxy-cm") pod "insights-runtime-extractor-db66r" (UID: "e5b81533-a7d9-4a5e-9802-9912a8db6293") : configmap "kube-rbac-proxy" not found Jul 08 18:00:35.537223 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:35.537186 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/95031ded-dd92-46ed-96d8-0f0ec453c374-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-dnv2n\" (UID: \"95031ded-dd92-46ed-96d8-0f0ec453c374\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dnv2n" Jul 08 18:00:35.537697 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:35.537347 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 18:00:35.537697 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:35.537378 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af37eaef-0d57-4b20-8562-4c782bda5732-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-8q89n\" (UID: \"af37eaef-0d57-4b20-8562-4c782bda5732\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8q89n" Jul 08 18:00:35.537697 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:35.537426 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95031ded-dd92-46ed-96d8-0f0ec453c374-samples-operator-tls podName:95031ded-dd92-46ed-96d8-0f0ec453c374 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:43.537404008 +0000 UTC m=+287.477211431 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/95031ded-dd92-46ed-96d8-0f0ec453c374-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-dnv2n" (UID: "95031ded-dd92-46ed-96d8-0f0ec453c374") : secret "samples-operator-tls" not found Jul 08 18:00:35.537697 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:35.537480 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 18:00:35.537697 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:35.537540 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af37eaef-0d57-4b20-8562-4c782bda5732-cluster-monitoring-operator-tls podName:af37eaef-0d57-4b20-8562-4c782bda5732 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:43.537526003 +0000 UTC m=+287.477333425 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af37eaef-0d57-4b20-8562-4c782bda5732-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-8q89n" (UID: "af37eaef-0d57-4b20-8562-4c782bda5732") : secret "cluster-monitoring-operator-tls" not found Jul 08 18:00:35.638366 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:35.638278 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-metrics-certs\") pod \"router-default-59d7db58ff-wx86z\" (UID: \"a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6\") " pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:35.638514 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:35.638421 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-service-ca-bundle\") pod \"router-default-59d7db58ff-wx86z\" (UID: \"a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6\") " pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:35.638514 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:35.638427 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 18:00:35.638514 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:35.638494 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-metrics-certs podName:a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:43.638473732 +0000 UTC m=+287.578281152 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-metrics-certs") pod "router-default-59d7db58ff-wx86z" (UID: "a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6") : secret "router-metrics-certs-default" not found Jul 08 18:00:35.638623 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:35.638542 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-service-ca-bundle podName:a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:43.638533385 +0000 UTC m=+287.578340793 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-service-ca-bundle") pod "router-default-59d7db58ff-wx86z" (UID: "a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6") : configmap references non-existent config key: service-ca.crt Jul 08 18:00:36.344315 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:36.344276 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e5b81533-a7d9-4a5e-9802-9912a8db6293-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-db66r\" (UID: \"e5b81533-a7d9-4a5e-9802-9912a8db6293\") " pod="openshift-insights/insights-runtime-extractor-db66r" Jul 08 18:00:36.344495 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:36.344372 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5b81533-a7d9-4a5e-9802-9912a8db6293-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-db66r\" (UID: \"e5b81533-a7d9-4a5e-9802-9912a8db6293\") " pod="openshift-insights/insights-runtime-extractor-db66r" Jul 08 18:00:36.344495 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:36.344406 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 18:00:36.344495 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:36.344469 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e5b81533-a7d9-4a5e-9802-9912a8db6293-kube-rbac-proxy-cm podName:e5b81533-a7d9-4a5e-9802-9912a8db6293 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:38.344453166 +0000 UTC m=+282.284260574 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e5b81533-a7d9-4a5e-9802-9912a8db6293-kube-rbac-proxy-cm") pod "insights-runtime-extractor-db66r" (UID: "e5b81533-a7d9-4a5e-9802-9912a8db6293") : configmap "kube-rbac-proxy" not found Jul 08 18:00:36.344622 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:36.344519 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:00:36.344622 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:36.344573 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5b81533-a7d9-4a5e-9802-9912a8db6293-insights-runtime-extractor-tls podName:e5b81533-a7d9-4a5e-9802-9912a8db6293 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:38.344560752 +0000 UTC m=+282.284368161 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e5b81533-a7d9-4a5e-9802-9912a8db6293-insights-runtime-extractor-tls") pod "insights-runtime-extractor-db66r" (UID: "e5b81533-a7d9-4a5e-9802-9912a8db6293") : secret "insights-runtime-extractor-tls" not found Jul 08 18:00:37.425924 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:37.425894 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cxg6h_088e9df1-9c28-430a-a67d-c8ac11e6564e/dns-node-resolver/0.log" Jul 08 18:00:38.147160 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:38.147129 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-fthbc" Jul 08 18:00:38.147350 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:38.147229 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-fthbc" Jul 08 18:00:38.147571 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:38.147559 2579 scope.go:117] "RemoveContainer" containerID="1be6f3af843cb354778673b61fbc938dd15cd63da062bbe2ff960d14b48d3d34" Jul 08 18:00:38.147720 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:38.147702 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-fthbc_openshift-console-operator(f43817dc-4c29-4408-987d-c7f86cfa07ce)\"" pod="openshift-console-operator/console-operator-68b757fb67-fthbc" podUID="f43817dc-4c29-4408-987d-c7f86cfa07ce" Jul 08 18:00:38.362725 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:38.362687 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e5b81533-a7d9-4a5e-9802-9912a8db6293-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-db66r\" (UID: \"e5b81533-a7d9-4a5e-9802-9912a8db6293\") " pod="openshift-insights/insights-runtime-extractor-db66r" Jul 08 18:00:38.362899 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:38.362758 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5b81533-a7d9-4a5e-9802-9912a8db6293-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-db66r\" (UID: \"e5b81533-a7d9-4a5e-9802-9912a8db6293\") " pod="openshift-insights/insights-runtime-extractor-db66r" Jul 08 18:00:38.362899 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:38.362813 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 18:00:38.362899 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:38.362878 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:00:38.362899 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:38.362883 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e5b81533-a7d9-4a5e-9802-9912a8db6293-kube-rbac-proxy-cm podName:e5b81533-a7d9-4a5e-9802-9912a8db6293 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:42.36286577 +0000 UTC m=+286.302673176 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e5b81533-a7d9-4a5e-9802-9912a8db6293-kube-rbac-proxy-cm") pod "insights-runtime-extractor-db66r" (UID: "e5b81533-a7d9-4a5e-9802-9912a8db6293") : configmap "kube-rbac-proxy" not found Jul 08 18:00:38.363046 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:38.362918 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5b81533-a7d9-4a5e-9802-9912a8db6293-insights-runtime-extractor-tls podName:e5b81533-a7d9-4a5e-9802-9912a8db6293 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:42.362907748 +0000 UTC m=+286.302715154 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e5b81533-a7d9-4a5e-9802-9912a8db6293-insights-runtime-extractor-tls") pod "insights-runtime-extractor-db66r" (UID: "e5b81533-a7d9-4a5e-9802-9912a8db6293") : secret "insights-runtime-extractor-tls" not found Jul 08 18:00:38.426317 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:38.426244 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c2d4p_549e5f27-43e4-43b4-b0d9-a8dca67dea84/node-ca/0.log" Jul 08 18:00:39.430703 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:39.430675 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p7gp6_e4ca3fa5-27eb-4a4e-834a-a2f3ae615d92/serve-healthcheck-canary/0.log" Jul 08 18:00:40.027788 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:40.027757 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-k2gq9_d978efe4-a0ee-46e0-838a-77ec2ffc352f/kube-storage-version-migrator-operator/0.log" Jul 08 18:00:41.068771 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:41.068731 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" podUID="61e8dba2-955c-41e8-b903-e0e55d277ea4" Jul 08 18:00:41.068771 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:41.068731 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-mfl6x" podUID="96b11027-4864-4174-8225-5a1f1f0ac9db" Jul 08 18:00:41.378564 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:41.378474 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-mfl6x" Jul 08 18:00:41.378737 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:41.378478 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 18:00:42.400437 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:42.400402 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e5b81533-a7d9-4a5e-9802-9912a8db6293-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-db66r\" (UID: \"e5b81533-a7d9-4a5e-9802-9912a8db6293\") " pod="openshift-insights/insights-runtime-extractor-db66r" Jul 08 18:00:42.400908 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:42.400476 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5b81533-a7d9-4a5e-9802-9912a8db6293-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-db66r\" (UID: \"e5b81533-a7d9-4a5e-9802-9912a8db6293\") " pod="openshift-insights/insights-runtime-extractor-db66r" Jul 08 18:00:42.400908 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:42.400550 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 18:00:42.400908 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:42.400626 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:00:42.400908 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:42.400645 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e5b81533-a7d9-4a5e-9802-9912a8db6293-kube-rbac-proxy-cm podName:e5b81533-a7d9-4a5e-9802-9912a8db6293 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:50.400623267 +0000 UTC m=+294.340430673 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e5b81533-a7d9-4a5e-9802-9912a8db6293-kube-rbac-proxy-cm") pod "insights-runtime-extractor-db66r" (UID: "e5b81533-a7d9-4a5e-9802-9912a8db6293") : configmap "kube-rbac-proxy" not found Jul 08 18:00:42.400908 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:42.400684 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5b81533-a7d9-4a5e-9802-9912a8db6293-insights-runtime-extractor-tls podName:e5b81533-a7d9-4a5e-9802-9912a8db6293 nodeName:}" failed. No retries permitted until 2026-07-08 18:00:50.400672021 +0000 UTC m=+294.340479425 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e5b81533-a7d9-4a5e-9802-9912a8db6293-insights-runtime-extractor-tls") pod "insights-runtime-extractor-db66r" (UID: "e5b81533-a7d9-4a5e-9802-9912a8db6293") : secret "insights-runtime-extractor-tls" not found Jul 08 18:00:43.611287 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:43.611246 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/95031ded-dd92-46ed-96d8-0f0ec453c374-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-dnv2n\" (UID: \"95031ded-dd92-46ed-96d8-0f0ec453c374\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dnv2n" Jul 08 18:00:43.611768 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:43.611337 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af37eaef-0d57-4b20-8562-4c782bda5732-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-8q89n\" (UID: \"af37eaef-0d57-4b20-8562-4c782bda5732\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8q89n" Jul 08 18:00:43.613818 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:43.613788 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/95031ded-dd92-46ed-96d8-0f0ec453c374-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-dnv2n\" (UID: \"95031ded-dd92-46ed-96d8-0f0ec453c374\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dnv2n" Jul 08 18:00:43.613973 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:43.613867 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af37eaef-0d57-4b20-8562-4c782bda5732-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-8q89n\" (UID: \"af37eaef-0d57-4b20-8562-4c782bda5732\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8q89n" Jul 08 18:00:43.633889 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:43.633854 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dnv2n" Jul 08 18:00:43.650234 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:43.650210 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8q89n" Jul 08 18:00:43.712539 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:43.712504 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-metrics-certs\") pod \"router-default-59d7db58ff-wx86z\" (UID: \"a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6\") " pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:43.712671 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:43.712596 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-service-ca-bundle\") pod \"router-default-59d7db58ff-wx86z\" (UID: \"a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6\") " pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:43.713667 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:43.713606 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-service-ca-bundle\") pod \"router-default-59d7db58ff-wx86z\" (UID: \"a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6\") " pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:43.715022 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:43.714976 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6-metrics-certs\") pod \"router-default-59d7db58ff-wx86z\" (UID: \"a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6\") " pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:43.758644 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:43.758599 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:43.805281 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:43.805250 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dnv2n"] Jul 08 18:00:43.814245 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:43.812152 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8q89n"] Jul 08 18:00:43.820625 ip-10-0-128-234 kubenswrapper[2579]: W0708 18:00:43.820591 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf37eaef_0d57_4b20_8562_4c782bda5732.slice/crio-5866a655b0c72e9eba3ebe8d483974d149f4d2726b305abd215e0ce32afdd0af WatchSource:0}: Error finding container 5866a655b0c72e9eba3ebe8d483974d149f4d2726b305abd215e0ce32afdd0af: Status 404 returned error can't find the container with id 5866a655b0c72e9eba3ebe8d483974d149f4d2726b305abd215e0ce32afdd0af Jul 08 18:00:43.900222 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:43.900141 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-59d7db58ff-wx86z"] Jul 08 18:00:43.902259 ip-10-0-128-234 kubenswrapper[2579]: W0708 18:00:43.902220 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6f9cd5f_0e97_4f32_beee_c3aaaf3c4cd6.slice/crio-7faad6d42dfa621e51808ced09552484e2940d2c35ecc8cbddf63367b55d4181 WatchSource:0}: Error finding container 7faad6d42dfa621e51808ced09552484e2940d2c35ecc8cbddf63367b55d4181: Status 404 returned error can't find the container with id 7faad6d42dfa621e51808ced09552484e2940d2c35ecc8cbddf63367b55d4181 Jul 08 18:00:44.387968 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:44.387931 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-59d7db58ff-wx86z" event={"ID":"a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6","Type":"ContainerStarted","Data":"82fbebdc032a86ebb238b17a633482495d5dfb1cff450f5b16350469419c7a50"} Jul 08 18:00:44.388151 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:44.387987 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-59d7db58ff-wx86z" event={"ID":"a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6","Type":"ContainerStarted","Data":"7faad6d42dfa621e51808ced09552484e2940d2c35ecc8cbddf63367b55d4181"} Jul 08 18:00:44.389089 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:44.389061 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8q89n" event={"ID":"af37eaef-0d57-4b20-8562-4c782bda5732","Type":"ContainerStarted","Data":"5866a655b0c72e9eba3ebe8d483974d149f4d2726b305abd215e0ce32afdd0af"} Jul 08 18:00:44.390059 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:44.390029 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dnv2n" event={"ID":"95031ded-dd92-46ed-96d8-0f0ec453c374","Type":"ContainerStarted","Data":"0cee725e0fe1b66adc0b886e2ea690019c7e85a703fe2793b03d531b60bf4f1d"} Jul 08 18:00:44.414228 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:44.414164 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-59d7db58ff-wx86z" podStartSLOduration=17.414150322 podStartE2EDuration="17.414150322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:00:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:00:44.412589438 +0000 UTC m=+288.352396859" watchObservedRunningTime="2026-07-08 18:00:44.414150322 +0000 UTC m=+288.353957791" Jul 08 18:00:44.759504 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:44.759412 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:44.762361 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:44.762338 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:44.924760 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:44.924719 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-mfl6x\" (UID: \"96b11027-4864-4174-8225-5a1f1f0ac9db\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mfl6x" Jul 08 18:00:44.924947 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:44.924881 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 18:00:44.927313 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:44.927282 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96b11027-4864-4174-8225-5a1f1f0ac9db-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-mfl6x\" (UID: \"96b11027-4864-4174-8225-5a1f1f0ac9db\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mfl6x" Jul 08 18:00:44.927423 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:44.927290 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls\") pod \"image-registry-57684fd7c6-5ns46\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 18:00:44.984995 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:44.984964 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qtmzb\"" Jul 08 18:00:44.985215 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:44.985010 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2kn4m\"" Jul 08 18:00:44.990093 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:44.990065 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-mfl6x" Jul 08 18:00:44.990233 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:44.990109 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 18:00:45.026190 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:45.026092 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls\") pod \"dns-default-phj4c\" (UID: \"9da39558-d4cb-4ef1-90d8-44ad3f6b939c\") " pod="openshift-dns/dns-default-phj4c" Jul 08 18:00:45.029205 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:45.029145 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9da39558-d4cb-4ef1-90d8-44ad3f6b939c-metrics-tls\") pod \"dns-default-phj4c\" (UID: \"9da39558-d4cb-4ef1-90d8-44ad3f6b939c\") " pod="openshift-dns/dns-default-phj4c" Jul 08 18:00:45.157520 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:45.157489 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-mfl6x"] Jul 08 18:00:45.163385 ip-10-0-128-234 kubenswrapper[2579]: W0708 18:00:45.163360 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96b11027_4864_4174_8225_5a1f1f0ac9db.slice/crio-168d02783a277de485f6dec1eeb6afaf1fceab537c55f57c79d994f396b13584 WatchSource:0}: Error finding container 168d02783a277de485f6dec1eeb6afaf1fceab537c55f57c79d994f396b13584: Status 404 returned error can't find the container with id 168d02783a277de485f6dec1eeb6afaf1fceab537c55f57c79d994f396b13584 Jul 08 18:00:45.175524 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:45.175501 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57684fd7c6-5ns46"] Jul 08 18:00:45.177624 ip-10-0-128-234 kubenswrapper[2579]: W0708 18:00:45.177600 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61e8dba2_955c_41e8_b903_e0e55d277ea4.slice/crio-2bee7b3c18b3f085bee841da37e57f7439c1b8492bc24e4df9d56d2169dedd42 WatchSource:0}: Error finding container 2bee7b3c18b3f085bee841da37e57f7439c1b8492bc24e4df9d56d2169dedd42: Status 404 returned error can't find the container with id 2bee7b3c18b3f085bee841da37e57f7439c1b8492bc24e4df9d56d2169dedd42 Jul 08 18:00:45.217532 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:45.217433 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jfscm\"" Jul 08 18:00:45.225359 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:45.225331 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-phj4c" Jul 08 18:00:45.397364 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:45.397188 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-phj4c"] Jul 08 18:00:45.398877 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:45.398423 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" event={"ID":"61e8dba2-955c-41e8-b903-e0e55d277ea4","Type":"ContainerStarted","Data":"4719c646a13ecd44e4b84a82d1bd208b711050da435a92a732f40f9d23b2056c"} Jul 08 18:00:45.398877 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:45.398482 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" event={"ID":"61e8dba2-955c-41e8-b903-e0e55d277ea4","Type":"ContainerStarted","Data":"2bee7b3c18b3f085bee841da37e57f7439c1b8492bc24e4df9d56d2169dedd42"} Jul 08 18:00:45.398877 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:45.398512 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 18:00:45.400256 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:45.400213 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-mfl6x" event={"ID":"96b11027-4864-4174-8225-5a1f1f0ac9db","Type":"ContainerStarted","Data":"168d02783a277de485f6dec1eeb6afaf1fceab537c55f57c79d994f396b13584"} Jul 08 18:00:45.400513 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:45.400473 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:45.402036 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:45.402020 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-59d7db58ff-wx86z" Jul 08 18:00:45.402672 ip-10-0-128-234 kubenswrapper[2579]: W0708 18:00:45.402646 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9da39558_d4cb_4ef1_90d8_44ad3f6b939c.slice/crio-c11e60469b99ae70a9db31bf0e70c778655c28fb4fe6119e1826c54945193f0d WatchSource:0}: Error finding container c11e60469b99ae70a9db31bf0e70c778655c28fb4fe6119e1826c54945193f0d: Status 404 returned error can't find the container with id c11e60469b99ae70a9db31bf0e70c778655c28fb4fe6119e1826c54945193f0d Jul 08 18:00:45.425466 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:45.425411 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" podStartSLOduration=278.425391382 podStartE2EDuration="4m38.425391382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:56:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:00:45.424701193 +0000 UTC m=+289.364508618" watchObservedRunningTime="2026-07-08 18:00:45.425391382 +0000 UTC m=+289.365198806" Jul 08 18:00:46.405417 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:46.405378 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-phj4c" event={"ID":"9da39558-d4cb-4ef1-90d8-44ad3f6b939c","Type":"ContainerStarted","Data":"c11e60469b99ae70a9db31bf0e70c778655c28fb4fe6119e1826c54945193f0d"} Jul 08 18:00:47.411608 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:47.411562 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dnv2n" event={"ID":"95031ded-dd92-46ed-96d8-0f0ec453c374","Type":"ContainerStarted","Data":"bfce0dee36b090d107bf0ba1368b9b0bbcd23e59c61dceb33e4d6b55dafc94e8"} Jul 08 18:00:47.412064 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:47.411674 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dnv2n" event={"ID":"95031ded-dd92-46ed-96d8-0f0ec453c374","Type":"ContainerStarted","Data":"d4270a7ff6d8c089bd99b5bb3174aa07a59b48280be1aa0abb0b65007354b246"} Jul 08 18:00:47.413479 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:47.413422 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8q89n" event={"ID":"af37eaef-0d57-4b20-8562-4c782bda5732","Type":"ContainerStarted","Data":"9476f03e57a79ab608b13e3703dd0567f46c31eab2489c1573d2f586c3f5d1e1"} Jul 08 18:00:47.432740 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:47.432691 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dnv2n" podStartSLOduration=17.564705766 podStartE2EDuration="20.432671734s" totalImagesPullingTime="2.867965968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:00:47.431742431 +0000 UTC m=+291.371549860" watchObservedRunningTime="2026-07-08 18:00:47.432671734 +0000 UTC m=+291.372479158" Jul 08 18:00:47.450455 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:47.450407 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8q89n" podStartSLOduration=18.070677135 podStartE2EDuration="20.450389757s" totalImagesPullingTime="2.379712622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:00:47.449090544 +0000 UTC m=+291.388897972" watchObservedRunningTime="2026-07-08 18:00:47.450389757 +0000 UTC m=+291.390197184" Jul 08 18:00:48.418346 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:48.418259 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-mfl6x" event={"ID":"96b11027-4864-4174-8225-5a1f1f0ac9db","Type":"ContainerStarted","Data":"2f7e55124259d522cd004c26db9290f9b9b8cbf0bddee3a051365eb21d89bfa5"} Jul 08 18:00:48.420041 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:48.420013 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-phj4c" event={"ID":"9da39558-d4cb-4ef1-90d8-44ad3f6b939c","Type":"ContainerStarted","Data":"8b7a66599dd7812e9b411e8f321493e3022c5e3edfdcf3eae5b8fa11ac3b3a9b"} Jul 08 18:00:48.420148 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:48.420066 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-phj4c" event={"ID":"9da39558-d4cb-4ef1-90d8-44ad3f6b939c","Type":"ContainerStarted","Data":"9368f6c5e5fde0cf34914de710bbed25269dee4b63a443e52b26c6df54e31575"} Jul 08 18:00:48.420148 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:48.420108 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-phj4c" Jul 08 18:00:48.441370 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:48.441330 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-mfl6x" podStartSLOduration=262.976699694 podStartE2EDuration="4m25.441316682s" totalImagesPullingTime="2.464616988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:00:48.441286712 +0000 UTC m=+292.381094139" watchObservedRunningTime="2026-07-08 18:00:48.441316682 +0000 UTC m=+292.381124109" Jul 08 18:00:48.464275 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:48.464235 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-phj4c" podStartSLOduration=251.735454599 podStartE2EDuration="4m14.464217351s" totalImagesPullingTime="2.728762752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:56:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:00:48.464025486 +0000 UTC m=+292.403832914" watchObservedRunningTime="2026-07-08 18:00:48.464217351 +0000 UTC m=+292.404024779" Jul 08 18:00:50.472763 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:50.472715 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e5b81533-a7d9-4a5e-9802-9912a8db6293-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-db66r\" (UID: \"e5b81533-a7d9-4a5e-9802-9912a8db6293\") " pod="openshift-insights/insights-runtime-extractor-db66r" Jul 08 18:00:50.473142 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:50.472774 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5b81533-a7d9-4a5e-9802-9912a8db6293-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-db66r\" (UID: \"e5b81533-a7d9-4a5e-9802-9912a8db6293\") " pod="openshift-insights/insights-runtime-extractor-db66r" Jul 08 18:00:50.473291 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:50.473271 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e5b81533-a7d9-4a5e-9802-9912a8db6293-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-db66r\" (UID: \"e5b81533-a7d9-4a5e-9802-9912a8db6293\") " pod="openshift-insights/insights-runtime-extractor-db66r" Jul 08 18:00:50.474986 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:50.474968 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5b81533-a7d9-4a5e-9802-9912a8db6293-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-db66r\" (UID: \"e5b81533-a7d9-4a5e-9802-9912a8db6293\") " pod="openshift-insights/insights-runtime-extractor-db66r" Jul 08 18:00:50.566250 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:50.566200 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-db66r" Jul 08 18:00:50.613998 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:50.613941 2579 scope.go:117] "RemoveContainer" containerID="1be6f3af843cb354778673b61fbc938dd15cd63da062bbe2ff960d14b48d3d34" Jul 08 18:00:50.694569 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:50.694536 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-db66r"] Jul 08 18:00:50.697837 ip-10-0-128-234 kubenswrapper[2579]: W0708 18:00:50.697798 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5b81533_a7d9_4a5e_9802_9912a8db6293.slice/crio-ff42a2f097f042c19eb4855e67c93997d50a45241cb9a8cc0b16ee6f436b1dad WatchSource:0}: Error finding container ff42a2f097f042c19eb4855e67c93997d50a45241cb9a8cc0b16ee6f436b1dad: Status 404 returned error can't find the container with id ff42a2f097f042c19eb4855e67c93997d50a45241cb9a8cc0b16ee6f436b1dad Jul 08 18:00:51.447664 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:51.447528 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-db66r" event={"ID":"e5b81533-a7d9-4a5e-9802-9912a8db6293","Type":"ContainerStarted","Data":"ff42a2f097f042c19eb4855e67c93997d50a45241cb9a8cc0b16ee6f436b1dad"} Jul 08 18:00:51.450103 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:51.450075 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fthbc_f43817dc-4c29-4408-987d-c7f86cfa07ce/console-operator/1.log" Jul 08 18:00:51.450265 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:51.450131 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-fthbc" event={"ID":"f43817dc-4c29-4408-987d-c7f86cfa07ce","Type":"ContainerStarted","Data":"cb46609f0d3a8d217f88020643510eef5fcc29a0953b9cf9687d46299a0383fd"} Jul 08 18:00:51.452583 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:51.452561 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-fthbc" Jul 08 18:00:51.471131 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:51.469623 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-fthbc" podStartSLOduration=21.421643275 podStartE2EDuration="24.469604686s" totalImagesPullingTime="3.047961411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:00:51.469242791 +0000 UTC m=+295.409050219" watchObservedRunningTime="2026-07-08 18:00:51.469604686 +0000 UTC m=+295.409412114" Jul 08 18:00:52.163902 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:52.163866 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-fthbc" Jul 08 18:00:55.468899 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:55.468865 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-db66r" event={"ID":"e5b81533-a7d9-4a5e-9802-9912a8db6293","Type":"ContainerStarted","Data":"692826ee5eac8710e063343f7614363859876325c5126e8180222091d4322ee4"} Jul 08 18:00:55.474290 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:55.474264 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-gd5d5"] Jul 08 18:00:55.477700 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:55.477677 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-gd5d5" Jul 08 18:00:55.481993 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:55.481972 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-9k62p\"" Jul 08 18:00:55.484887 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:55.484862 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 08 18:00:55.484995 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:55.484908 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 08 18:00:55.493276 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:55.493248 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-gd5d5"] Jul 08 18:00:55.518720 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:55.518690 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bp46\" (UniqueName: \"kubernetes.io/projected/1f9ad66b-56ab-4883-8a3f-0ed1d5a19082-kube-api-access-5bp46\") pod \"downloads-685bfb5f64-gd5d5\" (UID: \"1f9ad66b-56ab-4883-8a3f-0ed1d5a19082\") " pod="openshift-console/downloads-685bfb5f64-gd5d5" Jul 08 18:00:55.619508 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:55.619467 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bp46\" (UniqueName: \"kubernetes.io/projected/1f9ad66b-56ab-4883-8a3f-0ed1d5a19082-kube-api-access-5bp46\") pod \"downloads-685bfb5f64-gd5d5\" (UID: \"1f9ad66b-56ab-4883-8a3f-0ed1d5a19082\") " pod="openshift-console/downloads-685bfb5f64-gd5d5" Jul 08 18:00:55.629756 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:55.629720 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bp46\" (UniqueName: \"kubernetes.io/projected/1f9ad66b-56ab-4883-8a3f-0ed1d5a19082-kube-api-access-5bp46\") pod \"downloads-685bfb5f64-gd5d5\" (UID: \"1f9ad66b-56ab-4883-8a3f-0ed1d5a19082\") " pod="openshift-console/downloads-685bfb5f64-gd5d5" Jul 08 18:00:55.787286 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:55.787256 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-gd5d5" Jul 08 18:00:55.914730 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:55.914697 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-gd5d5"] Jul 08 18:00:55.917614 ip-10-0-128-234 kubenswrapper[2579]: W0708 18:00:55.917581 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f9ad66b_56ab_4883_8a3f_0ed1d5a19082.slice/crio-b1083f18fbef4b2c30d1af6072010cdce46c4c97227f001180dff32bc81dfe7f WatchSource:0}: Error finding container b1083f18fbef4b2c30d1af6072010cdce46c4c97227f001180dff32bc81dfe7f: Status 404 returned error can't find the container with id b1083f18fbef4b2c30d1af6072010cdce46c4c97227f001180dff32bc81dfe7f Jul 08 18:00:56.476776 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:56.476734 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-db66r" event={"ID":"e5b81533-a7d9-4a5e-9802-9912a8db6293","Type":"ContainerStarted","Data":"c77eef5b60d103c03b661c368de673f28d5faa20805dac6795ea2b452c859b3e"} Jul 08 18:00:56.478271 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:56.478239 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-gd5d5" event={"ID":"1f9ad66b-56ab-4883-8a3f-0ed1d5a19082","Type":"ContainerStarted","Data":"b1083f18fbef4b2c30d1af6072010cdce46c4c97227f001180dff32bc81dfe7f"} Jul 08 18:00:56.479143 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:56.479118 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fthbc_f43817dc-4c29-4408-987d-c7f86cfa07ce/console-operator/1.log" Jul 08 18:00:56.479904 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:56.479887 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fthbc_f43817dc-4c29-4408-987d-c7f86cfa07ce/console-operator/1.log" Jul 08 18:00:56.492960 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:56.492937 2579 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 18:00:57.615482 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:57.615423 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mrv85" podUID="077db27a-abe8-4647-9b18-9d59458f3f9c" Jul 08 18:00:58.425465 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:58.425437 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-phj4c" Jul 08 18:00:58.487065 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:58.487034 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-db66r" event={"ID":"e5b81533-a7d9-4a5e-9802-9912a8db6293","Type":"ContainerStarted","Data":"732c23360b608e5cba9765cdb6bc32c4bbe197dbc9ff2eeb2c8c3bdad8ee0805"} Jul 08 18:00:58.505512 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:58.505453 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-db66r" podStartSLOduration=17.026143512 podStartE2EDuration="24.505437485s" totalImagesPullingTime="7.479293973s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:00:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:00:58.504729075 +0000 UTC m=+302.444536502" watchObservedRunningTime="2026-07-08 18:00:58.505437485 +0000 UTC m=+302.445244912" Jul 08 18:00:59.339049 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:59.339011 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-bjvxv"] Jul 08 18:00:59.342294 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:59.342278 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bjvxv" Jul 08 18:00:59.346657 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:59.346635 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 08 18:00:59.346912 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:59.346898 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-fqcpd\"" Jul 08 18:00:59.347743 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:59.347716 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 08 18:00:59.347856 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:59.347846 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 18:00:59.362527 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:59.362500 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-bjvxv"] Jul 08 18:00:59.450509 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:59.450476 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46a1caa3-180a-43d0-b699-584a99717dcd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-bjvxv\" (UID: \"46a1caa3-180a-43d0-b699-584a99717dcd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bjvxv" Jul 08 18:00:59.450509 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:59.450522 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn4nj\" (UniqueName: \"kubernetes.io/projected/46a1caa3-180a-43d0-b699-584a99717dcd-kube-api-access-xn4nj\") pod \"prometheus-operator-567f7b8b7c-bjvxv\" (UID: \"46a1caa3-180a-43d0-b699-584a99717dcd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bjvxv" Jul 08 18:00:59.450763 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:59.450583 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46a1caa3-180a-43d0-b699-584a99717dcd-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-bjvxv\" (UID: \"46a1caa3-180a-43d0-b699-584a99717dcd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bjvxv" Jul 08 18:00:59.450763 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:59.450609 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/46a1caa3-180a-43d0-b699-584a99717dcd-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-bjvxv\" (UID: \"46a1caa3-180a-43d0-b699-584a99717dcd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bjvxv" Jul 08 18:00:59.551308 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:59.551270 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn4nj\" (UniqueName: \"kubernetes.io/projected/46a1caa3-180a-43d0-b699-584a99717dcd-kube-api-access-xn4nj\") pod \"prometheus-operator-567f7b8b7c-bjvxv\" (UID: \"46a1caa3-180a-43d0-b699-584a99717dcd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bjvxv" Jul 08 18:00:59.551487 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:59.551319 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46a1caa3-180a-43d0-b699-584a99717dcd-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-bjvxv\" (UID: \"46a1caa3-180a-43d0-b699-584a99717dcd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bjvxv" Jul 08 18:00:59.551487 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:59.551362 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/46a1caa3-180a-43d0-b699-584a99717dcd-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-bjvxv\" (UID: \"46a1caa3-180a-43d0-b699-584a99717dcd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bjvxv" Jul 08 18:00:59.551487 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:59.551457 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 08 18:00:59.551641 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:00:59.551519 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46a1caa3-180a-43d0-b699-584a99717dcd-prometheus-operator-tls podName:46a1caa3-180a-43d0-b699-584a99717dcd nodeName:}" failed. No retries permitted until 2026-07-08 18:01:00.051498749 +0000 UTC m=+303.991306155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/46a1caa3-180a-43d0-b699-584a99717dcd-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-bjvxv" (UID: "46a1caa3-180a-43d0-b699-584a99717dcd") : secret "prometheus-operator-tls" not found Jul 08 18:00:59.551641 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:59.551611 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46a1caa3-180a-43d0-b699-584a99717dcd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-bjvxv\" (UID: \"46a1caa3-180a-43d0-b699-584a99717dcd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bjvxv" Jul 08 18:00:59.552087 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:59.552063 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46a1caa3-180a-43d0-b699-584a99717dcd-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-bjvxv\" (UID: \"46a1caa3-180a-43d0-b699-584a99717dcd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bjvxv" Jul 08 18:00:59.554220 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:59.554194 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46a1caa3-180a-43d0-b699-584a99717dcd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-bjvxv\" (UID: \"46a1caa3-180a-43d0-b699-584a99717dcd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bjvxv" Jul 08 18:00:59.560708 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:00:59.560686 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn4nj\" (UniqueName: \"kubernetes.io/projected/46a1caa3-180a-43d0-b699-584a99717dcd-kube-api-access-xn4nj\") pod \"prometheus-operator-567f7b8b7c-bjvxv\" (UID: \"46a1caa3-180a-43d0-b699-584a99717dcd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bjvxv" Jul 08 18:01:00.056723 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:00.056681 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/46a1caa3-180a-43d0-b699-584a99717dcd-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-bjvxv\" (UID: \"46a1caa3-180a-43d0-b699-584a99717dcd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bjvxv" Jul 08 18:01:00.059782 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:00.059756 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/46a1caa3-180a-43d0-b699-584a99717dcd-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-bjvxv\" (UID: \"46a1caa3-180a-43d0-b699-584a99717dcd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bjvxv" Jul 08 18:01:00.250857 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:00.250821 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bjvxv" Jul 08 18:01:00.380392 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:00.380240 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-bjvxv"] Jul 08 18:01:00.382765 ip-10-0-128-234 kubenswrapper[2579]: W0708 18:01:00.382739 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46a1caa3_180a_43d0_b699_584a99717dcd.slice/crio-ace3f108946ffc2a3fa18b3a74fdd0d6a0d51f7f29d4e1478d8d9a1d5833fce7 WatchSource:0}: Error finding container ace3f108946ffc2a3fa18b3a74fdd0d6a0d51f7f29d4e1478d8d9a1d5833fce7: Status 404 returned error can't find the container with id ace3f108946ffc2a3fa18b3a74fdd0d6a0d51f7f29d4e1478d8d9a1d5833fce7 Jul 08 18:01:00.384774 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:00.384759 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 18:01:00.495713 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:00.495672 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bjvxv" event={"ID":"46a1caa3-180a-43d0-b699-584a99717dcd","Type":"ContainerStarted","Data":"ace3f108946ffc2a3fa18b3a74fdd0d6a0d51f7f29d4e1478d8d9a1d5833fce7"} Jul 08 18:01:02.506549 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:02.506116 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bjvxv" event={"ID":"46a1caa3-180a-43d0-b699-584a99717dcd","Type":"ContainerStarted","Data":"47a5cdfaca9c032f719ad40cee22da95c956c6d4f8be198eb6b2fb67aabff63d"} Jul 08 18:01:02.506549 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:02.506206 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bjvxv" event={"ID":"46a1caa3-180a-43d0-b699-584a99717dcd","Type":"ContainerStarted","Data":"379a644f3a98b9e5ac53527cc389d18d92939314efb955fb790daf9db07b3b89"} Jul 08 18:01:02.526687 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:02.526625 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bjvxv" podStartSLOduration=1.576759323 podStartE2EDuration="3.526608727s" totalImagesPullingTime="1.949849404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:01:02.525933964 +0000 UTC m=+306.465741401" watchObservedRunningTime="2026-07-08 18:01:02.526608727 +0000 UTC m=+306.466416154" Jul 08 18:01:04.725872 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.725839 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mpp67"] Jul 08 18:01:04.732377 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.732349 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:04.735813 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.735789 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 18:01:04.735952 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.735825 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 18:01:04.736049 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.736032 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xfpfm\"" Jul 08 18:01:04.736423 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.736405 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 18:01:04.802232 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.802189 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/acbfbe44-056d-4cd2-9b39-dc4381cc731a-node-exporter-tls\") pod \"node-exporter-mpp67\" (UID: \"acbfbe44-056d-4cd2-9b39-dc4381cc731a\") " pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:04.802401 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.802236 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acbfbe44-056d-4cd2-9b39-dc4381cc731a-metrics-client-ca\") pod \"node-exporter-mpp67\" (UID: \"acbfbe44-056d-4cd2-9b39-dc4381cc731a\") " pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:04.802401 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.802335 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acbfbe44-056d-4cd2-9b39-dc4381cc731a-sys\") pod \"node-exporter-mpp67\" (UID: \"acbfbe44-056d-4cd2-9b39-dc4381cc731a\") " pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:04.802401 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.802356 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/acbfbe44-056d-4cd2-9b39-dc4381cc731a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mpp67\" (UID: \"acbfbe44-056d-4cd2-9b39-dc4381cc731a\") " pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:04.802401 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.802378 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/acbfbe44-056d-4cd2-9b39-dc4381cc731a-node-exporter-accelerators-collector-config\") pod \"node-exporter-mpp67\" (UID: \"acbfbe44-056d-4cd2-9b39-dc4381cc731a\") " pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:04.802618 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.802405 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/acbfbe44-056d-4cd2-9b39-dc4381cc731a-root\") pod \"node-exporter-mpp67\" (UID: \"acbfbe44-056d-4cd2-9b39-dc4381cc731a\") " pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:04.802618 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.802501 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/acbfbe44-056d-4cd2-9b39-dc4381cc731a-node-exporter-wtmp\") pod \"node-exporter-mpp67\" (UID: \"acbfbe44-056d-4cd2-9b39-dc4381cc731a\") " pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:04.802618 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.802544 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/acbfbe44-056d-4cd2-9b39-dc4381cc731a-node-exporter-textfile\") pod \"node-exporter-mpp67\" (UID: \"acbfbe44-056d-4cd2-9b39-dc4381cc731a\") " pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:04.802618 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.802583 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czl4t\" (UniqueName: \"kubernetes.io/projected/acbfbe44-056d-4cd2-9b39-dc4381cc731a-kube-api-access-czl4t\") pod \"node-exporter-mpp67\" (UID: \"acbfbe44-056d-4cd2-9b39-dc4381cc731a\") " pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:04.903438 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.903397 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acbfbe44-056d-4cd2-9b39-dc4381cc731a-sys\") pod \"node-exporter-mpp67\" (UID: \"acbfbe44-056d-4cd2-9b39-dc4381cc731a\") " pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:04.903438 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.903440 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/acbfbe44-056d-4cd2-9b39-dc4381cc731a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mpp67\" (UID: \"acbfbe44-056d-4cd2-9b39-dc4381cc731a\") " pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:04.903714 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.903459 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/acbfbe44-056d-4cd2-9b39-dc4381cc731a-node-exporter-accelerators-collector-config\") pod \"node-exporter-mpp67\" (UID: \"acbfbe44-056d-4cd2-9b39-dc4381cc731a\") " pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:04.903714 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.903489 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/acbfbe44-056d-4cd2-9b39-dc4381cc731a-root\") pod \"node-exporter-mpp67\" (UID: \"acbfbe44-056d-4cd2-9b39-dc4381cc731a\") " pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:04.903714 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.903523 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/acbfbe44-056d-4cd2-9b39-dc4381cc731a-node-exporter-wtmp\") pod \"node-exporter-mpp67\" (UID: \"acbfbe44-056d-4cd2-9b39-dc4381cc731a\") " pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:04.903714 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.903536 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acbfbe44-056d-4cd2-9b39-dc4381cc731a-sys\") pod \"node-exporter-mpp67\" (UID: \"acbfbe44-056d-4cd2-9b39-dc4381cc731a\") " pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:04.903714 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.903593 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/acbfbe44-056d-4cd2-9b39-dc4381cc731a-node-exporter-textfile\") pod \"node-exporter-mpp67\" (UID: \"acbfbe44-056d-4cd2-9b39-dc4381cc731a\") " pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:04.903714 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.903663 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czl4t\" (UniqueName: \"kubernetes.io/projected/acbfbe44-056d-4cd2-9b39-dc4381cc731a-kube-api-access-czl4t\") pod \"node-exporter-mpp67\" (UID: \"acbfbe44-056d-4cd2-9b39-dc4381cc731a\") " pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:04.903714 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.903674 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/acbfbe44-056d-4cd2-9b39-dc4381cc731a-node-exporter-wtmp\") pod \"node-exporter-mpp67\" (UID: \"acbfbe44-056d-4cd2-9b39-dc4381cc731a\") " pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:04.904091 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.903737 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/acbfbe44-056d-4cd2-9b39-dc4381cc731a-node-exporter-tls\") pod \"node-exporter-mpp67\" (UID: \"acbfbe44-056d-4cd2-9b39-dc4381cc731a\") " pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:04.904091 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.903765 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acbfbe44-056d-4cd2-9b39-dc4381cc731a-metrics-client-ca\") pod \"node-exporter-mpp67\" (UID: \"acbfbe44-056d-4cd2-9b39-dc4381cc731a\") " pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:04.904091 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.903887 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/acbfbe44-056d-4cd2-9b39-dc4381cc731a-root\") pod \"node-exporter-mpp67\" (UID: \"acbfbe44-056d-4cd2-9b39-dc4381cc731a\") " pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:04.904304 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.904275 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/acbfbe44-056d-4cd2-9b39-dc4381cc731a-node-exporter-accelerators-collector-config\") pod \"node-exporter-mpp67\" (UID: \"acbfbe44-056d-4cd2-9b39-dc4381cc731a\") " pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:04.904413 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.904381 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acbfbe44-056d-4cd2-9b39-dc4381cc731a-metrics-client-ca\") pod \"node-exporter-mpp67\" (UID: \"acbfbe44-056d-4cd2-9b39-dc4381cc731a\") " pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:04.904464 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.904448 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/acbfbe44-056d-4cd2-9b39-dc4381cc731a-node-exporter-textfile\") pod \"node-exporter-mpp67\" (UID: \"acbfbe44-056d-4cd2-9b39-dc4381cc731a\") " pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:04.906004 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.905982 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/acbfbe44-056d-4cd2-9b39-dc4381cc731a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mpp67\" (UID: \"acbfbe44-056d-4cd2-9b39-dc4381cc731a\") " pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:04.906225 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.906205 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/acbfbe44-056d-4cd2-9b39-dc4381cc731a-node-exporter-tls\") pod \"node-exporter-mpp67\" (UID: \"acbfbe44-056d-4cd2-9b39-dc4381cc731a\") " pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:04.912027 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.912004 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czl4t\" (UniqueName: \"kubernetes.io/projected/acbfbe44-056d-4cd2-9b39-dc4381cc731a-kube-api-access-czl4t\") pod \"node-exporter-mpp67\" (UID: \"acbfbe44-056d-4cd2-9b39-dc4381cc731a\") " pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:04.995935 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.995837 2579 patch_prober.go:28] interesting pod/image-registry-57684fd7c6-5ns46 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 18:01:04.995935 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:04.995899 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" podUID="61e8dba2-955c-41e8-b903-e0e55d277ea4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 18:01:05.044487 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:05.044455 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mpp67" Jul 08 18:01:05.057383 ip-10-0-128-234 kubenswrapper[2579]: W0708 18:01:05.057351 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacbfbe44_056d_4cd2_9b39_dc4381cc731a.slice/crio-1dffe3e46a3dc6713a69752c332cfe00dfc194facd376d16dc2b68531e91d1a0 WatchSource:0}: Error finding container 1dffe3e46a3dc6713a69752c332cfe00dfc194facd376d16dc2b68531e91d1a0: Status 404 returned error can't find the container with id 1dffe3e46a3dc6713a69752c332cfe00dfc194facd376d16dc2b68531e91d1a0 Jul 08 18:01:05.519874 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:05.519827 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mpp67" event={"ID":"acbfbe44-056d-4cd2-9b39-dc4381cc731a","Type":"ContainerStarted","Data":"1dffe3e46a3dc6713a69752c332cfe00dfc194facd376d16dc2b68531e91d1a0"} Jul 08 18:01:05.807720 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:05.807678 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 18:01:05.813293 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:05.813264 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:05.818509 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:05.818481 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 08 18:01:05.819052 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:05.818818 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 08 18:01:05.819052 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:05.818857 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 08 18:01:05.819052 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:05.818875 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 08 18:01:05.819308 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:05.819102 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-r8sl4\"" Jul 08 18:01:05.819308 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:05.819135 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 08 18:01:05.819423 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:05.819405 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 08 18:01:05.819542 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:05.819516 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 08 18:01:05.819621 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:05.819556 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 08 18:01:05.819673 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:05.819627 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 08 18:01:05.829421 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:05.829394 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 18:01:05.914590 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:05.914552 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gq2m\" (UniqueName: \"kubernetes.io/projected/25441665-460a-45a6-9df9-7e7c3560b55c-kube-api-access-2gq2m\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:05.914787 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:05.914635 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:05.914787 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:05.914673 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/25441665-460a-45a6-9df9-7e7c3560b55c-config-out\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:05.914787 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:05.914698 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/25441665-460a-45a6-9df9-7e7c3560b55c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:05.914787 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:05.914723 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25441665-460a-45a6-9df9-7e7c3560b55c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:05.914787 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:05.914747 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25441665-460a-45a6-9df9-7e7c3560b55c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:05.914787 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:05.914773 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:05.915111 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:05.914796 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:05.915111 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:05.914838 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:05.915111 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:05.914880 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-config-volume\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:05.915111 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:05.914911 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/25441665-460a-45a6-9df9-7e7c3560b55c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:05.915111 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:05.914943 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:05.915111 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:05.914967 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-web-config\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:06.015824 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.015773 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/25441665-460a-45a6-9df9-7e7c3560b55c-config-out\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:06.015824 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.015823 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/25441665-460a-45a6-9df9-7e7c3560b55c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:06.016064 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.015851 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25441665-460a-45a6-9df9-7e7c3560b55c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:06.016064 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.015877 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25441665-460a-45a6-9df9-7e7c3560b55c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:06.016064 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.015905 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:06.016064 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.015927 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:06.016064 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.015971 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:06.016064 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.016017 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-config-volume\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:06.016064 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.016053 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/25441665-460a-45a6-9df9-7e7c3560b55c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:06.016399 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.016086 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:06.016399 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.016111 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-web-config\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:06.016399 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.016152 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gq2m\" (UniqueName: \"kubernetes.io/projected/25441665-460a-45a6-9df9-7e7c3560b55c-kube-api-access-2gq2m\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:06.016399 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.016258 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:06.017726 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.017390 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25441665-460a-45a6-9df9-7e7c3560b55c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:06.020675 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:01:06.018515 2579 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 08 18:01:06.020675 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:01:06.018604 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-main-tls podName:25441665-460a-45a6-9df9-7e7c3560b55c nodeName:}" failed. No retries permitted until 2026-07-08 18:01:06.518582947 +0000 UTC m=+310.458390359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "25441665-460a-45a6-9df9-7e7c3560b55c") : secret "alertmanager-main-tls" not found Jul 08 18:01:06.020675 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.019747 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:06.020675 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.020007 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/25441665-460a-45a6-9df9-7e7c3560b55c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:06.020675 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.020207 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/25441665-460a-45a6-9df9-7e7c3560b55c-config-out\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:06.020675 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.020618 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25441665-460a-45a6-9df9-7e7c3560b55c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:06.021088 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.020914 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/25441665-460a-45a6-9df9-7e7c3560b55c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:06.021756 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.021734 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-web-config\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:06.022455 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.022411 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:06.023143 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.023100 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:06.023760 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.023732 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:06.025260 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.025240 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-config-volume\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:06.031403 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.031364 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gq2m\" (UniqueName: \"kubernetes.io/projected/25441665-460a-45a6-9df9-7e7c3560b55c-kube-api-access-2gq2m\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:06.411477 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.411449 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 18:01:06.522620 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.522373 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:06.522620 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:01:06.522508 2579 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 08 18:01:06.522620 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:01:06.522577 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-main-tls podName:25441665-460a-45a6-9df9-7e7c3560b55c nodeName:}" failed. No retries permitted until 2026-07-08 18:01:07.522556027 +0000 UTC m=+311.462363453 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "25441665-460a-45a6-9df9-7e7c3560b55c") : secret "alertmanager-main-tls" not found Jul 08 18:01:06.527673 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.527638 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mpp67" event={"ID":"acbfbe44-056d-4cd2-9b39-dc4381cc731a","Type":"ContainerStarted","Data":"c495e4ee8676cadaef0fb1ee9b04dfb7a1593bb37ae16899abd238b39932d391"} Jul 08 18:01:06.707258 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.707159 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm"] Jul 08 18:01:06.711558 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.711532 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" Jul 08 18:01:06.714206 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.714158 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 08 18:01:06.714584 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.714561 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 08 18:01:06.714818 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.714590 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-mvljl\"" Jul 08 18:01:06.714818 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.714683 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dde463h0agm1k\"" Jul 08 18:01:06.714818 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.714569 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 08 18:01:06.714980 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.714899 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 08 18:01:06.715147 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.715125 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 08 18:01:06.724746 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.724687 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm"] Jul 08 18:01:06.824943 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.824902 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b-secret-thanos-querier-tls\") pod \"thanos-querier-5ddbb5b97b-p6tzm\" (UID: \"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b\") " pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" Jul 08 18:01:06.824943 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.824957 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b-metrics-client-ca\") pod \"thanos-querier-5ddbb5b97b-p6tzm\" (UID: \"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b\") " pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" Jul 08 18:01:06.825399 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.824976 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5ddbb5b97b-p6tzm\" (UID: \"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b\") " pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" Jul 08 18:01:06.825399 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.825137 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5ddbb5b97b-p6tzm\" (UID: \"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b\") " pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" Jul 08 18:01:06.825399 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.825227 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5ddbb5b97b-p6tzm\" (UID: \"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b\") " pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" Jul 08 18:01:06.825399 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.825259 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5ddbb5b97b-p6tzm\" (UID: \"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b\") " pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" Jul 08 18:01:06.825399 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.825285 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b-secret-grpc-tls\") pod \"thanos-querier-5ddbb5b97b-p6tzm\" (UID: \"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b\") " pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" Jul 08 18:01:06.825399 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.825309 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2pq2\" (UniqueName: \"kubernetes.io/projected/5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b-kube-api-access-m2pq2\") pod \"thanos-querier-5ddbb5b97b-p6tzm\" (UID: \"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b\") " pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" Jul 08 18:01:06.926317 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.926272 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5ddbb5b97b-p6tzm\" (UID: \"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b\") " pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" Jul 08 18:01:06.926496 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.926339 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5ddbb5b97b-p6tzm\" (UID: \"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b\") " pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" Jul 08 18:01:06.926496 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.926370 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5ddbb5b97b-p6tzm\" (UID: \"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b\") " pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" Jul 08 18:01:06.926496 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.926391 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5ddbb5b97b-p6tzm\" (UID: \"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b\") " pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" Jul 08 18:01:06.926496 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.926414 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b-secret-grpc-tls\") pod \"thanos-querier-5ddbb5b97b-p6tzm\" (UID: \"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b\") " pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" Jul 08 18:01:06.926496 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.926441 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2pq2\" (UniqueName: \"kubernetes.io/projected/5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b-kube-api-access-m2pq2\") pod \"thanos-querier-5ddbb5b97b-p6tzm\" (UID: \"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b\") " pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" Jul 08 18:01:06.926675 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.926524 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b-secret-thanos-querier-tls\") pod \"thanos-querier-5ddbb5b97b-p6tzm\" (UID: \"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b\") " pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" Jul 08 18:01:06.926675 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.926580 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b-metrics-client-ca\") pod \"thanos-querier-5ddbb5b97b-p6tzm\" (UID: \"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b\") " pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" Jul 08 18:01:06.927423 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.927358 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b-metrics-client-ca\") pod \"thanos-querier-5ddbb5b97b-p6tzm\" (UID: \"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b\") " pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" Jul 08 18:01:06.929623 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.929552 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5ddbb5b97b-p6tzm\" (UID: \"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b\") " pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" Jul 08 18:01:06.929623 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.929579 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5ddbb5b97b-p6tzm\" (UID: \"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b\") " pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" Jul 08 18:01:06.930013 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.929970 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b-secret-grpc-tls\") pod \"thanos-querier-5ddbb5b97b-p6tzm\" (UID: \"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b\") " pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" Jul 08 18:01:06.930013 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.930007 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5ddbb5b97b-p6tzm\" (UID: \"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b\") " pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" Jul 08 18:01:06.930153 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.930089 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5ddbb5b97b-p6tzm\" (UID: \"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b\") " pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" Jul 08 18:01:06.930446 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.930425 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b-secret-thanos-querier-tls\") pod \"thanos-querier-5ddbb5b97b-p6tzm\" (UID: \"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b\") " pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" Jul 08 18:01:06.936365 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:06.936340 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2pq2\" (UniqueName: \"kubernetes.io/projected/5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b-kube-api-access-m2pq2\") pod \"thanos-querier-5ddbb5b97b-p6tzm\" (UID: \"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b\") " pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" Jul 08 18:01:07.023461 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:07.023382 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" Jul 08 18:01:07.179128 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:07.179009 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm"] Jul 08 18:01:07.181622 ip-10-0-128-234 kubenswrapper[2579]: W0708 18:01:07.181593 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ed4fe8f_2485_4c92_a94b_3fbd740b0b1b.slice/crio-6519f63cebab113af93d891194186d0832d98fbdf81719f41abb4336622f7aa4 WatchSource:0}: Error finding container 6519f63cebab113af93d891194186d0832d98fbdf81719f41abb4336622f7aa4: Status 404 returned error can't find the container with id 6519f63cebab113af93d891194186d0832d98fbdf81719f41abb4336622f7aa4 Jul 08 18:01:07.531935 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:07.531903 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:07.532134 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:07.531951 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" event={"ID":"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b","Type":"ContainerStarted","Data":"6519f63cebab113af93d891194186d0832d98fbdf81719f41abb4336622f7aa4"} Jul 08 18:01:07.533475 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:07.533444 2579 generic.go:356] "Generic (PLEG): container finished" podID="acbfbe44-056d-4cd2-9b39-dc4381cc731a" containerID="c495e4ee8676cadaef0fb1ee9b04dfb7a1593bb37ae16899abd238b39932d391" exitCode=0 Jul 08 18:01:07.533579 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:07.533492 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mpp67" event={"ID":"acbfbe44-056d-4cd2-9b39-dc4381cc731a","Type":"ContainerDied","Data":"c495e4ee8676cadaef0fb1ee9b04dfb7a1593bb37ae16899abd238b39932d391"} Jul 08 18:01:07.534790 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:07.534768 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:07.626850 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:07.626639 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:01:07.810079 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:07.810000 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 18:01:07.813493 ip-10-0-128-234 kubenswrapper[2579]: W0708 18:01:07.813467 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25441665_460a_45a6_9df9_7e7c3560b55c.slice/crio-ce03c6f9a7d64e951b61d6eac305d3e78fcf320863dc5a5b3f14cf5ce7e71039 WatchSource:0}: Error finding container ce03c6f9a7d64e951b61d6eac305d3e78fcf320863dc5a5b3f14cf5ce7e71039: Status 404 returned error can't find the container with id ce03c6f9a7d64e951b61d6eac305d3e78fcf320863dc5a5b3f14cf5ce7e71039 Jul 08 18:01:08.540189 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:08.540137 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25441665-460a-45a6-9df9-7e7c3560b55c","Type":"ContainerStarted","Data":"ce03c6f9a7d64e951b61d6eac305d3e78fcf320863dc5a5b3f14cf5ce7e71039"} Jul 08 18:01:08.542072 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:08.542047 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mpp67" event={"ID":"acbfbe44-056d-4cd2-9b39-dc4381cc731a","Type":"ContainerStarted","Data":"a688456f3b158ab3bc49758154770dfe795530b254cf0a3616088aaf51c176e9"} Jul 08 18:01:08.542216 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:08.542090 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mpp67" event={"ID":"acbfbe44-056d-4cd2-9b39-dc4381cc731a","Type":"ContainerStarted","Data":"21e508ff2cd3d4d83d572769cd8c65ddb80b751ed1b2f91228daf0c9eebe5ef1"} Jul 08 18:01:08.568603 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:08.568553 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mpp67" podStartSLOduration=3.127893321 podStartE2EDuration="4.568538764s" totalImagesPullingTime="1.358721385s" totalInitContainerRuntime="81.924058ms" isStatefulPod=true podCreationTimestamp="2026-07-08 18:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:01:08.567469589 +0000 UTC m=+312.507277076" watchObservedRunningTime="2026-07-08 18:01:08.568538764 +0000 UTC m=+312.508346191" Jul 08 18:01:09.026358 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.026275 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-9d9768dd-vn25d"] Jul 08 18:01:09.029849 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.029819 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" Jul 08 18:01:09.032360 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.032336 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-qlzlt\"" Jul 08 18:01:09.032506 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.032435 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 08 18:01:09.032810 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.032793 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 08 18:01:09.033365 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.033327 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 08 18:01:09.033502 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.033488 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 08 18:01:09.033718 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.033701 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4a6cumuud1si6\"" Jul 08 18:01:09.039197 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.038729 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-9d9768dd-vn25d"] Jul 08 18:01:09.148267 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.148222 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/605ef669-3323-412e-8723-a2ef7af0914c-audit-log\") pod \"metrics-server-9d9768dd-vn25d\" (UID: \"605ef669-3323-412e-8723-a2ef7af0914c\") " pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" Jul 08 18:01:09.148451 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.148291 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw24t\" (UniqueName: \"kubernetes.io/projected/605ef669-3323-412e-8723-a2ef7af0914c-kube-api-access-nw24t\") pod \"metrics-server-9d9768dd-vn25d\" (UID: \"605ef669-3323-412e-8723-a2ef7af0914c\") " pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" Jul 08 18:01:09.148451 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.148376 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/605ef669-3323-412e-8723-a2ef7af0914c-secret-metrics-server-client-certs\") pod \"metrics-server-9d9768dd-vn25d\" (UID: \"605ef669-3323-412e-8723-a2ef7af0914c\") " pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" Jul 08 18:01:09.148451 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.148421 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/605ef669-3323-412e-8723-a2ef7af0914c-secret-metrics-server-tls\") pod \"metrics-server-9d9768dd-vn25d\" (UID: \"605ef669-3323-412e-8723-a2ef7af0914c\") " pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" Jul 08 18:01:09.148639 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.148463 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605ef669-3323-412e-8723-a2ef7af0914c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9d9768dd-vn25d\" (UID: \"605ef669-3323-412e-8723-a2ef7af0914c\") " pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" Jul 08 18:01:09.148639 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.148491 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/605ef669-3323-412e-8723-a2ef7af0914c-metrics-server-audit-profiles\") pod \"metrics-server-9d9768dd-vn25d\" (UID: \"605ef669-3323-412e-8723-a2ef7af0914c\") " pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" Jul 08 18:01:09.148639 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.148553 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/605ef669-3323-412e-8723-a2ef7af0914c-client-ca-bundle\") pod \"metrics-server-9d9768dd-vn25d\" (UID: \"605ef669-3323-412e-8723-a2ef7af0914c\") " pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" Jul 08 18:01:09.250086 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.250048 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/605ef669-3323-412e-8723-a2ef7af0914c-audit-log\") pod \"metrics-server-9d9768dd-vn25d\" (UID: \"605ef669-3323-412e-8723-a2ef7af0914c\") " pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" Jul 08 18:01:09.250287 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.250210 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw24t\" (UniqueName: \"kubernetes.io/projected/605ef669-3323-412e-8723-a2ef7af0914c-kube-api-access-nw24t\") pod \"metrics-server-9d9768dd-vn25d\" (UID: \"605ef669-3323-412e-8723-a2ef7af0914c\") " pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" Jul 08 18:01:09.250350 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.250284 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/605ef669-3323-412e-8723-a2ef7af0914c-secret-metrics-server-client-certs\") pod \"metrics-server-9d9768dd-vn25d\" (UID: \"605ef669-3323-412e-8723-a2ef7af0914c\") " pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" Jul 08 18:01:09.250350 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.250333 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/605ef669-3323-412e-8723-a2ef7af0914c-secret-metrics-server-tls\") pod \"metrics-server-9d9768dd-vn25d\" (UID: \"605ef669-3323-412e-8723-a2ef7af0914c\") " pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" Jul 08 18:01:09.250533 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.250511 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/605ef669-3323-412e-8723-a2ef7af0914c-audit-log\") pod \"metrics-server-9d9768dd-vn25d\" (UID: \"605ef669-3323-412e-8723-a2ef7af0914c\") " pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" Jul 08 18:01:09.250630 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.250519 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605ef669-3323-412e-8723-a2ef7af0914c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9d9768dd-vn25d\" (UID: \"605ef669-3323-412e-8723-a2ef7af0914c\") " pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" Jul 08 18:01:09.250630 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.250569 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/605ef669-3323-412e-8723-a2ef7af0914c-metrics-server-audit-profiles\") pod \"metrics-server-9d9768dd-vn25d\" (UID: \"605ef669-3323-412e-8723-a2ef7af0914c\") " pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" Jul 08 18:01:09.250630 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.250617 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/605ef669-3323-412e-8723-a2ef7af0914c-client-ca-bundle\") pod \"metrics-server-9d9768dd-vn25d\" (UID: \"605ef669-3323-412e-8723-a2ef7af0914c\") " pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" Jul 08 18:01:09.251300 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.251250 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605ef669-3323-412e-8723-a2ef7af0914c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9d9768dd-vn25d\" (UID: \"605ef669-3323-412e-8723-a2ef7af0914c\") " pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" Jul 08 18:01:09.251671 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.251618 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/605ef669-3323-412e-8723-a2ef7af0914c-metrics-server-audit-profiles\") pod \"metrics-server-9d9768dd-vn25d\" (UID: \"605ef669-3323-412e-8723-a2ef7af0914c\") " pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" Jul 08 18:01:09.253438 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.253416 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/605ef669-3323-412e-8723-a2ef7af0914c-secret-metrics-server-tls\") pod \"metrics-server-9d9768dd-vn25d\" (UID: \"605ef669-3323-412e-8723-a2ef7af0914c\") " pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" Jul 08 18:01:09.253642 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.253621 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/605ef669-3323-412e-8723-a2ef7af0914c-client-ca-bundle\") pod \"metrics-server-9d9768dd-vn25d\" (UID: \"605ef669-3323-412e-8723-a2ef7af0914c\") " pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" Jul 08 18:01:09.253862 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.253831 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/605ef669-3323-412e-8723-a2ef7af0914c-secret-metrics-server-client-certs\") pod \"metrics-server-9d9768dd-vn25d\" (UID: \"605ef669-3323-412e-8723-a2ef7af0914c\") " pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" Jul 08 18:01:09.259145 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.259113 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw24t\" (UniqueName: \"kubernetes.io/projected/605ef669-3323-412e-8723-a2ef7af0914c-kube-api-access-nw24t\") pod \"metrics-server-9d9768dd-vn25d\" (UID: \"605ef669-3323-412e-8723-a2ef7af0914c\") " pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" Jul 08 18:01:09.341844 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.341809 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" Jul 08 18:01:09.463460 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.463421 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-bgfvj"] Jul 08 18:01:09.467325 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.467290 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bgfvj" Jul 08 18:01:09.470082 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.470059 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-j56fd\"" Jul 08 18:01:09.470431 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.470389 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 08 18:01:09.476565 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.476508 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-bgfvj"] Jul 08 18:01:09.554243 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.554215 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7nqp\" (UniqueName: \"kubernetes.io/projected/c58ce84e-ce79-4cbb-a3a5-15043f4424ef-kube-api-access-p7nqp\") pod \"monitoring-plugin-d5dcff7cf-bgfvj\" (UID: \"c58ce84e-ce79-4cbb-a3a5-15043f4424ef\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bgfvj" Jul 08 18:01:09.554646 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.554323 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c58ce84e-ce79-4cbb-a3a5-15043f4424ef-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-bgfvj\" (UID: \"c58ce84e-ce79-4cbb-a3a5-15043f4424ef\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bgfvj" Jul 08 18:01:09.656256 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.655689 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c58ce84e-ce79-4cbb-a3a5-15043f4424ef-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-bgfvj\" (UID: \"c58ce84e-ce79-4cbb-a3a5-15043f4424ef\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bgfvj" Jul 08 18:01:09.656256 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.655842 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7nqp\" (UniqueName: \"kubernetes.io/projected/c58ce84e-ce79-4cbb-a3a5-15043f4424ef-kube-api-access-p7nqp\") pod \"monitoring-plugin-d5dcff7cf-bgfvj\" (UID: \"c58ce84e-ce79-4cbb-a3a5-15043f4424ef\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bgfvj" Jul 08 18:01:09.658763 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.658735 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c58ce84e-ce79-4cbb-a3a5-15043f4424ef-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-bgfvj\" (UID: \"c58ce84e-ce79-4cbb-a3a5-15043f4424ef\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bgfvj" Jul 08 18:01:09.665702 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.665654 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7nqp\" (UniqueName: \"kubernetes.io/projected/c58ce84e-ce79-4cbb-a3a5-15043f4424ef-kube-api-access-p7nqp\") pod \"monitoring-plugin-d5dcff7cf-bgfvj\" (UID: \"c58ce84e-ce79-4cbb-a3a5-15043f4424ef\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bgfvj" Jul 08 18:01:09.783837 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:09.783754 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bgfvj" Jul 08 18:01:10.189497 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:10.189449 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-9d9768dd-vn25d"] Jul 08 18:01:10.194154 ip-10-0-128-234 kubenswrapper[2579]: W0708 18:01:10.194116 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod605ef669_3323_412e_8723_a2ef7af0914c.slice/crio-d0095f0cb12594701b07441e3ac8336806224b07d92f17b744a50be642976030 WatchSource:0}: Error finding container d0095f0cb12594701b07441e3ac8336806224b07d92f17b744a50be642976030: Status 404 returned error can't find the container with id d0095f0cb12594701b07441e3ac8336806224b07d92f17b744a50be642976030 Jul 08 18:01:10.209099 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:10.208998 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-bgfvj"] Jul 08 18:01:10.212309 ip-10-0-128-234 kubenswrapper[2579]: W0708 18:01:10.212285 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc58ce84e_ce79_4cbb_a3a5_15043f4424ef.slice/crio-d9b6255d4331f6d0c56ba0368a33fa96a75952b7c288e7dbc5996f7d14a00eef WatchSource:0}: Error finding container d9b6255d4331f6d0c56ba0368a33fa96a75952b7c288e7dbc5996f7d14a00eef: Status 404 returned error can't find the container with id d9b6255d4331f6d0c56ba0368a33fa96a75952b7c288e7dbc5996f7d14a00eef Jul 08 18:01:10.557503 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:10.557463 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" event={"ID":"605ef669-3323-412e-8723-a2ef7af0914c","Type":"ContainerStarted","Data":"d0095f0cb12594701b07441e3ac8336806224b07d92f17b744a50be642976030"} Jul 08 18:01:10.559764 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:10.559732 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" event={"ID":"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b","Type":"ContainerStarted","Data":"9a2645edf944695d6f938aafddf232434664f579ad05da20d2e55ce1c4ee6069"} Jul 08 18:01:10.559886 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:10.559805 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" event={"ID":"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b","Type":"ContainerStarted","Data":"3ada19618fd49f8e60a7ea3b0b6de503d6f84089ff0e2978a3a5feb9a286ea12"} Jul 08 18:01:10.559886 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:10.559846 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" event={"ID":"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b","Type":"ContainerStarted","Data":"938a3c1235bdf22a5edc52ddbf8ffd03d860aba3dda90d7d0625bc9a2534af78"} Jul 08 18:01:10.560895 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:10.560868 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bgfvj" event={"ID":"c58ce84e-ce79-4cbb-a3a5-15043f4424ef","Type":"ContainerStarted","Data":"d9b6255d4331f6d0c56ba0368a33fa96a75952b7c288e7dbc5996f7d14a00eef"} Jul 08 18:01:10.562568 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:10.562542 2579 generic.go:356] "Generic (PLEG): container finished" podID="25441665-460a-45a6-9df9-7e7c3560b55c" containerID="881d21eaa796b457c69f2abd162edf142be1b83e903d9681d5f889256dc1d2d6" exitCode=0 Jul 08 18:01:10.562660 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:10.562603 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25441665-460a-45a6-9df9-7e7c3560b55c","Type":"ContainerDied","Data":"881d21eaa796b457c69f2abd162edf142be1b83e903d9681d5f889256dc1d2d6"} Jul 08 18:01:10.959004 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:10.957887 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 18:01:10.962845 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:10.962818 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:10.972227 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:10.970416 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 08 18:01:10.972227 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:10.970631 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 08 18:01:10.972227 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:10.970869 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 08 18:01:10.972227 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:10.971126 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 08 18:01:10.972227 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:10.971215 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 08 18:01:10.972227 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:10.971363 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 08 18:01:10.972227 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:10.971462 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 08 18:01:10.972227 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:10.971833 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 08 18:01:10.972227 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:10.972042 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zflzc\"" Jul 08 18:01:10.972227 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:10.972135 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 08 18:01:10.973676 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:10.973587 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 08 18:01:10.974393 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:10.974092 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 08 18:01:10.974393 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:10.974150 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 08 18:01:10.974393 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:10.974152 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 08 18:01:10.974393 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:10.974207 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 08 18:01:10.974393 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:10.974246 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ekplpo2rbem1o\"" Jul 08 18:01:10.987082 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:10.987045 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 18:01:11.068655 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.068618 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-config\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.068853 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.068662 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.068853 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.068690 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.068853 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.068750 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/22731683-d752-4256-be6f-6430add1d555-config-out\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.068853 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.068783 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.068853 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.068819 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.068853 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.068844 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.069342 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.068874 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.069342 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.068904 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/22731683-d752-4256-be6f-6430add1d555-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.069342 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.068978 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.069342 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.069046 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.069342 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.069072 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.069342 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.069095 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.069342 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.069123 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw4jb\" (UniqueName: \"kubernetes.io/projected/22731683-d752-4256-be6f-6430add1d555-kube-api-access-gw4jb\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.069342 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.069214 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.069342 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.069267 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.069813 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.069356 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.069813 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.069388 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.069813 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.069448 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-web-config\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.069813 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.069471 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/22731683-d752-4256-be6f-6430add1d555-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.169936 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.169902 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.170139 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.169964 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.170139 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.170022 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.170139 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.170046 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.170139 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.170069 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-web-config\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.170139 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.170093 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/22731683-d752-4256-be6f-6430add1d555-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.170139 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.170134 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-config\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.170530 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.170157 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.170530 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.170218 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.170530 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.170256 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/22731683-d752-4256-be6f-6430add1d555-config-out\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.170530 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.170277 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.170530 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.170301 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.170530 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.170321 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.170530 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.170349 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.170530 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.170377 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/22731683-d752-4256-be6f-6430add1d555-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.170530 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.170405 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.170998 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.170792 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.170998 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.170853 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.170998 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.170883 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.170998 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.170909 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.170998 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.170936 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw4jb\" (UniqueName: \"kubernetes.io/projected/22731683-d752-4256-be6f-6430add1d555-kube-api-access-gw4jb\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.171264 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.171074 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.171886 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.171855 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.172280 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.171975 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.172280 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.172160 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.173214 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.173130 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.179232 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.176146 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/22731683-d752-4256-be6f-6430add1d555-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.179232 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.176335 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.179797 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.179742 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.180688 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.180641 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.180792 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.180764 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-web-config\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.181324 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.181300 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.182191 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.182151 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.182292 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.182219 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.182823 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.182769 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-config\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.183315 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.182931 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.183315 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.183277 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/22731683-d752-4256-be6f-6430add1d555-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.183716 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.183677 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/22731683-d752-4256-be6f-6430add1d555-config-out\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.183997 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.183975 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.186089 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.186066 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw4jb\" (UniqueName: \"kubernetes.io/projected/22731683-d752-4256-be6f-6430add1d555-kube-api-access-gw4jb\") pod \"prometheus-k8s-0\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.276542 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.276442 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:11.473837 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.473717 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 18:01:11.476386 ip-10-0-128-234 kubenswrapper[2579]: W0708 18:01:11.476354 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22731683_d752_4256_be6f_6430add1d555.slice/crio-6da66d96895561df9aa22f06665ba3500dfc41617bad570d1e0afaf4fe4f646f WatchSource:0}: Error finding container 6da66d96895561df9aa22f06665ba3500dfc41617bad570d1e0afaf4fe4f646f: Status 404 returned error can't find the container with id 6da66d96895561df9aa22f06665ba3500dfc41617bad570d1e0afaf4fe4f646f Jul 08 18:01:11.580525 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:11.580472 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22731683-d752-4256-be6f-6430add1d555","Type":"ContainerStarted","Data":"6da66d96895561df9aa22f06665ba3500dfc41617bad570d1e0afaf4fe4f646f"} Jul 08 18:01:12.587208 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:12.587073 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bgfvj" event={"ID":"c58ce84e-ce79-4cbb-a3a5-15043f4424ef","Type":"ContainerStarted","Data":"834176d6fa5ac8fc344d83fe53bd2d32a3913b3e11432e8fd356c4c881edf7f6"} Jul 08 18:01:12.587654 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:12.587305 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bgfvj" Jul 08 18:01:12.589618 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:12.589518 2579 generic.go:356] "Generic (PLEG): container finished" podID="22731683-d752-4256-be6f-6430add1d555" containerID="0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621" exitCode=0 Jul 08 18:01:12.589618 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:12.589564 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22731683-d752-4256-be6f-6430add1d555","Type":"ContainerDied","Data":"0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621"} Jul 08 18:01:12.594474 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:12.594317 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bgfvj" Jul 08 18:01:12.608716 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:12.608659 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bgfvj" podStartSLOduration=1.787420357 podStartE2EDuration="3.608644312s" totalImagesPullingTime="1.821223955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:01:12.60687263 +0000 UTC m=+316.546680060" watchObservedRunningTime="2026-07-08 18:01:12.608644312 +0000 UTC m=+316.548451752" Jul 08 18:01:12.614226 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:12.614164 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 18:01:13.599943 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:13.599906 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25441665-460a-45a6-9df9-7e7c3560b55c","Type":"ContainerStarted","Data":"87535a1444fb41ed7ba961e2eb7b5720bc2498f0f08fb94a6614d0986b4a62ac"} Jul 08 18:01:13.600424 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:13.599991 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25441665-460a-45a6-9df9-7e7c3560b55c","Type":"ContainerStarted","Data":"1d6a248739986c5afa09a89ec3b6484bb04bba9c245a51cb590a68c6a02e7ac1"} Jul 08 18:01:13.600424 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:13.600043 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25441665-460a-45a6-9df9-7e7c3560b55c","Type":"ContainerStarted","Data":"df19d433de0e8a24416597d99d82bdcbec2347117ca0214c70ae8797b67ecb30"} Jul 08 18:01:13.600424 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:13.600084 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25441665-460a-45a6-9df9-7e7c3560b55c","Type":"ContainerStarted","Data":"eda182db6dc46c884fafb2bf87db29c89ade3c73f962f16d779924291e421968"} Jul 08 18:01:13.600424 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:13.600124 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25441665-460a-45a6-9df9-7e7c3560b55c","Type":"ContainerStarted","Data":"91d8b04f7dc20b081e06a366193c9181c702ece7dfb5f13726ffa06d6c2e9720"} Jul 08 18:01:17.894085 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:17.894039 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57684fd7c6-5ns46"] Jul 08 18:01:24.658747 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:24.658702 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" event={"ID":"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b","Type":"ContainerStarted","Data":"10ddd5fbf10543a1a569ebf42ddac723591047bc52d04e288f8396e192abf909"} Jul 08 18:01:24.659267 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:24.658790 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" event={"ID":"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b","Type":"ContainerStarted","Data":"0f7c2a3f67d367f2d8eba5a05da022cff3ba11ac7207b110c5041130fa03d637"} Jul 08 18:01:24.659267 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:24.658831 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" event={"ID":"5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b","Type":"ContainerStarted","Data":"ad8c0a0bbc06edda9d5e29efcdfd39d3f5d7e1cc4bae99cae8f2bcb74f5672bc"} Jul 08 18:01:24.659267 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:24.658876 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" Jul 08 18:01:24.663481 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:24.663453 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25441665-460a-45a6-9df9-7e7c3560b55c","Type":"ContainerStarted","Data":"645aae87d3e8ab6ba31fbee9489f2cd5023683057ee64ee84e1f03a1dd60c5fb"} Jul 08 18:01:24.666323 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:24.666296 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" Jul 08 18:01:24.668234 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:24.668206 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22731683-d752-4256-be6f-6430add1d555","Type":"ContainerStarted","Data":"96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06"} Jul 08 18:01:24.668360 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:24.668280 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22731683-d752-4256-be6f-6430add1d555","Type":"ContainerStarted","Data":"30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6"} Jul 08 18:01:24.668360 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:24.668325 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22731683-d752-4256-be6f-6430add1d555","Type":"ContainerStarted","Data":"70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed"} Jul 08 18:01:24.668360 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:24.668359 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22731683-d752-4256-be6f-6430add1d555","Type":"ContainerStarted","Data":"61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476"} Jul 08 18:01:24.668809 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:24.668384 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22731683-d752-4256-be6f-6430add1d555","Type":"ContainerStarted","Data":"367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1"} Jul 08 18:01:24.668907 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:24.668886 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22731683-d752-4256-be6f-6430add1d555","Type":"ContainerStarted","Data":"cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608"} Jul 08 18:01:24.678325 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:24.678290 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-gd5d5" event={"ID":"1f9ad66b-56ab-4883-8a3f-0ed1d5a19082","Type":"ContainerStarted","Data":"6aa56da9ddb151783e7b781e37d3c0da38b742162c8ebdd63808b1dd0cbf6746"} Jul 08 18:01:24.678596 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:24.678577 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-gd5d5" Jul 08 18:01:24.681100 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:24.681063 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" event={"ID":"605ef669-3323-412e-8723-a2ef7af0914c","Type":"ContainerStarted","Data":"d1cf15663f512e5bb0840e2c48c5578c5ac4aafd303ff905a2988c80d965b2aa"} Jul 08 18:01:24.685841 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:24.685765 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5ddbb5b97b-p6tzm" podStartSLOduration=2.5256448320000002 podStartE2EDuration="18.685750249s" totalImagesPullingTime="16.160105417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:01:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:01:24.68386372 +0000 UTC m=+328.623671148" watchObservedRunningTime="2026-07-08 18:01:24.685750249 +0000 UTC m=+328.625557658" Jul 08 18:01:24.693382 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:24.693360 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-gd5d5" Jul 08 18:01:24.717993 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:24.717934 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.876244364 podStartE2EDuration="14.717913459s" totalImagesPullingTime="10.817370815s" totalInitContainerRuntime="24.29828ms" isStatefulPod=false podCreationTimestamp="2026-07-08 18:01:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:01:24.714670648 +0000 UTC m=+328.654478076" watchObservedRunningTime="2026-07-08 18:01:24.717913459 +0000 UTC m=+328.657720887" Jul 08 18:01:24.747026 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:24.746961 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.778425724 podStartE2EDuration="19.74694128s" totalImagesPullingTime="14.940485638s" totalInitContainerRuntime="28.029918ms" isStatefulPod=false podCreationTimestamp="2026-07-08 18:01:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:01:24.743872269 +0000 UTC m=+328.683679735" watchObservedRunningTime="2026-07-08 18:01:24.74694128 +0000 UTC m=+328.686748706" Jul 08 18:01:24.799432 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:24.799323 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-gd5d5" podStartSLOduration=2.310177722 podStartE2EDuration="29.799302808s" totalImagesPullingTime="27.489125086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:00:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:01:24.798119359 +0000 UTC m=+328.737926786" watchObservedRunningTime="2026-07-08 18:01:24.799302808 +0000 UTC m=+328.739110236" Jul 08 18:01:24.800000 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:24.799957 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" podStartSLOduration=2.585400812 podStartE2EDuration="15.799943772s" totalImagesPullingTime="13.21454296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:01:24.771086506 +0000 UTC m=+328.710893937" watchObservedRunningTime="2026-07-08 18:01:24.799943772 +0000 UTC m=+328.739751224" Jul 08 18:01:26.277258 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:26.277212 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:01:29.342962 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:29.342917 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" Jul 08 18:01:29.343430 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:29.342989 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" Jul 08 18:01:42.916879 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:42.916838 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" podUID="61e8dba2-955c-41e8-b903-e0e55d277ea4" containerName="registry" containerID="cri-o://4719c646a13ecd44e4b84a82d1bd208b711050da435a92a732f40f9d23b2056c" gracePeriod=30 Jul 08 18:01:43.206773 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.206741 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 18:01:43.297541 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.297506 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls\") pod \"61e8dba2-955c-41e8-b903-e0e55d277ea4\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " Jul 08 18:01:43.297541 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.297548 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61e8dba2-955c-41e8-b903-e0e55d277ea4-trusted-ca\") pod \"61e8dba2-955c-41e8-b903-e0e55d277ea4\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " Jul 08 18:01:43.297832 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.297586 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61e8dba2-955c-41e8-b903-e0e55d277ea4-installation-pull-secrets\") pod \"61e8dba2-955c-41e8-b903-e0e55d277ea4\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " Jul 08 18:01:43.297832 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.297619 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-bound-sa-token\") pod \"61e8dba2-955c-41e8-b903-e0e55d277ea4\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " Jul 08 18:01:43.297832 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.297649 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-certificates\") pod \"61e8dba2-955c-41e8-b903-e0e55d277ea4\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " Jul 08 18:01:43.297832 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.297696 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pltrl\" (UniqueName: \"kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-kube-api-access-pltrl\") pod \"61e8dba2-955c-41e8-b903-e0e55d277ea4\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " Jul 08 18:01:43.297832 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.297725 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61e8dba2-955c-41e8-b903-e0e55d277ea4-ca-trust-extracted\") pod \"61e8dba2-955c-41e8-b903-e0e55d277ea4\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " Jul 08 18:01:43.297832 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.297764 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61e8dba2-955c-41e8-b903-e0e55d277ea4-image-registry-private-configuration\") pod \"61e8dba2-955c-41e8-b903-e0e55d277ea4\" (UID: \"61e8dba2-955c-41e8-b903-e0e55d277ea4\") " Jul 08 18:01:43.298137 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.298082 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61e8dba2-955c-41e8-b903-e0e55d277ea4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "61e8dba2-955c-41e8-b903-e0e55d277ea4" (UID: "61e8dba2-955c-41e8-b903-e0e55d277ea4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:01:43.298225 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.298204 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "61e8dba2-955c-41e8-b903-e0e55d277ea4" (UID: "61e8dba2-955c-41e8-b903-e0e55d277ea4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:01:43.300224 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.300156 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "61e8dba2-955c-41e8-b903-e0e55d277ea4" (UID: "61e8dba2-955c-41e8-b903-e0e55d277ea4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:01:43.300358 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.300230 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61e8dba2-955c-41e8-b903-e0e55d277ea4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "61e8dba2-955c-41e8-b903-e0e55d277ea4" (UID: "61e8dba2-955c-41e8-b903-e0e55d277ea4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:01:43.300422 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.300380 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-kube-api-access-pltrl" (OuterVolumeSpecName: "kube-api-access-pltrl") pod "61e8dba2-955c-41e8-b903-e0e55d277ea4" (UID: "61e8dba2-955c-41e8-b903-e0e55d277ea4"). InnerVolumeSpecName "kube-api-access-pltrl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:01:43.300471 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.300446 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "61e8dba2-955c-41e8-b903-e0e55d277ea4" (UID: "61e8dba2-955c-41e8-b903-e0e55d277ea4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:01:43.300519 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.300467 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61e8dba2-955c-41e8-b903-e0e55d277ea4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "61e8dba2-955c-41e8-b903-e0e55d277ea4" (UID: "61e8dba2-955c-41e8-b903-e0e55d277ea4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:01:43.306468 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.306436 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61e8dba2-955c-41e8-b903-e0e55d277ea4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "61e8dba2-955c-41e8-b903-e0e55d277ea4" (UID: "61e8dba2-955c-41e8-b903-e0e55d277ea4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:01:43.399332 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.399298 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-tls\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:01:43.399332 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.399324 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61e8dba2-955c-41e8-b903-e0e55d277ea4-trusted-ca\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:01:43.399332 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.399335 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61e8dba2-955c-41e8-b903-e0e55d277ea4-installation-pull-secrets\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:01:43.399332 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.399344 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-bound-sa-token\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:01:43.399603 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.399353 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61e8dba2-955c-41e8-b903-e0e55d277ea4-registry-certificates\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:01:43.399603 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.399361 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pltrl\" (UniqueName: \"kubernetes.io/projected/61e8dba2-955c-41e8-b903-e0e55d277ea4-kube-api-access-pltrl\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:01:43.399603 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.399369 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61e8dba2-955c-41e8-b903-e0e55d277ea4-ca-trust-extracted\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:01:43.399603 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.399379 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61e8dba2-955c-41e8-b903-e0e55d277ea4-image-registry-private-configuration\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:01:43.764475 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.764390 2579 generic.go:356] "Generic (PLEG): container finished" podID="61e8dba2-955c-41e8-b903-e0e55d277ea4" containerID="4719c646a13ecd44e4b84a82d1bd208b711050da435a92a732f40f9d23b2056c" exitCode=0 Jul 08 18:01:43.764475 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.764432 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" Jul 08 18:01:43.764475 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.764465 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" event={"ID":"61e8dba2-955c-41e8-b903-e0e55d277ea4","Type":"ContainerDied","Data":"4719c646a13ecd44e4b84a82d1bd208b711050da435a92a732f40f9d23b2056c"} Jul 08 18:01:43.764818 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.764513 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57684fd7c6-5ns46" event={"ID":"61e8dba2-955c-41e8-b903-e0e55d277ea4","Type":"ContainerDied","Data":"2bee7b3c18b3f085bee841da37e57f7439c1b8492bc24e4df9d56d2169dedd42"} Jul 08 18:01:43.764818 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.764534 2579 scope.go:117] "RemoveContainer" containerID="4719c646a13ecd44e4b84a82d1bd208b711050da435a92a732f40f9d23b2056c" Jul 08 18:01:43.765959 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.765940 2579 generic.go:356] "Generic (PLEG): container finished" podID="de99acf9-7a92-4681-b0b3-918c51c1dea5" containerID="efcd685d3034d0ee0a44b753e3f38044bfb0cbf7b70f8d6726e128d8e6b9de45" exitCode=0 Jul 08 18:01:43.766055 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.765987 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-bp5bl" event={"ID":"de99acf9-7a92-4681-b0b3-918c51c1dea5","Type":"ContainerDied","Data":"efcd685d3034d0ee0a44b753e3f38044bfb0cbf7b70f8d6726e128d8e6b9de45"} Jul 08 18:01:43.766390 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.766374 2579 scope.go:117] "RemoveContainer" containerID="efcd685d3034d0ee0a44b753e3f38044bfb0cbf7b70f8d6726e128d8e6b9de45" Jul 08 18:01:43.775684 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.775662 2579 scope.go:117] "RemoveContainer" containerID="4719c646a13ecd44e4b84a82d1bd208b711050da435a92a732f40f9d23b2056c" Jul 08 18:01:43.775972 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:01:43.775953 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4719c646a13ecd44e4b84a82d1bd208b711050da435a92a732f40f9d23b2056c\": container with ID starting with 4719c646a13ecd44e4b84a82d1bd208b711050da435a92a732f40f9d23b2056c not found: ID does not exist" containerID="4719c646a13ecd44e4b84a82d1bd208b711050da435a92a732f40f9d23b2056c" Jul 08 18:01:43.776017 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.775981 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4719c646a13ecd44e4b84a82d1bd208b711050da435a92a732f40f9d23b2056c"} err="failed to get container status \"4719c646a13ecd44e4b84a82d1bd208b711050da435a92a732f40f9d23b2056c\": rpc error: code = NotFound desc = could not find container \"4719c646a13ecd44e4b84a82d1bd208b711050da435a92a732f40f9d23b2056c\": container with ID starting with 4719c646a13ecd44e4b84a82d1bd208b711050da435a92a732f40f9d23b2056c not found: ID does not exist" Jul 08 18:01:43.814750 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.814717 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57684fd7c6-5ns46"] Jul 08 18:01:43.822841 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:43.822816 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-57684fd7c6-5ns46"] Jul 08 18:01:44.618753 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:44.618717 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61e8dba2-955c-41e8-b903-e0e55d277ea4" path="/var/lib/kubelet/pods/61e8dba2-955c-41e8-b903-e0e55d277ea4/volumes" Jul 08 18:01:44.772683 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:44.772647 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-bp5bl" event={"ID":"de99acf9-7a92-4681-b0b3-918c51c1dea5","Type":"ContainerStarted","Data":"c0b2535995954baa23301a589d7b6a658b1b9e64b562ed0aa32f51e6a6f5f399"} Jul 08 18:01:49.347631 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:49.347545 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" Jul 08 18:01:49.351461 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:01:49.351434 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-9d9768dd-vn25d" Jul 08 18:02:08.886290 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:08.886254 2579 generic.go:356] "Generic (PLEG): container finished" podID="d978efe4-a0ee-46e0-838a-77ec2ffc352f" containerID="079e9afae986c26fb60f19b584a34aab0d8c7aaaa715a513a160eaae589ec233" exitCode=0 Jul 08 18:02:08.886782 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:08.886331 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-k2gq9" event={"ID":"d978efe4-a0ee-46e0-838a-77ec2ffc352f","Type":"ContainerDied","Data":"079e9afae986c26fb60f19b584a34aab0d8c7aaaa715a513a160eaae589ec233"} Jul 08 18:02:08.886782 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:08.886762 2579 scope.go:117] "RemoveContainer" containerID="079e9afae986c26fb60f19b584a34aab0d8c7aaaa715a513a160eaae589ec233" Jul 08 18:02:09.892660 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:09.892624 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-k2gq9" event={"ID":"d978efe4-a0ee-46e0-838a-77ec2ffc352f","Type":"ContainerStarted","Data":"2a37b77ce262a5737460bcb50b9b398ed773e7889ffc2dac95a6fe2f74df76c8"} Jul 08 18:02:10.458541 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:10.458496 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs\") pod \"network-metrics-daemon-mrv85\" (UID: \"077db27a-abe8-4647-9b18-9d59458f3f9c\") " pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 18:02:10.460758 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:10.460727 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/077db27a-abe8-4647-9b18-9d59458f3f9c-metrics-certs\") pod \"network-metrics-daemon-mrv85\" (UID: \"077db27a-abe8-4647-9b18-9d59458f3f9c\") " pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 18:02:10.517480 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:10.517449 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5k7v7\"" Jul 08 18:02:10.525642 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:10.525608 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrv85" Jul 08 18:02:10.665045 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:10.665019 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mrv85"] Jul 08 18:02:10.667556 ip-10-0-128-234 kubenswrapper[2579]: W0708 18:02:10.667532 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod077db27a_abe8_4647_9b18_9d59458f3f9c.slice/crio-561b02566405c8179c586d0bf09b1e24811cca6d5b3f2addae07b50d6db106c0 WatchSource:0}: Error finding container 561b02566405c8179c586d0bf09b1e24811cca6d5b3f2addae07b50d6db106c0: Status 404 returned error can't find the container with id 561b02566405c8179c586d0bf09b1e24811cca6d5b3f2addae07b50d6db106c0 Jul 08 18:02:10.898069 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:10.898035 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mrv85" event={"ID":"077db27a-abe8-4647-9b18-9d59458f3f9c","Type":"ContainerStarted","Data":"561b02566405c8179c586d0bf09b1e24811cca6d5b3f2addae07b50d6db106c0"} Jul 08 18:02:11.277436 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:11.277346 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:11.293213 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:11.293189 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:11.920092 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:11.920060 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:12.908639 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:12.908529 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mrv85" event={"ID":"077db27a-abe8-4647-9b18-9d59458f3f9c","Type":"ContainerStarted","Data":"ea4ede9a189eb993aba3f95b735d5ba61ee0f213c2f06375d0b7177bce3d983d"} Jul 08 18:02:12.908639 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:12.908594 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mrv85" event={"ID":"077db27a-abe8-4647-9b18-9d59458f3f9c","Type":"ContainerStarted","Data":"514d4475dcc3247ac6c1278472b33ed0fc8a67772fb518c46d21b2e1a43481be"} Jul 08 18:02:12.929338 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:12.929280 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mrv85" podStartSLOduration=375.058270912 podStartE2EDuration="6m16.929264908s" totalImagesPullingTime="1.870993996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:55:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:02:12.927333414 +0000 UTC m=+376.867140841" watchObservedRunningTime="2026-07-08 18:02:12.929264908 +0000 UTC m=+376.869072335" Jul 08 18:02:25.162164 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:25.162126 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 18:02:25.162771 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:25.162521 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="25441665-460a-45a6-9df9-7e7c3560b55c" containerName="alertmanager" containerID="cri-o://91d8b04f7dc20b081e06a366193c9181c702ece7dfb5f13726ffa06d6c2e9720" gracePeriod=120 Jul 08 18:02:25.162771 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:25.162564 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="25441665-460a-45a6-9df9-7e7c3560b55c" containerName="kube-rbac-proxy-metric" containerID="cri-o://87535a1444fb41ed7ba961e2eb7b5720bc2498f0f08fb94a6614d0986b4a62ac" gracePeriod=120 Jul 08 18:02:25.162771 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:25.162639 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="25441665-460a-45a6-9df9-7e7c3560b55c" containerName="prom-label-proxy" containerID="cri-o://645aae87d3e8ab6ba31fbee9489f2cd5023683057ee64ee84e1f03a1dd60c5fb" gracePeriod=120 Jul 08 18:02:25.162771 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:25.162648 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="25441665-460a-45a6-9df9-7e7c3560b55c" containerName="config-reloader" containerID="cri-o://eda182db6dc46c884fafb2bf87db29c89ade3c73f962f16d779924291e421968" gracePeriod=120 Jul 08 18:02:25.162771 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:25.162584 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="25441665-460a-45a6-9df9-7e7c3560b55c" containerName="kube-rbac-proxy-web" containerID="cri-o://df19d433de0e8a24416597d99d82bdcbec2347117ca0214c70ae8797b67ecb30" gracePeriod=120 Jul 08 18:02:25.162771 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:25.162630 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="25441665-460a-45a6-9df9-7e7c3560b55c" containerName="kube-rbac-proxy" containerID="cri-o://1d6a248739986c5afa09a89ec3b6484bb04bba9c245a51cb590a68c6a02e7ac1" gracePeriod=120 Jul 08 18:02:25.963719 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:25.963690 2579 generic.go:356] "Generic (PLEG): container finished" podID="25441665-460a-45a6-9df9-7e7c3560b55c" containerID="645aae87d3e8ab6ba31fbee9489f2cd5023683057ee64ee84e1f03a1dd60c5fb" exitCode=0 Jul 08 18:02:25.963719 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:25.963714 2579 generic.go:356] "Generic (PLEG): container finished" podID="25441665-460a-45a6-9df9-7e7c3560b55c" containerID="87535a1444fb41ed7ba961e2eb7b5720bc2498f0f08fb94a6614d0986b4a62ac" exitCode=0 Jul 08 18:02:25.963719 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:25.963720 2579 generic.go:356] "Generic (PLEG): container finished" podID="25441665-460a-45a6-9df9-7e7c3560b55c" containerID="1d6a248739986c5afa09a89ec3b6484bb04bba9c245a51cb590a68c6a02e7ac1" exitCode=0 Jul 08 18:02:25.963719 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:25.963726 2579 generic.go:356] "Generic (PLEG): container finished" podID="25441665-460a-45a6-9df9-7e7c3560b55c" containerID="eda182db6dc46c884fafb2bf87db29c89ade3c73f962f16d779924291e421968" exitCode=0 Jul 08 18:02:25.964052 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:25.963732 2579 generic.go:356] "Generic (PLEG): container finished" podID="25441665-460a-45a6-9df9-7e7c3560b55c" containerID="91d8b04f7dc20b081e06a366193c9181c702ece7dfb5f13726ffa06d6c2e9720" exitCode=0 Jul 08 18:02:25.964052 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:25.963763 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25441665-460a-45a6-9df9-7e7c3560b55c","Type":"ContainerDied","Data":"645aae87d3e8ab6ba31fbee9489f2cd5023683057ee64ee84e1f03a1dd60c5fb"} Jul 08 18:02:25.964052 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:25.963841 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25441665-460a-45a6-9df9-7e7c3560b55c","Type":"ContainerDied","Data":"87535a1444fb41ed7ba961e2eb7b5720bc2498f0f08fb94a6614d0986b4a62ac"} Jul 08 18:02:25.964052 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:25.963879 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25441665-460a-45a6-9df9-7e7c3560b55c","Type":"ContainerDied","Data":"1d6a248739986c5afa09a89ec3b6484bb04bba9c245a51cb590a68c6a02e7ac1"} Jul 08 18:02:25.964052 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:25.963917 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25441665-460a-45a6-9df9-7e7c3560b55c","Type":"ContainerDied","Data":"eda182db6dc46c884fafb2bf87db29c89ade3c73f962f16d779924291e421968"} Jul 08 18:02:25.964052 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:25.963957 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25441665-460a-45a6-9df9-7e7c3560b55c","Type":"ContainerDied","Data":"91d8b04f7dc20b081e06a366193c9181c702ece7dfb5f13726ffa06d6c2e9720"} Jul 08 18:02:26.411576 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.411554 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:26.507648 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.507547 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-kube-rbac-proxy\") pod \"25441665-460a-45a6-9df9-7e7c3560b55c\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " Jul 08 18:02:26.507648 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.507604 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/25441665-460a-45a6-9df9-7e7c3560b55c-tls-assets\") pod \"25441665-460a-45a6-9df9-7e7c3560b55c\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " Jul 08 18:02:26.507648 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.507638 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"25441665-460a-45a6-9df9-7e7c3560b55c\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " Jul 08 18:02:26.507922 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.507671 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gq2m\" (UniqueName: \"kubernetes.io/projected/25441665-460a-45a6-9df9-7e7c3560b55c-kube-api-access-2gq2m\") pod \"25441665-460a-45a6-9df9-7e7c3560b55c\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " Jul 08 18:02:26.507922 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.507711 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25441665-460a-45a6-9df9-7e7c3560b55c-alertmanager-trusted-ca-bundle\") pod \"25441665-460a-45a6-9df9-7e7c3560b55c\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " Jul 08 18:02:26.507922 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.507756 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/25441665-460a-45a6-9df9-7e7c3560b55c-alertmanager-main-db\") pod \"25441665-460a-45a6-9df9-7e7c3560b55c\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " Jul 08 18:02:26.507922 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.507819 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-cluster-tls-config\") pod \"25441665-460a-45a6-9df9-7e7c3560b55c\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " Jul 08 18:02:26.507922 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.507859 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-kube-rbac-proxy-web\") pod \"25441665-460a-45a6-9df9-7e7c3560b55c\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " Jul 08 18:02:26.507922 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.507886 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-config-volume\") pod \"25441665-460a-45a6-9df9-7e7c3560b55c\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " Jul 08 18:02:26.507922 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.507914 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/25441665-460a-45a6-9df9-7e7c3560b55c-config-out\") pod \"25441665-460a-45a6-9df9-7e7c3560b55c\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " Jul 08 18:02:26.508433 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.507951 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-main-tls\") pod \"25441665-460a-45a6-9df9-7e7c3560b55c\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " Jul 08 18:02:26.508433 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.507981 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25441665-460a-45a6-9df9-7e7c3560b55c-metrics-client-ca\") pod \"25441665-460a-45a6-9df9-7e7c3560b55c\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " Jul 08 18:02:26.508433 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.508022 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-web-config\") pod \"25441665-460a-45a6-9df9-7e7c3560b55c\" (UID: \"25441665-460a-45a6-9df9-7e7c3560b55c\") " Jul 08 18:02:26.508433 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.508157 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25441665-460a-45a6-9df9-7e7c3560b55c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "25441665-460a-45a6-9df9-7e7c3560b55c" (UID: "25441665-460a-45a6-9df9-7e7c3560b55c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:02:26.508433 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.508276 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25441665-460a-45a6-9df9-7e7c3560b55c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "25441665-460a-45a6-9df9-7e7c3560b55c" (UID: "25441665-460a-45a6-9df9-7e7c3560b55c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:02:26.508433 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.508320 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/25441665-460a-45a6-9df9-7e7c3560b55c-alertmanager-main-db\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:26.509861 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.509823 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25441665-460a-45a6-9df9-7e7c3560b55c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "25441665-460a-45a6-9df9-7e7c3560b55c" (UID: "25441665-460a-45a6-9df9-7e7c3560b55c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:02:26.510706 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.510668 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "25441665-460a-45a6-9df9-7e7c3560b55c" (UID: "25441665-460a-45a6-9df9-7e7c3560b55c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:02:26.511023 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.510995 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25441665-460a-45a6-9df9-7e7c3560b55c-config-out" (OuterVolumeSpecName: "config-out") pod "25441665-460a-45a6-9df9-7e7c3560b55c" (UID: "25441665-460a-45a6-9df9-7e7c3560b55c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:02:26.511023 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.511013 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "25441665-460a-45a6-9df9-7e7c3560b55c" (UID: "25441665-460a-45a6-9df9-7e7c3560b55c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:02:26.511212 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.511166 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25441665-460a-45a6-9df9-7e7c3560b55c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "25441665-460a-45a6-9df9-7e7c3560b55c" (UID: "25441665-460a-45a6-9df9-7e7c3560b55c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:02:26.511332 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.511293 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25441665-460a-45a6-9df9-7e7c3560b55c-kube-api-access-2gq2m" (OuterVolumeSpecName: "kube-api-access-2gq2m") pod "25441665-460a-45a6-9df9-7e7c3560b55c" (UID: "25441665-460a-45a6-9df9-7e7c3560b55c"). InnerVolumeSpecName "kube-api-access-2gq2m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:02:26.511605 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.511568 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-config-volume" (OuterVolumeSpecName: "config-volume") pod "25441665-460a-45a6-9df9-7e7c3560b55c" (UID: "25441665-460a-45a6-9df9-7e7c3560b55c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:02:26.512261 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.512241 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "25441665-460a-45a6-9df9-7e7c3560b55c" (UID: "25441665-460a-45a6-9df9-7e7c3560b55c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:02:26.512526 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.512502 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "25441665-460a-45a6-9df9-7e7c3560b55c" (UID: "25441665-460a-45a6-9df9-7e7c3560b55c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:02:26.516815 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.516745 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "25441665-460a-45a6-9df9-7e7c3560b55c" (UID: "25441665-460a-45a6-9df9-7e7c3560b55c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:02:26.523430 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.523401 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-web-config" (OuterVolumeSpecName: "web-config") pod "25441665-460a-45a6-9df9-7e7c3560b55c" (UID: "25441665-460a-45a6-9df9-7e7c3560b55c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:02:26.608826 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.608790 2579 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25441665-460a-45a6-9df9-7e7c3560b55c-metrics-client-ca\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:26.608826 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.608817 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-web-config\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:26.608826 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.608829 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:26.608826 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.608838 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/25441665-460a-45a6-9df9-7e7c3560b55c-tls-assets\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:26.609136 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.608847 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:26.609136 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.608859 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gq2m\" (UniqueName: \"kubernetes.io/projected/25441665-460a-45a6-9df9-7e7c3560b55c-kube-api-access-2gq2m\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:26.609136 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.608873 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25441665-460a-45a6-9df9-7e7c3560b55c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:26.609136 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.608885 2579 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-cluster-tls-config\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:26.609136 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.608894 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:26.609136 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.608902 2579 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:26.609136 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.608911 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/25441665-460a-45a6-9df9-7e7c3560b55c-config-out\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:26.609136 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.608924 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/25441665-460a-45a6-9df9-7e7c3560b55c-secret-alertmanager-main-tls\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:26.970754 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.970713 2579 generic.go:356] "Generic (PLEG): container finished" podID="25441665-460a-45a6-9df9-7e7c3560b55c" containerID="df19d433de0e8a24416597d99d82bdcbec2347117ca0214c70ae8797b67ecb30" exitCode=0 Jul 08 18:02:26.970950 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.970770 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25441665-460a-45a6-9df9-7e7c3560b55c","Type":"ContainerDied","Data":"df19d433de0e8a24416597d99d82bdcbec2347117ca0214c70ae8797b67ecb30"} Jul 08 18:02:26.970950 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.970826 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:26.970950 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.970865 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25441665-460a-45a6-9df9-7e7c3560b55c","Type":"ContainerDied","Data":"ce03c6f9a7d64e951b61d6eac305d3e78fcf320863dc5a5b3f14cf5ce7e71039"} Jul 08 18:02:26.970950 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.970900 2579 scope.go:117] "RemoveContainer" containerID="645aae87d3e8ab6ba31fbee9489f2cd5023683057ee64ee84e1f03a1dd60c5fb" Jul 08 18:02:26.978810 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.978793 2579 scope.go:117] "RemoveContainer" containerID="87535a1444fb41ed7ba961e2eb7b5720bc2498f0f08fb94a6614d0986b4a62ac" Jul 08 18:02:26.985709 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.985692 2579 scope.go:117] "RemoveContainer" containerID="1d6a248739986c5afa09a89ec3b6484bb04bba9c245a51cb590a68c6a02e7ac1" Jul 08 18:02:26.992550 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.992525 2579 scope.go:117] "RemoveContainer" containerID="df19d433de0e8a24416597d99d82bdcbec2347117ca0214c70ae8797b67ecb30" Jul 08 18:02:26.996024 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:26.996006 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 18:02:27.000489 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.000471 2579 scope.go:117] "RemoveContainer" containerID="eda182db6dc46c884fafb2bf87db29c89ade3c73f962f16d779924291e421968" Jul 08 18:02:27.007293 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.007277 2579 scope.go:117] "RemoveContainer" containerID="91d8b04f7dc20b081e06a366193c9181c702ece7dfb5f13726ffa06d6c2e9720" Jul 08 18:02:27.011770 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.011747 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 18:02:27.015374 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.015355 2579 scope.go:117] "RemoveContainer" containerID="881d21eaa796b457c69f2abd162edf142be1b83e903d9681d5f889256dc1d2d6" Jul 08 18:02:27.022283 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.022266 2579 scope.go:117] "RemoveContainer" containerID="645aae87d3e8ab6ba31fbee9489f2cd5023683057ee64ee84e1f03a1dd60c5fb" Jul 08 18:02:27.022529 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:02:27.022511 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"645aae87d3e8ab6ba31fbee9489f2cd5023683057ee64ee84e1f03a1dd60c5fb\": container with ID starting with 645aae87d3e8ab6ba31fbee9489f2cd5023683057ee64ee84e1f03a1dd60c5fb not found: ID does not exist" containerID="645aae87d3e8ab6ba31fbee9489f2cd5023683057ee64ee84e1f03a1dd60c5fb" Jul 08 18:02:27.022580 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.022536 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"645aae87d3e8ab6ba31fbee9489f2cd5023683057ee64ee84e1f03a1dd60c5fb"} err="failed to get container status \"645aae87d3e8ab6ba31fbee9489f2cd5023683057ee64ee84e1f03a1dd60c5fb\": rpc error: code = NotFound desc = could not find container \"645aae87d3e8ab6ba31fbee9489f2cd5023683057ee64ee84e1f03a1dd60c5fb\": container with ID starting with 645aae87d3e8ab6ba31fbee9489f2cd5023683057ee64ee84e1f03a1dd60c5fb not found: ID does not exist" Jul 08 18:02:27.022580 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.022554 2579 scope.go:117] "RemoveContainer" containerID="87535a1444fb41ed7ba961e2eb7b5720bc2498f0f08fb94a6614d0986b4a62ac" Jul 08 18:02:27.022762 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:02:27.022748 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87535a1444fb41ed7ba961e2eb7b5720bc2498f0f08fb94a6614d0986b4a62ac\": container with ID starting with 87535a1444fb41ed7ba961e2eb7b5720bc2498f0f08fb94a6614d0986b4a62ac not found: ID does not exist" containerID="87535a1444fb41ed7ba961e2eb7b5720bc2498f0f08fb94a6614d0986b4a62ac" Jul 08 18:02:27.022805 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.022768 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87535a1444fb41ed7ba961e2eb7b5720bc2498f0f08fb94a6614d0986b4a62ac"} err="failed to get container status \"87535a1444fb41ed7ba961e2eb7b5720bc2498f0f08fb94a6614d0986b4a62ac\": rpc error: code = NotFound desc = could not find container \"87535a1444fb41ed7ba961e2eb7b5720bc2498f0f08fb94a6614d0986b4a62ac\": container with ID starting with 87535a1444fb41ed7ba961e2eb7b5720bc2498f0f08fb94a6614d0986b4a62ac not found: ID does not exist" Jul 08 18:02:27.022805 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.022783 2579 scope.go:117] "RemoveContainer" containerID="1d6a248739986c5afa09a89ec3b6484bb04bba9c245a51cb590a68c6a02e7ac1" Jul 08 18:02:27.022968 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:02:27.022953 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d6a248739986c5afa09a89ec3b6484bb04bba9c245a51cb590a68c6a02e7ac1\": container with ID starting with 1d6a248739986c5afa09a89ec3b6484bb04bba9c245a51cb590a68c6a02e7ac1 not found: ID does not exist" containerID="1d6a248739986c5afa09a89ec3b6484bb04bba9c245a51cb590a68c6a02e7ac1" Jul 08 18:02:27.023011 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.022972 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d6a248739986c5afa09a89ec3b6484bb04bba9c245a51cb590a68c6a02e7ac1"} err="failed to get container status \"1d6a248739986c5afa09a89ec3b6484bb04bba9c245a51cb590a68c6a02e7ac1\": rpc error: code = NotFound desc = could not find container \"1d6a248739986c5afa09a89ec3b6484bb04bba9c245a51cb590a68c6a02e7ac1\": container with ID starting with 1d6a248739986c5afa09a89ec3b6484bb04bba9c245a51cb590a68c6a02e7ac1 not found: ID does not exist" Jul 08 18:02:27.023011 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.022984 2579 scope.go:117] "RemoveContainer" containerID="df19d433de0e8a24416597d99d82bdcbec2347117ca0214c70ae8797b67ecb30" Jul 08 18:02:27.023209 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:02:27.023169 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df19d433de0e8a24416597d99d82bdcbec2347117ca0214c70ae8797b67ecb30\": container with ID starting with df19d433de0e8a24416597d99d82bdcbec2347117ca0214c70ae8797b67ecb30 not found: ID does not exist" containerID="df19d433de0e8a24416597d99d82bdcbec2347117ca0214c70ae8797b67ecb30" Jul 08 18:02:27.023254 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.023213 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df19d433de0e8a24416597d99d82bdcbec2347117ca0214c70ae8797b67ecb30"} err="failed to get container status \"df19d433de0e8a24416597d99d82bdcbec2347117ca0214c70ae8797b67ecb30\": rpc error: code = NotFound desc = could not find container \"df19d433de0e8a24416597d99d82bdcbec2347117ca0214c70ae8797b67ecb30\": container with ID starting with df19d433de0e8a24416597d99d82bdcbec2347117ca0214c70ae8797b67ecb30 not found: ID does not exist" Jul 08 18:02:27.023254 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.023225 2579 scope.go:117] "RemoveContainer" containerID="eda182db6dc46c884fafb2bf87db29c89ade3c73f962f16d779924291e421968" Jul 08 18:02:27.023429 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:02:27.023411 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eda182db6dc46c884fafb2bf87db29c89ade3c73f962f16d779924291e421968\": container with ID starting with eda182db6dc46c884fafb2bf87db29c89ade3c73f962f16d779924291e421968 not found: ID does not exist" containerID="eda182db6dc46c884fafb2bf87db29c89ade3c73f962f16d779924291e421968" Jul 08 18:02:27.023469 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.023434 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eda182db6dc46c884fafb2bf87db29c89ade3c73f962f16d779924291e421968"} err="failed to get container status \"eda182db6dc46c884fafb2bf87db29c89ade3c73f962f16d779924291e421968\": rpc error: code = NotFound desc = could not find container \"eda182db6dc46c884fafb2bf87db29c89ade3c73f962f16d779924291e421968\": container with ID starting with eda182db6dc46c884fafb2bf87db29c89ade3c73f962f16d779924291e421968 not found: ID does not exist" Jul 08 18:02:27.023469 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.023446 2579 scope.go:117] "RemoveContainer" containerID="91d8b04f7dc20b081e06a366193c9181c702ece7dfb5f13726ffa06d6c2e9720" Jul 08 18:02:27.023697 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:02:27.023677 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91d8b04f7dc20b081e06a366193c9181c702ece7dfb5f13726ffa06d6c2e9720\": container with ID starting with 91d8b04f7dc20b081e06a366193c9181c702ece7dfb5f13726ffa06d6c2e9720 not found: ID does not exist" containerID="91d8b04f7dc20b081e06a366193c9181c702ece7dfb5f13726ffa06d6c2e9720" Jul 08 18:02:27.023762 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.023707 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91d8b04f7dc20b081e06a366193c9181c702ece7dfb5f13726ffa06d6c2e9720"} err="failed to get container status \"91d8b04f7dc20b081e06a366193c9181c702ece7dfb5f13726ffa06d6c2e9720\": rpc error: code = NotFound desc = could not find container \"91d8b04f7dc20b081e06a366193c9181c702ece7dfb5f13726ffa06d6c2e9720\": container with ID starting with 91d8b04f7dc20b081e06a366193c9181c702ece7dfb5f13726ffa06d6c2e9720 not found: ID does not exist" Jul 08 18:02:27.023762 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.023730 2579 scope.go:117] "RemoveContainer" containerID="881d21eaa796b457c69f2abd162edf142be1b83e903d9681d5f889256dc1d2d6" Jul 08 18:02:27.024043 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:02:27.024026 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"881d21eaa796b457c69f2abd162edf142be1b83e903d9681d5f889256dc1d2d6\": container with ID starting with 881d21eaa796b457c69f2abd162edf142be1b83e903d9681d5f889256dc1d2d6 not found: ID does not exist" containerID="881d21eaa796b457c69f2abd162edf142be1b83e903d9681d5f889256dc1d2d6" Jul 08 18:02:27.024086 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.024048 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"881d21eaa796b457c69f2abd162edf142be1b83e903d9681d5f889256dc1d2d6"} err="failed to get container status \"881d21eaa796b457c69f2abd162edf142be1b83e903d9681d5f889256dc1d2d6\": rpc error: code = NotFound desc = could not find container \"881d21eaa796b457c69f2abd162edf142be1b83e903d9681d5f889256dc1d2d6\": container with ID starting with 881d21eaa796b457c69f2abd162edf142be1b83e903d9681d5f889256dc1d2d6 not found: ID does not exist" Jul 08 18:02:27.064416 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.064386 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 18:02:27.064718 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.064705 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25441665-460a-45a6-9df9-7e7c3560b55c" containerName="init-config-reloader" Jul 08 18:02:27.064760 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.064720 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="25441665-460a-45a6-9df9-7e7c3560b55c" containerName="init-config-reloader" Jul 08 18:02:27.064760 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.064730 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61e8dba2-955c-41e8-b903-e0e55d277ea4" containerName="registry" Jul 08 18:02:27.064760 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.064736 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="61e8dba2-955c-41e8-b903-e0e55d277ea4" containerName="registry" Jul 08 18:02:27.064760 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.064743 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25441665-460a-45a6-9df9-7e7c3560b55c" containerName="alertmanager" Jul 08 18:02:27.064760 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.064749 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="25441665-460a-45a6-9df9-7e7c3560b55c" containerName="alertmanager" Jul 08 18:02:27.064760 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.064755 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25441665-460a-45a6-9df9-7e7c3560b55c" containerName="kube-rbac-proxy-metric" Jul 08 18:02:27.064760 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.064760 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="25441665-460a-45a6-9df9-7e7c3560b55c" containerName="kube-rbac-proxy-metric" Jul 08 18:02:27.064958 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.064768 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25441665-460a-45a6-9df9-7e7c3560b55c" containerName="prom-label-proxy" Jul 08 18:02:27.064958 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.064774 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="25441665-460a-45a6-9df9-7e7c3560b55c" containerName="prom-label-proxy" Jul 08 18:02:27.064958 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.064786 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25441665-460a-45a6-9df9-7e7c3560b55c" containerName="config-reloader" Jul 08 18:02:27.064958 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.064791 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="25441665-460a-45a6-9df9-7e7c3560b55c" containerName="config-reloader" Jul 08 18:02:27.064958 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.064811 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25441665-460a-45a6-9df9-7e7c3560b55c" containerName="kube-rbac-proxy-web" Jul 08 18:02:27.064958 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.064835 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="25441665-460a-45a6-9df9-7e7c3560b55c" containerName="kube-rbac-proxy-web" Jul 08 18:02:27.064958 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.064846 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25441665-460a-45a6-9df9-7e7c3560b55c" containerName="kube-rbac-proxy" Jul 08 18:02:27.064958 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.064851 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="25441665-460a-45a6-9df9-7e7c3560b55c" containerName="kube-rbac-proxy" Jul 08 18:02:27.064958 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.064903 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="25441665-460a-45a6-9df9-7e7c3560b55c" containerName="alertmanager" Jul 08 18:02:27.064958 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.064910 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="61e8dba2-955c-41e8-b903-e0e55d277ea4" containerName="registry" Jul 08 18:02:27.064958 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.064918 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="25441665-460a-45a6-9df9-7e7c3560b55c" containerName="config-reloader" Jul 08 18:02:27.064958 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.064925 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="25441665-460a-45a6-9df9-7e7c3560b55c" containerName="kube-rbac-proxy" Jul 08 18:02:27.064958 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.064931 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="25441665-460a-45a6-9df9-7e7c3560b55c" containerName="prom-label-proxy" Jul 08 18:02:27.064958 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.064937 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="25441665-460a-45a6-9df9-7e7c3560b55c" containerName="kube-rbac-proxy-metric" Jul 08 18:02:27.064958 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.064942 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="25441665-460a-45a6-9df9-7e7c3560b55c" containerName="kube-rbac-proxy-web" Jul 08 18:02:27.068847 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.068829 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.072013 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.071991 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-r8sl4\"" Jul 08 18:02:27.072114 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.071996 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 08 18:02:27.072114 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.071996 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 08 18:02:27.072301 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.072278 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 08 18:02:27.072391 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.072375 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 08 18:02:27.072904 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.072885 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 08 18:02:27.073001 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.072984 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 08 18:02:27.073069 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.072986 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 08 18:02:27.073069 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.072986 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 08 18:02:27.078077 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.078056 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 08 18:02:27.102622 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.102594 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 18:02:27.213269 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.213230 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73f5f865-0f31-404b-95b3-990900abf698-config-out\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.213269 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.213268 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73f5f865-0f31-404b-95b3-990900abf698-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.213492 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.213329 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73f5f865-0f31-404b-95b3-990900abf698-web-config\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.213492 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.213370 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/73f5f865-0f31-404b-95b3-990900abf698-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.213492 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.213416 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/73f5f865-0f31-404b-95b3-990900abf698-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.213492 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.213435 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73f5f865-0f31-404b-95b3-990900abf698-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.213492 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.213450 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/73f5f865-0f31-404b-95b3-990900abf698-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.213492 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.213469 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfj4n\" (UniqueName: \"kubernetes.io/projected/73f5f865-0f31-404b-95b3-990900abf698-kube-api-access-gfj4n\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.213747 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.213523 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73f5f865-0f31-404b-95b3-990900abf698-tls-assets\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.213747 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.213587 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73f5f865-0f31-404b-95b3-990900abf698-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.213747 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.213609 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/73f5f865-0f31-404b-95b3-990900abf698-config-volume\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.213747 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.213626 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/73f5f865-0f31-404b-95b3-990900abf698-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.213747 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.213644 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73f5f865-0f31-404b-95b3-990900abf698-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.315008 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.314967 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73f5f865-0f31-404b-95b3-990900abf698-tls-assets\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.315008 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.315011 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73f5f865-0f31-404b-95b3-990900abf698-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.315250 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.315032 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/73f5f865-0f31-404b-95b3-990900abf698-config-volume\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.315250 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.315090 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/73f5f865-0f31-404b-95b3-990900abf698-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.315250 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.315124 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73f5f865-0f31-404b-95b3-990900abf698-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.315250 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.315205 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73f5f865-0f31-404b-95b3-990900abf698-config-out\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.315450 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.315249 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73f5f865-0f31-404b-95b3-990900abf698-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.315450 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.315299 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73f5f865-0f31-404b-95b3-990900abf698-web-config\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.315450 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.315340 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/73f5f865-0f31-404b-95b3-990900abf698-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.315450 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.315378 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/73f5f865-0f31-404b-95b3-990900abf698-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.315450 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.315408 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73f5f865-0f31-404b-95b3-990900abf698-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.315450 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.315433 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/73f5f865-0f31-404b-95b3-990900abf698-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.315752 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.315468 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfj4n\" (UniqueName: \"kubernetes.io/projected/73f5f865-0f31-404b-95b3-990900abf698-kube-api-access-gfj4n\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.315932 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.315909 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73f5f865-0f31-404b-95b3-990900abf698-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.316682 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.316329 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73f5f865-0f31-404b-95b3-990900abf698-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.316803 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.316745 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/73f5f865-0f31-404b-95b3-990900abf698-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.318317 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.318269 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/73f5f865-0f31-404b-95b3-990900abf698-config-volume\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.318317 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.318313 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73f5f865-0f31-404b-95b3-990900abf698-tls-assets\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.318486 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.318362 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73f5f865-0f31-404b-95b3-990900abf698-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.318629 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.318604 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/73f5f865-0f31-404b-95b3-990900abf698-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.318629 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.318624 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/73f5f865-0f31-404b-95b3-990900abf698-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.318758 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.318605 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73f5f865-0f31-404b-95b3-990900abf698-config-out\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.319010 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.318988 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73f5f865-0f31-404b-95b3-990900abf698-web-config\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.319046 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.319032 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73f5f865-0f31-404b-95b3-990900abf698-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.320140 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.320124 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/73f5f865-0f31-404b-95b3-990900abf698-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.324092 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.324064 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfj4n\" (UniqueName: \"kubernetes.io/projected/73f5f865-0f31-404b-95b3-990900abf698-kube-api-access-gfj4n\") pod \"alertmanager-main-0\" (UID: \"73f5f865-0f31-404b-95b3-990900abf698\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.379068 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.379029 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:02:27.521630 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.521556 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 18:02:27.524533 ip-10-0-128-234 kubenswrapper[2579]: W0708 18:02:27.524509 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73f5f865_0f31_404b_95b3_990900abf698.slice/crio-dfa2f42aa80bba4bd36ec3838925f275bd81779cb3d4655f3a90d257ad6fedc8 WatchSource:0}: Error finding container dfa2f42aa80bba4bd36ec3838925f275bd81779cb3d4655f3a90d257ad6fedc8: Status 404 returned error can't find the container with id dfa2f42aa80bba4bd36ec3838925f275bd81779cb3d4655f3a90d257ad6fedc8 Jul 08 18:02:27.976450 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.976415 2579 generic.go:356] "Generic (PLEG): container finished" podID="73f5f865-0f31-404b-95b3-990900abf698" containerID="25ad2fcdbf2b194487dcc66076f899042fdf581b7d3bb627d8d44be1a78af583" exitCode=0 Jul 08 18:02:27.976639 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.976498 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73f5f865-0f31-404b-95b3-990900abf698","Type":"ContainerDied","Data":"25ad2fcdbf2b194487dcc66076f899042fdf581b7d3bb627d8d44be1a78af583"} Jul 08 18:02:27.976639 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:27.976563 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73f5f865-0f31-404b-95b3-990900abf698","Type":"ContainerStarted","Data":"dfa2f42aa80bba4bd36ec3838925f275bd81779cb3d4655f3a90d257ad6fedc8"} Jul 08 18:02:28.620462 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:28.620430 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25441665-460a-45a6-9df9-7e7c3560b55c" path="/var/lib/kubelet/pods/25441665-460a-45a6-9df9-7e7c3560b55c/volumes" Jul 08 18:02:28.986250 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:28.986142 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73f5f865-0f31-404b-95b3-990900abf698","Type":"ContainerStarted","Data":"526f99cbaba954cd52e66d92a54ecf89a6432e9355c9ab337b22e76f62d015f5"} Jul 08 18:02:28.986418 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:28.986272 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73f5f865-0f31-404b-95b3-990900abf698","Type":"ContainerStarted","Data":"08cf8d127d2d897b3721eb66d5c2644626963348d5e2e2eaac614cbe00584893"} Jul 08 18:02:28.986418 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:28.986320 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73f5f865-0f31-404b-95b3-990900abf698","Type":"ContainerStarted","Data":"eac2ef29159198c3f33ceb597735756a6d1d36c6c1e490ee565e8fc4d43df583"} Jul 08 18:02:28.986418 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:28.986354 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73f5f865-0f31-404b-95b3-990900abf698","Type":"ContainerStarted","Data":"dcc95ea2d3fd5ba4cbdfe6e31cc8b2869fc26496f196042587202d39d61e7412"} Jul 08 18:02:28.986418 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:28.986388 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73f5f865-0f31-404b-95b3-990900abf698","Type":"ContainerStarted","Data":"6015aaad141dcde7080e4d6be008aa5510a754d7a324121a88ffc6204b71100b"} Jul 08 18:02:28.986567 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:28.986421 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73f5f865-0f31-404b-95b3-990900abf698","Type":"ContainerStarted","Data":"41aa6ae02d7b01b0abf121611abdcb93ecb8a55f78899992b021c0906af458be"} Jul 08 18:02:29.028208 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.028142 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.012370872 podStartE2EDuration="2.028125134s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.754262ms" isStatefulPod=false podCreationTimestamp="2026-07-08 18:02:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:02:29.026726895 +0000 UTC m=+392.966534343" watchObservedRunningTime="2026-07-08 18:02:29.028125134 +0000 UTC m=+392.967932560" Jul 08 18:02:29.160508 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.160470 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-786f755556-69dxm"] Jul 08 18:02:29.164662 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.164630 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-786f755556-69dxm" Jul 08 18:02:29.167767 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.167739 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 08 18:02:29.167767 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.167765 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 08 18:02:29.167983 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.167775 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 08 18:02:29.167983 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.167818 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 08 18:02:29.168090 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.168077 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-5bz9n\"" Jul 08 18:02:29.168216 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.168190 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 08 18:02:29.173773 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.173571 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 08 18:02:29.179100 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.179072 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-786f755556-69dxm"] Jul 08 18:02:29.234264 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.234231 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0fd15029-20a1-4d8b-86ea-4851615ece95-telemeter-client-tls\") pod \"telemeter-client-786f755556-69dxm\" (UID: \"0fd15029-20a1-4d8b-86ea-4851615ece95\") " pod="openshift-monitoring/telemeter-client-786f755556-69dxm" Jul 08 18:02:29.234264 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.234270 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0fd15029-20a1-4d8b-86ea-4851615ece95-secret-telemeter-client\") pod \"telemeter-client-786f755556-69dxm\" (UID: \"0fd15029-20a1-4d8b-86ea-4851615ece95\") " pod="openshift-monitoring/telemeter-client-786f755556-69dxm" Jul 08 18:02:29.234501 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.234361 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0fd15029-20a1-4d8b-86ea-4851615ece95-federate-client-tls\") pod \"telemeter-client-786f755556-69dxm\" (UID: \"0fd15029-20a1-4d8b-86ea-4851615ece95\") " pod="openshift-monitoring/telemeter-client-786f755556-69dxm" Jul 08 18:02:29.234501 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.234394 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fd15029-20a1-4d8b-86ea-4851615ece95-telemeter-trusted-ca-bundle\") pod \"telemeter-client-786f755556-69dxm\" (UID: \"0fd15029-20a1-4d8b-86ea-4851615ece95\") " pod="openshift-monitoring/telemeter-client-786f755556-69dxm" Jul 08 18:02:29.234501 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.234447 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s28b9\" (UniqueName: \"kubernetes.io/projected/0fd15029-20a1-4d8b-86ea-4851615ece95-kube-api-access-s28b9\") pod \"telemeter-client-786f755556-69dxm\" (UID: \"0fd15029-20a1-4d8b-86ea-4851615ece95\") " pod="openshift-monitoring/telemeter-client-786f755556-69dxm" Jul 08 18:02:29.234501 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.234472 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fd15029-20a1-4d8b-86ea-4851615ece95-metrics-client-ca\") pod \"telemeter-client-786f755556-69dxm\" (UID: \"0fd15029-20a1-4d8b-86ea-4851615ece95\") " pod="openshift-monitoring/telemeter-client-786f755556-69dxm" Jul 08 18:02:29.234654 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.234505 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0fd15029-20a1-4d8b-86ea-4851615ece95-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-786f755556-69dxm\" (UID: \"0fd15029-20a1-4d8b-86ea-4851615ece95\") " pod="openshift-monitoring/telemeter-client-786f755556-69dxm" Jul 08 18:02:29.234654 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.234525 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fd15029-20a1-4d8b-86ea-4851615ece95-serving-certs-ca-bundle\") pod \"telemeter-client-786f755556-69dxm\" (UID: \"0fd15029-20a1-4d8b-86ea-4851615ece95\") " pod="openshift-monitoring/telemeter-client-786f755556-69dxm" Jul 08 18:02:29.335399 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.335354 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0fd15029-20a1-4d8b-86ea-4851615ece95-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-786f755556-69dxm\" (UID: \"0fd15029-20a1-4d8b-86ea-4851615ece95\") " pod="openshift-monitoring/telemeter-client-786f755556-69dxm" Jul 08 18:02:29.335609 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.335413 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fd15029-20a1-4d8b-86ea-4851615ece95-serving-certs-ca-bundle\") pod \"telemeter-client-786f755556-69dxm\" (UID: \"0fd15029-20a1-4d8b-86ea-4851615ece95\") " pod="openshift-monitoring/telemeter-client-786f755556-69dxm" Jul 08 18:02:29.335609 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.335484 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0fd15029-20a1-4d8b-86ea-4851615ece95-telemeter-client-tls\") pod \"telemeter-client-786f755556-69dxm\" (UID: \"0fd15029-20a1-4d8b-86ea-4851615ece95\") " pod="openshift-monitoring/telemeter-client-786f755556-69dxm" Jul 08 18:02:29.335609 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.335513 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0fd15029-20a1-4d8b-86ea-4851615ece95-secret-telemeter-client\") pod \"telemeter-client-786f755556-69dxm\" (UID: \"0fd15029-20a1-4d8b-86ea-4851615ece95\") " pod="openshift-monitoring/telemeter-client-786f755556-69dxm" Jul 08 18:02:29.335609 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.335570 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0fd15029-20a1-4d8b-86ea-4851615ece95-federate-client-tls\") pod \"telemeter-client-786f755556-69dxm\" (UID: \"0fd15029-20a1-4d8b-86ea-4851615ece95\") " pod="openshift-monitoring/telemeter-client-786f755556-69dxm" Jul 08 18:02:29.335609 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.335596 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fd15029-20a1-4d8b-86ea-4851615ece95-telemeter-trusted-ca-bundle\") pod \"telemeter-client-786f755556-69dxm\" (UID: \"0fd15029-20a1-4d8b-86ea-4851615ece95\") " pod="openshift-monitoring/telemeter-client-786f755556-69dxm" Jul 08 18:02:29.335858 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.335640 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s28b9\" (UniqueName: \"kubernetes.io/projected/0fd15029-20a1-4d8b-86ea-4851615ece95-kube-api-access-s28b9\") pod \"telemeter-client-786f755556-69dxm\" (UID: \"0fd15029-20a1-4d8b-86ea-4851615ece95\") " pod="openshift-monitoring/telemeter-client-786f755556-69dxm" Jul 08 18:02:29.335858 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.335675 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fd15029-20a1-4d8b-86ea-4851615ece95-metrics-client-ca\") pod \"telemeter-client-786f755556-69dxm\" (UID: \"0fd15029-20a1-4d8b-86ea-4851615ece95\") " pod="openshift-monitoring/telemeter-client-786f755556-69dxm" Jul 08 18:02:29.336525 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.336497 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fd15029-20a1-4d8b-86ea-4851615ece95-metrics-client-ca\") pod \"telemeter-client-786f755556-69dxm\" (UID: \"0fd15029-20a1-4d8b-86ea-4851615ece95\") " pod="openshift-monitoring/telemeter-client-786f755556-69dxm" Jul 08 18:02:29.337741 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.337715 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fd15029-20a1-4d8b-86ea-4851615ece95-serving-certs-ca-bundle\") pod \"telemeter-client-786f755556-69dxm\" (UID: \"0fd15029-20a1-4d8b-86ea-4851615ece95\") " pod="openshift-monitoring/telemeter-client-786f755556-69dxm" Jul 08 18:02:29.338226 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.338202 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fd15029-20a1-4d8b-86ea-4851615ece95-telemeter-trusted-ca-bundle\") pod \"telemeter-client-786f755556-69dxm\" (UID: \"0fd15029-20a1-4d8b-86ea-4851615ece95\") " pod="openshift-monitoring/telemeter-client-786f755556-69dxm" Jul 08 18:02:29.339484 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.339455 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0fd15029-20a1-4d8b-86ea-4851615ece95-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-786f755556-69dxm\" (UID: \"0fd15029-20a1-4d8b-86ea-4851615ece95\") " pod="openshift-monitoring/telemeter-client-786f755556-69dxm" Jul 08 18:02:29.339601 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.339580 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0fd15029-20a1-4d8b-86ea-4851615ece95-telemeter-client-tls\") pod \"telemeter-client-786f755556-69dxm\" (UID: \"0fd15029-20a1-4d8b-86ea-4851615ece95\") " pod="openshift-monitoring/telemeter-client-786f755556-69dxm" Jul 08 18:02:29.339674 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.339659 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0fd15029-20a1-4d8b-86ea-4851615ece95-federate-client-tls\") pod \"telemeter-client-786f755556-69dxm\" (UID: \"0fd15029-20a1-4d8b-86ea-4851615ece95\") " pod="openshift-monitoring/telemeter-client-786f755556-69dxm" Jul 08 18:02:29.339872 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.339851 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0fd15029-20a1-4d8b-86ea-4851615ece95-secret-telemeter-client\") pod \"telemeter-client-786f755556-69dxm\" (UID: \"0fd15029-20a1-4d8b-86ea-4851615ece95\") " pod="openshift-monitoring/telemeter-client-786f755556-69dxm" Jul 08 18:02:29.346148 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.346122 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s28b9\" (UniqueName: \"kubernetes.io/projected/0fd15029-20a1-4d8b-86ea-4851615ece95-kube-api-access-s28b9\") pod \"telemeter-client-786f755556-69dxm\" (UID: \"0fd15029-20a1-4d8b-86ea-4851615ece95\") " pod="openshift-monitoring/telemeter-client-786f755556-69dxm" Jul 08 18:02:29.476623 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.476586 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-786f755556-69dxm" Jul 08 18:02:29.564923 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.564891 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 18:02:29.565298 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.565266 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="22731683-d752-4256-be6f-6430add1d555" containerName="prometheus" containerID="cri-o://cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608" gracePeriod=600 Jul 08 18:02:29.565690 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.565654 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="22731683-d752-4256-be6f-6430add1d555" containerName="kube-rbac-proxy-thanos" containerID="cri-o://96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06" gracePeriod=600 Jul 08 18:02:29.565793 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.565771 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="22731683-d752-4256-be6f-6430add1d555" containerName="kube-rbac-proxy" containerID="cri-o://30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6" gracePeriod=600 Jul 08 18:02:29.565884 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.565862 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="22731683-d752-4256-be6f-6430add1d555" containerName="kube-rbac-proxy-web" containerID="cri-o://70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed" gracePeriod=600 Jul 08 18:02:29.565967 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.565940 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="22731683-d752-4256-be6f-6430add1d555" containerName="thanos-sidecar" containerID="cri-o://61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476" gracePeriod=600 Jul 08 18:02:29.566045 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.566018 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="22731683-d752-4256-be6f-6430add1d555" containerName="config-reloader" containerID="cri-o://367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1" gracePeriod=600 Jul 08 18:02:29.666690 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.666663 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-786f755556-69dxm"] Jul 08 18:02:29.700080 ip-10-0-128-234 kubenswrapper[2579]: W0708 18:02:29.700055 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fd15029_20a1_4d8b_86ea_4851615ece95.slice/crio-e40764559eec42541dacdb4e20f4b19c5be3a1a4e1bb843926d9d3081c2ce6ea WatchSource:0}: Error finding container e40764559eec42541dacdb4e20f4b19c5be3a1a4e1bb843926d9d3081c2ce6ea: Status 404 returned error can't find the container with id e40764559eec42541dacdb4e20f4b19c5be3a1a4e1bb843926d9d3081c2ce6ea Jul 08 18:02:29.818381 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.818352 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:29.942162 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.942066 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-configmap-kubelet-serving-ca-bundle\") pod \"22731683-d752-4256-be6f-6430add1d555\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " Jul 08 18:02:29.942162 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.942117 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-configmap-serving-certs-ca-bundle\") pod \"22731683-d752-4256-be6f-6430add1d555\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " Jul 08 18:02:29.942162 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.942149 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-prometheus-k8s-rulefiles-2\") pod \"22731683-d752-4256-be6f-6430add1d555\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " Jul 08 18:02:29.942442 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.942215 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"22731683-d752-4256-be6f-6430add1d555\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " Jul 08 18:02:29.942442 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.942244 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-grpc-tls\") pod \"22731683-d752-4256-be6f-6430add1d555\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " Jul 08 18:02:29.942442 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.942289 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-kube-rbac-proxy\") pod \"22731683-d752-4256-be6f-6430add1d555\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " Jul 08 18:02:29.942442 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.942326 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gw4jb\" (UniqueName: \"kubernetes.io/projected/22731683-d752-4256-be6f-6430add1d555-kube-api-access-gw4jb\") pod \"22731683-d752-4256-be6f-6430add1d555\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " Jul 08 18:02:29.942442 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.942379 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-prometheus-k8s-tls\") pod \"22731683-d752-4256-be6f-6430add1d555\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " Jul 08 18:02:29.942442 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.942401 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-web-config\") pod \"22731683-d752-4256-be6f-6430add1d555\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " Jul 08 18:02:29.942442 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.942430 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"22731683-d752-4256-be6f-6430add1d555\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " Jul 08 18:02:29.942836 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.942465 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-configmap-metrics-client-ca\") pod \"22731683-d752-4256-be6f-6430add1d555\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " Jul 08 18:02:29.942836 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.942490 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-prometheus-k8s-rulefiles-1\") pod \"22731683-d752-4256-be6f-6430add1d555\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " Jul 08 18:02:29.942836 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.942485 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "22731683-d752-4256-be6f-6430add1d555" (UID: "22731683-d752-4256-be6f-6430add1d555"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:02:29.942836 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.942521 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-thanos-prometheus-http-client-file\") pod \"22731683-d752-4256-be6f-6430add1d555\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " Jul 08 18:02:29.942836 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.942546 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "22731683-d752-4256-be6f-6430add1d555" (UID: "22731683-d752-4256-be6f-6430add1d555"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:02:29.942836 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.942551 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-prometheus-k8s-rulefiles-0\") pod \"22731683-d752-4256-be6f-6430add1d555\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " Jul 08 18:02:29.942836 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.942563 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "22731683-d752-4256-be6f-6430add1d555" (UID: "22731683-d752-4256-be6f-6430add1d555"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:02:29.942836 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.942599 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/22731683-d752-4256-be6f-6430add1d555-tls-assets\") pod \"22731683-d752-4256-be6f-6430add1d555\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " Jul 08 18:02:29.942836 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.942637 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-config\") pod \"22731683-d752-4256-be6f-6430add1d555\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " Jul 08 18:02:29.942836 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.942802 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-prometheus-trusted-ca-bundle\") pod \"22731683-d752-4256-be6f-6430add1d555\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " Jul 08 18:02:29.942836 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.942833 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/22731683-d752-4256-be6f-6430add1d555-config-out\") pod \"22731683-d752-4256-be6f-6430add1d555\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " Jul 08 18:02:29.943372 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.942885 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-metrics-client-certs\") pod \"22731683-d752-4256-be6f-6430add1d555\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " Jul 08 18:02:29.943372 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.942910 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/22731683-d752-4256-be6f-6430add1d555-prometheus-k8s-db\") pod \"22731683-d752-4256-be6f-6430add1d555\" (UID: \"22731683-d752-4256-be6f-6430add1d555\") " Jul 08 18:02:29.943372 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.942911 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "22731683-d752-4256-be6f-6430add1d555" (UID: "22731683-d752-4256-be6f-6430add1d555"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:02:29.943372 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.943247 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-configmap-metrics-client-ca\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:29.943372 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.943268 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:29.943372 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.943302 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:29.943372 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.943318 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:29.943986 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.943955 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "22731683-d752-4256-be6f-6430add1d555" (UID: "22731683-d752-4256-be6f-6430add1d555"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:02:29.944686 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.944480 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "22731683-d752-4256-be6f-6430add1d555" (UID: "22731683-d752-4256-be6f-6430add1d555"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:02:29.944686 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.944569 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22731683-d752-4256-be6f-6430add1d555-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "22731683-d752-4256-be6f-6430add1d555" (UID: "22731683-d752-4256-be6f-6430add1d555"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:02:29.944820 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.944749 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "22731683-d752-4256-be6f-6430add1d555" (UID: "22731683-d752-4256-be6f-6430add1d555"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:02:29.945125 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.945097 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "22731683-d752-4256-be6f-6430add1d555" (UID: "22731683-d752-4256-be6f-6430add1d555"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:02:29.945673 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.945375 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22731683-d752-4256-be6f-6430add1d555-kube-api-access-gw4jb" (OuterVolumeSpecName: "kube-api-access-gw4jb") pod "22731683-d752-4256-be6f-6430add1d555" (UID: "22731683-d752-4256-be6f-6430add1d555"). InnerVolumeSpecName "kube-api-access-gw4jb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:02:29.945673 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.945460 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "22731683-d752-4256-be6f-6430add1d555" (UID: "22731683-d752-4256-be6f-6430add1d555"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:02:29.945968 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.945943 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "22731683-d752-4256-be6f-6430add1d555" (UID: "22731683-d752-4256-be6f-6430add1d555"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:02:29.946127 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.946102 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "22731683-d752-4256-be6f-6430add1d555" (UID: "22731683-d752-4256-be6f-6430add1d555"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:02:29.947067 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.947032 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22731683-d752-4256-be6f-6430add1d555-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "22731683-d752-4256-be6f-6430add1d555" (UID: "22731683-d752-4256-be6f-6430add1d555"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:02:29.947211 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.947161 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "22731683-d752-4256-be6f-6430add1d555" (UID: "22731683-d752-4256-be6f-6430add1d555"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:02:29.947630 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.947581 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "22731683-d752-4256-be6f-6430add1d555" (UID: "22731683-d752-4256-be6f-6430add1d555"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:02:29.947630 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.947600 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-config" (OuterVolumeSpecName: "config") pod "22731683-d752-4256-be6f-6430add1d555" (UID: "22731683-d752-4256-be6f-6430add1d555"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:02:29.948042 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.948020 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22731683-d752-4256-be6f-6430add1d555-config-out" (OuterVolumeSpecName: "config-out") pod "22731683-d752-4256-be6f-6430add1d555" (UID: "22731683-d752-4256-be6f-6430add1d555"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:02:29.948426 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.948400 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "22731683-d752-4256-be6f-6430add1d555" (UID: "22731683-d752-4256-be6f-6430add1d555"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:02:29.956979 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.956958 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-web-config" (OuterVolumeSpecName: "web-config") pod "22731683-d752-4256-be6f-6430add1d555" (UID: "22731683-d752-4256-be6f-6430add1d555"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:02:29.994500 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.994471 2579 generic.go:356] "Generic (PLEG): container finished" podID="22731683-d752-4256-be6f-6430add1d555" containerID="96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06" exitCode=0 Jul 08 18:02:29.994500 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.994495 2579 generic.go:356] "Generic (PLEG): container finished" podID="22731683-d752-4256-be6f-6430add1d555" containerID="30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6" exitCode=0 Jul 08 18:02:29.994500 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.994501 2579 generic.go:356] "Generic (PLEG): container finished" podID="22731683-d752-4256-be6f-6430add1d555" containerID="70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed" exitCode=0 Jul 08 18:02:29.994500 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.994506 2579 generic.go:356] "Generic (PLEG): container finished" podID="22731683-d752-4256-be6f-6430add1d555" containerID="61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476" exitCode=0 Jul 08 18:02:29.994500 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.994511 2579 generic.go:356] "Generic (PLEG): container finished" podID="22731683-d752-4256-be6f-6430add1d555" containerID="367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1" exitCode=0 Jul 08 18:02:29.994841 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.994516 2579 generic.go:356] "Generic (PLEG): container finished" podID="22731683-d752-4256-be6f-6430add1d555" containerID="cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608" exitCode=0 Jul 08 18:02:29.994841 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.994566 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:29.994841 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.994560 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22731683-d752-4256-be6f-6430add1d555","Type":"ContainerDied","Data":"96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06"} Jul 08 18:02:29.994841 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.994709 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22731683-d752-4256-be6f-6430add1d555","Type":"ContainerDied","Data":"30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6"} Jul 08 18:02:29.994841 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.994760 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22731683-d752-4256-be6f-6430add1d555","Type":"ContainerDied","Data":"70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed"} Jul 08 18:02:29.994841 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.994768 2579 scope.go:117] "RemoveContainer" containerID="96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06" Jul 08 18:02:29.994841 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.994791 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22731683-d752-4256-be6f-6430add1d555","Type":"ContainerDied","Data":"61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476"} Jul 08 18:02:29.994841 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.994824 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22731683-d752-4256-be6f-6430add1d555","Type":"ContainerDied","Data":"367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1"} Jul 08 18:02:29.995232 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.994849 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22731683-d752-4256-be6f-6430add1d555","Type":"ContainerDied","Data":"cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608"} Jul 08 18:02:29.995232 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.994881 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22731683-d752-4256-be6f-6430add1d555","Type":"ContainerDied","Data":"6da66d96895561df9aa22f06665ba3500dfc41617bad570d1e0afaf4fe4f646f"} Jul 08 18:02:29.996028 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:29.996010 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-786f755556-69dxm" event={"ID":"0fd15029-20a1-4d8b-86ea-4851615ece95","Type":"ContainerStarted","Data":"e40764559eec42541dacdb4e20f4b19c5be3a1a4e1bb843926d9d3081c2ce6ea"} Jul 08 18:02:30.003297 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.003254 2579 scope.go:117] "RemoveContainer" containerID="30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6" Jul 08 18:02:30.014561 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.012656 2579 scope.go:117] "RemoveContainer" containerID="70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed" Jul 08 18:02:30.025434 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.025408 2579 scope.go:117] "RemoveContainer" containerID="61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476" Jul 08 18:02:30.029610 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.029588 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 18:02:30.033144 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.033128 2579 scope.go:117] "RemoveContainer" containerID="367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1" Jul 08 18:02:30.042572 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.042534 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 18:02:30.043852 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.043833 2579 scope.go:117] "RemoveContainer" containerID="cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608" Jul 08 18:02:30.044198 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.044149 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:30.044290 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.044206 2579 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-grpc-tls\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:30.044290 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.044219 2579 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-kube-rbac-proxy\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:30.044290 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.044229 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gw4jb\" (UniqueName: \"kubernetes.io/projected/22731683-d752-4256-be6f-6430add1d555-kube-api-access-gw4jb\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:30.044290 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.044238 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:30.044290 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.044264 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-web-config\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:30.044290 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.044273 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:30.044290 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.044282 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:30.044290 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.044291 2579 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:30.044549 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.044300 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:30.044549 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.044308 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/22731683-d752-4256-be6f-6430add1d555-tls-assets\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:30.044549 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.044317 2579 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-config\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:30.044549 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.044324 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22731683-d752-4256-be6f-6430add1d555-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:30.044549 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.044333 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/22731683-d752-4256-be6f-6430add1d555-config-out\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:30.044549 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.044341 2579 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/22731683-d752-4256-be6f-6430add1d555-secret-metrics-client-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:30.044549 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.044348 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/22731683-d752-4256-be6f-6430add1d555-prometheus-k8s-db\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:02:30.051418 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.051397 2579 scope.go:117] "RemoveContainer" containerID="0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621" Jul 08 18:02:30.058425 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.058409 2579 scope.go:117] "RemoveContainer" containerID="96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06" Jul 08 18:02:30.058707 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:02:30.058688 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06\": container with ID starting with 96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06 not found: ID does not exist" containerID="96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06" Jul 08 18:02:30.058758 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.058715 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06"} err="failed to get container status \"96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06\": rpc error: code = NotFound desc = could not find container \"96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06\": container with ID starting with 96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06 not found: ID does not exist" Jul 08 18:02:30.058758 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.058734 2579 scope.go:117] "RemoveContainer" containerID="30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6" Jul 08 18:02:30.058963 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:02:30.058944 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6\": container with ID starting with 30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6 not found: ID does not exist" containerID="30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6" Jul 08 18:02:30.059020 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.058973 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6"} err="failed to get container status \"30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6\": rpc error: code = NotFound desc = could not find container \"30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6\": container with ID starting with 30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6 not found: ID does not exist" Jul 08 18:02:30.059020 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.058996 2579 scope.go:117] "RemoveContainer" containerID="70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed" Jul 08 18:02:30.059229 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:02:30.059210 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed\": container with ID starting with 70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed not found: ID does not exist" containerID="70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed" Jul 08 18:02:30.059273 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.059234 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed"} err="failed to get container status \"70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed\": rpc error: code = NotFound desc = could not find container \"70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed\": container with ID starting with 70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed not found: ID does not exist" Jul 08 18:02:30.059273 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.059246 2579 scope.go:117] "RemoveContainer" containerID="61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476" Jul 08 18:02:30.059436 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:02:30.059421 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476\": container with ID starting with 61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476 not found: ID does not exist" containerID="61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476" Jul 08 18:02:30.059474 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.059439 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476"} err="failed to get container status \"61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476\": rpc error: code = NotFound desc = could not find container \"61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476\": container with ID starting with 61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476 not found: ID does not exist" Jul 08 18:02:30.059474 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.059450 2579 scope.go:117] "RemoveContainer" containerID="367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1" Jul 08 18:02:30.059661 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:02:30.059644 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1\": container with ID starting with 367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1 not found: ID does not exist" containerID="367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1" Jul 08 18:02:30.059716 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.059666 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1"} err="failed to get container status \"367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1\": rpc error: code = NotFound desc = could not find container \"367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1\": container with ID starting with 367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1 not found: ID does not exist" Jul 08 18:02:30.059716 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.059685 2579 scope.go:117] "RemoveContainer" containerID="cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608" Jul 08 18:02:30.059893 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:02:30.059877 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608\": container with ID starting with cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608 not found: ID does not exist" containerID="cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608" Jul 08 18:02:30.059935 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.059895 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608"} err="failed to get container status \"cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608\": rpc error: code = NotFound desc = could not find container \"cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608\": container with ID starting with cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608 not found: ID does not exist" Jul 08 18:02:30.059935 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.059907 2579 scope.go:117] "RemoveContainer" containerID="0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621" Jul 08 18:02:30.060100 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:02:30.060087 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621\": container with ID starting with 0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621 not found: ID does not exist" containerID="0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621" Jul 08 18:02:30.060137 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.060102 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621"} err="failed to get container status \"0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621\": rpc error: code = NotFound desc = could not find container \"0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621\": container with ID starting with 0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621 not found: ID does not exist" Jul 08 18:02:30.060137 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.060114 2579 scope.go:117] "RemoveContainer" containerID="96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06" Jul 08 18:02:30.060306 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.060289 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06"} err="failed to get container status \"96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06\": rpc error: code = NotFound desc = could not find container \"96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06\": container with ID starting with 96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06 not found: ID does not exist" Jul 08 18:02:30.060369 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.060309 2579 scope.go:117] "RemoveContainer" containerID="30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6" Jul 08 18:02:30.060504 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.060487 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6"} err="failed to get container status \"30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6\": rpc error: code = NotFound desc = could not find container \"30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6\": container with ID starting with 30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6 not found: ID does not exist" Jul 08 18:02:30.060565 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.060507 2579 scope.go:117] "RemoveContainer" containerID="70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed" Jul 08 18:02:30.060719 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.060704 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed"} err="failed to get container status \"70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed\": rpc error: code = NotFound desc = could not find container \"70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed\": container with ID starting with 70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed not found: ID does not exist" Jul 08 18:02:30.060765 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.060719 2579 scope.go:117] "RemoveContainer" containerID="61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476" Jul 08 18:02:30.060930 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.060903 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476"} err="failed to get container status \"61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476\": rpc error: code = NotFound desc = could not find container \"61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476\": container with ID starting with 61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476 not found: ID does not exist" Jul 08 18:02:30.060930 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.060921 2579 scope.go:117] "RemoveContainer" containerID="367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1" Jul 08 18:02:30.061233 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.061158 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1"} err="failed to get container status \"367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1\": rpc error: code = NotFound desc = could not find container \"367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1\": container with ID starting with 367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1 not found: ID does not exist" Jul 08 18:02:30.061233 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.061192 2579 scope.go:117] "RemoveContainer" containerID="cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608" Jul 08 18:02:30.061410 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.061391 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608"} err="failed to get container status \"cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608\": rpc error: code = NotFound desc = could not find container \"cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608\": container with ID starting with cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608 not found: ID does not exist" Jul 08 18:02:30.061459 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.061410 2579 scope.go:117] "RemoveContainer" containerID="0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621" Jul 08 18:02:30.061622 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.061604 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621"} err="failed to get container status \"0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621\": rpc error: code = NotFound desc = could not find container \"0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621\": container with ID starting with 0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621 not found: ID does not exist" Jul 08 18:02:30.061658 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.061622 2579 scope.go:117] "RemoveContainer" containerID="96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06" Jul 08 18:02:30.061803 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.061788 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06"} err="failed to get container status \"96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06\": rpc error: code = NotFound desc = could not find container \"96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06\": container with ID starting with 96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06 not found: ID does not exist" Jul 08 18:02:30.061847 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.061803 2579 scope.go:117] "RemoveContainer" containerID="30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6" Jul 08 18:02:30.061986 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.061972 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6"} err="failed to get container status \"30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6\": rpc error: code = NotFound desc = could not find container \"30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6\": container with ID starting with 30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6 not found: ID does not exist" Jul 08 18:02:30.062031 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.061986 2579 scope.go:117] "RemoveContainer" containerID="70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed" Jul 08 18:02:30.062165 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.062151 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed"} err="failed to get container status \"70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed\": rpc error: code = NotFound desc = could not find container \"70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed\": container with ID starting with 70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed not found: ID does not exist" Jul 08 18:02:30.062217 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.062165 2579 scope.go:117] "RemoveContainer" containerID="61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476" Jul 08 18:02:30.062370 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.062354 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476"} err="failed to get container status \"61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476\": rpc error: code = NotFound desc = could not find container \"61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476\": container with ID starting with 61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476 not found: ID does not exist" Jul 08 18:02:30.062418 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.062372 2579 scope.go:117] "RemoveContainer" containerID="367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1" Jul 08 18:02:30.062562 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.062546 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1"} err="failed to get container status \"367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1\": rpc error: code = NotFound desc = could not find container \"367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1\": container with ID starting with 367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1 not found: ID does not exist" Jul 08 18:02:30.062610 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.062563 2579 scope.go:117] "RemoveContainer" containerID="cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608" Jul 08 18:02:30.062756 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.062727 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608"} err="failed to get container status \"cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608\": rpc error: code = NotFound desc = could not find container \"cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608\": container with ID starting with cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608 not found: ID does not exist" Jul 08 18:02:30.062794 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.062756 2579 scope.go:117] "RemoveContainer" containerID="0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621" Jul 08 18:02:30.062947 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.062931 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621"} err="failed to get container status \"0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621\": rpc error: code = NotFound desc = could not find container \"0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621\": container with ID starting with 0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621 not found: ID does not exist" Jul 08 18:02:30.062988 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.062947 2579 scope.go:117] "RemoveContainer" containerID="96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06" Jul 08 18:02:30.063151 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.063134 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06"} err="failed to get container status \"96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06\": rpc error: code = NotFound desc = could not find container \"96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06\": container with ID starting with 96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06 not found: ID does not exist" Jul 08 18:02:30.063227 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.063152 2579 scope.go:117] "RemoveContainer" containerID="30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6" Jul 08 18:02:30.063441 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.063422 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6"} err="failed to get container status \"30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6\": rpc error: code = NotFound desc = could not find container \"30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6\": container with ID starting with 30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6 not found: ID does not exist" Jul 08 18:02:30.063508 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.063443 2579 scope.go:117] "RemoveContainer" containerID="70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed" Jul 08 18:02:30.063645 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.063628 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed"} err="failed to get container status \"70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed\": rpc error: code = NotFound desc = could not find container \"70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed\": container with ID starting with 70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed not found: ID does not exist" Jul 08 18:02:30.063690 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.063645 2579 scope.go:117] "RemoveContainer" containerID="61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476" Jul 08 18:02:30.063860 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.063844 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476"} err="failed to get container status \"61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476\": rpc error: code = NotFound desc = could not find container \"61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476\": container with ID starting with 61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476 not found: ID does not exist" Jul 08 18:02:30.063860 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.063860 2579 scope.go:117] "RemoveContainer" containerID="367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1" Jul 08 18:02:30.064082 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.064066 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1"} err="failed to get container status \"367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1\": rpc error: code = NotFound desc = could not find container \"367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1\": container with ID starting with 367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1 not found: ID does not exist" Jul 08 18:02:30.064128 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.064083 2579 scope.go:117] "RemoveContainer" containerID="cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608" Jul 08 18:02:30.064312 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.064295 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608"} err="failed to get container status \"cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608\": rpc error: code = NotFound desc = could not find container \"cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608\": container with ID starting with cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608 not found: ID does not exist" Jul 08 18:02:30.064367 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.064312 2579 scope.go:117] "RemoveContainer" containerID="0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621" Jul 08 18:02:30.064535 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.064511 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621"} err="failed to get container status \"0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621\": rpc error: code = NotFound desc = could not find container \"0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621\": container with ID starting with 0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621 not found: ID does not exist" Jul 08 18:02:30.064535 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.064534 2579 scope.go:117] "RemoveContainer" containerID="96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06" Jul 08 18:02:30.064730 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.064714 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06"} err="failed to get container status \"96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06\": rpc error: code = NotFound desc = could not find container \"96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06\": container with ID starting with 96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06 not found: ID does not exist" Jul 08 18:02:30.064773 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.064730 2579 scope.go:117] "RemoveContainer" containerID="30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6" Jul 08 18:02:30.064906 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.064889 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6"} err="failed to get container status \"30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6\": rpc error: code = NotFound desc = could not find container \"30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6\": container with ID starting with 30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6 not found: ID does not exist" Jul 08 18:02:30.064962 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.064907 2579 scope.go:117] "RemoveContainer" containerID="70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed" Jul 08 18:02:30.065165 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.065145 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed"} err="failed to get container status \"70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed\": rpc error: code = NotFound desc = could not find container \"70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed\": container with ID starting with 70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed not found: ID does not exist" Jul 08 18:02:30.065165 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.065165 2579 scope.go:117] "RemoveContainer" containerID="61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476" Jul 08 18:02:30.065401 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.065378 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476"} err="failed to get container status \"61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476\": rpc error: code = NotFound desc = could not find container \"61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476\": container with ID starting with 61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476 not found: ID does not exist" Jul 08 18:02:30.065449 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.065402 2579 scope.go:117] "RemoveContainer" containerID="367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1" Jul 08 18:02:30.065717 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.065698 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1"} err="failed to get container status \"367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1\": rpc error: code = NotFound desc = could not find container \"367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1\": container with ID starting with 367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1 not found: ID does not exist" Jul 08 18:02:30.065717 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.065716 2579 scope.go:117] "RemoveContainer" containerID="cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608" Jul 08 18:02:30.065987 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.065969 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608"} err="failed to get container status \"cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608\": rpc error: code = NotFound desc = could not find container \"cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608\": container with ID starting with cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608 not found: ID does not exist" Jul 08 18:02:30.065987 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.065987 2579 scope.go:117] "RemoveContainer" containerID="0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621" Jul 08 18:02:30.066214 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.066196 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621"} err="failed to get container status \"0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621\": rpc error: code = NotFound desc = could not find container \"0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621\": container with ID starting with 0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621 not found: ID does not exist" Jul 08 18:02:30.066265 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.066215 2579 scope.go:117] "RemoveContainer" containerID="96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06" Jul 08 18:02:30.066393 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.066379 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06"} err="failed to get container status \"96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06\": rpc error: code = NotFound desc = could not find container \"96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06\": container with ID starting with 96887b8bf78ebbb55194b1b69d28a8f57bf0b0c0af283072b24de2e8b7214d06 not found: ID does not exist" Jul 08 18:02:30.066393 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.066392 2579 scope.go:117] "RemoveContainer" containerID="30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6" Jul 08 18:02:30.066564 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.066541 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6"} err="failed to get container status \"30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6\": rpc error: code = NotFound desc = could not find container \"30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6\": container with ID starting with 30b566d4300dff39131cc310db7cf12a3ac90989295522f7f524d67968e405f6 not found: ID does not exist" Jul 08 18:02:30.066564 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.066555 2579 scope.go:117] "RemoveContainer" containerID="70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed" Jul 08 18:02:30.066738 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.066721 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed"} err="failed to get container status \"70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed\": rpc error: code = NotFound desc = could not find container \"70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed\": container with ID starting with 70b7f0229fd1d2f7156108da0ed6ed3ced8a4007a96b352074647c4bddebf0ed not found: ID does not exist" Jul 08 18:02:30.066793 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.066739 2579 scope.go:117] "RemoveContainer" containerID="61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476" Jul 08 18:02:30.066958 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.066942 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476"} err="failed to get container status \"61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476\": rpc error: code = NotFound desc = could not find container \"61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476\": container with ID starting with 61f78cb61814e5b006c446bfa6cf0eb774623e5ef085eaf7842c12769de65476 not found: ID does not exist" Jul 08 18:02:30.066998 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.066959 2579 scope.go:117] "RemoveContainer" containerID="367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1" Jul 08 18:02:30.067205 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.067163 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1"} err="failed to get container status \"367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1\": rpc error: code = NotFound desc = could not find container \"367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1\": container with ID starting with 367b64ec52f5cdc5d9e8361866c4e5ebe3f77a065b3156b2c31567d2c62e94f1 not found: ID does not exist" Jul 08 18:02:30.067285 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.067208 2579 scope.go:117] "RemoveContainer" containerID="cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608" Jul 08 18:02:30.067452 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.067423 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608"} err="failed to get container status \"cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608\": rpc error: code = NotFound desc = could not find container \"cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608\": container with ID starting with cea6e205c166899723bec8242817767f4d168a3adcfa257d50f7c6b58b9ee608 not found: ID does not exist" Jul 08 18:02:30.067452 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.067445 2579 scope.go:117] "RemoveContainer" containerID="0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621" Jul 08 18:02:30.067647 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.067630 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621"} err="failed to get container status \"0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621\": rpc error: code = NotFound desc = could not find container \"0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621\": container with ID starting with 0c2c8434afff8ba4a59535b872ce02fb246c540ac8cc256bf46282c59ab54621 not found: ID does not exist" Jul 08 18:02:30.084209 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.084167 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 18:02:30.084597 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.084583 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22731683-d752-4256-be6f-6430add1d555" containerName="config-reloader" Jul 08 18:02:30.084597 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.084598 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="22731683-d752-4256-be6f-6430add1d555" containerName="config-reloader" Jul 08 18:02:30.084707 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.084606 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22731683-d752-4256-be6f-6430add1d555" containerName="kube-rbac-proxy-web" Jul 08 18:02:30.084707 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.084611 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="22731683-d752-4256-be6f-6430add1d555" containerName="kube-rbac-proxy-web" Jul 08 18:02:30.084707 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.084620 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22731683-d752-4256-be6f-6430add1d555" containerName="kube-rbac-proxy-thanos" Jul 08 18:02:30.084707 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.084625 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="22731683-d752-4256-be6f-6430add1d555" containerName="kube-rbac-proxy-thanos" Jul 08 18:02:30.084707 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.084632 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22731683-d752-4256-be6f-6430add1d555" containerName="init-config-reloader" Jul 08 18:02:30.084707 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.084637 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="22731683-d752-4256-be6f-6430add1d555" containerName="init-config-reloader" Jul 08 18:02:30.084707 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.084649 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22731683-d752-4256-be6f-6430add1d555" containerName="thanos-sidecar" Jul 08 18:02:30.084707 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.084654 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="22731683-d752-4256-be6f-6430add1d555" containerName="thanos-sidecar" Jul 08 18:02:30.084707 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.084663 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22731683-d752-4256-be6f-6430add1d555" containerName="prometheus" Jul 08 18:02:30.084707 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.084668 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="22731683-d752-4256-be6f-6430add1d555" containerName="prometheus" Jul 08 18:02:30.084707 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.084676 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22731683-d752-4256-be6f-6430add1d555" containerName="kube-rbac-proxy" Jul 08 18:02:30.084707 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.084681 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="22731683-d752-4256-be6f-6430add1d555" containerName="kube-rbac-proxy" Jul 08 18:02:30.085028 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.084736 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="22731683-d752-4256-be6f-6430add1d555" containerName="thanos-sidecar" Jul 08 18:02:30.085028 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.084744 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="22731683-d752-4256-be6f-6430add1d555" containerName="config-reloader" Jul 08 18:02:30.085028 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.084751 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="22731683-d752-4256-be6f-6430add1d555" containerName="kube-rbac-proxy" Jul 08 18:02:30.085028 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.084756 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="22731683-d752-4256-be6f-6430add1d555" containerName="kube-rbac-proxy-thanos" Jul 08 18:02:30.085028 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.084763 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="22731683-d752-4256-be6f-6430add1d555" containerName="prometheus" Jul 08 18:02:30.085028 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.084768 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="22731683-d752-4256-be6f-6430add1d555" containerName="kube-rbac-proxy-web" Jul 08 18:02:30.088234 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.088217 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.092583 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.092563 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 08 18:02:30.092948 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.092926 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 08 18:02:30.093063 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.093046 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 08 18:02:30.093301 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.093286 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 08 18:02:30.093565 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.093549 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 08 18:02:30.093651 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.093617 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ekplpo2rbem1o\"" Jul 08 18:02:30.093704 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.093686 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zflzc\"" Jul 08 18:02:30.093704 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.093556 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 08 18:02:30.093805 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.093793 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 08 18:02:30.094084 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.094065 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 08 18:02:30.094153 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.094104 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 08 18:02:30.094153 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.094141 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 08 18:02:30.094264 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.094253 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 08 18:02:30.095591 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.095483 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 08 18:02:30.099333 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.099315 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 08 18:02:30.106189 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.106147 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 08 18:02:30.119187 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.119149 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 18:02:30.247318 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.247231 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-config-out\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.247318 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.247266 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.247318 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.247305 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.247548 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.247340 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.247548 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.247355 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5q9v\" (UniqueName: \"kubernetes.io/projected/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-kube-api-access-q5q9v\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.247548 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.247416 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.247548 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.247441 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.247548 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.247460 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.247548 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.247480 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-config\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.247548 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.247499 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.247548 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.247517 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.247548 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.247531 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.247835 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.247557 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.247835 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.247599 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.247835 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.247617 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.247835 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.247635 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.247835 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.247682 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-web-config\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.247835 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.247721 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.247835 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.247737 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.247835 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.247754 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.348720 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.348636 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.348720 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.348694 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.348883 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.348722 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5q9v\" (UniqueName: \"kubernetes.io/projected/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-kube-api-access-q5q9v\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.348883 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.348757 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.348883 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.348785 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.348883 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.348811 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.348883 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.348839 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-config\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.348883 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.348865 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.349200 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.348895 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.349200 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.348918 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.349200 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.348976 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.349200 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.349009 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.349200 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.349039 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.349200 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.349064 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.349200 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.349085 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-web-config\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.349200 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.349115 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.349200 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.349141 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.349200 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.349160 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.349673 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.349230 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-config-out\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.349673 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.349249 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.349673 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.349322 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.349673 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.349477 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.349673 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.349607 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.352393 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.350808 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.352393 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.351249 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.352393 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.351851 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.352606 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.352537 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-config\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.353442 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.353002 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-web-config\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.353442 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.353234 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.354212 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.353858 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.354212 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.353924 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.354832 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.354759 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.354924 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.354837 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.355915 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.355857 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.356844 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.356659 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.356844 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.356831 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-config-out\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.356998 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.356856 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.358225 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.358200 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.359731 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.359711 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.364215 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.364142 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5q9v\" (UniqueName: \"kubernetes.io/projected/0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d-kube-api-access-q5q9v\") pod \"prometheus-k8s-0\" (UID: \"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.398834 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.398801 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:02:30.565232 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.565202 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 18:02:30.568492 ip-10-0-128-234 kubenswrapper[2579]: W0708 18:02:30.568455 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d4c01bf_bfbe_4ca3_acb4_6b4f5f994b7d.slice/crio-95e688e30b328d4f5ca871eec1d33af4855d2ed98ff7ea7aeac6870a414c55df WatchSource:0}: Error finding container 95e688e30b328d4f5ca871eec1d33af4855d2ed98ff7ea7aeac6870a414c55df: Status 404 returned error can't find the container with id 95e688e30b328d4f5ca871eec1d33af4855d2ed98ff7ea7aeac6870a414c55df Jul 08 18:02:30.620192 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:30.620154 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22731683-d752-4256-be6f-6430add1d555" path="/var/lib/kubelet/pods/22731683-d752-4256-be6f-6430add1d555/volumes" Jul 08 18:02:31.005865 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:31.005767 2579 generic.go:356] "Generic (PLEG): container finished" podID="0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d" containerID="6f300e13f4d227517c4a215bca8fd7a9047b86287d5e3824c8a9dd96143c34dd" exitCode=0 Jul 08 18:02:31.005865 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:31.005849 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d","Type":"ContainerDied","Data":"6f300e13f4d227517c4a215bca8fd7a9047b86287d5e3824c8a9dd96143c34dd"} Jul 08 18:02:31.006325 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:31.005934 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d","Type":"ContainerStarted","Data":"95e688e30b328d4f5ca871eec1d33af4855d2ed98ff7ea7aeac6870a414c55df"} Jul 08 18:02:32.015120 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:32.015089 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d","Type":"ContainerStarted","Data":"779a9f524f13f2387606421852bacb04786e9265c9f745d21ffeb9e1aa5207ad"} Jul 08 18:02:32.015552 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:32.015233 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d","Type":"ContainerStarted","Data":"e223d1ba39e61712ef673adeb6e92a4420d18ba7ca96bd0432784808b078f2aa"} Jul 08 18:02:32.015552 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:32.015273 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d","Type":"ContainerStarted","Data":"690ec9178ed696ede3249362e3d7467d397efc3f7c8446caa604bf8f61a1ab34"} Jul 08 18:02:32.015552 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:32.015301 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d","Type":"ContainerStarted","Data":"4fb83cf30d725dc187a55da706b75d9ac9996be7d08c19de9e939603eef5afd2"} Jul 08 18:02:32.015552 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:32.015330 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d","Type":"ContainerStarted","Data":"3deaab446d1d9571b53dcf59851f0fc69b7bee8a823596276b091e46d06db468"} Jul 08 18:02:32.015552 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:32.015360 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d","Type":"ContainerStarted","Data":"41fee448e82d95c5bb4b1fe85141a62ef5163c722b2a1425732de2006a3c1953"} Jul 08 18:02:32.017397 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:32.017360 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-786f755556-69dxm" event={"ID":"0fd15029-20a1-4d8b-86ea-4851615ece95","Type":"ContainerStarted","Data":"1222429ff0890e64e301aaac7464fca8beb17f12cfa32c04ef82bb60986b2bfa"} Jul 08 18:02:32.017492 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:32.017425 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-786f755556-69dxm" event={"ID":"0fd15029-20a1-4d8b-86ea-4851615ece95","Type":"ContainerStarted","Data":"3ed56c9f33c84714ff19701540586145c9ed04fdae66ea152b95602b6663d776"} Jul 08 18:02:32.067474 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:32.067410 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.047957483 podStartE2EDuration="2.067387058s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.429575ms" isStatefulPod=false podCreationTimestamp="2026-07-08 18:02:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:02:32.064730237 +0000 UTC m=+396.004537662" watchObservedRunningTime="2026-07-08 18:02:32.067387058 +0000 UTC m=+396.007194486" Jul 08 18:02:33.024715 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:33.024676 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-786f755556-69dxm" event={"ID":"0fd15029-20a1-4d8b-86ea-4851615ece95","Type":"ContainerStarted","Data":"1588240d1fe8b7c6e2a3259e6685e8507ab08c03ad25081704e59281bd90e87a"} Jul 08 18:02:33.055865 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:33.055807 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-786f755556-69dxm" podStartSLOduration=1.878685612 podStartE2EDuration="4.055791629s" totalImagesPullingTime="2.177106017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:02:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:02:33.053627735 +0000 UTC m=+396.993435190" watchObservedRunningTime="2026-07-08 18:02:33.055791629 +0000 UTC m=+396.995599056" Jul 08 18:02:35.399406 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:02:35.399352 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:03:30.399250 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:03:30.399191 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:03:30.414969 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:03:30.414940 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:03:31.304887 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:03:31.304852 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:05:56.509895 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:05:56.509858 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fthbc_f43817dc-4c29-4408-987d-c7f86cfa07ce/console-operator/1.log" Jul 08 18:05:56.511137 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:05:56.511115 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fthbc_f43817dc-4c29-4408-987d-c7f86cfa07ce/console-operator/1.log" Jul 08 18:07:26.661208 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:07:26.661161 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-857f77d56c-nhkqp"] Jul 08 18:07:26.664079 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:07:26.664063 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-nhkqp" Jul 08 18:07:26.667728 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:07:26.667702 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jul 08 18:07:26.667919 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:07:26.667897 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jul 08 18:07:26.667994 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:07:26.667897 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 18:07:26.667994 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:07:26.667899 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 18:07:26.668451 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:07:26.668435 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-skkzh\"" Jul 08 18:07:26.675390 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:07:26.675365 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-857f77d56c-nhkqp"] Jul 08 18:07:26.734752 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:07:26.734708 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92738e55-f5af-467f-a5a2-d38852df1e74-cert\") pod \"kubeflow-trainer-controller-manager-857f77d56c-nhkqp\" (UID: \"92738e55-f5af-467f-a5a2-d38852df1e74\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-nhkqp" Jul 08 18:07:26.734937 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:07:26.734771 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/92738e55-f5af-467f-a5a2-d38852df1e74-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-857f77d56c-nhkqp\" (UID: \"92738e55-f5af-467f-a5a2-d38852df1e74\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-nhkqp" Jul 08 18:07:26.734937 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:07:26.734825 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k446l\" (UniqueName: \"kubernetes.io/projected/92738e55-f5af-467f-a5a2-d38852df1e74-kube-api-access-k446l\") pod \"kubeflow-trainer-controller-manager-857f77d56c-nhkqp\" (UID: \"92738e55-f5af-467f-a5a2-d38852df1e74\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-nhkqp" Jul 08 18:07:26.835960 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:07:26.835925 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92738e55-f5af-467f-a5a2-d38852df1e74-cert\") pod \"kubeflow-trainer-controller-manager-857f77d56c-nhkqp\" (UID: \"92738e55-f5af-467f-a5a2-d38852df1e74\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-nhkqp" Jul 08 18:07:26.836149 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:07:26.835978 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/92738e55-f5af-467f-a5a2-d38852df1e74-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-857f77d56c-nhkqp\" (UID: \"92738e55-f5af-467f-a5a2-d38852df1e74\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-nhkqp" Jul 08 18:07:26.836149 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:07:26.836021 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k446l\" (UniqueName: \"kubernetes.io/projected/92738e55-f5af-467f-a5a2-d38852df1e74-kube-api-access-k446l\") pod \"kubeflow-trainer-controller-manager-857f77d56c-nhkqp\" (UID: \"92738e55-f5af-467f-a5a2-d38852df1e74\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-nhkqp" Jul 08 18:07:26.836742 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:07:26.836723 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/92738e55-f5af-467f-a5a2-d38852df1e74-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-857f77d56c-nhkqp\" (UID: \"92738e55-f5af-467f-a5a2-d38852df1e74\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-nhkqp" Jul 08 18:07:26.838381 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:07:26.838359 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92738e55-f5af-467f-a5a2-d38852df1e74-cert\") pod \"kubeflow-trainer-controller-manager-857f77d56c-nhkqp\" (UID: \"92738e55-f5af-467f-a5a2-d38852df1e74\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-nhkqp" Jul 08 18:07:26.851213 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:07:26.851164 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k446l\" (UniqueName: \"kubernetes.io/projected/92738e55-f5af-467f-a5a2-d38852df1e74-kube-api-access-k446l\") pod \"kubeflow-trainer-controller-manager-857f77d56c-nhkqp\" (UID: \"92738e55-f5af-467f-a5a2-d38852df1e74\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-nhkqp" Jul 08 18:07:26.981398 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:07:26.981304 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-nhkqp" Jul 08 18:07:27.131862 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:07:27.131835 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-857f77d56c-nhkqp"] Jul 08 18:07:27.134538 ip-10-0-128-234 kubenswrapper[2579]: W0708 18:07:27.134509 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92738e55_f5af_467f_a5a2_d38852df1e74.slice/crio-a95991014e33cab858ed79b195799eecaf1a950ac32af33a31934baf15356c32 WatchSource:0}: Error finding container a95991014e33cab858ed79b195799eecaf1a950ac32af33a31934baf15356c32: Status 404 returned error can't find the container with id a95991014e33cab858ed79b195799eecaf1a950ac32af33a31934baf15356c32 Jul 08 18:07:27.136460 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:07:27.136440 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 18:07:27.290287 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:07:27.290252 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-nhkqp" event={"ID":"92738e55-f5af-467f-a5a2-d38852df1e74","Type":"ContainerStarted","Data":"a95991014e33cab858ed79b195799eecaf1a950ac32af33a31934baf15356c32"} Jul 08 18:07:31.315887 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:07:31.315844 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-nhkqp" event={"ID":"92738e55-f5af-467f-a5a2-d38852df1e74","Type":"ContainerStarted","Data":"c23949c476f11a1c5cabc966da915bdf142ef0e622ec32540362e879f880379d"} Jul 08 18:07:31.316373 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:07:31.316029 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-nhkqp" Jul 08 18:07:31.342627 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:07:31.342571 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-nhkqp" podStartSLOduration=1.821119061 podStartE2EDuration="5.342553387s" totalImagesPullingTime="3.521434326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:07:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:07:31.339857658 +0000 UTC m=+695.279665086" watchObservedRunningTime="2026-07-08 18:07:31.342553387 +0000 UTC m=+695.282360814" Jul 08 18:07:47.325763 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:07:47.325667 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-nhkqp" Jul 08 18:10:56.538513 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:10:56.538435 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fthbc_f43817dc-4c29-4408-987d-c7f86cfa07ce/console-operator/1.log" Jul 08 18:10:56.539744 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:10:56.539721 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fthbc_f43817dc-4c29-4408-987d-c7f86cfa07ce/console-operator/1.log" Jul 08 18:15:56.567431 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:15:56.567397 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fthbc_f43817dc-4c29-4408-987d-c7f86cfa07ce/console-operator/1.log" Jul 08 18:15:56.569015 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:15:56.568992 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fthbc_f43817dc-4c29-4408-987d-c7f86cfa07ce/console-operator/1.log" Jul 08 18:17:08.907992 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:17:08.907914 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vzxvq/must-gather-f96cb"] Jul 08 18:17:08.911247 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:17:08.911226 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vzxvq/must-gather-f96cb" Jul 08 18:17:08.913959 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:17:08.913938 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vzxvq\"/\"kube-root-ca.crt\"" Jul 08 18:17:08.914822 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:17:08.914803 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vzxvq\"/\"default-dockercfg-d2xw6\"" Jul 08 18:17:08.914927 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:17:08.914803 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vzxvq\"/\"openshift-service-ca.crt\"" Jul 08 18:17:08.920688 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:17:08.920666 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vzxvq/must-gather-f96cb"] Jul 08 18:17:09.009186 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:17:09.009146 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/34a9fd5a-ca81-49af-8c70-323f1d827605-must-gather-output\") pod \"must-gather-f96cb\" (UID: \"34a9fd5a-ca81-49af-8c70-323f1d827605\") " pod="openshift-must-gather-vzxvq/must-gather-f96cb" Jul 08 18:17:09.009367 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:17:09.009214 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4v86\" (UniqueName: \"kubernetes.io/projected/34a9fd5a-ca81-49af-8c70-323f1d827605-kube-api-access-m4v86\") pod \"must-gather-f96cb\" (UID: \"34a9fd5a-ca81-49af-8c70-323f1d827605\") " pod="openshift-must-gather-vzxvq/must-gather-f96cb" Jul 08 18:17:09.109737 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:17:09.109698 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/34a9fd5a-ca81-49af-8c70-323f1d827605-must-gather-output\") pod \"must-gather-f96cb\" (UID: \"34a9fd5a-ca81-49af-8c70-323f1d827605\") " pod="openshift-must-gather-vzxvq/must-gather-f96cb" Jul 08 18:17:09.109891 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:17:09.109748 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4v86\" (UniqueName: \"kubernetes.io/projected/34a9fd5a-ca81-49af-8c70-323f1d827605-kube-api-access-m4v86\") pod \"must-gather-f96cb\" (UID: \"34a9fd5a-ca81-49af-8c70-323f1d827605\") " pod="openshift-must-gather-vzxvq/must-gather-f96cb" Jul 08 18:17:09.110061 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:17:09.110043 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/34a9fd5a-ca81-49af-8c70-323f1d827605-must-gather-output\") pod \"must-gather-f96cb\" (UID: \"34a9fd5a-ca81-49af-8c70-323f1d827605\") " pod="openshift-must-gather-vzxvq/must-gather-f96cb" Jul 08 18:17:09.117673 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:17:09.117650 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4v86\" (UniqueName: \"kubernetes.io/projected/34a9fd5a-ca81-49af-8c70-323f1d827605-kube-api-access-m4v86\") pod \"must-gather-f96cb\" (UID: \"34a9fd5a-ca81-49af-8c70-323f1d827605\") " pod="openshift-must-gather-vzxvq/must-gather-f96cb" Jul 08 18:17:09.220924 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:17:09.220840 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vzxvq/must-gather-f96cb" Jul 08 18:17:09.352970 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:17:09.352948 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vzxvq/must-gather-f96cb"] Jul 08 18:17:09.355190 ip-10-0-128-234 kubenswrapper[2579]: W0708 18:17:09.355151 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34a9fd5a_ca81_49af_8c70_323f1d827605.slice/crio-f7835fba8b3b07e5d13dd9f6b6d654c693bc7c1a566104af595bec017045f469 WatchSource:0}: Error finding container f7835fba8b3b07e5d13dd9f6b6d654c693bc7c1a566104af595bec017045f469: Status 404 returned error can't find the container with id f7835fba8b3b07e5d13dd9f6b6d654c693bc7c1a566104af595bec017045f469 Jul 08 18:17:09.357056 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:17:09.357041 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 18:17:09.785699 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:17:09.785665 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vzxvq/must-gather-f96cb" event={"ID":"34a9fd5a-ca81-49af-8c70-323f1d827605","Type":"ContainerStarted","Data":"f7835fba8b3b07e5d13dd9f6b6d654c693bc7c1a566104af595bec017045f469"} Jul 08 18:17:16.822408 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:17:16.822367 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vzxvq/must-gather-f96cb" event={"ID":"34a9fd5a-ca81-49af-8c70-323f1d827605","Type":"ContainerStarted","Data":"31c3fc7901653d9be6b71206036c15b40ad6b94fa5f10a563bf4b714e5503b83"} Jul 08 18:17:16.822932 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:17:16.822417 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vzxvq/must-gather-f96cb" event={"ID":"34a9fd5a-ca81-49af-8c70-323f1d827605","Type":"ContainerStarted","Data":"88b3a768a036ed8d8ecaa869fc26afcb430fdeb31682aebf38c0faebab95f4b3"} Jul 08 18:17:16.838003 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:17:16.837944 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vzxvq/must-gather-f96cb" podStartSLOduration=2.065015291 podStartE2EDuration="8.837923264s" totalImagesPullingTime="6.772907973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:17:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:17:16.837450181 +0000 UTC m=+1280.777257609" watchObservedRunningTime="2026-07-08 18:17:16.837923264 +0000 UTC m=+1280.777730691" Jul 08 18:17:26.053488 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:17:26.053460 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-857f77d56c-nhkqp_92738e55-f5af-467f-a5a2-d38852df1e74/manager/0.log" Jul 08 18:17:26.556348 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:17:26.556318 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-857f77d56c-nhkqp_92738e55-f5af-467f-a5a2-d38852df1e74/manager/0.log" Jul 08 18:17:27.040167 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:17:27.040137 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-857f77d56c-nhkqp_92738e55-f5af-467f-a5a2-d38852df1e74/manager/0.log" Jul 08 18:18:04.056847 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:04.056812 2579 generic.go:356] "Generic (PLEG): container finished" podID="34a9fd5a-ca81-49af-8c70-323f1d827605" containerID="88b3a768a036ed8d8ecaa869fc26afcb430fdeb31682aebf38c0faebab95f4b3" exitCode=0 Jul 08 18:18:04.057296 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:04.056885 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vzxvq/must-gather-f96cb" event={"ID":"34a9fd5a-ca81-49af-8c70-323f1d827605","Type":"ContainerDied","Data":"88b3a768a036ed8d8ecaa869fc26afcb430fdeb31682aebf38c0faebab95f4b3"} Jul 08 18:18:04.057296 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:04.057209 2579 scope.go:117] "RemoveContainer" containerID="88b3a768a036ed8d8ecaa869fc26afcb430fdeb31682aebf38c0faebab95f4b3" Jul 08 18:18:04.300068 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:04.300039 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-vzxvq_must-gather-f96cb_34a9fd5a-ca81-49af-8c70-323f1d827605/gather/0.log" Jul 08 18:18:07.707090 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:07.707060 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-t6rk4_34698452-3dd9-43df-a496-5971c144095b/global-pull-secret-syncer/0.log" Jul 08 18:18:07.804032 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:07.804001 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jnnhn_97b4b0ca-1889-469e-bb9e-c71b128caa10/konnectivity-agent/0.log" Jul 08 18:18:07.883476 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:07.883447 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-234.ec2.internal_1822161f850ef2b3317aaf5916b61399/haproxy/0.log" Jul 08 18:18:09.646634 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:09.646595 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-vzxvq/must-gather-f96cb"] Jul 08 18:18:09.647020 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:09.646799 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-vzxvq/must-gather-f96cb" podUID="34a9fd5a-ca81-49af-8c70-323f1d827605" containerName="copy" containerID="cri-o://31c3fc7901653d9be6b71206036c15b40ad6b94fa5f10a563bf4b714e5503b83" gracePeriod=2 Jul 08 18:18:09.655018 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:18:09.654974 2579 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"34a9fd5a-ca81-49af-8c70-323f1d827605\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-vzxvq\"/\"must-gather-f96cb\": pods \"must-gather-f96cb\" not found" pod="openshift-must-gather-vzxvq/must-gather-f96cb" Jul 08 18:18:09.655152 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:09.655110 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-vzxvq/must-gather-f96cb"] Jul 08 18:18:09.886684 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:09.886660 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-vzxvq_must-gather-f96cb_34a9fd5a-ca81-49af-8c70-323f1d827605/copy/0.log" Jul 08 18:18:09.889157 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:09.889140 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vzxvq/must-gather-f96cb" Jul 08 18:18:09.891336 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:18:09.891311 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-f96cb\" is forbidden: User \"system:node:ip-10-0-128-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-vzxvq\": no relationship found between node 'ip-10-0-128-234.ec2.internal' and this object" podUID="34a9fd5a-ca81-49af-8c70-323f1d827605" pod="openshift-must-gather-vzxvq/must-gather-f96cb" Jul 08 18:18:10.000860 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:10.000758 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4v86\" (UniqueName: \"kubernetes.io/projected/34a9fd5a-ca81-49af-8c70-323f1d827605-kube-api-access-m4v86\") pod \"34a9fd5a-ca81-49af-8c70-323f1d827605\" (UID: \"34a9fd5a-ca81-49af-8c70-323f1d827605\") " Jul 08 18:18:10.000860 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:10.000847 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/34a9fd5a-ca81-49af-8c70-323f1d827605-must-gather-output\") pod \"34a9fd5a-ca81-49af-8c70-323f1d827605\" (UID: \"34a9fd5a-ca81-49af-8c70-323f1d827605\") " Jul 08 18:18:10.002993 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:10.002959 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34a9fd5a-ca81-49af-8c70-323f1d827605-kube-api-access-m4v86" (OuterVolumeSpecName: "kube-api-access-m4v86") pod "34a9fd5a-ca81-49af-8c70-323f1d827605" (UID: "34a9fd5a-ca81-49af-8c70-323f1d827605"). InnerVolumeSpecName "kube-api-access-m4v86". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:18:10.003115 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:10.003092 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34a9fd5a-ca81-49af-8c70-323f1d827605-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "34a9fd5a-ca81-49af-8c70-323f1d827605" (UID: "34a9fd5a-ca81-49af-8c70-323f1d827605"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:18:10.083586 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:10.083557 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-vzxvq_must-gather-f96cb_34a9fd5a-ca81-49af-8c70-323f1d827605/copy/0.log" Jul 08 18:18:10.083974 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:10.083950 2579 generic.go:356] "Generic (PLEG): container finished" podID="34a9fd5a-ca81-49af-8c70-323f1d827605" containerID="31c3fc7901653d9be6b71206036c15b40ad6b94fa5f10a563bf4b714e5503b83" exitCode=143 Jul 08 18:18:10.084050 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:10.084007 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vzxvq/must-gather-f96cb" Jul 08 18:18:10.084087 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:10.084052 2579 scope.go:117] "RemoveContainer" containerID="31c3fc7901653d9be6b71206036c15b40ad6b94fa5f10a563bf4b714e5503b83" Jul 08 18:18:10.086490 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:18:10.086461 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-f96cb\" is forbidden: User \"system:node:ip-10-0-128-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-vzxvq\": no relationship found between node 'ip-10-0-128-234.ec2.internal' and this object" podUID="34a9fd5a-ca81-49af-8c70-323f1d827605" pod="openshift-must-gather-vzxvq/must-gather-f96cb" Jul 08 18:18:10.092360 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:10.092346 2579 scope.go:117] "RemoveContainer" containerID="88b3a768a036ed8d8ecaa869fc26afcb430fdeb31682aebf38c0faebab95f4b3" Jul 08 18:18:10.093964 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:18:10.093942 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-f96cb\" is forbidden: User \"system:node:ip-10-0-128-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-vzxvq\": no relationship found between node 'ip-10-0-128-234.ec2.internal' and this object" podUID="34a9fd5a-ca81-49af-8c70-323f1d827605" pod="openshift-must-gather-vzxvq/must-gather-f96cb" Jul 08 18:18:10.102370 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:10.102349 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4v86\" (UniqueName: \"kubernetes.io/projected/34a9fd5a-ca81-49af-8c70-323f1d827605-kube-api-access-m4v86\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:18:10.102447 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:10.102373 2579 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/34a9fd5a-ca81-49af-8c70-323f1d827605-must-gather-output\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\"" Jul 08 18:18:10.103067 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:10.103054 2579 scope.go:117] "RemoveContainer" containerID="31c3fc7901653d9be6b71206036c15b40ad6b94fa5f10a563bf4b714e5503b83" Jul 08 18:18:10.103353 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:18:10.103335 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31c3fc7901653d9be6b71206036c15b40ad6b94fa5f10a563bf4b714e5503b83\": container with ID starting with 31c3fc7901653d9be6b71206036c15b40ad6b94fa5f10a563bf4b714e5503b83 not found: ID does not exist" containerID="31c3fc7901653d9be6b71206036c15b40ad6b94fa5f10a563bf4b714e5503b83" Jul 08 18:18:10.103442 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:10.103362 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31c3fc7901653d9be6b71206036c15b40ad6b94fa5f10a563bf4b714e5503b83"} err="failed to get container status \"31c3fc7901653d9be6b71206036c15b40ad6b94fa5f10a563bf4b714e5503b83\": rpc error: code = NotFound desc = could not find container \"31c3fc7901653d9be6b71206036c15b40ad6b94fa5f10a563bf4b714e5503b83\": container with ID starting with 31c3fc7901653d9be6b71206036c15b40ad6b94fa5f10a563bf4b714e5503b83 not found: ID does not exist" Jul 08 18:18:10.103442 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:10.103380 2579 scope.go:117] "RemoveContainer" containerID="88b3a768a036ed8d8ecaa869fc26afcb430fdeb31682aebf38c0faebab95f4b3" Jul 08 18:18:10.103660 ip-10-0-128-234 kubenswrapper[2579]: E0708 18:18:10.103645 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88b3a768a036ed8d8ecaa869fc26afcb430fdeb31682aebf38c0faebab95f4b3\": container with ID starting with 88b3a768a036ed8d8ecaa869fc26afcb430fdeb31682aebf38c0faebab95f4b3 not found: ID does not exist" containerID="88b3a768a036ed8d8ecaa869fc26afcb430fdeb31682aebf38c0faebab95f4b3" Jul 08 18:18:10.103710 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:10.103663 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88b3a768a036ed8d8ecaa869fc26afcb430fdeb31682aebf38c0faebab95f4b3"} err="failed to get container status \"88b3a768a036ed8d8ecaa869fc26afcb430fdeb31682aebf38c0faebab95f4b3\": rpc error: code = NotFound desc = could not find container \"88b3a768a036ed8d8ecaa869fc26afcb430fdeb31682aebf38c0faebab95f4b3\": container with ID starting with 88b3a768a036ed8d8ecaa869fc26afcb430fdeb31682aebf38c0faebab95f4b3 not found: ID does not exist" Jul 08 18:18:10.619268 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:10.619239 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34a9fd5a-ca81-49af-8c70-323f1d827605" path="/var/lib/kubelet/pods/34a9fd5a-ca81-49af-8c70-323f1d827605/volumes" Jul 08 18:18:11.403340 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:11.403310 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73f5f865-0f31-404b-95b3-990900abf698/alertmanager/0.log" Jul 08 18:18:11.431872 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:11.431841 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73f5f865-0f31-404b-95b3-990900abf698/config-reloader/0.log" Jul 08 18:18:11.458843 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:11.458820 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73f5f865-0f31-404b-95b3-990900abf698/kube-rbac-proxy-web/0.log" Jul 08 18:18:11.483690 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:11.483669 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73f5f865-0f31-404b-95b3-990900abf698/kube-rbac-proxy/0.log" Jul 08 18:18:11.511534 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:11.511510 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73f5f865-0f31-404b-95b3-990900abf698/kube-rbac-proxy-metric/0.log" Jul 08 18:18:11.539282 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:11.539251 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73f5f865-0f31-404b-95b3-990900abf698/prom-label-proxy/0.log" Jul 08 18:18:11.564705 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:11.564681 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73f5f865-0f31-404b-95b3-990900abf698/init-config-reloader/0.log" Jul 08 18:18:11.612113 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:11.612084 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-8q89n_af37eaef-0d57-4b20-8562-4c782bda5732/cluster-monitoring-operator/0.log" Jul 08 18:18:11.725543 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:11.725491 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-9d9768dd-vn25d_605ef669-3323-412e-8723-a2ef7af0914c/metrics-server/0.log" Jul 08 18:18:11.758201 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:11.758153 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-bgfvj_c58ce84e-ce79-4cbb-a3a5-15043f4424ef/monitoring-plugin/0.log" Jul 08 18:18:11.873924 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:11.873897 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mpp67_acbfbe44-056d-4cd2-9b39-dc4381cc731a/node-exporter/0.log" Jul 08 18:18:11.905601 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:11.905575 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mpp67_acbfbe44-056d-4cd2-9b39-dc4381cc731a/kube-rbac-proxy/0.log" Jul 08 18:18:11.939918 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:11.939842 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mpp67_acbfbe44-056d-4cd2-9b39-dc4381cc731a/init-textfile/0.log" Jul 08 18:18:12.146902 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:12.146870 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d/prometheus/0.log" Jul 08 18:18:12.172930 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:12.172906 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d/config-reloader/0.log" Jul 08 18:18:12.203247 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:12.203148 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d/thanos-sidecar/0.log" Jul 08 18:18:12.228191 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:12.228154 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d/kube-rbac-proxy-web/0.log" Jul 08 18:18:12.249847 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:12.249827 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d/kube-rbac-proxy/0.log" Jul 08 18:18:12.280558 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:12.280529 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d/kube-rbac-proxy-thanos/0.log" Jul 08 18:18:12.304688 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:12.304671 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0d4c01bf-bfbe-4ca3-acb4-6b4f5f994b7d/init-config-reloader/0.log" Jul 08 18:18:12.336687 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:12.336662 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-bjvxv_46a1caa3-180a-43d0-b699-584a99717dcd/prometheus-operator/0.log" Jul 08 18:18:12.357451 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:12.357428 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-bjvxv_46a1caa3-180a-43d0-b699-584a99717dcd/kube-rbac-proxy/0.log" Jul 08 18:18:12.418638 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:12.418617 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-786f755556-69dxm_0fd15029-20a1-4d8b-86ea-4851615ece95/telemeter-client/0.log" Jul 08 18:18:12.441080 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:12.441057 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-786f755556-69dxm_0fd15029-20a1-4d8b-86ea-4851615ece95/reload/0.log" Jul 08 18:18:12.465169 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:12.465098 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-786f755556-69dxm_0fd15029-20a1-4d8b-86ea-4851615ece95/kube-rbac-proxy/0.log" Jul 08 18:18:12.497544 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:12.497518 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ddbb5b97b-p6tzm_5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b/thanos-query/0.log" Jul 08 18:18:12.521642 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:12.521620 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ddbb5b97b-p6tzm_5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b/kube-rbac-proxy-web/0.log" Jul 08 18:18:12.548308 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:12.548287 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ddbb5b97b-p6tzm_5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b/kube-rbac-proxy/0.log" Jul 08 18:18:12.569974 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:12.569950 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ddbb5b97b-p6tzm_5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b/prom-label-proxy/0.log" Jul 08 18:18:12.593606 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:12.593580 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ddbb5b97b-p6tzm_5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b/kube-rbac-proxy-rules/0.log" Jul 08 18:18:12.620726 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:12.620701 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ddbb5b97b-p6tzm_5ed4fe8f-2485-4c92-a94b-3fbd740b0b1b/kube-rbac-proxy-metrics/0.log" Jul 08 18:18:13.917435 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:13.917357 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-mfl6x_96b11027-4864-4174-8225-5a1f1f0ac9db/networking-console-plugin/0.log" Jul 08 18:18:14.460881 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:14.460849 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fthbc_f43817dc-4c29-4408-987d-c7f86cfa07ce/console-operator/1.log" Jul 08 18:18:14.465344 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:14.465327 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fthbc_f43817dc-4c29-4408-987d-c7f86cfa07ce/console-operator/2.log" Jul 08 18:18:15.010288 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.010240 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-gd5d5_1f9ad66b-56ab-4883-8a3f-0ed1d5a19082/download-server/0.log" Jul 08 18:18:15.406347 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.406320 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x8rqv/perf-node-gather-daemonset-mp4m4"] Jul 08 18:18:15.406668 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.406656 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34a9fd5a-ca81-49af-8c70-323f1d827605" containerName="gather" Jul 08 18:18:15.406712 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.406670 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="34a9fd5a-ca81-49af-8c70-323f1d827605" containerName="gather" Jul 08 18:18:15.406712 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.406680 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34a9fd5a-ca81-49af-8c70-323f1d827605" containerName="copy" Jul 08 18:18:15.406712 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.406686 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="34a9fd5a-ca81-49af-8c70-323f1d827605" containerName="copy" Jul 08 18:18:15.406809 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.406754 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="34a9fd5a-ca81-49af-8c70-323f1d827605" containerName="copy" Jul 08 18:18:15.406809 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.406764 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="34a9fd5a-ca81-49af-8c70-323f1d827605" containerName="gather" Jul 08 18:18:15.414380 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.414357 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x8rqv/perf-node-gather-daemonset-mp4m4" Jul 08 18:18:15.418127 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.418104 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-x8rqv\"/\"default-dockercfg-n2hmp\"" Jul 08 18:18:15.418443 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.418424 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x8rqv\"/\"kube-root-ca.crt\"" Jul 08 18:18:15.418569 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.418450 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x8rqv\"/\"openshift-service-ca.crt\"" Jul 08 18:18:15.422802 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.422779 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x8rqv/perf-node-gather-daemonset-mp4m4"] Jul 08 18:18:15.546753 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.546706 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/abeef6e2-7da3-4ef7-b131-6e5a13208e72-podres\") pod \"perf-node-gather-daemonset-mp4m4\" (UID: \"abeef6e2-7da3-4ef7-b131-6e5a13208e72\") " pod="openshift-must-gather-x8rqv/perf-node-gather-daemonset-mp4m4" Jul 08 18:18:15.546936 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.546774 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abeef6e2-7da3-4ef7-b131-6e5a13208e72-sys\") pod \"perf-node-gather-daemonset-mp4m4\" (UID: \"abeef6e2-7da3-4ef7-b131-6e5a13208e72\") " pod="openshift-must-gather-x8rqv/perf-node-gather-daemonset-mp4m4" Jul 08 18:18:15.546936 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.546837 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/abeef6e2-7da3-4ef7-b131-6e5a13208e72-lib-modules\") pod \"perf-node-gather-daemonset-mp4m4\" (UID: \"abeef6e2-7da3-4ef7-b131-6e5a13208e72\") " pod="openshift-must-gather-x8rqv/perf-node-gather-daemonset-mp4m4" Jul 08 18:18:15.546936 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.546885 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfq2x\" (UniqueName: \"kubernetes.io/projected/abeef6e2-7da3-4ef7-b131-6e5a13208e72-kube-api-access-qfq2x\") pod \"perf-node-gather-daemonset-mp4m4\" (UID: \"abeef6e2-7da3-4ef7-b131-6e5a13208e72\") " pod="openshift-must-gather-x8rqv/perf-node-gather-daemonset-mp4m4" Jul 08 18:18:15.547057 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.546954 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/abeef6e2-7da3-4ef7-b131-6e5a13208e72-proc\") pod \"perf-node-gather-daemonset-mp4m4\" (UID: \"abeef6e2-7da3-4ef7-b131-6e5a13208e72\") " pod="openshift-must-gather-x8rqv/perf-node-gather-daemonset-mp4m4" Jul 08 18:18:15.647428 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.647387 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/abeef6e2-7da3-4ef7-b131-6e5a13208e72-proc\") pod \"perf-node-gather-daemonset-mp4m4\" (UID: \"abeef6e2-7da3-4ef7-b131-6e5a13208e72\") " pod="openshift-must-gather-x8rqv/perf-node-gather-daemonset-mp4m4" Jul 08 18:18:15.647623 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.647441 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/abeef6e2-7da3-4ef7-b131-6e5a13208e72-podres\") pod \"perf-node-gather-daemonset-mp4m4\" (UID: \"abeef6e2-7da3-4ef7-b131-6e5a13208e72\") " pod="openshift-must-gather-x8rqv/perf-node-gather-daemonset-mp4m4" Jul 08 18:18:15.647623 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.647473 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abeef6e2-7da3-4ef7-b131-6e5a13208e72-sys\") pod \"perf-node-gather-daemonset-mp4m4\" (UID: \"abeef6e2-7da3-4ef7-b131-6e5a13208e72\") " pod="openshift-must-gather-x8rqv/perf-node-gather-daemonset-mp4m4" Jul 08 18:18:15.647623 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.647490 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/abeef6e2-7da3-4ef7-b131-6e5a13208e72-lib-modules\") pod \"perf-node-gather-daemonset-mp4m4\" (UID: \"abeef6e2-7da3-4ef7-b131-6e5a13208e72\") " pod="openshift-must-gather-x8rqv/perf-node-gather-daemonset-mp4m4" Jul 08 18:18:15.647623 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.647509 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfq2x\" (UniqueName: \"kubernetes.io/projected/abeef6e2-7da3-4ef7-b131-6e5a13208e72-kube-api-access-qfq2x\") pod \"perf-node-gather-daemonset-mp4m4\" (UID: \"abeef6e2-7da3-4ef7-b131-6e5a13208e72\") " pod="openshift-must-gather-x8rqv/perf-node-gather-daemonset-mp4m4" Jul 08 18:18:15.647623 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.647523 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/abeef6e2-7da3-4ef7-b131-6e5a13208e72-proc\") pod \"perf-node-gather-daemonset-mp4m4\" (UID: \"abeef6e2-7da3-4ef7-b131-6e5a13208e72\") " pod="openshift-must-gather-x8rqv/perf-node-gather-daemonset-mp4m4" Jul 08 18:18:15.647623 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.647586 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abeef6e2-7da3-4ef7-b131-6e5a13208e72-sys\") pod \"perf-node-gather-daemonset-mp4m4\" (UID: \"abeef6e2-7da3-4ef7-b131-6e5a13208e72\") " pod="openshift-must-gather-x8rqv/perf-node-gather-daemonset-mp4m4" Jul 08 18:18:15.647833 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.647626 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/abeef6e2-7da3-4ef7-b131-6e5a13208e72-podres\") pod \"perf-node-gather-daemonset-mp4m4\" (UID: \"abeef6e2-7da3-4ef7-b131-6e5a13208e72\") " pod="openshift-must-gather-x8rqv/perf-node-gather-daemonset-mp4m4" Jul 08 18:18:15.647833 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.647637 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/abeef6e2-7da3-4ef7-b131-6e5a13208e72-lib-modules\") pod \"perf-node-gather-daemonset-mp4m4\" (UID: \"abeef6e2-7da3-4ef7-b131-6e5a13208e72\") " pod="openshift-must-gather-x8rqv/perf-node-gather-daemonset-mp4m4" Jul 08 18:18:15.661454 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.661391 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfq2x\" (UniqueName: \"kubernetes.io/projected/abeef6e2-7da3-4ef7-b131-6e5a13208e72-kube-api-access-qfq2x\") pod \"perf-node-gather-daemonset-mp4m4\" (UID: \"abeef6e2-7da3-4ef7-b131-6e5a13208e72\") " pod="openshift-must-gather-x8rqv/perf-node-gather-daemonset-mp4m4" Jul 08 18:18:15.725501 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.725465 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x8rqv/perf-node-gather-daemonset-mp4m4" Jul 08 18:18:15.857118 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:15.857090 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x8rqv/perf-node-gather-daemonset-mp4m4"] Jul 08 18:18:15.863428 ip-10-0-128-234 kubenswrapper[2579]: W0708 18:18:15.863394 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podabeef6e2_7da3_4ef7_b131_6e5a13208e72.slice/crio-ca6260f535c13599d2112ecaac9cfc270a1c8ec9d85d03ef94ee0ba06dd00297 WatchSource:0}: Error finding container ca6260f535c13599d2112ecaac9cfc270a1c8ec9d85d03ef94ee0ba06dd00297: Status 404 returned error can't find the container with id ca6260f535c13599d2112ecaac9cfc270a1c8ec9d85d03ef94ee0ba06dd00297 Jul 08 18:18:16.117092 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:16.117052 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x8rqv/perf-node-gather-daemonset-mp4m4" event={"ID":"abeef6e2-7da3-4ef7-b131-6e5a13208e72","Type":"ContainerStarted","Data":"55540b21e6d9fce265d41ae1689fa841265a6d308b5c787f59fd1908a50060bd"} Jul 08 18:18:16.117480 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:16.117127 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x8rqv/perf-node-gather-daemonset-mp4m4" event={"ID":"abeef6e2-7da3-4ef7-b131-6e5a13208e72","Type":"ContainerStarted","Data":"ca6260f535c13599d2112ecaac9cfc270a1c8ec9d85d03ef94ee0ba06dd00297"} Jul 08 18:18:16.117480 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:16.117150 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-x8rqv/perf-node-gather-daemonset-mp4m4" Jul 08 18:18:16.134618 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:16.134565 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-x8rqv/perf-node-gather-daemonset-mp4m4" podStartSLOduration=1.134550251 podStartE2EDuration="1.134550251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:18:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:16.133550496 +0000 UTC m=+1340.073357924" watchObservedRunningTime="2026-07-08 18:18:16.134550251 +0000 UTC m=+1340.074357677" Jul 08 18:18:16.474243 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:16.474215 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-phj4c_9da39558-d4cb-4ef1-90d8-44ad3f6b939c/dns/0.log" Jul 08 18:18:16.496496 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:16.496469 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-phj4c_9da39558-d4cb-4ef1-90d8-44ad3f6b939c/kube-rbac-proxy/0.log" Jul 08 18:18:16.564362 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:16.564332 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cxg6h_088e9df1-9c28-430a-a67d-c8ac11e6564e/dns-node-resolver/0.log" Jul 08 18:18:17.065300 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:17.065270 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c2d4p_549e5f27-43e4-43b4-b0d9-a8dca67dea84/node-ca/0.log" Jul 08 18:18:17.822726 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:17.822698 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59d7db58ff-wx86z_a6f9cd5f-0e97-4f32-beee-c3aaaf3c4cd6/router/0.log" Jul 08 18:18:18.195717 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:18.195639 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p7gp6_e4ca3fa5-27eb-4a4e-834a-a2f3ae615d92/serve-healthcheck-canary/0.log" Jul 08 18:18:18.538831 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:18.538796 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-bp5bl_de99acf9-7a92-4681-b0b3-918c51c1dea5/insights-operator/0.log" Jul 08 18:18:18.539005 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:18.538874 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-bp5bl_de99acf9-7a92-4681-b0b3-918c51c1dea5/insights-operator/1.log" Jul 08 18:18:18.561272 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:18.561253 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-db66r_e5b81533-a7d9-4a5e-9802-9912a8db6293/kube-rbac-proxy/0.log" Jul 08 18:18:18.587300 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:18.587281 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-db66r_e5b81533-a7d9-4a5e-9802-9912a8db6293/exporter/0.log" Jul 08 18:18:18.610895 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:18.610873 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-db66r_e5b81533-a7d9-4a5e-9802-9912a8db6293/extractor/0.log" Jul 08 18:18:22.132483 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:22.132458 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-x8rqv/perf-node-gather-daemonset-mp4m4" Jul 08 18:18:23.921776 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:23.921729 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-k2gq9_d978efe4-a0ee-46e0-838a-77ec2ffc352f/kube-storage-version-migrator-operator/1.log" Jul 08 18:18:23.922764 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:23.922750 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-k2gq9_d978efe4-a0ee-46e0-838a-77ec2ffc352f/kube-storage-version-migrator-operator/0.log" Jul 08 18:18:25.053080 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:25.053045 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pc728_8a1adfb2-9a71-43a3-892f-41b2881f1fe8/kube-multus-additional-cni-plugins/0.log" Jul 08 18:18:25.074948 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:25.074919 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pc728_8a1adfb2-9a71-43a3-892f-41b2881f1fe8/egress-router-binary-copy/0.log" Jul 08 18:18:25.097612 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:25.097586 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pc728_8a1adfb2-9a71-43a3-892f-41b2881f1fe8/cni-plugins/0.log" Jul 08 18:18:25.120835 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:25.120809 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pc728_8a1adfb2-9a71-43a3-892f-41b2881f1fe8/bond-cni-plugin/0.log" Jul 08 18:18:25.145944 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:25.145914 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pc728_8a1adfb2-9a71-43a3-892f-41b2881f1fe8/routeoverride-cni/0.log" Jul 08 18:18:25.167641 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:25.167599 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pc728_8a1adfb2-9a71-43a3-892f-41b2881f1fe8/whereabouts-cni-bincopy/0.log" Jul 08 18:18:25.191421 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:25.191342 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pc728_8a1adfb2-9a71-43a3-892f-41b2881f1fe8/whereabouts-cni/0.log" Jul 08 18:18:25.437482 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:25.437451 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mrs6x_01f209d5-dc76-42e1-a119-f9caaaee0961/kube-multus/0.log" Jul 08 18:18:25.500684 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:25.500603 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mrv85_077db27a-abe8-4647-9b18-9d59458f3f9c/network-metrics-daemon/0.log" Jul 08 18:18:25.520769 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:25.520743 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mrv85_077db27a-abe8-4647-9b18-9d59458f3f9c/kube-rbac-proxy/0.log" Jul 08 18:18:26.557828 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:26.557796 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqgcf_f628956a-833b-4922-8da3-9a95c252175e/ovn-controller/0.log" Jul 08 18:18:26.580489 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:26.580464 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqgcf_f628956a-833b-4922-8da3-9a95c252175e/ovn-acl-logging/0.log" Jul 08 18:18:26.605273 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:26.605243 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqgcf_f628956a-833b-4922-8da3-9a95c252175e/kube-rbac-proxy-node/0.log" Jul 08 18:18:26.627018 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:26.626995 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqgcf_f628956a-833b-4922-8da3-9a95c252175e/kube-rbac-proxy-ovn-metrics/0.log" Jul 08 18:18:26.644297 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:26.644232 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqgcf_f628956a-833b-4922-8da3-9a95c252175e/northd/0.log" Jul 08 18:18:26.666952 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:26.666926 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqgcf_f628956a-833b-4922-8da3-9a95c252175e/nbdb/0.log" Jul 08 18:18:26.688640 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:26.688618 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqgcf_f628956a-833b-4922-8da3-9a95c252175e/sbdb/0.log" Jul 08 18:18:26.727629 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:26.727599 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqgcf_f628956a-833b-4922-8da3-9a95c252175e/ovnkube-controller/0.log" Jul 08 18:18:27.813537 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:27.813509 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-989f8b8dc-dbnrk_2f44d2bf-8fe4-417f-9d1c-a7301d298135/check-endpoints/0.log" Jul 08 18:18:27.896658 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:27.896627 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-k678l_b3fffa77-4964-4e33-bb38-fd4483bbd32d/network-check-target-container/0.log" Jul 08 18:18:28.851860 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:28.851832 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-xmvk2_a2bc2a50-5b6e-42d2-9e28-e6d60a176fd9/iptables-alerter/0.log" Jul 08 18:18:29.661978 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:29.661954 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-ngmzd_239c19ca-ad22-4864-b17c-feffccde78d9/tuned/0.log" Jul 08 18:18:31.287648 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:31.287617 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-56fcf86bf-dnv2n_95031ded-dd92-46ed-96d8-0f0ec453c374/cluster-samples-operator/0.log" Jul 08 18:18:31.303330 ip-10-0-128-234 kubenswrapper[2579]: I0708 18:18:31.303302 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-56fcf86bf-dnv2n_95031ded-dd92-46ed-96d8-0f0ec453c374/cluster-samples-operator-watch/0.log"