Jul 10 00:58:22.755890 ip-10-0-138-251 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 10 00:58:22.755901 ip-10-0-138-251 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 10 00:58:22.755908 ip-10-0-138-251 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 10 00:58:22.756153 ip-10-0-138-251 systemd[1]: Failed to start Kubernetes Kubelet. Jul 10 00:58:32.833439 ip-10-0-138-251 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 10 00:58:32.833460 ip-10-0-138-251 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot a5c5d7781ce54443b713374382560379 -- Jul 10 01:00:09.840210 ip-10-0-138-251 systemd[1]: Starting Kubernetes Kubelet... Jul 10 01:00:10.419908 ip-10-0-138-251 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 01:00:10.419908 ip-10-0-138-251 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 10 01:00:10.419908 ip-10-0-138-251 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 01:00:10.419908 ip-10-0-138-251 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 10 01:00:10.419908 ip-10-0-138-251 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 01:00:10.419908 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.296298 2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 10 01:00:10.419908 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301846 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 01:00:10.419908 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301868 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 01:00:10.419908 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301873 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 01:00:10.419908 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301876 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 01:00:10.419908 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301879 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 01:00:10.419908 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301882 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 01:00:10.419908 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301885 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 01:00:10.419908 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301907 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 01:00:10.422825 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301912 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 01:00:10.422825 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301916 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 01:00:10.422825 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301919 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 01:00:10.422825 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301922 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 01:00:10.422825 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301924 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 01:00:10.422825 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301927 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 01:00:10.422825 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301930 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 01:00:10.422825 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301933 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 01:00:10.422825 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301936 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 01:00:10.422825 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301938 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 01:00:10.422825 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301941 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 01:00:10.422825 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301943 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 01:00:10.422825 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301950 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 01:00:10.422825 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301952 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 01:00:10.422825 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301955 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 01:00:10.422825 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301958 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 01:00:10.422825 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301960 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 01:00:10.422825 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301963 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 01:00:10.422825 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301966 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 01:00:10.422825 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301969 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 01:00:10.424833 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301972 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 01:00:10.424833 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301974 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 01:00:10.424833 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301977 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 01:00:10.424833 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301979 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 01:00:10.424833 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301982 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 01:00:10.424833 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301984 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 01:00:10.424833 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301988 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 01:00:10.424833 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301992 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 01:00:10.424833 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301995 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 01:00:10.424833 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.301999 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 01:00:10.424833 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302001 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 01:00:10.424833 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302004 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 01:00:10.424833 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302007 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 01:00:10.424833 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302009 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 01:00:10.424833 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302012 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 01:00:10.424833 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302015 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 01:00:10.424833 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302017 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 01:00:10.424833 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302020 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 01:00:10.424833 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302023 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 01:00:10.427085 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302025 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 01:00:10.427085 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302028 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 01:00:10.427085 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302030 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 01:00:10.427085 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302033 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 01:00:10.427085 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302036 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 01:00:10.427085 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302038 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 01:00:10.427085 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302041 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 01:00:10.427085 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302043 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 01:00:10.427085 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302045 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 01:00:10.427085 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302048 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 01:00:10.427085 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302051 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 01:00:10.427085 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302054 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 01:00:10.427085 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302056 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 01:00:10.427085 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302059 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 01:00:10.427085 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302061 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 01:00:10.427085 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302064 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 01:00:10.427085 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302066 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 01:00:10.427085 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302069 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 01:00:10.427085 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302072 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 01:00:10.440377 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302075 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 01:00:10.440377 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302079 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 01:00:10.440377 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302081 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 01:00:10.440377 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302084 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 01:00:10.440377 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302087 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 01:00:10.440377 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302090 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 01:00:10.440377 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302092 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 01:00:10.440377 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302095 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 01:00:10.440377 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302098 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 01:00:10.440377 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302100 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 01:00:10.440377 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302103 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 01:00:10.440377 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302105 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 01:00:10.440377 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302108 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 01:00:10.440377 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302111 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 01:00:10.440377 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302114 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 01:00:10.440377 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302116 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 01:00:10.440377 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302119 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 01:00:10.440377 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302122 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 01:00:10.440377 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302126 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 01:00:10.440377 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302129 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 10 01:00:10.442374 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302131 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 01:00:10.442374 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302136 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 01:00:10.442374 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302138 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 01:00:10.442374 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302141 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 01:00:10.442374 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302143 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 01:00:10.442374 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302146 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 01:00:10.442374 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302148 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 01:00:10.442374 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302151 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 01:00:10.442374 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302154 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 01:00:10.442374 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302156 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 01:00:10.442374 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302159 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 01:00:10.442374 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302161 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 01:00:10.442374 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302165 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 01:00:10.442374 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302872 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 01:00:10.442374 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302879 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 01:00:10.442374 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302882 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 01:00:10.442374 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302885 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 01:00:10.442374 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302903 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 01:00:10.442374 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302906 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 01:00:10.454869 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302909 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 01:00:10.454869 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302912 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 01:00:10.454869 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302914 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 01:00:10.454869 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302917 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 01:00:10.454869 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302920 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 01:00:10.454869 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302922 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 01:00:10.454869 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302925 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 01:00:10.454869 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302928 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 01:00:10.454869 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302931 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 01:00:10.454869 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302933 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 01:00:10.454869 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302936 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 01:00:10.454869 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302939 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 01:00:10.454869 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302942 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 01:00:10.454869 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302945 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 01:00:10.454869 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302948 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 01:00:10.454869 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302950 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 01:00:10.454869 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302953 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 01:00:10.454869 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302955 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 01:00:10.454869 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302958 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 01:00:10.454869 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302968 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 01:00:10.452857 ip-10-0-138-251 systemd[1]: Started Kubernetes Kubelet. Jul 10 01:00:10.457417 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302971 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 01:00:10.457417 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302974 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 01:00:10.457417 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302977 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 01:00:10.457417 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302980 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 01:00:10.457417 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302982 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 01:00:10.457417 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302985 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 01:00:10.457417 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302988 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 01:00:10.457417 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302991 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 01:00:10.457417 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302993 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 01:00:10.457417 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302996 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 01:00:10.457417 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.302999 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 01:00:10.457417 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303003 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 01:00:10.457417 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303006 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 01:00:10.457417 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303008 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 01:00:10.457417 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303011 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 01:00:10.457417 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303013 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 01:00:10.457417 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303016 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 01:00:10.457417 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303019 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 01:00:10.457417 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303022 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 01:00:10.465135 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303024 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 01:00:10.465135 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303027 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 01:00:10.465135 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303029 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 01:00:10.465135 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303032 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 01:00:10.465135 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303035 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 01:00:10.465135 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303038 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 01:00:10.465135 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303041 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 01:00:10.465135 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303043 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 01:00:10.465135 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303046 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 01:00:10.465135 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303049 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 01:00:10.465135 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303051 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 01:00:10.465135 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303056 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 01:00:10.465135 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303060 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 01:00:10.465135 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303063 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 01:00:10.465135 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303066 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 01:00:10.465135 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303069 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 10 01:00:10.465135 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303071 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 01:00:10.465135 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303074 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 01:00:10.465135 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303077 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 01:00:10.465135 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303079 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 01:00:10.466033 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303082 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 01:00:10.466033 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303084 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 01:00:10.466033 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303087 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 01:00:10.466033 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303089 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 01:00:10.466033 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303091 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 01:00:10.466033 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303094 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 01:00:10.466033 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303097 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 01:00:10.466033 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303099 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 01:00:10.466033 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303102 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 01:00:10.466033 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303104 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 01:00:10.466033 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303107 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 01:00:10.466033 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303112 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 01:00:10.466033 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303114 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 01:00:10.466033 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303117 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 01:00:10.466033 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303120 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 01:00:10.466033 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303123 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 01:00:10.466033 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303125 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 01:00:10.466033 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303128 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 01:00:10.466033 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303132 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 01:00:10.466033 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303135 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 01:00:10.466864 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303138 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 01:00:10.466864 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303141 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 01:00:10.466864 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303144 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 01:00:10.466864 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303147 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 01:00:10.466864 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303149 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 01:00:10.466864 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303153 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 01:00:10.466864 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303156 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 01:00:10.466864 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303159 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 01:00:10.466864 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303163 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 01:00:10.466864 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303166 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 01:00:10.466864 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303169 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 01:00:10.466864 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303171 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 01:00:10.466864 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303175 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 01:00:10.466864 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303177 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 01:00:10.466864 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303598 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 01:00:10.466864 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303604 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 01:00:10.466864 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303608 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 01:00:10.466864 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303612 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 01:00:10.466864 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303616 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 01:00:10.467710 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303618 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 01:00:10.467710 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303621 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 01:00:10.467710 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303625 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 01:00:10.467710 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303628 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 01:00:10.467710 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303634 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 01:00:10.467710 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303638 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 01:00:10.467710 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303641 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 01:00:10.467710 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303644 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 01:00:10.467710 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303647 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 01:00:10.467710 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303650 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 01:00:10.467710 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303652 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 01:00:10.467710 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303656 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 01:00:10.467710 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303659 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 01:00:10.467710 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303662 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 01:00:10.467710 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303664 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 01:00:10.467710 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303666 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 01:00:10.467710 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303670 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 01:00:10.467710 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303673 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 01:00:10.467710 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303676 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 01:00:10.468350 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303678 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 01:00:10.468350 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303681 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 01:00:10.468350 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303683 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 01:00:10.468350 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303686 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 01:00:10.468350 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303688 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 01:00:10.468350 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303691 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 01:00:10.468350 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303693 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 01:00:10.468350 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303696 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 01:00:10.468350 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303698 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 01:00:10.468350 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303701 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 01:00:10.468350 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303704 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 01:00:10.468350 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303706 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 01:00:10.468350 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303712 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 01:00:10.468350 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303715 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 01:00:10.468350 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303719 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 01:00:10.468350 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303722 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 01:00:10.468350 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303724 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 10 01:00:10.468350 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303728 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 01:00:10.468350 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303731 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 01:00:10.468350 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303734 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 01:00:10.469216 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303736 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 01:00:10.469216 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303739 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 01:00:10.469216 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303741 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 01:00:10.469216 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303744 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 01:00:10.469216 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303747 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 01:00:10.469216 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303750 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 01:00:10.469216 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303752 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 01:00:10.469216 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303755 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 01:00:10.469216 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303757 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 01:00:10.469216 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303760 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 01:00:10.469216 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303762 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 01:00:10.469216 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303765 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 01:00:10.469216 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303767 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 01:00:10.469216 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303770 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 01:00:10.469216 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303772 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 01:00:10.469216 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303776 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 01:00:10.469216 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303779 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 01:00:10.469216 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303781 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 01:00:10.469216 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303784 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 01:00:10.470070 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303786 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 01:00:10.470070 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303789 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 01:00:10.470070 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303791 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 01:00:10.470070 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303794 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 01:00:10.470070 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303797 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 01:00:10.470070 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303801 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 01:00:10.470070 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303803 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 01:00:10.470070 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303806 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 01:00:10.470070 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303808 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 01:00:10.470070 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303811 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 01:00:10.470070 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303815 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 01:00:10.470070 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303817 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 01:00:10.470070 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303820 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 01:00:10.470070 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303822 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 01:00:10.470070 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303825 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 01:00:10.470070 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303828 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 01:00:10.470070 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303831 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 01:00:10.470070 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303833 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 01:00:10.470070 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303835 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 01:00:10.470070 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303838 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 01:00:10.471095 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303841 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 01:00:10.471095 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303843 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 01:00:10.471095 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303846 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 01:00:10.471095 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303849 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 01:00:10.471095 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303851 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 01:00:10.471095 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303853 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 01:00:10.471095 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303856 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 01:00:10.471095 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303858 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 01:00:10.471095 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303861 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 01:00:10.471095 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303863 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 01:00:10.471095 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303866 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 01:00:10.471095 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303869 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 01:00:10.471095 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303871 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 01:00:10.471095 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303874 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 01:00:10.471095 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303876 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 01:00:10.471095 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.303879 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 01:00:10.471095 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.303970 2554 flags.go:64] FLAG: --address="0.0.0.0" Jul 10 01:00:10.471095 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.303982 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 10 01:00:10.471095 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.303991 2554 flags.go:64] FLAG: --anonymous-auth="true" Jul 10 01:00:10.471095 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.303998 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 10 01:00:10.471095 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304004 2554 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 10 01:00:10.472129 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304008 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 10 01:00:10.472129 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304014 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 10 01:00:10.472129 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304018 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 10 01:00:10.472129 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304022 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 10 01:00:10.472129 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304025 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 10 01:00:10.472129 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304028 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 10 01:00:10.472129 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304031 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 10 01:00:10.472129 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304035 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 10 01:00:10.472129 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304037 2554 flags.go:64] FLAG: --cgroup-root="" Jul 10 01:00:10.472129 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304040 2554 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 10 01:00:10.472129 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304043 2554 flags.go:64] FLAG: --client-ca-file="" Jul 10 01:00:10.472129 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304047 2554 flags.go:64] FLAG: --cloud-provider="external" Jul 10 01:00:10.472129 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304050 2554 flags.go:64] FLAG: --cluster-dns="[]" Jul 10 01:00:10.472129 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304055 2554 flags.go:64] FLAG: --cluster-domain="" Jul 10 01:00:10.472129 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304058 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 10 01:00:10.472129 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304061 2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 10 01:00:10.472129 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304064 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 10 01:00:10.472129 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304067 2554 flags.go:64] FLAG: --container-log-max-files="5" Jul 10 01:00:10.472129 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304071 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 10 01:00:10.472129 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304074 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 10 01:00:10.472129 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304077 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 10 01:00:10.472129 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304080 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 10 01:00:10.472129 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304083 2554 flags.go:64] FLAG: --contention-profiling="false" Jul 10 01:00:10.472129 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304087 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 10 01:00:10.473194 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304090 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 10 01:00:10.473194 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304093 2554 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 10 01:00:10.473194 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304096 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 10 01:00:10.473194 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304100 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 10 01:00:10.473194 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304105 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 10 01:00:10.473194 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304108 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 10 01:00:10.473194 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304110 2554 flags.go:64] FLAG: --enable-load-reader="false" Jul 10 01:00:10.473194 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304113 2554 flags.go:64] FLAG: --enable-server="true" Jul 10 01:00:10.473194 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304117 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 10 01:00:10.473194 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304122 2554 flags.go:64] FLAG: --event-burst="100" Jul 10 01:00:10.473194 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304125 2554 flags.go:64] FLAG: --event-qps="50" Jul 10 01:00:10.473194 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304128 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 10 01:00:10.473194 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304131 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 10 01:00:10.473194 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304134 2554 flags.go:64] FLAG: --eviction-hard="" Jul 10 01:00:10.473194 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304138 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 10 01:00:10.473194 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304141 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 10 01:00:10.473194 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304144 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 10 01:00:10.473194 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304147 2554 flags.go:64] FLAG: --eviction-soft="" Jul 10 01:00:10.473194 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304150 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 10 01:00:10.473194 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304153 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 10 01:00:10.473194 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304156 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 10 01:00:10.473194 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304159 2554 flags.go:64] FLAG: --experimental-mounter-path="" Jul 10 01:00:10.473194 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304162 2554 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 10 01:00:10.473194 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304165 2554 flags.go:64] FLAG: --fail-swap-on="true" Jul 10 01:00:10.473194 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304168 2554 flags.go:64] FLAG: --feature-gates="" Jul 10 01:00:10.474226 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304171 2554 flags.go:64] FLAG: --file-check-frequency="20s" Jul 10 01:00:10.474226 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304174 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 10 01:00:10.474226 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304178 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 10 01:00:10.474226 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304181 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 10 01:00:10.474226 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304184 2554 flags.go:64] FLAG: --healthz-port="10248" Jul 10 01:00:10.474226 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304187 2554 flags.go:64] FLAG: --help="false" Jul 10 01:00:10.474226 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304189 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-138-251.ec2.internal" Jul 10 01:00:10.474226 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304192 2554 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 10 01:00:10.474226 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304195 2554 flags.go:64] FLAG: --http-check-frequency="20s" Jul 10 01:00:10.474226 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304198 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 10 01:00:10.474226 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304201 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 10 01:00:10.474226 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304206 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 10 01:00:10.474226 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304209 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 10 01:00:10.474226 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304212 2554 flags.go:64] FLAG: --image-service-endpoint="" Jul 10 01:00:10.474226 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304215 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 10 01:00:10.474226 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304218 2554 flags.go:64] FLAG: --kube-api-burst="100" Jul 10 01:00:10.474226 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304222 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 10 01:00:10.474226 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304225 2554 flags.go:64] FLAG: --kube-api-qps="50" Jul 10 01:00:10.474226 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304228 2554 flags.go:64] FLAG: --kube-reserved="" Jul 10 01:00:10.474226 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304231 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 10 01:00:10.474226 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304234 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 10 01:00:10.474226 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304237 2554 flags.go:64] FLAG: --kubelet-cgroups="" Jul 10 01:00:10.474226 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304240 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 10 01:00:10.474226 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304243 2554 flags.go:64] FLAG: --lock-file="" Jul 10 01:00:10.475231 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304245 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 10 01:00:10.475231 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304248 2554 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 10 01:00:10.475231 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304251 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 10 01:00:10.475231 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304256 2554 flags.go:64] FLAG: --log-json-split-stream="false" Jul 10 01:00:10.475231 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304259 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 10 01:00:10.475231 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304262 2554 flags.go:64] FLAG: --log-text-split-stream="false" Jul 10 01:00:10.475231 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304265 2554 flags.go:64] FLAG: --logging-format="text" Jul 10 01:00:10.475231 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304268 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 10 01:00:10.475231 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304271 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 10 01:00:10.475231 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304274 2554 flags.go:64] FLAG: --manifest-url="" Jul 10 01:00:10.475231 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304277 2554 flags.go:64] FLAG: --manifest-url-header="" Jul 10 01:00:10.475231 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304281 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 10 01:00:10.475231 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304284 2554 flags.go:64] FLAG: --max-open-files="1000000" Jul 10 01:00:10.475231 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304288 2554 flags.go:64] FLAG: --max-pods="110" Jul 10 01:00:10.475231 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304291 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 10 01:00:10.475231 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304294 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 10 01:00:10.475231 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304296 2554 flags.go:64] FLAG: --memory-manager-policy="None" Jul 10 01:00:10.475231 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304299 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 10 01:00:10.475231 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304302 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 10 01:00:10.475231 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304306 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 10 01:00:10.475231 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304309 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 10 01:00:10.475231 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304316 2554 flags.go:64] FLAG: --node-status-max-images="50" Jul 10 01:00:10.475231 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304319 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 10 01:00:10.475231 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304323 2554 flags.go:64] FLAG: --oom-score-adj="-999" Jul 10 01:00:10.475231 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304327 2554 flags.go:64] FLAG: --pod-cidr="" Jul 10 01:00:10.476161 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304330 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 10 01:00:10.476161 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304336 2554 flags.go:64] FLAG: --pod-manifest-path="" Jul 10 01:00:10.476161 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304339 2554 flags.go:64] FLAG: --pod-max-pids="-1" Jul 10 01:00:10.476161 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304342 2554 flags.go:64] FLAG: --pods-per-core="0" Jul 10 01:00:10.476161 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304345 2554 flags.go:64] FLAG: --port="10250" Jul 10 01:00:10.476161 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304348 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 10 01:00:10.476161 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304351 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02cccc93aba0838b5" Jul 10 01:00:10.476161 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304355 2554 flags.go:64] FLAG: --qos-reserved="" Jul 10 01:00:10.476161 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304357 2554 flags.go:64] FLAG: --read-only-port="10255" Jul 10 01:00:10.476161 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304360 2554 flags.go:64] FLAG: --register-node="true" Jul 10 01:00:10.476161 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304363 2554 flags.go:64] FLAG: --register-with-taints="" Jul 10 01:00:10.476161 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304367 2554 flags.go:64] FLAG: --registry-burst="10" Jul 10 01:00:10.476161 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304370 2554 flags.go:64] FLAG: --registry-qps="5" Jul 10 01:00:10.476161 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304373 2554 flags.go:64] FLAG: --reserved-cpus="" Jul 10 01:00:10.476161 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304376 2554 flags.go:64] FLAG: --reserved-memory="" Jul 10 01:00:10.476161 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304379 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 10 01:00:10.476161 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304382 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 10 01:00:10.476161 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304385 2554 flags.go:64] FLAG: --rotate-certificates="false" Jul 10 01:00:10.476161 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304388 2554 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 10 01:00:10.476161 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304391 2554 flags.go:64] FLAG: --runonce="false" Jul 10 01:00:10.476161 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304393 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 10 01:00:10.476161 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304396 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 10 01:00:10.476161 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304399 2554 flags.go:64] FLAG: --seccomp-default="false" Jul 10 01:00:10.476161 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304402 2554 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 10 01:00:10.476161 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304405 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 10 01:00:10.477187 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304408 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 10 01:00:10.477187 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304414 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 10 01:00:10.477187 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304417 2554 flags.go:64] FLAG: --storage-driver-password="root" Jul 10 01:00:10.477187 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304420 2554 flags.go:64] FLAG: --storage-driver-secure="false" Jul 10 01:00:10.477187 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304423 2554 flags.go:64] FLAG: --storage-driver-table="stats" Jul 10 01:00:10.477187 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304425 2554 flags.go:64] FLAG: --storage-driver-user="root" Jul 10 01:00:10.477187 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304428 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 10 01:00:10.477187 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304432 2554 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 10 01:00:10.477187 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304435 2554 flags.go:64] FLAG: --system-cgroups="" Jul 10 01:00:10.477187 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304438 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 10 01:00:10.477187 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304443 2554 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 10 01:00:10.477187 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304446 2554 flags.go:64] FLAG: --tls-cert-file="" Jul 10 01:00:10.477187 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304448 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 10 01:00:10.477187 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304453 2554 flags.go:64] FLAG: --tls-min-version="" Jul 10 01:00:10.477187 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304456 2554 flags.go:64] FLAG: --tls-private-key-file="" Jul 10 01:00:10.477187 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304459 2554 flags.go:64] FLAG: --topology-manager-policy="none" Jul 10 01:00:10.477187 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304462 2554 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 10 01:00:10.477187 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304465 2554 flags.go:64] FLAG: --topology-manager-scope="container" Jul 10 01:00:10.477187 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304468 2554 flags.go:64] FLAG: --v="2" Jul 10 01:00:10.477187 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304472 2554 flags.go:64] FLAG: --version="false" Jul 10 01:00:10.477187 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304476 2554 flags.go:64] FLAG: --vmodule="" Jul 10 01:00:10.477187 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304480 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 10 01:00:10.477187 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.304483 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 10 01:00:10.477187 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304603 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 01:00:10.477187 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304607 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 01:00:10.478330 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304610 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 01:00:10.478330 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304613 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 01:00:10.478330 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304615 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 01:00:10.478330 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304618 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 01:00:10.478330 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304621 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 01:00:10.478330 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304623 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 01:00:10.478330 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304626 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 01:00:10.478330 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304629 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 01:00:10.478330 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304633 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 01:00:10.478330 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304637 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 01:00:10.478330 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304641 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 01:00:10.478330 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304644 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 01:00:10.478330 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304647 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 01:00:10.478330 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304650 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 01:00:10.478330 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304655 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 01:00:10.478330 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304659 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 01:00:10.478330 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304662 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 01:00:10.478330 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304664 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 01:00:10.478330 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304667 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 01:00:10.479291 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304670 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 01:00:10.479291 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304673 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 01:00:10.479291 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304675 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 01:00:10.479291 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304678 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 01:00:10.479291 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304681 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 01:00:10.479291 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304684 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 01:00:10.479291 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304686 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 10 01:00:10.479291 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304689 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 01:00:10.479291 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304692 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 01:00:10.479291 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304694 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 01:00:10.479291 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304697 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 01:00:10.479291 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304700 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 01:00:10.479291 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304702 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 01:00:10.479291 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304705 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 01:00:10.479291 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304708 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 01:00:10.479291 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304711 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 01:00:10.479291 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304713 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 01:00:10.479291 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304716 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 01:00:10.479291 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304719 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 01:00:10.479291 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304721 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 01:00:10.480176 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304724 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 01:00:10.480176 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304727 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 01:00:10.480176 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304730 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 01:00:10.480176 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304732 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 01:00:10.480176 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304735 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 01:00:10.480176 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304737 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 01:00:10.480176 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304740 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 01:00:10.480176 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304744 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 01:00:10.480176 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304747 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 01:00:10.480176 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304749 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 01:00:10.480176 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304752 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 01:00:10.480176 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304754 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 01:00:10.480176 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304757 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 01:00:10.480176 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304759 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 01:00:10.480176 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304762 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 01:00:10.480176 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304765 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 01:00:10.480176 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304767 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 01:00:10.480176 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304770 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 01:00:10.480176 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304772 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 01:00:10.480176 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304775 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 01:00:10.481165 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304777 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 01:00:10.481165 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304780 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 01:00:10.481165 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304783 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 01:00:10.481165 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304785 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 01:00:10.481165 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304788 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 01:00:10.481165 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304790 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 01:00:10.481165 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304793 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 01:00:10.481165 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304795 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 01:00:10.481165 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304798 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 01:00:10.481165 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304801 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 01:00:10.481165 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304803 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 01:00:10.481165 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304806 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 01:00:10.481165 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304808 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 01:00:10.481165 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304812 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 01:00:10.481165 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304815 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 01:00:10.481165 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304817 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 01:00:10.481165 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304820 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 01:00:10.481165 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304822 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 01:00:10.481165 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304825 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 01:00:10.481165 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304828 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 01:00:10.482112 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304831 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 01:00:10.482112 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304833 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 01:00:10.482112 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304836 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 01:00:10.482112 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304838 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 01:00:10.482112 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304841 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 01:00:10.482112 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304845 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 01:00:10.482112 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304849 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 01:00:10.482112 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304852 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 01:00:10.482112 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304855 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 01:00:10.482112 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304858 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 01:00:10.482112 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304861 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 01:00:10.482112 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304864 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 01:00:10.482112 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304867 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 01:00:10.482112 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304870 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 01:00:10.482112 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304873 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 01:00:10.482112 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304876 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 01:00:10.482112 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304878 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 01:00:10.482112 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.304881 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 01:00:10.482969 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.305820 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 01:00:10.482969 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.313557 2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 10 01:00:10.482969 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.313583 2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 10 01:00:10.482969 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.313606 2554 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 10 01:00:10.482969 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.313612 2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 10 01:00:10.482969 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313682 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 01:00:10.482969 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313689 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 01:00:10.482969 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313693 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 01:00:10.482969 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313701 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 01:00:10.482969 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313706 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 01:00:10.482969 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313711 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 01:00:10.482969 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313715 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 01:00:10.482969 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313718 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 01:00:10.482969 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313721 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 01:00:10.561369 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313725 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 01:00:10.561369 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313727 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 01:00:10.561369 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313730 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 01:00:10.561369 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313733 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 01:00:10.561369 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313735 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 01:00:10.561369 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313738 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 01:00:10.561369 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313740 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 01:00:10.561369 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313745 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 01:00:10.561369 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313749 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 01:00:10.561369 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313752 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 01:00:10.561369 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313755 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 01:00:10.561369 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313758 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 01:00:10.561369 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313760 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 01:00:10.561369 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313763 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 01:00:10.561369 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313765 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 01:00:10.561369 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313767 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 01:00:10.561369 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313770 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 01:00:10.561369 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313772 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 01:00:10.561369 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313775 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 01:00:10.586260 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313779 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 01:00:10.586260 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313798 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 01:00:10.586260 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313803 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 01:00:10.586260 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313805 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 01:00:10.586260 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313808 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 01:00:10.586260 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313811 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 01:00:10.586260 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313815 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 01:00:10.586260 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313821 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 01:00:10.586260 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313825 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 01:00:10.586260 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313828 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 01:00:10.586260 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313831 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 01:00:10.586260 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313834 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 01:00:10.586260 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313837 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 01:00:10.586260 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313839 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 01:00:10.586260 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313842 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 01:00:10.586260 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313845 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 01:00:10.586260 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313847 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 01:00:10.586260 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313851 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 01:00:10.586260 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313853 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 01:00:10.593518 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313856 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 01:00:10.593518 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313860 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 01:00:10.593518 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313864 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 01:00:10.593518 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313869 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 01:00:10.593518 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313873 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 01:00:10.593518 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313877 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 01:00:10.593518 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313880 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 01:00:10.593518 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313882 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 01:00:10.593518 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313885 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 01:00:10.593518 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313887 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 01:00:10.593518 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313905 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 01:00:10.593518 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313908 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 01:00:10.593518 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313911 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 01:00:10.593518 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313914 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 01:00:10.593518 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313917 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 01:00:10.593518 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313926 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 01:00:10.593518 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313929 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 01:00:10.593518 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313931 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 01:00:10.593518 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313934 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 01:00:10.594365 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313937 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 01:00:10.594365 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313942 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 01:00:10.594365 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313946 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 01:00:10.594365 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313951 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 01:00:10.594365 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313955 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 01:00:10.594365 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313959 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 01:00:10.594365 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313962 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 01:00:10.594365 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313965 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 01:00:10.594365 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313968 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 01:00:10.594365 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313970 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 01:00:10.594365 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313974 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 01:00:10.594365 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313977 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 01:00:10.594365 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313980 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 01:00:10.594365 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313982 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 01:00:10.594365 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313985 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 01:00:10.594365 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313988 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 01:00:10.594365 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313990 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 01:00:10.594365 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313993 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 01:00:10.594365 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313996 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 01:00:10.594365 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.313998 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 01:00:10.595016 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314000 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 01:00:10.595016 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314003 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 01:00:10.595016 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314006 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 01:00:10.595016 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314008 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 01:00:10.595016 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314011 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 01:00:10.595016 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314014 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 01:00:10.595016 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314016 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 01:00:10.595016 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314019 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 10 01:00:10.595016 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314023 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 01:00:10.595016 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314038 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 01:00:10.595016 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314042 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 01:00:10.595016 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314045 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 01:00:10.595016 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314047 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 01:00:10.595016 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.314055 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 01:00:10.595016 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314231 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 01:00:10.595655 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314236 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 01:00:10.595655 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314240 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 01:00:10.595655 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314243 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 01:00:10.595655 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314246 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 01:00:10.595655 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314249 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 01:00:10.595655 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314251 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 01:00:10.595655 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314254 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 01:00:10.595655 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314257 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 01:00:10.595655 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314262 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 01:00:10.595655 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314266 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 01:00:10.595655 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314271 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 01:00:10.595655 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314276 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 01:00:10.595655 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314280 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 01:00:10.595655 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314283 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 01:00:10.595655 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314286 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 01:00:10.595655 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314289 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 01:00:10.595655 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314291 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 01:00:10.595655 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314295 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 01:00:10.595655 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314299 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 01:00:10.596238 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314302 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 01:00:10.596238 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314305 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 01:00:10.596238 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314308 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 01:00:10.596238 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314311 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 01:00:10.596238 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314313 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 01:00:10.596238 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314316 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 01:00:10.596238 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314319 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 01:00:10.596238 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314321 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 01:00:10.596238 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314332 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 01:00:10.596238 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314335 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 01:00:10.596238 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314338 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 01:00:10.596238 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314344 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 01:00:10.596238 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314349 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 01:00:10.596238 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314353 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 01:00:10.596238 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314357 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 01:00:10.596238 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314362 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 01:00:10.596238 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314365 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 01:00:10.596238 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314367 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 01:00:10.596238 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314370 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 01:00:10.596238 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314372 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 01:00:10.596860 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314375 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 01:00:10.596860 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314379 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 01:00:10.596860 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314381 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 01:00:10.596860 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314384 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 01:00:10.596860 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314386 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 01:00:10.596860 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314389 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 01:00:10.596860 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314391 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 01:00:10.596860 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314394 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 01:00:10.596860 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314397 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 01:00:10.596860 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314399 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 01:00:10.596860 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314402 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 01:00:10.596860 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314404 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 01:00:10.596860 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314407 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 01:00:10.596860 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314410 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 01:00:10.596860 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314412 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 01:00:10.596860 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314415 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 01:00:10.596860 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314417 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 01:00:10.596860 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314420 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 01:00:10.596860 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314423 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 01:00:10.596860 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314431 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 01:00:10.597446 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314436 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 01:00:10.597446 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314447 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 01:00:10.597446 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314450 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 01:00:10.597446 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314454 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 01:00:10.597446 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314457 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 01:00:10.597446 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314460 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 01:00:10.597446 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314463 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 01:00:10.597446 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314465 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 01:00:10.597446 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314468 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 01:00:10.597446 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314471 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 01:00:10.597446 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314473 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 01:00:10.597446 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314476 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 01:00:10.597446 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314479 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 01:00:10.597446 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314483 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 01:00:10.597446 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314486 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 01:00:10.597446 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314489 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 01:00:10.597446 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314492 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 01:00:10.597446 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314495 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 01:00:10.597446 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314497 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 01:00:10.597446 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314501 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 01:00:10.598087 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314505 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 01:00:10.598087 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314509 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 01:00:10.598087 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314513 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 01:00:10.598087 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314517 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 01:00:10.598087 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314520 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 01:00:10.598087 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314523 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 01:00:10.598087 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314526 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 01:00:10.598087 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314528 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 01:00:10.598087 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314531 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 01:00:10.598087 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314533 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 01:00:10.598087 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314536 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 01:00:10.598087 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314538 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 01:00:10.598087 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314541 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 01:00:10.598087 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314544 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 10 01:00:10.598087 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314552 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 01:00:10.598087 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314557 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 01:00:10.598087 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314560 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 01:00:10.598087 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314562 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 01:00:10.598087 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:10.314564 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 01:00:10.598608 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.314570 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 01:00:10.598608 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.314731 2554 server.go:962] "Client rotation is on, will bootstrap in background" Jul 10 01:00:10.598608 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.317433 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 10 01:00:10.598608 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.319217 2554 server.go:1019] "Starting client certificate rotation" Jul 10 01:00:10.598608 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.319322 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 01:00:10.598608 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.319367 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 01:00:10.598608 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.322246 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 01:00:10.598608 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.329541 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 01:00:10.598608 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.340366 2554 log.go:25] "Validated CRI v1 runtime API" Jul 10 01:00:10.598608 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.343034 2554 log.go:25] "Validated CRI v1 image API" Jul 10 01:00:10.598608 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.343981 2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 10 01:00:10.598608 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.348448 2554 fs.go:135] Filesystem UUIDs: map[185b6d45-7a31-409f-ad82-a2378fa91439:/dev/nvme0n1p4 6f2f136d-3578-4412-b477-7f7f9be0e743:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 10 01:00:10.599026 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.348465 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 10 01:00:10.599026 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.351486 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 01:00:10.599225 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.353097 2554 manager.go:216] Machine: {Timestamp:2026-07-10 01:00:10.352571504 +0000 UTC m=+0.379381033 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099700 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fbc813f3075b3e4f99b42140573c2 SystemUUID:ec2fbc81-3f30-75b3-e4f9-9b42140573c2 BootID:a5c5d778-1ce5-4443-b713-374382560379 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:22:e5:26:1c:e5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:22:e5:26:1c:e5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:c9:a8:82:0a:1f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 10 01:00:10.599225 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.353217 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 10 01:00:10.599225 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.353306 2554 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 10 01:00:10.599225 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.356136 2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 10 01:00:10.599225 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.356171 2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-251.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 10 01:00:10.599225 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.357060 2554 topology_manager.go:138] "Creating topology manager with none policy" Jul 10 01:00:10.599225 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.357071 2554 container_manager_linux.go:309] "Creating device plugin manager" Jul 10 01:00:10.599225 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.357084 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 01:00:10.599225 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.357980 2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 01:00:10.599225 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.369492 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cnwm8" Jul 10 01:00:10.599225 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.377488 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cnwm8" Jul 10 01:00:10.599225 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.420166 2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 10 01:00:10.599225 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.427079 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 10 01:00:10.599225 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.427227 2554 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 10 01:00:10.599225 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.427259 2554 kubelet.go:486] "Attempting to sync node with API server" Jul 10 01:00:10.599225 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.427269 2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 10 01:00:10.599225 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.427284 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.427297 2554 kubelet.go:398] "Adding apiserver pod source" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.427308 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.427751 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.427767 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.430412 2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.433361 2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.433390 2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.433551 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.433568 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.433577 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.433583 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.433591 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.433597 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.434225 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.434232 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.434241 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.434246 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.434255 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.434263 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.435838 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.435847 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.450817 2554 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-251.ec2.internal" not found Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.451008 2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.451327 2554 server.go:1268] "Started kubelet" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.451485 2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.451511 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.451634 2554 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.455921 2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.456587 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.456948 2554 server.go:310] "Adding debug handlers to kubelet server" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.468415 2554 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-251.ec2.internal" not found Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.469113 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.469120 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:10.469398 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-251.ec2.internal\" not found" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.470237 2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.470237 2554 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.470260 2554 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.470370 2554 reconstruct.go:97] "Volume reconstruction finished" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.470380 2554 reconciler.go:29] "Reconciler: start to sync state" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.471558 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:10.474078 2554 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-251.ec2.internal\" not found" node="ip-10-0-138-251.ec2.internal" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.474246 2554 factory.go:153] Registering CRI-O factory Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.474260 2554 factory.go:223] Registration of the crio container factory successfully Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.474313 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.474322 2554 factory.go:55] Registering systemd factory Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.474330 2554 factory.go:223] Registration of the systemd container factory successfully Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.474357 2554 factory.go:103] Registering Raw factory Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.474368 2554 manager.go:1196] Started watching for new ooms in manager Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.475014 2554 manager.go:349] Starting recovery of all containers Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.484147 2554 manager.go:354] Recovery completed Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.495251 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.497987 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientMemory" Jul 10 01:00:10.599762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.498015 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.498027 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientPID" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.498561 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.498575 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.498572 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.498637 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.499381 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientMemory" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.499412 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.499427 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientPID" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.500967 2554 policy_none.go:49] "None policy: Start" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.500984 2554 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.500997 2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.503062 2554 policy_none.go:47] "Start" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.527396 2554 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-251.ec2.internal" not found Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:10.570118 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-251.ec2.internal\" not found" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.577745 2554 manager.go:337] "Starting Device Plugin manager" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:10.577777 2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.577789 2554 server.go:87] "Starting device plugin registration server" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.578079 2554 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.578091 2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.578180 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.578265 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.578273 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:10.578749 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:10.578801 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-251.ec2.internal\" not found" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.585292 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.588681 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.588740 2554 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.588770 2554 kubelet.go:2448] "Starting kubelet main sync loop" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:10.588817 2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 10 01:00:10.601210 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.591384 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 01:00:10.705362 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.678614 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 01:00:10.705362 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.680498 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientMemory" Jul 10 01:00:10.705362 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.680530 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 01:00:10.705362 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.680544 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientPID" Jul 10 01:00:10.705362 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.680572 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-251.ec2.internal" Jul 10 01:00:10.705362 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.688821 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-251.ec2.internal" Jul 10 01:00:10.705362 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:10.688848 2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-251.ec2.internal\": node \"ip-10-0-138-251.ec2.internal\" not found" Jul 10 01:00:10.705362 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.690905 2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal"] Jul 10 01:00:10.705362 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.693482 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" Jul 10 01:00:10.705362 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.695694 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal" Jul 10 01:00:12.269603 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.732945 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" Jul 10 01:00:12.269603 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.738197 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal" Jul 10 01:00:12.269603 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.745029 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 01:00:12.269603 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.748419 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 01:00:12.269603 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.770563 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" Jul 10 01:00:12.269603 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.771686 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b3fdd7178350c5e8b9bc8be304d81a3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal\" (UID: \"1b3fdd7178350c5e8b9bc8be304d81a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" Jul 10 01:00:12.269603 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.771713 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c24d6c8d9b99ab2f60ec24f7270257cc-config\") pod \"kube-apiserver-proxy-ip-10-0-138-251.ec2.internal\" (UID: \"c24d6c8d9b99ab2f60ec24f7270257cc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal" Jul 10 01:00:12.269603 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.771728 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1b3fdd7178350c5e8b9bc8be304d81a3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal\" (UID: \"1b3fdd7178350c5e8b9bc8be304d81a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" Jul 10 01:00:12.269603 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.789709 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 01:00:12.269603 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:10.789760 2554 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" Jul 10 01:00:12.269603 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.789773 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal" Jul 10 01:00:12.269603 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:10.809686 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 01:00:12.269603 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:10.809727 2554 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-138-251.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal" Jul 10 01:00:12.443559 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.307260 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1b3fdd7178350c5e8b9bc8be304d81a3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal\" (UID: \"1b3fdd7178350c5e8b9bc8be304d81a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" Jul 10 01:00:12.443559 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.307319 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b3fdd7178350c5e8b9bc8be304d81a3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal\" (UID: \"1b3fdd7178350c5e8b9bc8be304d81a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" Jul 10 01:00:12.443559 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.307304 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1b3fdd7178350c5e8b9bc8be304d81a3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal\" (UID: \"1b3fdd7178350c5e8b9bc8be304d81a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" Jul 10 01:00:12.443559 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.307342 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c24d6c8d9b99ab2f60ec24f7270257cc-config\") pod \"kube-apiserver-proxy-ip-10-0-138-251.ec2.internal\" (UID: \"c24d6c8d9b99ab2f60ec24f7270257cc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal" Jul 10 01:00:12.443559 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.307373 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c24d6c8d9b99ab2f60ec24f7270257cc-config\") pod \"kube-apiserver-proxy-ip-10-0-138-251.ec2.internal\" (UID: \"c24d6c8d9b99ab2f60ec24f7270257cc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal" Jul 10 01:00:12.443559 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.307412 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b3fdd7178350c5e8b9bc8be304d81a3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal\" (UID: \"1b3fdd7178350c5e8b9bc8be304d81a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" Jul 10 01:00:12.616546 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.490091 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal" Jul 10 01:00:12.616546 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.490158 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" Jul 10 01:00:12.776687 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.753539 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 10 01:00:12.776687 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.753721 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 01:00:12.776687 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.753720 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 01:00:12.776687 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.753735 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.861735 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 00:55:11 +0000 UTC" deadline="2028-03-29 01:11:18.244895466 +0000 UTC" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.861790 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15072h11m5.383119484s" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.862811 2554 apiserver.go:52] "Watching apiserver" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.871270 2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.871672 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-29q6p","openshift-multus/network-metrics-daemon-qx5ln","openshift-network-operator/iptables-alerter-9wsgb","openshift-ovn-kubernetes/ovnkube-node-dsbgv","kube-system/global-pull-secret-syncer-4d5dw","kube-system/konnectivity-agent-pvtp7","kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b","openshift-cluster-node-tuning-operator/tuned-kwwcc","openshift-dns/node-resolver-tc8jw","openshift-multus/multus-additional-cni-plugins-5c4qd","openshift-network-diagnostics/network-check-target-9d9h6","openshift-image-registry/node-ca-thhvj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal"] Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.874399 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-29q6p" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.876584 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:12.876661 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx5ln" podUID="e76bc68e-d074-4131-8788-bfb781cc785a" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.877273 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.877284 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4q2mf\"" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.877336 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.877604 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.877661 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.879058 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9wsgb" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.881659 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.881723 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.881833 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qwqqc\"" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.881882 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.882062 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.884413 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:12.884478 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4d5dw" podUID="98691035-8cf9-4daf-b08b-702da9077a5c" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.884672 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.885755 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.885833 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.885839 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.885869 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2mp9k\"" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.885910 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.885846 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.886502 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pvtp7" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.888751 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b" Jul 10 01:00:12.939577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.889527 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.889692 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bvvhr\"" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.889743 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.890982 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.891541 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zgw7f\"" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.891584 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.891701 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.891543 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.893761 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.893945 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.893980 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pjnd5\"" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.894162 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tc8jw" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.896051 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5c4qd" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.896681 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-768ft\"" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.896815 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.896824 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.897716 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:12.897773 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9h6" podUID="2d15903f-0aa6-41f8-9a4e-ad47872ddd19" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.898423 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.898473 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-57mcq\"" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.898667 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.899601 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-thhvj" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.901945 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4bgrl\"" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.902066 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.902182 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.902188 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.904539 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.906694 2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.912861 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-etc-systemd\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.912884 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-multus-socket-dir-parent\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.912902 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83331c74-4d85-4282-aade-d6063bc7dd7c-host-slash\") pod \"iptables-alerter-9wsgb\" (UID: \"83331c74-4d85-4282-aade-d6063bc7dd7c\") " pod="openshift-network-operator/iptables-alerter-9wsgb" Jul 10 01:00:12.940996 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.912924 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxvj8\" (UniqueName: \"kubernetes.io/projected/be8fc9c0-d919-4435-bc77-ddd249ad1a3c-kube-api-access-qxvj8\") pod \"node-ca-thhvj\" (UID: \"be8fc9c0-d919-4435-bc77-ddd249ad1a3c\") " pod="openshift-image-registry/node-ca-thhvj" Jul 10 01:00:12.942012 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.912959 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs\") pod \"network-metrics-daemon-qx5ln\" (UID: \"e76bc68e-d074-4131-8788-bfb781cc785a\") " pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:12.942012 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.912979 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-host-kubelet\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:12.942012 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913019 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/38689ba6-fbae-4092-b63e-3488ce589912-ovnkube-config\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:12.942012 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913046 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98691035-8cf9-4daf-b08b-702da9077a5c-original-pull-secret\") pod \"global-pull-secret-syncer-4d5dw\" (UID: \"98691035-8cf9-4daf-b08b-702da9077a5c\") " pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:12.942012 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913125 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/29befb9d-1e91-493a-bbbd-8ec09e788e39-device-dir\") pod \"aws-ebs-csi-driver-node-wvq2b\" (UID: \"29befb9d-1e91-493a-bbbd-8ec09e788e39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b" Jul 10 01:00:12.942012 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913167 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhqgn\" (UniqueName: \"kubernetes.io/projected/e76bc68e-d074-4131-8788-bfb781cc785a-kube-api-access-vhqgn\") pod \"network-metrics-daemon-qx5ln\" (UID: \"e76bc68e-d074-4131-8788-bfb781cc785a\") " pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:12.942012 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913192 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-etc-openvswitch\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:12.942012 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913215 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-run-openvswitch\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:12.942012 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913250 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-run-ovn\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:12.942012 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913265 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/98691035-8cf9-4daf-b08b-702da9077a5c-dbus\") pod \"global-pull-secret-syncer-4d5dw\" (UID: \"98691035-8cf9-4daf-b08b-702da9077a5c\") " pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:12.942012 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913279 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-multus-cni-dir\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:12.942012 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913293 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-cnibin\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:12.942012 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913324 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/975dd67f-4a1f-42b9-88b0-8270b032f818-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5c4qd\" (UID: \"975dd67f-4a1f-42b9-88b0-8270b032f818\") " pod="openshift-multus/multus-additional-cni-plugins-5c4qd" Jul 10 01:00:12.942012 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913362 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-cni-binary-copy\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:12.942012 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913409 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-host-run-ovn-kubernetes\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:12.942012 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913440 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-host-cni-bin\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:12.942652 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913467 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/38689ba6-fbae-4092-b63e-3488ce589912-ovnkube-script-lib\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:12.942652 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913491 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-etc-sysctl-d\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:12.942652 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913516 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4tmn\" (UniqueName: \"kubernetes.io/projected/2d15903f-0aa6-41f8-9a4e-ad47872ddd19-kube-api-access-n4tmn\") pod \"network-check-target-9d9h6\" (UID: \"2d15903f-0aa6-41f8-9a4e-ad47872ddd19\") " pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:00:12.942652 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913539 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-hostroot\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:12.942652 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913576 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/83331c74-4d85-4282-aade-d6063bc7dd7c-iptables-alerter-script\") pod \"iptables-alerter-9wsgb\" (UID: \"83331c74-4d85-4282-aade-d6063bc7dd7c\") " pod="openshift-network-operator/iptables-alerter-9wsgb" Jul 10 01:00:12.942652 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913619 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-log-socket\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:12.942652 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913642 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:12.942652 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913684 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-etc-sysconfig\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:12.942652 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913708 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-run\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:12.942652 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913725 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/76247a4f-c780-4a08-bda6-8e8fc84d6f72-agent-certs\") pod \"konnectivity-agent-pvtp7\" (UID: \"76247a4f-c780-4a08-bda6-8e8fc84d6f72\") " pod="kube-system/konnectivity-agent-pvtp7" Jul 10 01:00:12.942652 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913747 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/76247a4f-c780-4a08-bda6-8e8fc84d6f72-konnectivity-ca\") pod \"konnectivity-agent-pvtp7\" (UID: \"76247a4f-c780-4a08-bda6-8e8fc84d6f72\") " pod="kube-system/konnectivity-agent-pvtp7" Jul 10 01:00:12.942652 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913780 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/29befb9d-1e91-493a-bbbd-8ec09e788e39-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wvq2b\" (UID: \"29befb9d-1e91-493a-bbbd-8ec09e788e39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b" Jul 10 01:00:12.942652 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913809 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-host-slash\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:12.942652 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913831 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-var-lib-openvswitch\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:12.942652 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913879 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/98691035-8cf9-4daf-b08b-702da9077a5c-kubelet-config\") pod \"global-pull-secret-syncer-4d5dw\" (UID: \"98691035-8cf9-4daf-b08b-702da9077a5c\") " pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:12.942652 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913915 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-host-run-k8s-cni-cncf-io\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:12.943736 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913940 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-host-run-netns\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:12.943736 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.913982 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/09043fd5-e2a5-493e-82b8-f0ac9fa1f99b-hosts-file\") pod \"node-resolver-tc8jw\" (UID: \"09043fd5-e2a5-493e-82b8-f0ac9fa1f99b\") " pod="openshift-dns/node-resolver-tc8jw" Jul 10 01:00:12.943736 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914007 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09043fd5-e2a5-493e-82b8-f0ac9fa1f99b-tmp-dir\") pod \"node-resolver-tc8jw\" (UID: \"09043fd5-e2a5-493e-82b8-f0ac9fa1f99b\") " pod="openshift-dns/node-resolver-tc8jw" Jul 10 01:00:12.943736 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914024 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-host-run-netns\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:12.943736 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914038 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-lib-modules\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:12.943736 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914054 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-host-var-lib-kubelet\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:12.943736 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914074 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/29befb9d-1e91-493a-bbbd-8ec09e788e39-sys-fs\") pod \"aws-ebs-csi-driver-node-wvq2b\" (UID: \"29befb9d-1e91-493a-bbbd-8ec09e788e39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b" Jul 10 01:00:12.943736 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914089 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/975dd67f-4a1f-42b9-88b0-8270b032f818-os-release\") pod \"multus-additional-cni-plugins-5c4qd\" (UID: \"975dd67f-4a1f-42b9-88b0-8270b032f818\") " pod="openshift-multus/multus-additional-cni-plugins-5c4qd" Jul 10 01:00:12.943736 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914128 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x75g\" (UniqueName: \"kubernetes.io/projected/975dd67f-4a1f-42b9-88b0-8270b032f818-kube-api-access-9x75g\") pod \"multus-additional-cni-plugins-5c4qd\" (UID: \"975dd67f-4a1f-42b9-88b0-8270b032f818\") " pod="openshift-multus/multus-additional-cni-plugins-5c4qd" Jul 10 01:00:12.943736 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914171 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be8fc9c0-d919-4435-bc77-ddd249ad1a3c-serviceca\") pod \"node-ca-thhvj\" (UID: \"be8fc9c0-d919-4435-bc77-ddd249ad1a3c\") " pod="openshift-image-registry/node-ca-thhvj" Jul 10 01:00:12.943736 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914189 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-run-systemd\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:12.943736 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914207 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-node-log\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:12.943736 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914250 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/67aec133-13cb-4b4d-9dc0-f858fc60410a-etc-tuned\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:12.943736 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914266 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-multus-daemon-config\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:12.943736 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914280 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-host-run-multus-certs\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:12.943736 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914314 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp9pn\" (UniqueName: \"kubernetes.io/projected/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-kube-api-access-hp9pn\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:12.944243 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914380 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdlpj\" (UniqueName: \"kubernetes.io/projected/29befb9d-1e91-493a-bbbd-8ec09e788e39-kube-api-access-rdlpj\") pod \"aws-ebs-csi-driver-node-wvq2b\" (UID: \"29befb9d-1e91-493a-bbbd-8ec09e788e39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b" Jul 10 01:00:12.944243 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914410 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/38689ba6-fbae-4092-b63e-3488ce589912-ovn-node-metrics-cert\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:12.944243 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914442 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-host\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:12.944243 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914470 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/975dd67f-4a1f-42b9-88b0-8270b032f818-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5c4qd\" (UID: \"975dd67f-4a1f-42b9-88b0-8270b032f818\") " pod="openshift-multus/multus-additional-cni-plugins-5c4qd" Jul 10 01:00:12.944243 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914486 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/975dd67f-4a1f-42b9-88b0-8270b032f818-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5c4qd\" (UID: \"975dd67f-4a1f-42b9-88b0-8270b032f818\") " pod="openshift-multus/multus-additional-cni-plugins-5c4qd" Jul 10 01:00:12.944243 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914503 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be8fc9c0-d919-4435-bc77-ddd249ad1a3c-host\") pod \"node-ca-thhvj\" (UID: \"be8fc9c0-d919-4435-bc77-ddd249ad1a3c\") " pod="openshift-image-registry/node-ca-thhvj" Jul 10 01:00:12.944243 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914545 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-host-var-lib-cni-bin\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:12.944243 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914581 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwrgh\" (UniqueName: \"kubernetes.io/projected/83331c74-4d85-4282-aade-d6063bc7dd7c-kube-api-access-dwrgh\") pod \"iptables-alerter-9wsgb\" (UID: \"83331c74-4d85-4282-aade-d6063bc7dd7c\") " pod="openshift-network-operator/iptables-alerter-9wsgb" Jul 10 01:00:12.944243 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914605 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/975dd67f-4a1f-42b9-88b0-8270b032f818-system-cni-dir\") pod \"multus-additional-cni-plugins-5c4qd\" (UID: \"975dd67f-4a1f-42b9-88b0-8270b032f818\") " pod="openshift-multus/multus-additional-cni-plugins-5c4qd" Jul 10 01:00:12.944243 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914627 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-systemd-units\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:12.944243 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914665 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-host-cni-netd\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:12.944243 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914688 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/29befb9d-1e91-493a-bbbd-8ec09e788e39-registration-dir\") pod \"aws-ebs-csi-driver-node-wvq2b\" (UID: \"29befb9d-1e91-493a-bbbd-8ec09e788e39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b" Jul 10 01:00:12.944243 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914711 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhrp8\" (UniqueName: \"kubernetes.io/projected/09043fd5-e2a5-493e-82b8-f0ac9fa1f99b-kube-api-access-mhrp8\") pod \"node-resolver-tc8jw\" (UID: \"09043fd5-e2a5-493e-82b8-f0ac9fa1f99b\") " pod="openshift-dns/node-resolver-tc8jw" Jul 10 01:00:12.944243 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914737 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/975dd67f-4a1f-42b9-88b0-8270b032f818-cni-binary-copy\") pod \"multus-additional-cni-plugins-5c4qd\" (UID: \"975dd67f-4a1f-42b9-88b0-8270b032f818\") " pod="openshift-multus/multus-additional-cni-plugins-5c4qd" Jul 10 01:00:12.944243 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914758 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/38689ba6-fbae-4092-b63e-3488ce589912-env-overrides\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:12.944243 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914787 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-sys\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:12.944741 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914810 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-multus-conf-dir\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:12.944741 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914831 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-os-release\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:12.944741 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914855 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-var-lib-kubelet\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:12.944741 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914875 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67aec133-13cb-4b4d-9dc0-f858fc60410a-tmp\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:12.944741 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914898 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-system-cni-dir\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:12.944741 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914974 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/29befb9d-1e91-493a-bbbd-8ec09e788e39-socket-dir\") pod \"aws-ebs-csi-driver-node-wvq2b\" (UID: \"29befb9d-1e91-493a-bbbd-8ec09e788e39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b" Jul 10 01:00:12.944741 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.914997 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/29befb9d-1e91-493a-bbbd-8ec09e788e39-etc-selinux\") pod \"aws-ebs-csi-driver-node-wvq2b\" (UID: \"29befb9d-1e91-493a-bbbd-8ec09e788e39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b" Jul 10 01:00:12.944741 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.915013 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xfkk\" (UniqueName: \"kubernetes.io/projected/38689ba6-fbae-4092-b63e-3488ce589912-kube-api-access-8xfkk\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:12.944741 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.915034 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-etc-modprobe-d\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:12.944741 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.915049 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-host-var-lib-cni-multus\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:12.944741 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.915069 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-etc-kubernetes\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:12.944741 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.915083 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-etc-kubernetes\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:12.944741 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.915101 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-etc-sysctl-conf\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:12.944741 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.915134 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2bdz\" (UniqueName: \"kubernetes.io/projected/67aec133-13cb-4b4d-9dc0-f858fc60410a-kube-api-access-v2bdz\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:12.944741 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.915156 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/975dd67f-4a1f-42b9-88b0-8270b032f818-cnibin\") pod \"multus-additional-cni-plugins-5c4qd\" (UID: \"975dd67f-4a1f-42b9-88b0-8270b032f818\") " pod="openshift-multus/multus-additional-cni-plugins-5c4qd" Jul 10 01:00:12.944741 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.915407 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 01:00:12.944741 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.937728 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-f24tj" Jul 10 01:00:13.048204 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:12.946793 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-f24tj" Jul 10 01:00:13.048204 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017242 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be8fc9c0-d919-4435-bc77-ddd249ad1a3c-host\") pod \"node-ca-thhvj\" (UID: \"be8fc9c0-d919-4435-bc77-ddd249ad1a3c\") " pod="openshift-image-registry/node-ca-thhvj" Jul 10 01:00:13.048204 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017275 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-host-var-lib-cni-bin\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.048204 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017297 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwrgh\" (UniqueName: \"kubernetes.io/projected/83331c74-4d85-4282-aade-d6063bc7dd7c-kube-api-access-dwrgh\") pod \"iptables-alerter-9wsgb\" (UID: \"83331c74-4d85-4282-aade-d6063bc7dd7c\") " pod="openshift-network-operator/iptables-alerter-9wsgb" Jul 10 01:00:13.048204 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017356 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-host-var-lib-cni-bin\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.048204 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017398 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/975dd67f-4a1f-42b9-88b0-8270b032f818-system-cni-dir\") pod \"multus-additional-cni-plugins-5c4qd\" (UID: \"975dd67f-4a1f-42b9-88b0-8270b032f818\") " pod="openshift-multus/multus-additional-cni-plugins-5c4qd" Jul 10 01:00:13.048204 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017411 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be8fc9c0-d919-4435-bc77-ddd249ad1a3c-host\") pod \"node-ca-thhvj\" (UID: \"be8fc9c0-d919-4435-bc77-ddd249ad1a3c\") " pod="openshift-image-registry/node-ca-thhvj" Jul 10 01:00:13.048204 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017431 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-systemd-units\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.048204 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017451 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-host-cni-netd\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.048204 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017450 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/975dd67f-4a1f-42b9-88b0-8270b032f818-system-cni-dir\") pod \"multus-additional-cni-plugins-5c4qd\" (UID: \"975dd67f-4a1f-42b9-88b0-8270b032f818\") " pod="openshift-multus/multus-additional-cni-plugins-5c4qd" Jul 10 01:00:13.048204 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017484 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-systemd-units\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.048204 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017501 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-host-cni-netd\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.048204 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017516 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/29befb9d-1e91-493a-bbbd-8ec09e788e39-registration-dir\") pod \"aws-ebs-csi-driver-node-wvq2b\" (UID: \"29befb9d-1e91-493a-bbbd-8ec09e788e39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b" Jul 10 01:00:13.048204 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017541 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhrp8\" (UniqueName: \"kubernetes.io/projected/09043fd5-e2a5-493e-82b8-f0ac9fa1f99b-kube-api-access-mhrp8\") pod \"node-resolver-tc8jw\" (UID: \"09043fd5-e2a5-493e-82b8-f0ac9fa1f99b\") " pod="openshift-dns/node-resolver-tc8jw" Jul 10 01:00:13.048204 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017563 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/975dd67f-4a1f-42b9-88b0-8270b032f818-cni-binary-copy\") pod \"multus-additional-cni-plugins-5c4qd\" (UID: \"975dd67f-4a1f-42b9-88b0-8270b032f818\") " pod="openshift-multus/multus-additional-cni-plugins-5c4qd" Jul 10 01:00:13.048204 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017585 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/38689ba6-fbae-4092-b63e-3488ce589912-env-overrides\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.048204 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017606 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/29befb9d-1e91-493a-bbbd-8ec09e788e39-registration-dir\") pod \"aws-ebs-csi-driver-node-wvq2b\" (UID: \"29befb9d-1e91-493a-bbbd-8ec09e788e39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b" Jul 10 01:00:13.048204 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017606 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-sys\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.049268 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017629 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-multus-conf-dir\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.049268 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017643 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-sys\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.049268 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017648 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-os-release\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.049268 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017674 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-var-lib-kubelet\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.049268 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017698 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-os-release\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.049268 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017700 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67aec133-13cb-4b4d-9dc0-f858fc60410a-tmp\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.049268 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017729 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-var-lib-kubelet\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.049268 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017736 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-system-cni-dir\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.049268 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017798 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/29befb9d-1e91-493a-bbbd-8ec09e788e39-socket-dir\") pod \"aws-ebs-csi-driver-node-wvq2b\" (UID: \"29befb9d-1e91-493a-bbbd-8ec09e788e39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b" Jul 10 01:00:13.049268 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017823 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/29befb9d-1e91-493a-bbbd-8ec09e788e39-etc-selinux\") pod \"aws-ebs-csi-driver-node-wvq2b\" (UID: \"29befb9d-1e91-493a-bbbd-8ec09e788e39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b" Jul 10 01:00:13.049268 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017774 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-system-cni-dir\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.049268 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017730 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-multus-conf-dir\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.049268 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017860 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xfkk\" (UniqueName: \"kubernetes.io/projected/38689ba6-fbae-4092-b63e-3488ce589912-kube-api-access-8xfkk\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.049268 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017926 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-etc-modprobe-d\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.049268 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017937 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/29befb9d-1e91-493a-bbbd-8ec09e788e39-etc-selinux\") pod \"aws-ebs-csi-driver-node-wvq2b\" (UID: \"29befb9d-1e91-493a-bbbd-8ec09e788e39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b" Jul 10 01:00:13.049268 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017933 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/29befb9d-1e91-493a-bbbd-8ec09e788e39-socket-dir\") pod \"aws-ebs-csi-driver-node-wvq2b\" (UID: \"29befb9d-1e91-493a-bbbd-8ec09e788e39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b" Jul 10 01:00:13.049268 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.017976 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-host-var-lib-cni-multus\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.049268 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018005 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-etc-kubernetes\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.050926 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018007 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 10 01:00:13.050926 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018048 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-etc-kubernetes\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.050926 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018055 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-host-var-lib-cni-multus\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.050926 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018074 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-etc-sysctl-conf\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.050926 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018091 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-etc-modprobe-d\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.050926 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018106 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-etc-kubernetes\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.050926 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018091 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/38689ba6-fbae-4092-b63e-3488ce589912-env-overrides\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.050926 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018088 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-etc-kubernetes\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.050926 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018116 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/975dd67f-4a1f-42b9-88b0-8270b032f818-cni-binary-copy\") pod \"multus-additional-cni-plugins-5c4qd\" (UID: \"975dd67f-4a1f-42b9-88b0-8270b032f818\") " pod="openshift-multus/multus-additional-cni-plugins-5c4qd" Jul 10 01:00:13.050926 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018114 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2bdz\" (UniqueName: \"kubernetes.io/projected/67aec133-13cb-4b4d-9dc0-f858fc60410a-kube-api-access-v2bdz\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.050926 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018155 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/975dd67f-4a1f-42b9-88b0-8270b032f818-cnibin\") pod \"multus-additional-cni-plugins-5c4qd\" (UID: \"975dd67f-4a1f-42b9-88b0-8270b032f818\") " pod="openshift-multus/multus-additional-cni-plugins-5c4qd" Jul 10 01:00:13.050926 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018193 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-etc-systemd\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.050926 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018196 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-etc-sysctl-conf\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.050926 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018242 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-multus-socket-dir-parent\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.050926 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018257 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-etc-systemd\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.050926 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018256 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/975dd67f-4a1f-42b9-88b0-8270b032f818-cnibin\") pod \"multus-additional-cni-plugins-5c4qd\" (UID: \"975dd67f-4a1f-42b9-88b0-8270b032f818\") " pod="openshift-multus/multus-additional-cni-plugins-5c4qd" Jul 10 01:00:13.050926 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018268 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83331c74-4d85-4282-aade-d6063bc7dd7c-host-slash\") pod \"iptables-alerter-9wsgb\" (UID: \"83331c74-4d85-4282-aade-d6063bc7dd7c\") " pod="openshift-network-operator/iptables-alerter-9wsgb" Jul 10 01:00:13.050926 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018299 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxvj8\" (UniqueName: \"kubernetes.io/projected/be8fc9c0-d919-4435-bc77-ddd249ad1a3c-kube-api-access-qxvj8\") pod \"node-ca-thhvj\" (UID: \"be8fc9c0-d919-4435-bc77-ddd249ad1a3c\") " pod="openshift-image-registry/node-ca-thhvj" Jul 10 01:00:13.051769 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018323 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs\") pod \"network-metrics-daemon-qx5ln\" (UID: \"e76bc68e-d074-4131-8788-bfb781cc785a\") " pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:13.051769 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018317 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-multus-socket-dir-parent\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.051769 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018342 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83331c74-4d85-4282-aade-d6063bc7dd7c-host-slash\") pod \"iptables-alerter-9wsgb\" (UID: \"83331c74-4d85-4282-aade-d6063bc7dd7c\") " pod="openshift-network-operator/iptables-alerter-9wsgb" Jul 10 01:00:13.051769 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018346 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-host-kubelet\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.051769 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018373 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-host-kubelet\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.051769 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018377 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/38689ba6-fbae-4092-b63e-3488ce589912-ovnkube-config\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.051769 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018399 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98691035-8cf9-4daf-b08b-702da9077a5c-original-pull-secret\") pod \"global-pull-secret-syncer-4d5dw\" (UID: \"98691035-8cf9-4daf-b08b-702da9077a5c\") " pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:13.051769 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:13.018405 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 01:00:13.051769 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018414 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/29befb9d-1e91-493a-bbbd-8ec09e788e39-device-dir\") pod \"aws-ebs-csi-driver-node-wvq2b\" (UID: \"29befb9d-1e91-493a-bbbd-8ec09e788e39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b" Jul 10 01:00:13.051769 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018433 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhqgn\" (UniqueName: \"kubernetes.io/projected/e76bc68e-d074-4131-8788-bfb781cc785a-kube-api-access-vhqgn\") pod \"network-metrics-daemon-qx5ln\" (UID: \"e76bc68e-d074-4131-8788-bfb781cc785a\") " pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:13.051769 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018456 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-etc-openvswitch\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.051769 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:13.018476 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs podName:e76bc68e-d074-4131-8788-bfb781cc785a nodeName:}" failed. No retries permitted until 2026-07-10 01:00:13.518455761 +0000 UTC m=+2.109936962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs") pod "network-metrics-daemon-qx5ln" (UID: "e76bc68e-d074-4131-8788-bfb781cc785a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 01:00:13.051769 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018488 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-etc-openvswitch\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.051769 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:13.018493 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 01:00:13.051769 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018506 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-run-openvswitch\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.051769 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018507 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/29befb9d-1e91-493a-bbbd-8ec09e788e39-device-dir\") pod \"aws-ebs-csi-driver-node-wvq2b\" (UID: \"29befb9d-1e91-493a-bbbd-8ec09e788e39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b" Jul 10 01:00:13.051769 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:13.018538 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98691035-8cf9-4daf-b08b-702da9077a5c-original-pull-secret podName:98691035-8cf9-4daf-b08b-702da9077a5c nodeName:}" failed. No retries permitted until 2026-07-10 01:00:13.518523148 +0000 UTC m=+2.110004327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98691035-8cf9-4daf-b08b-702da9077a5c-original-pull-secret") pod "global-pull-secret-syncer-4d5dw" (UID: "98691035-8cf9-4daf-b08b-702da9077a5c") : object "kube-system"/"original-pull-secret" not registered Jul 10 01:00:13.053064 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018541 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-run-openvswitch\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.053064 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018615 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-run-ovn\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.053064 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018639 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/98691035-8cf9-4daf-b08b-702da9077a5c-dbus\") pod \"global-pull-secret-syncer-4d5dw\" (UID: \"98691035-8cf9-4daf-b08b-702da9077a5c\") " pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:13.053064 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018663 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-multus-cni-dir\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.053064 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018666 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-run-ovn\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.053064 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018684 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-cnibin\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.053064 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018708 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/975dd67f-4a1f-42b9-88b0-8270b032f818-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5c4qd\" (UID: \"975dd67f-4a1f-42b9-88b0-8270b032f818\") " pod="openshift-multus/multus-additional-cni-plugins-5c4qd" Jul 10 01:00:13.053064 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018725 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-cni-binary-copy\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.053064 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018739 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-host-run-ovn-kubernetes\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.053064 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018753 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/98691035-8cf9-4daf-b08b-702da9077a5c-dbus\") pod \"global-pull-secret-syncer-4d5dw\" (UID: \"98691035-8cf9-4daf-b08b-702da9077a5c\") " pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:13.053064 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018765 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-multus-cni-dir\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.053064 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018788 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-host-run-ovn-kubernetes\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.053064 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018816 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-host-cni-bin\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.053064 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018833 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/38689ba6-fbae-4092-b63e-3488ce589912-ovnkube-config\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.053064 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018843 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/38689ba6-fbae-4092-b63e-3488ce589912-ovnkube-script-lib\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.053064 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018865 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-host-cni-bin\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.053064 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018875 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-etc-sysctl-d\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.053064 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018901 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4tmn\" (UniqueName: \"kubernetes.io/projected/2d15903f-0aa6-41f8-9a4e-ad47872ddd19-kube-api-access-n4tmn\") pod \"network-check-target-9d9h6\" (UID: \"2d15903f-0aa6-41f8-9a4e-ad47872ddd19\") " pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:00:13.053877 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018922 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-hostroot\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.053877 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018946 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/83331c74-4d85-4282-aade-d6063bc7dd7c-iptables-alerter-script\") pod \"iptables-alerter-9wsgb\" (UID: \"83331c74-4d85-4282-aade-d6063bc7dd7c\") " pod="openshift-network-operator/iptables-alerter-9wsgb" Jul 10 01:00:13.053877 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018960 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-etc-sysctl-d\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.053877 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018973 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-log-socket\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.053877 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018999 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.053877 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019026 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-etc-sysconfig\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.053877 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019047 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-run\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.053877 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019069 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/76247a4f-c780-4a08-bda6-8e8fc84d6f72-agent-certs\") pod \"konnectivity-agent-pvtp7\" (UID: \"76247a4f-c780-4a08-bda6-8e8fc84d6f72\") " pod="kube-system/konnectivity-agent-pvtp7" Jul 10 01:00:13.053877 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019094 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/76247a4f-c780-4a08-bda6-8e8fc84d6f72-konnectivity-ca\") pod \"konnectivity-agent-pvtp7\" (UID: \"76247a4f-c780-4a08-bda6-8e8fc84d6f72\") " pod="kube-system/konnectivity-agent-pvtp7" Jul 10 01:00:13.053877 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019118 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/29befb9d-1e91-493a-bbbd-8ec09e788e39-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wvq2b\" (UID: \"29befb9d-1e91-493a-bbbd-8ec09e788e39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b" Jul 10 01:00:13.053877 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019140 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-host-slash\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.053877 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.018817 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-cnibin\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.053877 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019165 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-var-lib-openvswitch\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.053877 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019191 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/98691035-8cf9-4daf-b08b-702da9077a5c-kubelet-config\") pod \"global-pull-secret-syncer-4d5dw\" (UID: \"98691035-8cf9-4daf-b08b-702da9077a5c\") " pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:13.053877 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019196 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/975dd67f-4a1f-42b9-88b0-8270b032f818-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5c4qd\" (UID: \"975dd67f-4a1f-42b9-88b0-8270b032f818\") " pod="openshift-multus/multus-additional-cni-plugins-5c4qd" Jul 10 01:00:13.053877 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019211 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-etc-sysconfig\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.053877 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019233 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-host-run-k8s-cni-cncf-io\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.054521 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019257 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-cni-binary-copy\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.054521 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019266 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-hostroot\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.054521 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019272 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-host-run-netns\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.054521 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019284 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-run\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.054521 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019283 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/38689ba6-fbae-4092-b63e-3488ce589912-ovnkube-script-lib\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.054521 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019313 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-host-slash\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.054521 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019302 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/09043fd5-e2a5-493e-82b8-f0ac9fa1f99b-hosts-file\") pod \"node-resolver-tc8jw\" (UID: \"09043fd5-e2a5-493e-82b8-f0ac9fa1f99b\") " pod="openshift-dns/node-resolver-tc8jw" Jul 10 01:00:13.054521 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019323 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.054521 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019345 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09043fd5-e2a5-493e-82b8-f0ac9fa1f99b-tmp-dir\") pod \"node-resolver-tc8jw\" (UID: \"09043fd5-e2a5-493e-82b8-f0ac9fa1f99b\") " pod="openshift-dns/node-resolver-tc8jw" Jul 10 01:00:13.054521 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019359 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/09043fd5-e2a5-493e-82b8-f0ac9fa1f99b-hosts-file\") pod \"node-resolver-tc8jw\" (UID: \"09043fd5-e2a5-493e-82b8-f0ac9fa1f99b\") " pod="openshift-dns/node-resolver-tc8jw" Jul 10 01:00:13.054521 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019367 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-host-run-netns\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.054521 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019361 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-var-lib-openvswitch\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.054521 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019385 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-lib-modules\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.054521 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019396 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-host-run-k8s-cni-cncf-io\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.054521 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019405 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-host-var-lib-kubelet\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.054521 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019411 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-host-run-netns\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.054521 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019420 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/29befb9d-1e91-493a-bbbd-8ec09e788e39-sys-fs\") pod \"aws-ebs-csi-driver-node-wvq2b\" (UID: \"29befb9d-1e91-493a-bbbd-8ec09e788e39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b" Jul 10 01:00:13.054521 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019438 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/98691035-8cf9-4daf-b08b-702da9077a5c-kubelet-config\") pod \"global-pull-secret-syncer-4d5dw\" (UID: \"98691035-8cf9-4daf-b08b-702da9077a5c\") " pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:13.055138 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019446 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/975dd67f-4a1f-42b9-88b0-8270b032f818-os-release\") pod \"multus-additional-cni-plugins-5c4qd\" (UID: \"975dd67f-4a1f-42b9-88b0-8270b032f818\") " pod="openshift-multus/multus-additional-cni-plugins-5c4qd" Jul 10 01:00:13.055138 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019456 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/29befb9d-1e91-493a-bbbd-8ec09e788e39-sys-fs\") pod \"aws-ebs-csi-driver-node-wvq2b\" (UID: \"29befb9d-1e91-493a-bbbd-8ec09e788e39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b" Jul 10 01:00:13.055138 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019472 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-log-socket\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.055138 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019474 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x75g\" (UniqueName: \"kubernetes.io/projected/975dd67f-4a1f-42b9-88b0-8270b032f818-kube-api-access-9x75g\") pod \"multus-additional-cni-plugins-5c4qd\" (UID: \"975dd67f-4a1f-42b9-88b0-8270b032f818\") " pod="openshift-multus/multus-additional-cni-plugins-5c4qd" Jul 10 01:00:13.055138 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019530 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/975dd67f-4a1f-42b9-88b0-8270b032f818-os-release\") pod \"multus-additional-cni-plugins-5c4qd\" (UID: \"975dd67f-4a1f-42b9-88b0-8270b032f818\") " pod="openshift-multus/multus-additional-cni-plugins-5c4qd" Jul 10 01:00:13.055138 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019558 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be8fc9c0-d919-4435-bc77-ddd249ad1a3c-serviceca\") pod \"node-ca-thhvj\" (UID: \"be8fc9c0-d919-4435-bc77-ddd249ad1a3c\") " pod="openshift-image-registry/node-ca-thhvj" Jul 10 01:00:13.055138 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019602 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-run-systemd\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.055138 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019629 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-node-log\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.055138 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019653 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/67aec133-13cb-4b4d-9dc0-f858fc60410a-etc-tuned\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.055138 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019698 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-multus-daemon-config\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.055138 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019726 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-host-run-multus-certs\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.055138 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019750 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09043fd5-e2a5-493e-82b8-f0ac9fa1f99b-tmp-dir\") pod \"node-resolver-tc8jw\" (UID: \"09043fd5-e2a5-493e-82b8-f0ac9fa1f99b\") " pod="openshift-dns/node-resolver-tc8jw" Jul 10 01:00:13.055138 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019751 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp9pn\" (UniqueName: \"kubernetes.io/projected/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-kube-api-access-hp9pn\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.055138 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019808 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdlpj\" (UniqueName: \"kubernetes.io/projected/29befb9d-1e91-493a-bbbd-8ec09e788e39-kube-api-access-rdlpj\") pod \"aws-ebs-csi-driver-node-wvq2b\" (UID: \"29befb9d-1e91-493a-bbbd-8ec09e788e39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b" Jul 10 01:00:13.055138 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019834 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/38689ba6-fbae-4092-b63e-3488ce589912-ovn-node-metrics-cert\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.055138 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019857 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-host\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.055138 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019881 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/975dd67f-4a1f-42b9-88b0-8270b032f818-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5c4qd\" (UID: \"975dd67f-4a1f-42b9-88b0-8270b032f818\") " pod="openshift-multus/multus-additional-cni-plugins-5c4qd" Jul 10 01:00:13.055692 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019905 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/975dd67f-4a1f-42b9-88b0-8270b032f818-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5c4qd\" (UID: \"975dd67f-4a1f-42b9-88b0-8270b032f818\") " pod="openshift-multus/multus-additional-cni-plugins-5c4qd" Jul 10 01:00:13.055692 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019922 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/76247a4f-c780-4a08-bda6-8e8fc84d6f72-konnectivity-ca\") pod \"konnectivity-agent-pvtp7\" (UID: \"76247a4f-c780-4a08-bda6-8e8fc84d6f72\") " pod="kube-system/konnectivity-agent-pvtp7" Jul 10 01:00:13.055692 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019956 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-node-log\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.055692 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.019978 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-host-run-netns\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.055692 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.020020 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/83331c74-4d85-4282-aade-d6063bc7dd7c-iptables-alerter-script\") pod \"iptables-alerter-9wsgb\" (UID: \"83331c74-4d85-4282-aade-d6063bc7dd7c\") " pod="openshift-network-operator/iptables-alerter-9wsgb" Jul 10 01:00:13.055692 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.020025 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/29befb9d-1e91-493a-bbbd-8ec09e788e39-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wvq2b\" (UID: \"29befb9d-1e91-493a-bbbd-8ec09e788e39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b" Jul 10 01:00:13.055692 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.020095 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be8fc9c0-d919-4435-bc77-ddd249ad1a3c-serviceca\") pod \"node-ca-thhvj\" (UID: \"be8fc9c0-d919-4435-bc77-ddd249ad1a3c\") " pod="openshift-image-registry/node-ca-thhvj" Jul 10 01:00:13.055692 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.020111 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-lib-modules\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.055692 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.020158 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-host-var-lib-kubelet\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.055692 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.020279 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-host-run-multus-certs\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.055692 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.020336 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/38689ba6-fbae-4092-b63e-3488ce589912-run-systemd\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.055692 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.020363 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67aec133-13cb-4b4d-9dc0-f858fc60410a-host\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.055692 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.020473 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/975dd67f-4a1f-42b9-88b0-8270b032f818-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5c4qd\" (UID: \"975dd67f-4a1f-42b9-88b0-8270b032f818\") " pod="openshift-multus/multus-additional-cni-plugins-5c4qd" Jul 10 01:00:13.055692 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.020677 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-multus-daemon-config\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.055692 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.020929 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/975dd67f-4a1f-42b9-88b0-8270b032f818-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5c4qd\" (UID: \"975dd67f-4a1f-42b9-88b0-8270b032f818\") " pod="openshift-multus/multus-additional-cni-plugins-5c4qd" Jul 10 01:00:13.055692 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.021533 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67aec133-13cb-4b4d-9dc0-f858fc60410a-tmp\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.055692 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.021937 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/76247a4f-c780-4a08-bda6-8e8fc84d6f72-agent-certs\") pod \"konnectivity-agent-pvtp7\" (UID: \"76247a4f-c780-4a08-bda6-8e8fc84d6f72\") " pod="kube-system/konnectivity-agent-pvtp7" Jul 10 01:00:13.055692 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.021985 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/67aec133-13cb-4b4d-9dc0-f858fc60410a-etc-tuned\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.056269 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.022282 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/38689ba6-fbae-4092-b63e-3488ce589912-ovn-node-metrics-cert\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.056269 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.025378 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwrgh\" (UniqueName: \"kubernetes.io/projected/83331c74-4d85-4282-aade-d6063bc7dd7c-kube-api-access-dwrgh\") pod \"iptables-alerter-9wsgb\" (UID: \"83331c74-4d85-4282-aade-d6063bc7dd7c\") " pod="openshift-network-operator/iptables-alerter-9wsgb" Jul 10 01:00:13.056269 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.028032 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xfkk\" (UniqueName: \"kubernetes.io/projected/38689ba6-fbae-4092-b63e-3488ce589912-kube-api-access-8xfkk\") pod \"ovnkube-node-dsbgv\" (UID: \"38689ba6-fbae-4092-b63e-3488ce589912\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.056269 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.032198 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxvj8\" (UniqueName: \"kubernetes.io/projected/be8fc9c0-d919-4435-bc77-ddd249ad1a3c-kube-api-access-qxvj8\") pod \"node-ca-thhvj\" (UID: \"be8fc9c0-d919-4435-bc77-ddd249ad1a3c\") " pod="openshift-image-registry/node-ca-thhvj" Jul 10 01:00:13.056269 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.032846 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhrp8\" (UniqueName: \"kubernetes.io/projected/09043fd5-e2a5-493e-82b8-f0ac9fa1f99b-kube-api-access-mhrp8\") pod \"node-resolver-tc8jw\" (UID: \"09043fd5-e2a5-493e-82b8-f0ac9fa1f99b\") " pod="openshift-dns/node-resolver-tc8jw" Jul 10 01:00:13.056269 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:13.033391 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 01:00:13.056269 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:13.033414 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 01:00:13.056269 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:13.033428 2554 projected.go:196] Error preparing data for projected volume kube-api-access-n4tmn for pod openshift-network-diagnostics/network-check-target-9d9h6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 01:00:13.056269 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:13.033484 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d15903f-0aa6-41f8-9a4e-ad47872ddd19-kube-api-access-n4tmn podName:2d15903f-0aa6-41f8-9a4e-ad47872ddd19 nodeName:}" failed. No retries permitted until 2026-07-10 01:00:13.533467128 +0000 UTC m=+2.124948324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-n4tmn" (UniqueName: "kubernetes.io/projected/2d15903f-0aa6-41f8-9a4e-ad47872ddd19-kube-api-access-n4tmn") pod "network-check-target-9d9h6" (UID: "2d15903f-0aa6-41f8-9a4e-ad47872ddd19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 01:00:13.056269 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.035459 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x75g\" (UniqueName: \"kubernetes.io/projected/975dd67f-4a1f-42b9-88b0-8270b032f818-kube-api-access-9x75g\") pod \"multus-additional-cni-plugins-5c4qd\" (UID: \"975dd67f-4a1f-42b9-88b0-8270b032f818\") " pod="openshift-multus/multus-additional-cni-plugins-5c4qd" Jul 10 01:00:13.056269 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.035763 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdlpj\" (UniqueName: \"kubernetes.io/projected/29befb9d-1e91-493a-bbbd-8ec09e788e39-kube-api-access-rdlpj\") pod \"aws-ebs-csi-driver-node-wvq2b\" (UID: \"29befb9d-1e91-493a-bbbd-8ec09e788e39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b" Jul 10 01:00:13.056269 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.036147 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2bdz\" (UniqueName: \"kubernetes.io/projected/67aec133-13cb-4b4d-9dc0-f858fc60410a-kube-api-access-v2bdz\") pod \"tuned-kwwcc\" (UID: \"67aec133-13cb-4b4d-9dc0-f858fc60410a\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.056269 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.036272 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp9pn\" (UniqueName: \"kubernetes.io/projected/17e4d0c0-a003-495f-bca4-4fbfbe95b5fb-kube-api-access-hp9pn\") pod \"multus-29q6p\" (UID: \"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb\") " pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.056269 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.039923 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhqgn\" (UniqueName: \"kubernetes.io/projected/e76bc68e-d074-4131-8788-bfb781cc785a-kube-api-access-vhqgn\") pod \"network-metrics-daemon-qx5ln\" (UID: \"e76bc68e-d074-4131-8788-bfb781cc785a\") " pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:13.273377 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.197322 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-29q6p" Jul 10 01:00:13.273377 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.215951 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9wsgb" Jul 10 01:00:13.273377 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.221724 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:13.273377 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.251870 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pvtp7" Jul 10 01:00:13.273377 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.262098 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b" Jul 10 01:00:13.273377 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:13.263675 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38689ba6_fbae_4092_b63e_3488ce589912.slice/crio-068abddc0f3eab2f572135425e3132eb20cf8dda40103d189a5311e8f117264f WatchSource:0}: Error finding container 068abddc0f3eab2f572135425e3132eb20cf8dda40103d189a5311e8f117264f: Status 404 returned error can't find the container with id 068abddc0f3eab2f572135425e3132eb20cf8dda40103d189a5311e8f117264f Jul 10 01:00:13.273377 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:13.264834 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76247a4f_c780_4a08_bda6_8e8fc84d6f72.slice/crio-928e655f379670d5ff832e5e83881b8c77b7a28009c381323815b869bf73dec1 WatchSource:0}: Error finding container 928e655f379670d5ff832e5e83881b8c77b7a28009c381323815b869bf73dec1: Status 404 returned error can't find the container with id 928e655f379670d5ff832e5e83881b8c77b7a28009c381323815b869bf73dec1 Jul 10 01:00:13.273377 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:13.265277 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b3fdd7178350c5e8b9bc8be304d81a3.slice/crio-cdd799baedd40ca4ccf99cb34c3345260b356b36a4a06948401b504edc9f0f11 WatchSource:0}: Error finding container cdd799baedd40ca4ccf99cb34c3345260b356b36a4a06948401b504edc9f0f11: Status 404 returned error can't find the container with id cdd799baedd40ca4ccf99cb34c3345260b356b36a4a06948401b504edc9f0f11 Jul 10 01:00:13.273377 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:13.266285 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc24d6c8d9b99ab2f60ec24f7270257cc.slice/crio-c44e648a93052001180dee9bcaadf46b9490565c018cc6e4973f3737857cb818 WatchSource:0}: Error finding container c44e648a93052001180dee9bcaadf46b9490565c018cc6e4973f3737857cb818: Status 404 returned error can't find the container with id c44e648a93052001180dee9bcaadf46b9490565c018cc6e4973f3737857cb818 Jul 10 01:00:13.273377 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.270154 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 01:00:13.277774 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:13.277619 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29befb9d_1e91_493a_bbbd_8ec09e788e39.slice/crio-75b1bd7f9b89dbbd16166cc867f58bc1446be69ad0f679b52ff1e3940287fe06 WatchSource:0}: Error finding container 75b1bd7f9b89dbbd16166cc867f58bc1446be69ad0f679b52ff1e3940287fe06: Status 404 returned error can't find the container with id 75b1bd7f9b89dbbd16166cc867f58bc1446be69ad0f679b52ff1e3940287fe06 Jul 10 01:00:13.357435 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.281348 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" Jul 10 01:00:13.357435 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.282362 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tc8jw" Jul 10 01:00:13.357435 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:13.299729 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67aec133_13cb_4b4d_9dc0_f858fc60410a.slice/crio-b3974f39d18ab0334f322708816f1094595beba6eb97d8d91c1df190f62bab81 WatchSource:0}: Error finding container b3974f39d18ab0334f322708816f1094595beba6eb97d8d91c1df190f62bab81: Status 404 returned error can't find the container with id b3974f39d18ab0334f322708816f1094595beba6eb97d8d91c1df190f62bab81 Jul 10 01:00:13.357435 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.304896 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5c4qd" Jul 10 01:00:13.357435 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.308419 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-thhvj" Jul 10 01:00:13.357435 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:13.321760 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod975dd67f_4a1f_42b9_88b0_8270b032f818.slice/crio-cecfa0b38cf951326fac1a351c30d3482980e3a36b0264453fc63c7d0845d1ba WatchSource:0}: Error finding container cecfa0b38cf951326fac1a351c30d3482980e3a36b0264453fc63c7d0845d1ba: Status 404 returned error can't find the container with id cecfa0b38cf951326fac1a351c30d3482980e3a36b0264453fc63c7d0845d1ba Jul 10 01:00:13.357435 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:13.323621 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe8fc9c0_d919_4435_bc77_ddd249ad1a3c.slice/crio-d43b9ba2d9565e73adf39fe411ca7725a612fdacd6a95317f5a7a8eb7f7a4538 WatchSource:0}: Error finding container d43b9ba2d9565e73adf39fe411ca7725a612fdacd6a95317f5a7a8eb7f7a4538: Status 404 returned error can't find the container with id d43b9ba2d9565e73adf39fe411ca7725a612fdacd6a95317f5a7a8eb7f7a4538 Jul 10 01:00:13.635182 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.523254 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs\") pod \"network-metrics-daemon-qx5ln\" (UID: \"e76bc68e-d074-4131-8788-bfb781cc785a\") " pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:13.635182 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.523290 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98691035-8cf9-4daf-b08b-702da9077a5c-original-pull-secret\") pod \"global-pull-secret-syncer-4d5dw\" (UID: \"98691035-8cf9-4daf-b08b-702da9077a5c\") " pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:13.635182 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:13.523383 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 01:00:13.635182 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:13.523448 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs podName:e76bc68e-d074-4131-8788-bfb781cc785a nodeName:}" failed. No retries permitted until 2026-07-10 01:00:14.523431455 +0000 UTC m=+3.114912647 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs") pod "network-metrics-daemon-qx5ln" (UID: "e76bc68e-d074-4131-8788-bfb781cc785a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 01:00:13.635182 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:13.523392 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 01:00:13.635182 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:13.523481 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98691035-8cf9-4daf-b08b-702da9077a5c-original-pull-secret podName:98691035-8cf9-4daf-b08b-702da9077a5c nodeName:}" failed. No retries permitted until 2026-07-10 01:00:14.523474977 +0000 UTC m=+3.114956158 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98691035-8cf9-4daf-b08b-702da9077a5c-original-pull-secret") pod "global-pull-secret-syncer-4d5dw" (UID: "98691035-8cf9-4daf-b08b-702da9077a5c") : object "kube-system"/"original-pull-secret" not registered Jul 10 01:00:13.635182 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.623729 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4tmn\" (UniqueName: \"kubernetes.io/projected/2d15903f-0aa6-41f8-9a4e-ad47872ddd19-kube-api-access-n4tmn\") pod \"network-check-target-9d9h6\" (UID: \"2d15903f-0aa6-41f8-9a4e-ad47872ddd19\") " pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:00:13.635182 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:13.623864 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 01:00:13.635182 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:13.623878 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 01:00:13.635182 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:13.623887 2554 projected.go:196] Error preparing data for projected volume kube-api-access-n4tmn for pod openshift-network-diagnostics/network-check-target-9d9h6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 01:00:13.635182 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:13.623935 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d15903f-0aa6-41f8-9a4e-ad47872ddd19-kube-api-access-n4tmn podName:2d15903f-0aa6-41f8-9a4e-ad47872ddd19 nodeName:}" failed. No retries permitted until 2026-07-10 01:00:14.623922974 +0000 UTC m=+3.215404151 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-n4tmn" (UniqueName: "kubernetes.io/projected/2d15903f-0aa6-41f8-9a4e-ad47872ddd19-kube-api-access-n4tmn") pod "network-check-target-9d9h6" (UID: "2d15903f-0aa6-41f8-9a4e-ad47872ddd19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 01:00:13.725774 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:13.650870 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83331c74_4d85_4282_aade_d6063bc7dd7c.slice/crio-f5e1a900e8063e6ea4a9107044e6867b6fe4f4b3ac3c2a1aa62170ca93436cbf WatchSource:0}: Error finding container f5e1a900e8063e6ea4a9107044e6867b6fe4f4b3ac3c2a1aa62170ca93436cbf: Status 404 returned error can't find the container with id f5e1a900e8063e6ea4a9107044e6867b6fe4f4b3ac3c2a1aa62170ca93436cbf Jul 10 01:00:13.870595 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.816525 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 01:00:13.950455 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.950367 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 01:00:13.951368 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.950647 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 00:55:12 +0000 UTC" deadline="2028-02-06 00:22:09.041392066 +0000 UTC" Jul 10 01:00:13.951368 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:13.950673 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13823h21m55.090724145s" Jul 10 01:00:14.027582 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:14.027549 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:14.027768 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:14.027692 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4d5dw" podUID="98691035-8cf9-4daf-b08b-702da9077a5c" Jul 10 01:00:14.028275 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:14.028255 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:00:14.028375 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:14.028356 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9h6" podUID="2d15903f-0aa6-41f8-9a4e-ad47872ddd19" Jul 10 01:00:14.042335 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:14.042267 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b" event={"ID":"29befb9d-1e91-493a-bbbd-8ec09e788e39","Type":"ContainerStarted","Data":"75b1bd7f9b89dbbd16166cc867f58bc1446be69ad0f679b52ff1e3940287fe06"} Jul 10 01:00:14.048013 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:14.047977 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pvtp7" event={"ID":"76247a4f-c780-4a08-bda6-8e8fc84d6f72","Type":"ContainerStarted","Data":"928e655f379670d5ff832e5e83881b8c77b7a28009c381323815b869bf73dec1"} Jul 10 01:00:14.057391 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:14.057356 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" event={"ID":"38689ba6-fbae-4092-b63e-3488ce589912","Type":"ContainerStarted","Data":"068abddc0f3eab2f572135425e3132eb20cf8dda40103d189a5311e8f117264f"} Jul 10 01:00:14.061765 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:14.061733 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" event={"ID":"1b3fdd7178350c5e8b9bc8be304d81a3","Type":"ContainerStarted","Data":"cdd799baedd40ca4ccf99cb34c3345260b356b36a4a06948401b504edc9f0f11"} Jul 10 01:00:14.066730 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:14.066693 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9wsgb" event={"ID":"83331c74-4d85-4282-aade-d6063bc7dd7c","Type":"ContainerStarted","Data":"f5e1a900e8063e6ea4a9107044e6867b6fe4f4b3ac3c2a1aa62170ca93436cbf"} Jul 10 01:00:14.078412 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:14.078370 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5c4qd" event={"ID":"975dd67f-4a1f-42b9-88b0-8270b032f818","Type":"ContainerStarted","Data":"cecfa0b38cf951326fac1a351c30d3482980e3a36b0264453fc63c7d0845d1ba"} Jul 10 01:00:14.081137 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:14.081102 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" event={"ID":"67aec133-13cb-4b4d-9dc0-f858fc60410a","Type":"ContainerStarted","Data":"b3974f39d18ab0334f322708816f1094595beba6eb97d8d91c1df190f62bab81"} Jul 10 01:00:14.084609 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:14.084572 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal" event={"ID":"c24d6c8d9b99ab2f60ec24f7270257cc","Type":"ContainerStarted","Data":"c44e648a93052001180dee9bcaadf46b9490565c018cc6e4973f3737857cb818"} Jul 10 01:00:14.092504 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:14.092463 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-thhvj" event={"ID":"be8fc9c0-d919-4435-bc77-ddd249ad1a3c","Type":"ContainerStarted","Data":"d43b9ba2d9565e73adf39fe411ca7725a612fdacd6a95317f5a7a8eb7f7a4538"} Jul 10 01:00:14.095294 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:14.095259 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tc8jw" event={"ID":"09043fd5-e2a5-493e-82b8-f0ac9fa1f99b","Type":"ContainerStarted","Data":"740092bca1f25f9753b1eac12e19eeb42abf7201b96d54a2eabfcc81ce88eb0d"} Jul 10 01:00:14.206556 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:14.206475 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17e4d0c0_a003_495f_bca4_4fbfbe95b5fb.slice/crio-fd8a31c309e03b0f15ccba28568f7e61751955d6deb5ac15c414c1ad89fa2ff6 WatchSource:0}: Error finding container fd8a31c309e03b0f15ccba28568f7e61751955d6deb5ac15c414c1ad89fa2ff6: Status 404 returned error can't find the container with id fd8a31c309e03b0f15ccba28568f7e61751955d6deb5ac15c414c1ad89fa2ff6 Jul 10 01:00:14.282795 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:14.282484 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 01:00:14.532468 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:14.532384 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs\") pod \"network-metrics-daemon-qx5ln\" (UID: \"e76bc68e-d074-4131-8788-bfb781cc785a\") " pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:14.532468 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:14.532435 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98691035-8cf9-4daf-b08b-702da9077a5c-original-pull-secret\") pod \"global-pull-secret-syncer-4d5dw\" (UID: \"98691035-8cf9-4daf-b08b-702da9077a5c\") " pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:14.532685 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:14.532607 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 01:00:14.532685 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:14.532628 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 01:00:14.532685 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:14.532668 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98691035-8cf9-4daf-b08b-702da9077a5c-original-pull-secret podName:98691035-8cf9-4daf-b08b-702da9077a5c nodeName:}" failed. No retries permitted until 2026-07-10 01:00:16.532650259 +0000 UTC m=+5.124131440 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98691035-8cf9-4daf-b08b-702da9077a5c-original-pull-secret") pod "global-pull-secret-syncer-4d5dw" (UID: "98691035-8cf9-4daf-b08b-702da9077a5c") : object "kube-system"/"original-pull-secret" not registered Jul 10 01:00:14.532852 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:14.532688 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs podName:e76bc68e-d074-4131-8788-bfb781cc785a nodeName:}" failed. No retries permitted until 2026-07-10 01:00:16.53267889 +0000 UTC m=+5.124160073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs") pod "network-metrics-daemon-qx5ln" (UID: "e76bc68e-d074-4131-8788-bfb781cc785a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 01:00:14.633062 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:14.633028 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4tmn\" (UniqueName: \"kubernetes.io/projected/2d15903f-0aa6-41f8-9a4e-ad47872ddd19-kube-api-access-n4tmn\") pod \"network-check-target-9d9h6\" (UID: \"2d15903f-0aa6-41f8-9a4e-ad47872ddd19\") " pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:00:14.633716 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:14.633249 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 01:00:14.633716 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:14.633278 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 01:00:14.633716 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:14.633291 2554 projected.go:196] Error preparing data for projected volume kube-api-access-n4tmn for pod openshift-network-diagnostics/network-check-target-9d9h6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 01:00:14.633716 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:14.633352 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d15903f-0aa6-41f8-9a4e-ad47872ddd19-kube-api-access-n4tmn podName:2d15903f-0aa6-41f8-9a4e-ad47872ddd19 nodeName:}" failed. No retries permitted until 2026-07-10 01:00:16.633333582 +0000 UTC m=+5.224814773 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-n4tmn" (UniqueName: "kubernetes.io/projected/2d15903f-0aa6-41f8-9a4e-ad47872ddd19-kube-api-access-n4tmn") pod "network-check-target-9d9h6" (UID: "2d15903f-0aa6-41f8-9a4e-ad47872ddd19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 01:00:14.951197 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:14.951107 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 00:55:12 +0000 UTC" deadline="2028-01-21 07:22:38.806474357 +0000 UTC" Jul 10 01:00:14.951197 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:14.951145 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13446h22m23.855334151s" Jul 10 01:00:15.025308 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:15.024774 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:15.025308 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:15.024936 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx5ln" podUID="e76bc68e-d074-4131-8788-bfb781cc785a" Jul 10 01:00:15.113960 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:15.113897 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-29q6p" event={"ID":"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb","Type":"ContainerStarted","Data":"fd8a31c309e03b0f15ccba28568f7e61751955d6deb5ac15c414c1ad89fa2ff6"} Jul 10 01:00:16.025890 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:16.025379 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:16.025890 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:16.025390 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:00:16.025890 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:16.025509 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4d5dw" podUID="98691035-8cf9-4daf-b08b-702da9077a5c" Jul 10 01:00:16.025890 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:16.025580 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9h6" podUID="2d15903f-0aa6-41f8-9a4e-ad47872ddd19" Jul 10 01:00:16.553110 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:16.552236 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs\") pod \"network-metrics-daemon-qx5ln\" (UID: \"e76bc68e-d074-4131-8788-bfb781cc785a\") " pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:16.553110 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:16.552326 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98691035-8cf9-4daf-b08b-702da9077a5c-original-pull-secret\") pod \"global-pull-secret-syncer-4d5dw\" (UID: \"98691035-8cf9-4daf-b08b-702da9077a5c\") " pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:16.553110 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:16.552526 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 01:00:16.553110 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:16.552595 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98691035-8cf9-4daf-b08b-702da9077a5c-original-pull-secret podName:98691035-8cf9-4daf-b08b-702da9077a5c nodeName:}" failed. No retries permitted until 2026-07-10 01:00:20.552573928 +0000 UTC m=+9.144055108 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98691035-8cf9-4daf-b08b-702da9077a5c-original-pull-secret") pod "global-pull-secret-syncer-4d5dw" (UID: "98691035-8cf9-4daf-b08b-702da9077a5c") : object "kube-system"/"original-pull-secret" not registered Jul 10 01:00:16.553110 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:16.553029 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 01:00:16.553110 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:16.553080 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs podName:e76bc68e-d074-4131-8788-bfb781cc785a nodeName:}" failed. No retries permitted until 2026-07-10 01:00:20.553063761 +0000 UTC m=+9.144544985 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs") pod "network-metrics-daemon-qx5ln" (UID: "e76bc68e-d074-4131-8788-bfb781cc785a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 01:00:16.653271 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:16.653215 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4tmn\" (UniqueName: \"kubernetes.io/projected/2d15903f-0aa6-41f8-9a4e-ad47872ddd19-kube-api-access-n4tmn\") pod \"network-check-target-9d9h6\" (UID: \"2d15903f-0aa6-41f8-9a4e-ad47872ddd19\") " pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:00:16.653490 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:16.653471 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 01:00:16.653584 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:16.653500 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 01:00:16.653584 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:16.653513 2554 projected.go:196] Error preparing data for projected volume kube-api-access-n4tmn for pod openshift-network-diagnostics/network-check-target-9d9h6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 01:00:16.653584 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:16.653580 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d15903f-0aa6-41f8-9a4e-ad47872ddd19-kube-api-access-n4tmn podName:2d15903f-0aa6-41f8-9a4e-ad47872ddd19 nodeName:}" failed. No retries permitted until 2026-07-10 01:00:20.653559912 +0000 UTC m=+9.245041106 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-n4tmn" (UniqueName: "kubernetes.io/projected/2d15903f-0aa6-41f8-9a4e-ad47872ddd19-kube-api-access-n4tmn") pod "network-check-target-9d9h6" (UID: "2d15903f-0aa6-41f8-9a4e-ad47872ddd19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 01:00:17.024726 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:17.024687 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:17.024932 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:17.024848 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx5ln" podUID="e76bc68e-d074-4131-8788-bfb781cc785a" Jul 10 01:00:18.025950 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:18.025260 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:18.025950 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:18.025295 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:00:18.025950 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:18.025403 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4d5dw" podUID="98691035-8cf9-4daf-b08b-702da9077a5c" Jul 10 01:00:18.025950 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:18.025904 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9h6" podUID="2d15903f-0aa6-41f8-9a4e-ad47872ddd19" Jul 10 01:00:19.024524 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:19.024345 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:19.024524 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:19.024496 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx5ln" podUID="e76bc68e-d074-4131-8788-bfb781cc785a" Jul 10 01:00:20.024348 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:20.024310 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:20.024803 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:20.024445 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4d5dw" podUID="98691035-8cf9-4daf-b08b-702da9077a5c" Jul 10 01:00:20.024803 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:20.024691 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:00:20.024922 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:20.024806 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9h6" podUID="2d15903f-0aa6-41f8-9a4e-ad47872ddd19" Jul 10 01:00:20.589916 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:20.589872 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs\") pod \"network-metrics-daemon-qx5ln\" (UID: \"e76bc68e-d074-4131-8788-bfb781cc785a\") " pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:20.589916 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:20.589924 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98691035-8cf9-4daf-b08b-702da9077a5c-original-pull-secret\") pod \"global-pull-secret-syncer-4d5dw\" (UID: \"98691035-8cf9-4daf-b08b-702da9077a5c\") " pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:20.590157 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:20.590095 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 01:00:20.590157 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:20.590157 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98691035-8cf9-4daf-b08b-702da9077a5c-original-pull-secret podName:98691035-8cf9-4daf-b08b-702da9077a5c nodeName:}" failed. No retries permitted until 2026-07-10 01:00:28.590138386 +0000 UTC m=+17.181619580 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98691035-8cf9-4daf-b08b-702da9077a5c-original-pull-secret") pod "global-pull-secret-syncer-4d5dw" (UID: "98691035-8cf9-4daf-b08b-702da9077a5c") : object "kube-system"/"original-pull-secret" not registered Jul 10 01:00:20.590426 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:20.590347 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 01:00:20.590426 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:20.590408 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs podName:e76bc68e-d074-4131-8788-bfb781cc785a nodeName:}" failed. No retries permitted until 2026-07-10 01:00:28.590394535 +0000 UTC m=+17.181875730 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs") pod "network-metrics-daemon-qx5ln" (UID: "e76bc68e-d074-4131-8788-bfb781cc785a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 01:00:20.691332 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:20.691205 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4tmn\" (UniqueName: \"kubernetes.io/projected/2d15903f-0aa6-41f8-9a4e-ad47872ddd19-kube-api-access-n4tmn\") pod \"network-check-target-9d9h6\" (UID: \"2d15903f-0aa6-41f8-9a4e-ad47872ddd19\") " pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:00:20.691487 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:20.691371 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 01:00:20.691487 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:20.691400 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 01:00:20.691487 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:20.691415 2554 projected.go:196] Error preparing data for projected volume kube-api-access-n4tmn for pod openshift-network-diagnostics/network-check-target-9d9h6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 01:00:20.691659 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:20.691476 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d15903f-0aa6-41f8-9a4e-ad47872ddd19-kube-api-access-n4tmn podName:2d15903f-0aa6-41f8-9a4e-ad47872ddd19 nodeName:}" failed. No retries permitted until 2026-07-10 01:00:28.691458076 +0000 UTC m=+17.282939266 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-n4tmn" (UniqueName: "kubernetes.io/projected/2d15903f-0aa6-41f8-9a4e-ad47872ddd19-kube-api-access-n4tmn") pod "network-check-target-9d9h6" (UID: "2d15903f-0aa6-41f8-9a4e-ad47872ddd19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 01:00:21.025082 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:21.024990 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:21.025482 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:21.025297 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx5ln" podUID="e76bc68e-d074-4131-8788-bfb781cc785a" Jul 10 01:00:22.026518 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:22.026482 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:22.026998 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:22.026528 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:00:22.026998 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:22.026589 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4d5dw" podUID="98691035-8cf9-4daf-b08b-702da9077a5c" Jul 10 01:00:22.026998 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:22.026725 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9h6" podUID="2d15903f-0aa6-41f8-9a4e-ad47872ddd19" Jul 10 01:00:23.024776 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:23.024734 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:23.024958 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:23.024923 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx5ln" podUID="e76bc68e-d074-4131-8788-bfb781cc785a" Jul 10 01:00:24.024587 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:24.024555 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:24.025073 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:24.024697 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4d5dw" podUID="98691035-8cf9-4daf-b08b-702da9077a5c" Jul 10 01:00:24.025073 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:24.024749 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:00:24.025073 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:24.024857 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9h6" podUID="2d15903f-0aa6-41f8-9a4e-ad47872ddd19" Jul 10 01:00:25.025695 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:25.025158 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:25.025695 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:25.025328 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx5ln" podUID="e76bc68e-d074-4131-8788-bfb781cc785a" Jul 10 01:00:26.024935 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:26.024674 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:26.025125 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:26.024729 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:00:26.025125 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:26.025046 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4d5dw" podUID="98691035-8cf9-4daf-b08b-702da9077a5c" Jul 10 01:00:26.025259 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:26.025119 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9h6" podUID="2d15903f-0aa6-41f8-9a4e-ad47872ddd19" Jul 10 01:00:27.024794 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:27.024758 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:27.025216 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:27.024897 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx5ln" podUID="e76bc68e-d074-4131-8788-bfb781cc785a" Jul 10 01:00:28.024391 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:28.024346 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:28.024597 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:28.024407 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:00:28.024597 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:28.024498 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4d5dw" podUID="98691035-8cf9-4daf-b08b-702da9077a5c" Jul 10 01:00:28.024706 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:28.024628 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9h6" podUID="2d15903f-0aa6-41f8-9a4e-ad47872ddd19" Jul 10 01:00:28.651573 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:28.651530 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs\") pod \"network-metrics-daemon-qx5ln\" (UID: \"e76bc68e-d074-4131-8788-bfb781cc785a\") " pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:28.651967 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:28.651585 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98691035-8cf9-4daf-b08b-702da9077a5c-original-pull-secret\") pod \"global-pull-secret-syncer-4d5dw\" (UID: \"98691035-8cf9-4daf-b08b-702da9077a5c\") " pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:28.651967 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:28.651742 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 01:00:28.651967 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:28.651806 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98691035-8cf9-4daf-b08b-702da9077a5c-original-pull-secret podName:98691035-8cf9-4daf-b08b-702da9077a5c nodeName:}" failed. No retries permitted until 2026-07-10 01:00:44.651790956 +0000 UTC m=+33.243272132 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98691035-8cf9-4daf-b08b-702da9077a5c-original-pull-secret") pod "global-pull-secret-syncer-4d5dw" (UID: "98691035-8cf9-4daf-b08b-702da9077a5c") : object "kube-system"/"original-pull-secret" not registered Jul 10 01:00:28.651967 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:28.651742 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 01:00:28.651967 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:28.651878 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs podName:e76bc68e-d074-4131-8788-bfb781cc785a nodeName:}" failed. No retries permitted until 2026-07-10 01:00:44.651865906 +0000 UTC m=+33.243347095 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs") pod "network-metrics-daemon-qx5ln" (UID: "e76bc68e-d074-4131-8788-bfb781cc785a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 01:00:28.752939 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:28.752906 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4tmn\" (UniqueName: \"kubernetes.io/projected/2d15903f-0aa6-41f8-9a4e-ad47872ddd19-kube-api-access-n4tmn\") pod \"network-check-target-9d9h6\" (UID: \"2d15903f-0aa6-41f8-9a4e-ad47872ddd19\") " pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:00:28.753168 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:28.753093 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 01:00:28.753168 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:28.753112 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 01:00:28.753168 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:28.753124 2554 projected.go:196] Error preparing data for projected volume kube-api-access-n4tmn for pod openshift-network-diagnostics/network-check-target-9d9h6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 01:00:28.753360 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:28.753177 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d15903f-0aa6-41f8-9a4e-ad47872ddd19-kube-api-access-n4tmn podName:2d15903f-0aa6-41f8-9a4e-ad47872ddd19 nodeName:}" failed. No retries permitted until 2026-07-10 01:00:44.753160969 +0000 UTC m=+33.344642147 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-n4tmn" (UniqueName: "kubernetes.io/projected/2d15903f-0aa6-41f8-9a4e-ad47872ddd19-kube-api-access-n4tmn") pod "network-check-target-9d9h6" (UID: "2d15903f-0aa6-41f8-9a4e-ad47872ddd19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 01:00:29.025316 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:29.025277 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:29.025452 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:29.025397 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx5ln" podUID="e76bc68e-d074-4131-8788-bfb781cc785a" Jul 10 01:00:30.024659 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:30.024615 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:00:30.025102 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:30.024615 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:30.025102 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:30.024759 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9h6" podUID="2d15903f-0aa6-41f8-9a4e-ad47872ddd19" Jul 10 01:00:30.025102 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:30.024895 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4d5dw" podUID="98691035-8cf9-4daf-b08b-702da9077a5c" Jul 10 01:00:31.024320 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:31.024283 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:31.024506 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:31.024405 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx5ln" podUID="e76bc68e-d074-4131-8788-bfb781cc785a" Jul 10 01:00:32.025886 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:32.025850 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:32.026373 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:32.025978 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4d5dw" podUID="98691035-8cf9-4daf-b08b-702da9077a5c" Jul 10 01:00:32.026373 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:32.026045 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:00:32.026373 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:32.026126 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9h6" podUID="2d15903f-0aa6-41f8-9a4e-ad47872ddd19" Jul 10 01:00:33.024641 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:33.024588 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:33.024822 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:33.024733 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx5ln" podUID="e76bc68e-d074-4131-8788-bfb781cc785a" Jul 10 01:00:34.024952 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:34.024916 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:34.025401 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:34.024965 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:00:34.025401 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:34.025038 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4d5dw" podUID="98691035-8cf9-4daf-b08b-702da9077a5c" Jul 10 01:00:34.025401 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:34.025162 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9h6" podUID="2d15903f-0aa6-41f8-9a4e-ad47872ddd19" Jul 10 01:00:34.163775 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:34.163745 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" event={"ID":"67aec133-13cb-4b4d-9dc0-f858fc60410a","Type":"ContainerStarted","Data":"6358858a6ff2f9348621146a71bf88e8a7acc8cb25d0fd74110fc4019440ec3f"} Jul 10 01:00:34.169827 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:34.169797 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal" event={"ID":"c24d6c8d9b99ab2f60ec24f7270257cc","Type":"ContainerStarted","Data":"c6f57d79540b2401831aec7d268d080c10c6aff18d0087e51d6b063ebd063172"} Jul 10 01:00:34.172666 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:34.172638 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-29q6p" event={"ID":"17e4d0c0-a003-495f-bca4-4fbfbe95b5fb","Type":"ContainerStarted","Data":"78d81beeb948697359f7aa377b4f16aee9ac5eb25d0b9f282d127043f7153928"} Jul 10 01:00:34.183631 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:34.183579 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kwwcc" podStartSLOduration=1.8349197240000001 podStartE2EDuration="22.183560823s" totalImagesPullingTime="20.348641099s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 01:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:00:34.183182998 +0000 UTC m=+22.774664202" watchObservedRunningTime="2026-07-10 01:00:34.183560823 +0000 UTC m=+22.775042022" Jul 10 01:00:34.200872 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:34.200806 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-29q6p" podStartSLOduration=2.7294655260000003 podStartE2EDuration="22.200784287s" totalImagesPullingTime="19.471318761s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 01:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:00:34.200264392 +0000 UTC m=+22.791745593" watchObservedRunningTime="2026-07-10 01:00:34.200784287 +0000 UTC m=+22.792265487" Jul 10 01:00:35.025199 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:35.024884 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:35.025890 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:35.025324 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx5ln" podUID="e76bc68e-d074-4131-8788-bfb781cc785a" Jul 10 01:00:35.176386 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:35.176349 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pvtp7" event={"ID":"76247a4f-c780-4a08-bda6-8e8fc84d6f72","Type":"ContainerStarted","Data":"790d41819e0461339e77c11cdbddfff330ad5da3349b360ec9ee7412783f1a8b"} Jul 10 01:00:35.178876 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:35.178855 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsbgv_38689ba6-fbae-4092-b63e-3488ce589912/ovn-acl-logging/0.log" Jul 10 01:00:35.179181 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:35.179162 2554 generic.go:356] "Generic (PLEG): container finished" podID="38689ba6-fbae-4092-b63e-3488ce589912" containerID="f1b6f2628963230c8be2d5d076d4c190b95e2d86a87be87e722a41a29264ee45" exitCode=1 Jul 10 01:00:35.179273 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:35.179251 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" event={"ID":"38689ba6-fbae-4092-b63e-3488ce589912","Type":"ContainerStarted","Data":"d6ff4e2cdc31ff32d4158099cabdeea1185dcaf3787e1f3ddaeda92e2616f305"} Jul 10 01:00:35.179348 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:35.179333 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" event={"ID":"38689ba6-fbae-4092-b63e-3488ce589912","Type":"ContainerStarted","Data":"2f8f073d4ce36bb60b4b7497b35ca2a059346a1475efd117738801529d138421"} Jul 10 01:00:35.179404 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:35.179388 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" event={"ID":"38689ba6-fbae-4092-b63e-3488ce589912","Type":"ContainerStarted","Data":"e44f5c066fb89227be69895d78f399321e94c69aaf8166945d5f56f942cc1a4d"} Jul 10 01:00:35.179463 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:35.179439 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" event={"ID":"38689ba6-fbae-4092-b63e-3488ce589912","Type":"ContainerStarted","Data":"a5f734cea0a8a27aafd4d311197e2df0945b201648af0e7fba772678041580d1"} Jul 10 01:00:35.179516 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:35.179488 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" event={"ID":"38689ba6-fbae-4092-b63e-3488ce589912","Type":"ContainerDied","Data":"f1b6f2628963230c8be2d5d076d4c190b95e2d86a87be87e722a41a29264ee45"} Jul 10 01:00:35.179568 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:35.179537 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" event={"ID":"38689ba6-fbae-4092-b63e-3488ce589912","Type":"ContainerStarted","Data":"8a7787009b1a6373528b2ea0460bdd1f0c9de9dfd5f11cc8367f160e13c09489"} Jul 10 01:00:35.180609 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:35.180588 2554 generic.go:356] "Generic (PLEG): container finished" podID="1b3fdd7178350c5e8b9bc8be304d81a3" containerID="3e0cb05df0bcb305c00c8a967f90edc1dc68ba085d709ff00e2b4e66fc06666b" exitCode=0 Jul 10 01:00:35.180609 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:35.180606 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" event={"ID":"1b3fdd7178350c5e8b9bc8be304d81a3","Type":"ContainerDied","Data":"3e0cb05df0bcb305c00c8a967f90edc1dc68ba085d709ff00e2b4e66fc06666b"} Jul 10 01:00:35.182049 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:35.182019 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9wsgb" event={"ID":"83331c74-4d85-4282-aade-d6063bc7dd7c","Type":"ContainerStarted","Data":"3f62472316002d0f47a75b93cfc1d4d338490d85bacafffbf79b2ac96a10ff6d"} Jul 10 01:00:35.183526 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:35.183507 2554 generic.go:356] "Generic (PLEG): container finished" podID="975dd67f-4a1f-42b9-88b0-8270b032f818" containerID="a7d601c6ef6876cec19708b8f3d9a5006a1a82b38f0b071a850e123ff187757f" exitCode=0 Jul 10 01:00:35.183614 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:35.183581 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5c4qd" event={"ID":"975dd67f-4a1f-42b9-88b0-8270b032f818","Type":"ContainerDied","Data":"a7d601c6ef6876cec19708b8f3d9a5006a1a82b38f0b071a850e123ff187757f"} Jul 10 01:00:35.184898 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:35.184868 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-thhvj" event={"ID":"be8fc9c0-d919-4435-bc77-ddd249ad1a3c","Type":"ContainerStarted","Data":"02f707f24717591d304ec72043e11b137089d809bfcb03484baa44991a62b048"} Jul 10 01:00:35.186190 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:35.186174 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tc8jw" event={"ID":"09043fd5-e2a5-493e-82b8-f0ac9fa1f99b","Type":"ContainerStarted","Data":"20d3384f61c6f1e826d98ec462fdb4af9da6c77e682f923e64c8bd57b1d28394"} Jul 10 01:00:35.187609 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:35.187588 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b" event={"ID":"29befb9d-1e91-493a-bbbd-8ec09e788e39","Type":"ContainerStarted","Data":"f8dcff5fcce68eac5fbdec5b368906b7db3f6d1320e8b78a6106a74a1d781142"} Jul 10 01:00:35.193887 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:35.193850 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pvtp7" podStartSLOduration=7.457172056 podStartE2EDuration="23.193838318s" totalImagesPullingTime="15.736666262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:00:35.192958402 +0000 UTC m=+23.784439602" watchObservedRunningTime="2026-07-10 01:00:35.193838318 +0000 UTC m=+23.785319517" Jul 10 01:00:35.193976 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:35.193922 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal" podStartSLOduration=23.193917648 podStartE2EDuration="23.193917648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 01:00:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:00:34.21435825 +0000 UTC m=+22.805839449" watchObservedRunningTime="2026-07-10 01:00:35.193917648 +0000 UTC m=+23.785398846" Jul 10 01:00:35.208736 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:35.208686 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-thhvj" podStartSLOduration=2.898929491 podStartE2EDuration="23.208674965s" totalImagesPullingTime="20.309745474s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 01:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:00:35.208539647 +0000 UTC m=+23.800020847" watchObservedRunningTime="2026-07-10 01:00:35.208674965 +0000 UTC m=+23.800156164" Jul 10 01:00:35.239294 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:35.239246 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9wsgb" podStartSLOduration=3.241783532 podStartE2EDuration="23.23919957s" totalImagesPullingTime="19.997416038s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 01:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:00:35.238913903 +0000 UTC m=+23.830395103" watchObservedRunningTime="2026-07-10 01:00:35.23919957 +0000 UTC m=+23.830680774" Jul 10 01:00:35.280904 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:35.280864 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tc8jw" podStartSLOduration=2.932018465 podStartE2EDuration="23.280849336s" totalImagesPullingTime="20.348830871s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 01:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:00:35.280672046 +0000 UTC m=+23.872153246" watchObservedRunningTime="2026-07-10 01:00:35.280849336 +0000 UTC m=+23.872330534" Jul 10 01:00:36.024675 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:36.024641 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:36.024828 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:36.024779 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4d5dw" podUID="98691035-8cf9-4daf-b08b-702da9077a5c" Jul 10 01:00:36.025384 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:36.025187 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:00:36.025384 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:36.025362 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9h6" podUID="2d15903f-0aa6-41f8-9a4e-ad47872ddd19" Jul 10 01:00:36.123435 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:36.123406 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 10 01:00:36.192201 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:36.192159 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b" event={"ID":"29befb9d-1e91-493a-bbbd-8ec09e788e39","Type":"ContainerStarted","Data":"0c83d1f442bffac32ccc8b1f83e626b75b41d846ceba777e156b62ae5119756e"} Jul 10 01:00:36.194283 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:36.194252 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" event={"ID":"1b3fdd7178350c5e8b9bc8be304d81a3","Type":"ContainerStarted","Data":"d3245caec981408d55793ea5931b69a340c5427fa865bb08e46cf19f4f516cd4"} Jul 10 01:00:36.216718 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:36.216667 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" podStartSLOduration=24.216648254 podStartE2EDuration="24.216648254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 01:00:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:00:36.216232269 +0000 UTC m=+24.807713464" watchObservedRunningTime="2026-07-10 01:00:36.216648254 +0000 UTC m=+24.808129455" Jul 10 01:00:36.516137 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:36.516103 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pvtp7" Jul 10 01:00:36.516739 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:36.516717 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pvtp7" Jul 10 01:00:37.024813 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:37.024579 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:37.024971 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:37.024934 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx5ln" podUID="e76bc68e-d074-4131-8788-bfb781cc785a" Jul 10 01:00:37.029431 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:37.029328 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T01:00:36.123430641Z","UUID":"71fca44f-b17a-4ce3-9b19-bfefa694f820","Handler":null,"Name":"","Endpoint":""} Jul 10 01:00:37.031406 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:37.031310 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 10 01:00:37.031406 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:37.031352 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 10 01:00:37.199762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:37.199694 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsbgv_38689ba6-fbae-4092-b63e-3488ce589912/ovn-acl-logging/0.log" Jul 10 01:00:37.200098 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:37.200067 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" event={"ID":"38689ba6-fbae-4092-b63e-3488ce589912","Type":"ContainerStarted","Data":"9ca96930d6e5d61fd082fb57c5a8ff1804d0cfbb5178d12237d7905a6c212485"} Jul 10 01:00:37.200430 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:37.200411 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pvtp7" Jul 10 01:00:37.200824 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:37.200808 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pvtp7" Jul 10 01:00:38.024888 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:38.024856 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:38.025180 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:38.024859 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:00:38.025180 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:38.025058 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9h6" podUID="2d15903f-0aa6-41f8-9a4e-ad47872ddd19" Jul 10 01:00:38.025180 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:38.025052 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4d5dw" podUID="98691035-8cf9-4daf-b08b-702da9077a5c" Jul 10 01:00:38.204682 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:38.204639 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b" event={"ID":"29befb9d-1e91-493a-bbbd-8ec09e788e39","Type":"ContainerStarted","Data":"3ba683a7e9cbf4e6837da991f3bcf96ee5b8224bf14a813a85e99cf533a6ca66"} Jul 10 01:00:38.222610 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:38.222561 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvq2b" podStartSLOduration=7.309765299 podStartE2EDuration="26.222547383s" totalImagesPullingTime="18.912782084s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 01:00:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:00:38.222382359 +0000 UTC m=+26.813863558" watchObservedRunningTime="2026-07-10 01:00:38.222547383 +0000 UTC m=+26.814028581" Jul 10 01:00:39.025055 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:39.025016 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:39.025252 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:39.025157 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx5ln" podUID="e76bc68e-d074-4131-8788-bfb781cc785a" Jul 10 01:00:40.024414 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:40.024381 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:40.025009 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:40.024527 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:00:40.025009 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:40.024533 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4d5dw" podUID="98691035-8cf9-4daf-b08b-702da9077a5c" Jul 10 01:00:40.025009 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:40.024619 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9h6" podUID="2d15903f-0aa6-41f8-9a4e-ad47872ddd19" Jul 10 01:00:41.025134 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:41.024945 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:41.025699 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:41.025246 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx5ln" podUID="e76bc68e-d074-4131-8788-bfb781cc785a" Jul 10 01:00:41.212798 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:41.212763 2554 generic.go:356] "Generic (PLEG): container finished" podID="975dd67f-4a1f-42b9-88b0-8270b032f818" containerID="c16cd803111f12a8c5528dc70b9773f491cde7a642f48f77dee85b49ae5be90e" exitCode=0 Jul 10 01:00:41.213155 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:41.212854 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5c4qd" event={"ID":"975dd67f-4a1f-42b9-88b0-8270b032f818","Type":"ContainerDied","Data":"c16cd803111f12a8c5528dc70b9773f491cde7a642f48f77dee85b49ae5be90e"} Jul 10 01:00:41.216393 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:41.216369 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsbgv_38689ba6-fbae-4092-b63e-3488ce589912/ovn-acl-logging/0.log" Jul 10 01:00:41.216723 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:41.216703 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" event={"ID":"38689ba6-fbae-4092-b63e-3488ce589912","Type":"ContainerStarted","Data":"3c4c4a5db9186e701607b4becb2ec7fc3a7a690ce2418c68b08dfd7ac5e9273f"} Jul 10 01:00:41.217075 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:41.217045 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:41.217290 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:41.217275 2554 scope.go:117] "RemoveContainer" containerID="f1b6f2628963230c8be2d5d076d4c190b95e2d86a87be87e722a41a29264ee45" Jul 10 01:00:41.235977 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:41.235948 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:42.025539 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:42.025507 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:42.026153 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:42.025557 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:00:42.026153 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:42.025626 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4d5dw" podUID="98691035-8cf9-4daf-b08b-702da9077a5c" Jul 10 01:00:42.026153 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:42.025744 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9h6" podUID="2d15903f-0aa6-41f8-9a4e-ad47872ddd19" Jul 10 01:00:42.238306 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:42.238278 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsbgv_38689ba6-fbae-4092-b63e-3488ce589912/ovn-acl-logging/0.log" Jul 10 01:00:42.238647 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:42.238625 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" event={"ID":"38689ba6-fbae-4092-b63e-3488ce589912","Type":"ContainerStarted","Data":"59757401051a78511aa13095e4fd06728e076f7195f2531840105a2092fedc64"} Jul 10 01:00:42.238811 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:42.238790 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:42.238877 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:42.238836 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:42.253802 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:42.253771 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:00:42.267091 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:42.267047 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" podStartSLOduration=9.380663846 podStartE2EDuration="30.267030273s" totalImagesPullingTime="20.886366427s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 01:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:00:42.265272645 +0000 UTC m=+30.856753844" watchObservedRunningTime="2026-07-10 01:00:42.267030273 +0000 UTC m=+30.858511473" Jul 10 01:00:42.653265 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:42.653160 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4d5dw"] Jul 10 01:00:42.653445 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:42.653322 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:42.653445 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:42.653423 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4d5dw" podUID="98691035-8cf9-4daf-b08b-702da9077a5c" Jul 10 01:00:42.656309 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:42.656278 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9d9h6"] Jul 10 01:00:42.656441 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:42.656392 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:00:42.656506 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:42.656478 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9h6" podUID="2d15903f-0aa6-41f8-9a4e-ad47872ddd19" Jul 10 01:00:42.656943 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:42.656922 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qx5ln"] Jul 10 01:00:42.657057 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:42.657020 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:42.657119 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:42.657099 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx5ln" podUID="e76bc68e-d074-4131-8788-bfb781cc785a" Jul 10 01:00:43.242997 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:43.242967 2554 generic.go:356] "Generic (PLEG): container finished" podID="975dd67f-4a1f-42b9-88b0-8270b032f818" containerID="569f61feb22011dfbab7fd67f4bf5f5124b25f55f03cc72151456becee7adb2a" exitCode=0 Jul 10 01:00:43.243476 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:43.243033 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5c4qd" event={"ID":"975dd67f-4a1f-42b9-88b0-8270b032f818","Type":"ContainerDied","Data":"569f61feb22011dfbab7fd67f4bf5f5124b25f55f03cc72151456becee7adb2a"} Jul 10 01:00:44.024492 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:44.024457 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:00:44.024647 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:44.024457 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:44.024647 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:44.024602 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9h6" podUID="2d15903f-0aa6-41f8-9a4e-ad47872ddd19" Jul 10 01:00:44.024720 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:44.024648 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4d5dw" podUID="98691035-8cf9-4daf-b08b-702da9077a5c" Jul 10 01:00:44.662424 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:44.662388 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs\") pod \"network-metrics-daemon-qx5ln\" (UID: \"e76bc68e-d074-4131-8788-bfb781cc785a\") " pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:44.662424 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:44.662426 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98691035-8cf9-4daf-b08b-702da9077a5c-original-pull-secret\") pod \"global-pull-secret-syncer-4d5dw\" (UID: \"98691035-8cf9-4daf-b08b-702da9077a5c\") " pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:44.663113 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:44.662539 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 01:00:44.663113 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:44.662566 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 01:00:44.663113 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:44.662590 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98691035-8cf9-4daf-b08b-702da9077a5c-original-pull-secret podName:98691035-8cf9-4daf-b08b-702da9077a5c nodeName:}" failed. No retries permitted until 2026-07-10 01:01:16.662577561 +0000 UTC m=+65.254058738 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98691035-8cf9-4daf-b08b-702da9077a5c-original-pull-secret") pod "global-pull-secret-syncer-4d5dw" (UID: "98691035-8cf9-4daf-b08b-702da9077a5c") : object "kube-system"/"original-pull-secret" not registered Jul 10 01:00:44.663113 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:44.662626 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs podName:e76bc68e-d074-4131-8788-bfb781cc785a nodeName:}" failed. No retries permitted until 2026-07-10 01:01:16.662608584 +0000 UTC m=+65.254089764 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs") pod "network-metrics-daemon-qx5ln" (UID: "e76bc68e-d074-4131-8788-bfb781cc785a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 01:00:44.763293 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:44.763260 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4tmn\" (UniqueName: \"kubernetes.io/projected/2d15903f-0aa6-41f8-9a4e-ad47872ddd19-kube-api-access-n4tmn\") pod \"network-check-target-9d9h6\" (UID: \"2d15903f-0aa6-41f8-9a4e-ad47872ddd19\") " pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:00:44.763426 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:44.763382 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 01:00:44.763426 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:44.763398 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 01:00:44.763426 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:44.763407 2554 projected.go:196] Error preparing data for projected volume kube-api-access-n4tmn for pod openshift-network-diagnostics/network-check-target-9d9h6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 01:00:44.763528 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:44.763458 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d15903f-0aa6-41f8-9a4e-ad47872ddd19-kube-api-access-n4tmn podName:2d15903f-0aa6-41f8-9a4e-ad47872ddd19 nodeName:}" failed. No retries permitted until 2026-07-10 01:01:16.763443228 +0000 UTC m=+65.354924424 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-n4tmn" (UniqueName: "kubernetes.io/projected/2d15903f-0aa6-41f8-9a4e-ad47872ddd19-kube-api-access-n4tmn") pod "network-check-target-9d9h6" (UID: "2d15903f-0aa6-41f8-9a4e-ad47872ddd19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 01:00:45.025013 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:45.024977 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:45.025129 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:45.025083 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx5ln" podUID="e76bc68e-d074-4131-8788-bfb781cc785a" Jul 10 01:00:45.250057 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:45.250025 2554 generic.go:356] "Generic (PLEG): container finished" podID="975dd67f-4a1f-42b9-88b0-8270b032f818" containerID="f9900ae7f8df630dc4d0891941bddeba7dee4d1e3d282520fa39053b19b5ff01" exitCode=0 Jul 10 01:00:45.250193 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:45.250085 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5c4qd" event={"ID":"975dd67f-4a1f-42b9-88b0-8270b032f818","Type":"ContainerDied","Data":"f9900ae7f8df630dc4d0891941bddeba7dee4d1e3d282520fa39053b19b5ff01"} Jul 10 01:00:46.025144 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.025109 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:46.025880 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.025112 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:00:46.025880 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:46.025210 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4d5dw" podUID="98691035-8cf9-4daf-b08b-702da9077a5c" Jul 10 01:00:46.025880 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:46.025300 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9h6" podUID="2d15903f-0aa6-41f8-9a4e-ad47872ddd19" Jul 10 01:00:46.668921 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.668890 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeReady" Jul 10 01:00:46.669084 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.669046 2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 10 01:00:46.702337 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.702309 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-kkhf6"] Jul 10 01:00:46.705614 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.705596 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75dc4ccdb6-67vrj"] Jul 10 01:00:46.705726 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.705710 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-kkhf6" Jul 10 01:00:46.708401 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.708379 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 10 01:00:46.708583 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.708557 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-kc2m8\"" Jul 10 01:00:46.708671 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.708616 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 10 01:00:46.709945 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.709931 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:00:46.712463 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.712443 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 10 01:00:46.712556 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.712474 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 10 01:00:46.712556 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.712544 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 10 01:00:46.712642 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.712580 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ghnd6\"" Jul 10 01:00:46.718248 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.716804 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-kkhf6"] Jul 10 01:00:46.721189 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.721167 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7q7jk"] Jul 10 01:00:46.722854 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.722678 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 10 01:00:46.725299 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.725264 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75dc4ccdb6-67vrj"] Jul 10 01:00:46.725299 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.725299 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b4kzz"] Jul 10 01:00:46.725801 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.725784 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7q7jk" Jul 10 01:00:46.728642 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.728618 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 10 01:00:46.728768 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.728745 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 10 01:00:46.728949 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.728930 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 10 01:00:46.729272 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.729255 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-86zlv\"" Jul 10 01:00:46.729479 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.729463 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b4kzz" Jul 10 01:00:46.732067 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.732049 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bmxj4\"" Jul 10 01:00:46.732951 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.732932 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 10 01:00:46.733044 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.732951 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 10 01:00:46.734031 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.734008 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7q7jk"] Jul 10 01:00:46.738846 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.738816 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b4kzz"] Jul 10 01:00:46.779293 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.779256 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:00:46.779293 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.779297 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-bound-sa-token\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:00:46.779499 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.779326 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-trusted-ca\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:00:46.779499 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.779357 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-certificates\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:00:46.779499 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.779382 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cthh\" (UniqueName: \"kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-kube-api-access-6cthh\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:00:46.779499 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.779408 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kkhf6\" (UID: \"ed34c96b-f17b-40b0-88de-639790a23f79\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kkhf6" Jul 10 01:00:46.779499 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.779436 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-ca-trust-extracted\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:00:46.779499 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.779462 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-installation-pull-secrets\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:00:46.779499 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.779490 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-image-registry-private-configuration\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:00:46.779743 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.779514 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ed34c96b-f17b-40b0-88de-639790a23f79-nginx-conf\") pod \"networking-console-plugin-6cf856758c-kkhf6\" (UID: \"ed34c96b-f17b-40b0-88de-639790a23f79\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kkhf6" Jul 10 01:00:46.880548 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.880364 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ed34c96b-f17b-40b0-88de-639790a23f79-nginx-conf\") pod \"networking-console-plugin-6cf856758c-kkhf6\" (UID: \"ed34c96b-f17b-40b0-88de-639790a23f79\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kkhf6" Jul 10 01:00:46.880548 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.880413 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r7vj\" (UniqueName: \"kubernetes.io/projected/77c25259-df3b-478e-ba40-7aa97d674ac3-kube-api-access-7r7vj\") pod \"ingress-canary-7q7jk\" (UID: \"77c25259-df3b-478e-ba40-7aa97d674ac3\") " pod="openshift-ingress-canary/ingress-canary-7q7jk" Jul 10 01:00:46.880548 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.880431 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls\") pod \"dns-default-b4kzz\" (UID: \"666a82b2-f068-427d-8a98-6380178c6be9\") " pod="openshift-dns/dns-default-b4kzz" Jul 10 01:00:46.880548 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.880453 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/666a82b2-f068-427d-8a98-6380178c6be9-tmp-dir\") pod \"dns-default-b4kzz\" (UID: \"666a82b2-f068-427d-8a98-6380178c6be9\") " pod="openshift-dns/dns-default-b4kzz" Jul 10 01:00:46.880856 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.880567 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:00:46.880856 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.880592 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-bound-sa-token\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:00:46.880856 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.880623 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-trusted-ca\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:00:46.880856 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.880647 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/666a82b2-f068-427d-8a98-6380178c6be9-config-volume\") pod \"dns-default-b4kzz\" (UID: \"666a82b2-f068-427d-8a98-6380178c6be9\") " pod="openshift-dns/dns-default-b4kzz" Jul 10 01:00:46.880856 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.880675 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-certificates\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:00:46.880856 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.880698 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cthh\" (UniqueName: \"kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-kube-api-access-6cthh\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:00:46.880856 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.880722 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kkhf6\" (UID: \"ed34c96b-f17b-40b0-88de-639790a23f79\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kkhf6" Jul 10 01:00:46.880856 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.880748 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77c25259-df3b-478e-ba40-7aa97d674ac3-cert\") pod \"ingress-canary-7q7jk\" (UID: \"77c25259-df3b-478e-ba40-7aa97d674ac3\") " pod="openshift-ingress-canary/ingress-canary-7q7jk" Jul 10 01:00:46.880856 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.880776 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-ca-trust-extracted\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:00:46.880856 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.880803 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l65jn\" (UniqueName: \"kubernetes.io/projected/666a82b2-f068-427d-8a98-6380178c6be9-kube-api-access-l65jn\") pod \"dns-default-b4kzz\" (UID: \"666a82b2-f068-427d-8a98-6380178c6be9\") " pod="openshift-dns/dns-default-b4kzz" Jul 10 01:00:46.880856 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.880835 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-installation-pull-secrets\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:00:46.881335 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.880867 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-image-registry-private-configuration\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:00:46.881335 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:46.881200 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 01:00:46.881335 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.881206 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ed34c96b-f17b-40b0-88de-639790a23f79-nginx-conf\") pod \"networking-console-plugin-6cf856758c-kkhf6\" (UID: \"ed34c96b-f17b-40b0-88de-639790a23f79\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kkhf6" Jul 10 01:00:46.881335 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:46.881232 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75dc4ccdb6-67vrj: secret "image-registry-tls" not found Jul 10 01:00:46.881335 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:46.881326 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls podName:8d5e8a39-1653-4164-9940-cd2fb9c7fee2 nodeName:}" failed. No retries permitted until 2026-07-10 01:00:47.38130704 +0000 UTC m=+35.972788234 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls") pod "image-registry-75dc4ccdb6-67vrj" (UID: "8d5e8a39-1653-4164-9940-cd2fb9c7fee2") : secret "image-registry-tls" not found Jul 10 01:00:46.881556 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.881527 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-ca-trust-extracted\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:00:46.881556 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:46.881541 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 01:00:46.881647 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:46.881625 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert podName:ed34c96b-f17b-40b0-88de-639790a23f79 nodeName:}" failed. No retries permitted until 2026-07-10 01:00:47.381599672 +0000 UTC m=+35.973080867 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-kkhf6" (UID: "ed34c96b-f17b-40b0-88de-639790a23f79") : secret "networking-console-plugin-cert" not found Jul 10 01:00:46.881647 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.881635 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-certificates\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:00:46.881997 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.881961 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-trusted-ca\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:00:46.885458 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.885440 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-installation-pull-secrets\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:00:46.885551 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.885458 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-image-registry-private-configuration\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:00:46.892762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.892737 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-bound-sa-token\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:00:46.892999 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.892978 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cthh\" (UniqueName: \"kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-kube-api-access-6cthh\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:00:46.981483 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.981451 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r7vj\" (UniqueName: \"kubernetes.io/projected/77c25259-df3b-478e-ba40-7aa97d674ac3-kube-api-access-7r7vj\") pod \"ingress-canary-7q7jk\" (UID: \"77c25259-df3b-478e-ba40-7aa97d674ac3\") " pod="openshift-ingress-canary/ingress-canary-7q7jk" Jul 10 01:00:46.981483 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.981487 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls\") pod \"dns-default-b4kzz\" (UID: \"666a82b2-f068-427d-8a98-6380178c6be9\") " pod="openshift-dns/dns-default-b4kzz" Jul 10 01:00:46.981709 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.981507 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/666a82b2-f068-427d-8a98-6380178c6be9-tmp-dir\") pod \"dns-default-b4kzz\" (UID: \"666a82b2-f068-427d-8a98-6380178c6be9\") " pod="openshift-dns/dns-default-b4kzz" Jul 10 01:00:46.981709 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.981602 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/666a82b2-f068-427d-8a98-6380178c6be9-config-volume\") pod \"dns-default-b4kzz\" (UID: \"666a82b2-f068-427d-8a98-6380178c6be9\") " pod="openshift-dns/dns-default-b4kzz" Jul 10 01:00:46.981709 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:46.981629 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 01:00:46.981709 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:46.981705 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls podName:666a82b2-f068-427d-8a98-6380178c6be9 nodeName:}" failed. No retries permitted until 2026-07-10 01:00:47.481682027 +0000 UTC m=+36.073163214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls") pod "dns-default-b4kzz" (UID: "666a82b2-f068-427d-8a98-6380178c6be9") : secret "dns-default-metrics-tls" not found Jul 10 01:00:46.981917 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.981636 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77c25259-df3b-478e-ba40-7aa97d674ac3-cert\") pod \"ingress-canary-7q7jk\" (UID: \"77c25259-df3b-478e-ba40-7aa97d674ac3\") " pod="openshift-ingress-canary/ingress-canary-7q7jk" Jul 10 01:00:46.981917 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.981823 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l65jn\" (UniqueName: \"kubernetes.io/projected/666a82b2-f068-427d-8a98-6380178c6be9-kube-api-access-l65jn\") pod \"dns-default-b4kzz\" (UID: \"666a82b2-f068-427d-8a98-6380178c6be9\") " pod="openshift-dns/dns-default-b4kzz" Jul 10 01:00:46.982012 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.981982 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/666a82b2-f068-427d-8a98-6380178c6be9-tmp-dir\") pod \"dns-default-b4kzz\" (UID: \"666a82b2-f068-427d-8a98-6380178c6be9\") " pod="openshift-dns/dns-default-b4kzz" Jul 10 01:00:46.982496 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.982469 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/666a82b2-f068-427d-8a98-6380178c6be9-config-volume\") pod \"dns-default-b4kzz\" (UID: \"666a82b2-f068-427d-8a98-6380178c6be9\") " pod="openshift-dns/dns-default-b4kzz" Jul 10 01:00:46.984258 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.984210 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77c25259-df3b-478e-ba40-7aa97d674ac3-cert\") pod \"ingress-canary-7q7jk\" (UID: \"77c25259-df3b-478e-ba40-7aa97d674ac3\") " pod="openshift-ingress-canary/ingress-canary-7q7jk" Jul 10 01:00:46.990936 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.990911 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l65jn\" (UniqueName: \"kubernetes.io/projected/666a82b2-f068-427d-8a98-6380178c6be9-kube-api-access-l65jn\") pod \"dns-default-b4kzz\" (UID: \"666a82b2-f068-427d-8a98-6380178c6be9\") " pod="openshift-dns/dns-default-b4kzz" Jul 10 01:00:46.991039 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:46.990921 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r7vj\" (UniqueName: \"kubernetes.io/projected/77c25259-df3b-478e-ba40-7aa97d674ac3-kube-api-access-7r7vj\") pod \"ingress-canary-7q7jk\" (UID: \"77c25259-df3b-478e-ba40-7aa97d674ac3\") " pod="openshift-ingress-canary/ingress-canary-7q7jk" Jul 10 01:00:47.024816 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:47.024786 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:00:47.027897 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:47.027870 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 01:00:47.028651 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:47.027913 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jjnvz\"" Jul 10 01:00:47.038906 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:47.038883 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7q7jk" Jul 10 01:00:47.192818 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:47.192447 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7q7jk"] Jul 10 01:00:47.196342 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:00:47.196313 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77c25259_df3b_478e_ba40_7aa97d674ac3.slice/crio-a1fdbc4576dac6eb3718b45b879e2ff49683fc7ad74021b8858fdb9cb2260f58 WatchSource:0}: Error finding container a1fdbc4576dac6eb3718b45b879e2ff49683fc7ad74021b8858fdb9cb2260f58: Status 404 returned error can't find the container with id a1fdbc4576dac6eb3718b45b879e2ff49683fc7ad74021b8858fdb9cb2260f58 Jul 10 01:00:47.256144 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:47.256099 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7q7jk" event={"ID":"77c25259-df3b-478e-ba40-7aa97d674ac3","Type":"ContainerStarted","Data":"a1fdbc4576dac6eb3718b45b879e2ff49683fc7ad74021b8858fdb9cb2260f58"} Jul 10 01:00:47.385485 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:47.385442 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:00:47.385670 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:47.385495 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kkhf6\" (UID: \"ed34c96b-f17b-40b0-88de-639790a23f79\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kkhf6" Jul 10 01:00:47.385670 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:47.385598 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 01:00:47.385670 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:47.385607 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 01:00:47.385670 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:47.385625 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75dc4ccdb6-67vrj: secret "image-registry-tls" not found Jul 10 01:00:47.385670 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:47.385669 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert podName:ed34c96b-f17b-40b0-88de-639790a23f79 nodeName:}" failed. No retries permitted until 2026-07-10 01:00:48.385653045 +0000 UTC m=+36.977134242 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-kkhf6" (UID: "ed34c96b-f17b-40b0-88de-639790a23f79") : secret "networking-console-plugin-cert" not found Jul 10 01:00:47.385918 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:47.385688 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls podName:8d5e8a39-1653-4164-9940-cd2fb9c7fee2 nodeName:}" failed. No retries permitted until 2026-07-10 01:00:48.385677239 +0000 UTC m=+36.977158418 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls") pod "image-registry-75dc4ccdb6-67vrj" (UID: "8d5e8a39-1653-4164-9940-cd2fb9c7fee2") : secret "image-registry-tls" not found Jul 10 01:00:47.486619 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:47.486581 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls\") pod \"dns-default-b4kzz\" (UID: \"666a82b2-f068-427d-8a98-6380178c6be9\") " pod="openshift-dns/dns-default-b4kzz" Jul 10 01:00:47.486811 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:47.486759 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 01:00:47.486859 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:47.486835 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls podName:666a82b2-f068-427d-8a98-6380178c6be9 nodeName:}" failed. No retries permitted until 2026-07-10 01:00:48.486814579 +0000 UTC m=+37.078295758 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls") pod "dns-default-b4kzz" (UID: "666a82b2-f068-427d-8a98-6380178c6be9") : secret "dns-default-metrics-tls" not found Jul 10 01:00:48.024995 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:48.024958 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:00:48.025338 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:48.025176 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:00:48.029115 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:48.029088 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 01:00:48.029510 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:48.029088 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 01:00:48.030292 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:48.030269 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dbd7q\"" Jul 10 01:00:48.030422 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:48.030275 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 01:00:48.395164 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:48.395074 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:00:48.395164 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:48.395140 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kkhf6\" (UID: \"ed34c96b-f17b-40b0-88de-639790a23f79\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kkhf6" Jul 10 01:00:48.395433 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:48.395255 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 01:00:48.395433 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:48.395277 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75dc4ccdb6-67vrj: secret "image-registry-tls" not found Jul 10 01:00:48.395433 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:48.395291 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 01:00:48.395433 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:48.395344 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls podName:8d5e8a39-1653-4164-9940-cd2fb9c7fee2 nodeName:}" failed. No retries permitted until 2026-07-10 01:00:50.395322893 +0000 UTC m=+38.986804087 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls") pod "image-registry-75dc4ccdb6-67vrj" (UID: "8d5e8a39-1653-4164-9940-cd2fb9c7fee2") : secret "image-registry-tls" not found Jul 10 01:00:48.395433 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:48.395368 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert podName:ed34c96b-f17b-40b0-88de-639790a23f79 nodeName:}" failed. No retries permitted until 2026-07-10 01:00:50.395358548 +0000 UTC m=+38.986839725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-kkhf6" (UID: "ed34c96b-f17b-40b0-88de-639790a23f79") : secret "networking-console-plugin-cert" not found Jul 10 01:00:48.495748 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:48.495702 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls\") pod \"dns-default-b4kzz\" (UID: \"666a82b2-f068-427d-8a98-6380178c6be9\") " pod="openshift-dns/dns-default-b4kzz" Jul 10 01:00:48.495981 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:48.495879 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 01:00:48.495981 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:48.495959 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls podName:666a82b2-f068-427d-8a98-6380178c6be9 nodeName:}" failed. No retries permitted until 2026-07-10 01:00:50.495938536 +0000 UTC m=+39.087419718 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls") pod "dns-default-b4kzz" (UID: "666a82b2-f068-427d-8a98-6380178c6be9") : secret "dns-default-metrics-tls" not found Jul 10 01:00:50.410834 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:50.410800 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:00:50.410834 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:50.410849 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kkhf6\" (UID: \"ed34c96b-f17b-40b0-88de-639790a23f79\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kkhf6" Jul 10 01:00:50.411403 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:50.410965 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 01:00:50.411403 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:50.410969 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 01:00:50.411403 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:50.411026 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert podName:ed34c96b-f17b-40b0-88de-639790a23f79 nodeName:}" failed. No retries permitted until 2026-07-10 01:00:54.411008759 +0000 UTC m=+43.002489950 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-kkhf6" (UID: "ed34c96b-f17b-40b0-88de-639790a23f79") : secret "networking-console-plugin-cert" not found Jul 10 01:00:50.411403 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:50.411041 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75dc4ccdb6-67vrj: secret "image-registry-tls" not found Jul 10 01:00:50.411403 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:50.411106 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls podName:8d5e8a39-1653-4164-9940-cd2fb9c7fee2 nodeName:}" failed. No retries permitted until 2026-07-10 01:00:54.411087523 +0000 UTC m=+43.002568700 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls") pod "image-registry-75dc4ccdb6-67vrj" (UID: "8d5e8a39-1653-4164-9940-cd2fb9c7fee2") : secret "image-registry-tls" not found Jul 10 01:00:50.512365 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:50.512330 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls\") pod \"dns-default-b4kzz\" (UID: \"666a82b2-f068-427d-8a98-6380178c6be9\") " pod="openshift-dns/dns-default-b4kzz" Jul 10 01:00:50.512534 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:50.512496 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 01:00:50.512582 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:50.512563 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls podName:666a82b2-f068-427d-8a98-6380178c6be9 nodeName:}" failed. No retries permitted until 2026-07-10 01:00:54.512544259 +0000 UTC m=+43.104025452 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls") pod "dns-default-b4kzz" (UID: "666a82b2-f068-427d-8a98-6380178c6be9") : secret "dns-default-metrics-tls" not found Jul 10 01:00:52.271107 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:52.270919 2554 generic.go:356] "Generic (PLEG): container finished" podID="975dd67f-4a1f-42b9-88b0-8270b032f818" containerID="fb1af7b335786cc16510611392e48f8bdfdec0f036782836c367d048ac67cf53" exitCode=0 Jul 10 01:00:52.271671 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:52.270999 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5c4qd" event={"ID":"975dd67f-4a1f-42b9-88b0-8270b032f818","Type":"ContainerDied","Data":"fb1af7b335786cc16510611392e48f8bdfdec0f036782836c367d048ac67cf53"} Jul 10 01:00:52.272748 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:52.272726 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7q7jk" event={"ID":"77c25259-df3b-478e-ba40-7aa97d674ac3","Type":"ContainerStarted","Data":"da7c8d835efb7099ef6a22f44a08ae3e40d4e76f1d42c039b71b9b30d49343ed"} Jul 10 01:00:52.309594 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:52.309505 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7q7jk" podStartSLOduration=2.241911812 podStartE2EDuration="6.309484402s" totalImagesPullingTime="4.06757259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:00:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:00:52.308945393 +0000 UTC m=+40.900426597" watchObservedRunningTime="2026-07-10 01:00:52.309484402 +0000 UTC m=+40.900965602" Jul 10 01:00:53.277892 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:53.277856 2554 generic.go:356] "Generic (PLEG): container finished" podID="975dd67f-4a1f-42b9-88b0-8270b032f818" containerID="1f0a42f6b669c34106499d72c058f0d8ecfe4fe64538d552d203e4e38351c25f" exitCode=0 Jul 10 01:00:53.278367 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:53.277939 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5c4qd" event={"ID":"975dd67f-4a1f-42b9-88b0-8270b032f818","Type":"ContainerDied","Data":"1f0a42f6b669c34106499d72c058f0d8ecfe4fe64538d552d203e4e38351c25f"} Jul 10 01:00:54.288931 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:54.288889 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5c4qd" event={"ID":"975dd67f-4a1f-42b9-88b0-8270b032f818","Type":"ContainerStarted","Data":"3ed01b850e01b5d0bee58ecd77d6c444023c74f0724982d228e56160d91860f9"} Jul 10 01:00:54.312083 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:54.312031 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5c4qd" podStartSLOduration=11.631087692 podStartE2EDuration="42.312015369s" totalImagesPullingTime="30.680927677s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 01:00:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:00:54.31032351 +0000 UTC m=+42.901804710" watchObservedRunningTime="2026-07-10 01:00:54.312015369 +0000 UTC m=+42.903496583" Jul 10 01:00:54.443855 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:54.443818 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:00:54.444016 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:54.443890 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kkhf6\" (UID: \"ed34c96b-f17b-40b0-88de-639790a23f79\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kkhf6" Jul 10 01:00:54.444016 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:54.443972 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 01:00:54.444150 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:54.444020 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 01:00:54.444150 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:54.444039 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75dc4ccdb6-67vrj: secret "image-registry-tls" not found Jul 10 01:00:54.444150 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:54.444046 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert podName:ed34c96b-f17b-40b0-88de-639790a23f79 nodeName:}" failed. No retries permitted until 2026-07-10 01:01:02.444027787 +0000 UTC m=+51.035508985 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-kkhf6" (UID: "ed34c96b-f17b-40b0-88de-639790a23f79") : secret "networking-console-plugin-cert" not found Jul 10 01:00:54.444150 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:54.444097 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls podName:8d5e8a39-1653-4164-9940-cd2fb9c7fee2 nodeName:}" failed. No retries permitted until 2026-07-10 01:01:02.444079521 +0000 UTC m=+51.035560706 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls") pod "image-registry-75dc4ccdb6-67vrj" (UID: "8d5e8a39-1653-4164-9940-cd2fb9c7fee2") : secret "image-registry-tls" not found Jul 10 01:00:54.545385 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:00:54.545294 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls\") pod \"dns-default-b4kzz\" (UID: \"666a82b2-f068-427d-8a98-6380178c6be9\") " pod="openshift-dns/dns-default-b4kzz" Jul 10 01:00:54.545528 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:54.545410 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 01:00:54.545528 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:00:54.545465 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls podName:666a82b2-f068-427d-8a98-6380178c6be9 nodeName:}" failed. No retries permitted until 2026-07-10 01:01:02.545452075 +0000 UTC m=+51.136933251 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls") pod "dns-default-b4kzz" (UID: "666a82b2-f068-427d-8a98-6380178c6be9") : secret "dns-default-metrics-tls" not found Jul 10 01:01:02.502522 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:02.502481 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:01:02.502989 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:02.502531 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kkhf6\" (UID: \"ed34c96b-f17b-40b0-88de-639790a23f79\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kkhf6" Jul 10 01:01:02.502989 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:01:02.502638 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 01:01:02.502989 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:01:02.502664 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75dc4ccdb6-67vrj: secret "image-registry-tls" not found Jul 10 01:01:02.502989 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:01:02.502717 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls podName:8d5e8a39-1653-4164-9940-cd2fb9c7fee2 nodeName:}" failed. No retries permitted until 2026-07-10 01:01:18.502700432 +0000 UTC m=+67.094181609 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls") pod "image-registry-75dc4ccdb6-67vrj" (UID: "8d5e8a39-1653-4164-9940-cd2fb9c7fee2") : secret "image-registry-tls" not found Jul 10 01:01:02.502989 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:01:02.502631 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 01:01:02.502989 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:01:02.502789 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert podName:ed34c96b-f17b-40b0-88de-639790a23f79 nodeName:}" failed. No retries permitted until 2026-07-10 01:01:18.502774684 +0000 UTC m=+67.094255880 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-kkhf6" (UID: "ed34c96b-f17b-40b0-88de-639790a23f79") : secret "networking-console-plugin-cert" not found Jul 10 01:01:02.603740 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:02.603707 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls\") pod \"dns-default-b4kzz\" (UID: \"666a82b2-f068-427d-8a98-6380178c6be9\") " pod="openshift-dns/dns-default-b4kzz" Jul 10 01:01:02.603907 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:01:02.603868 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 01:01:02.603946 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:01:02.603939 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls podName:666a82b2-f068-427d-8a98-6380178c6be9 nodeName:}" failed. No retries permitted until 2026-07-10 01:01:18.603923826 +0000 UTC m=+67.195405007 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls") pod "dns-default-b4kzz" (UID: "666a82b2-f068-427d-8a98-6380178c6be9") : secret "dns-default-metrics-tls" not found Jul 10 01:01:14.255189 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:14.255155 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dsbgv" Jul 10 01:01:16.711256 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:16.711181 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs\") pod \"network-metrics-daemon-qx5ln\" (UID: \"e76bc68e-d074-4131-8788-bfb781cc785a\") " pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:01:16.711660 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:16.711266 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98691035-8cf9-4daf-b08b-702da9077a5c-original-pull-secret\") pod \"global-pull-secret-syncer-4d5dw\" (UID: \"98691035-8cf9-4daf-b08b-702da9077a5c\") " pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:01:16.714379 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:16.714349 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 01:01:16.714379 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:16.714359 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 01:01:16.721889 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:01:16.721870 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 10 01:01:16.721976 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:01:16.721932 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs podName:e76bc68e-d074-4131-8788-bfb781cc785a nodeName:}" failed. No retries permitted until 2026-07-10 01:02:20.721913829 +0000 UTC m=+129.313395009 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs") pod "network-metrics-daemon-qx5ln" (UID: "e76bc68e-d074-4131-8788-bfb781cc785a") : secret "metrics-daemon-secret" not found Jul 10 01:01:16.725646 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:16.725622 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98691035-8cf9-4daf-b08b-702da9077a5c-original-pull-secret\") pod \"global-pull-secret-syncer-4d5dw\" (UID: \"98691035-8cf9-4daf-b08b-702da9077a5c\") " pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:01:16.811826 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:16.811788 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4tmn\" (UniqueName: \"kubernetes.io/projected/2d15903f-0aa6-41f8-9a4e-ad47872ddd19-kube-api-access-n4tmn\") pod \"network-check-target-9d9h6\" (UID: \"2d15903f-0aa6-41f8-9a4e-ad47872ddd19\") " pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:01:16.814817 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:16.814797 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 01:01:16.825354 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:16.825334 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 01:01:16.835760 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:16.835732 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4tmn\" (UniqueName: \"kubernetes.io/projected/2d15903f-0aa6-41f8-9a4e-ad47872ddd19-kube-api-access-n4tmn\") pod \"network-check-target-9d9h6\" (UID: \"2d15903f-0aa6-41f8-9a4e-ad47872ddd19\") " pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:01:16.839537 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:16.839517 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4d5dw" Jul 10 01:01:16.847555 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:16.847533 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dbd7q\"" Jul 10 01:01:16.855741 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:16.855718 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:01:16.970527 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:16.970451 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4d5dw"] Jul 10 01:01:16.973577 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:01:16.973552 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98691035_8cf9_4daf_b08b_702da9077a5c.slice/crio-0cbd988c044f655899564b44729f631a9a0535fba2a805ce8d4bc864a76ba9d2 WatchSource:0}: Error finding container 0cbd988c044f655899564b44729f631a9a0535fba2a805ce8d4bc864a76ba9d2: Status 404 returned error can't find the container with id 0cbd988c044f655899564b44729f631a9a0535fba2a805ce8d4bc864a76ba9d2 Jul 10 01:01:16.987613 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:16.987584 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9d9h6"] Jul 10 01:01:16.990115 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:01:16.990095 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d15903f_0aa6_41f8_9a4e_ad47872ddd19.slice/crio-8face4314da1d9df6d786b7ed10abaf1eca2b1c00c623f6b13c5b9e50c1b94a3 WatchSource:0}: Error finding container 8face4314da1d9df6d786b7ed10abaf1eca2b1c00c623f6b13c5b9e50c1b94a3: Status 404 returned error can't find the container with id 8face4314da1d9df6d786b7ed10abaf1eca2b1c00c623f6b13c5b9e50c1b94a3 Jul 10 01:01:17.342854 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:17.342761 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9d9h6" event={"ID":"2d15903f-0aa6-41f8-9a4e-ad47872ddd19","Type":"ContainerStarted","Data":"8face4314da1d9df6d786b7ed10abaf1eca2b1c00c623f6b13c5b9e50c1b94a3"} Jul 10 01:01:17.343696 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:17.343669 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4d5dw" event={"ID":"98691035-8cf9-4daf-b08b-702da9077a5c","Type":"ContainerStarted","Data":"0cbd988c044f655899564b44729f631a9a0535fba2a805ce8d4bc864a76ba9d2"} Jul 10 01:01:18.524661 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:18.524480 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:01:18.524661 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:18.524527 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kkhf6\" (UID: \"ed34c96b-f17b-40b0-88de-639790a23f79\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kkhf6" Jul 10 01:01:18.524661 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:01:18.524633 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 01:01:18.525251 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:01:18.524696 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert podName:ed34c96b-f17b-40b0-88de-639790a23f79 nodeName:}" failed. No retries permitted until 2026-07-10 01:01:50.524677858 +0000 UTC m=+99.116159048 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-kkhf6" (UID: "ed34c96b-f17b-40b0-88de-639790a23f79") : secret "networking-console-plugin-cert" not found Jul 10 01:01:18.525251 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:01:18.524637 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 01:01:18.525251 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:01:18.525064 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75dc4ccdb6-67vrj: secret "image-registry-tls" not found Jul 10 01:01:18.525251 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:01:18.525113 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls podName:8d5e8a39-1653-4164-9940-cd2fb9c7fee2 nodeName:}" failed. No retries permitted until 2026-07-10 01:01:50.525097947 +0000 UTC m=+99.116579126 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls") pod "image-registry-75dc4ccdb6-67vrj" (UID: "8d5e8a39-1653-4164-9940-cd2fb9c7fee2") : secret "image-registry-tls" not found Jul 10 01:01:18.625545 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:18.625479 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls\") pod \"dns-default-b4kzz\" (UID: \"666a82b2-f068-427d-8a98-6380178c6be9\") " pod="openshift-dns/dns-default-b4kzz" Jul 10 01:01:18.625731 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:01:18.625663 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 01:01:18.625796 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:01:18.625735 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls podName:666a82b2-f068-427d-8a98-6380178c6be9 nodeName:}" failed. No retries permitted until 2026-07-10 01:01:50.625714801 +0000 UTC m=+99.217195980 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls") pod "dns-default-b4kzz" (UID: "666a82b2-f068-427d-8a98-6380178c6be9") : secret "dns-default-metrics-tls" not found Jul 10 01:01:22.358158 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:22.358056 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9d9h6" event={"ID":"2d15903f-0aa6-41f8-9a4e-ad47872ddd19","Type":"ContainerStarted","Data":"62ea6483522886adaa0e86d01e1d377e904d12485248fd517443d7d73e8823f3"} Jul 10 01:01:22.358158 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:22.358125 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:01:22.359527 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:22.359498 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4d5dw" event={"ID":"98691035-8cf9-4daf-b08b-702da9077a5c","Type":"ContainerStarted","Data":"a3bb33deb41eedcda97d7cd9f801370ca13cf51018ba6aeac651cd7e5d1ce46d"} Jul 10 01:01:22.376371 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:22.376324 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9d9h6" podStartSLOduration=65.293312842 podStartE2EDuration="1m10.376309399s" totalImagesPullingTime="5.082996557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:01:22.375468188 +0000 UTC m=+70.966949388" watchObservedRunningTime="2026-07-10 01:01:22.376309399 +0000 UTC m=+70.967790598" Jul 10 01:01:22.390445 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:22.390385 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4d5dw" podStartSLOduration=65.279072658 podStartE2EDuration="1m10.390369333s" totalImagesPullingTime="5.111296675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 01:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:01:22.389824135 +0000 UTC m=+70.981305334" watchObservedRunningTime="2026-07-10 01:01:22.390369333 +0000 UTC m=+70.981850533" Jul 10 01:01:50.542497 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:50.542449 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:01:50.542497 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:50.542503 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kkhf6\" (UID: \"ed34c96b-f17b-40b0-88de-639790a23f79\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kkhf6" Jul 10 01:01:50.543044 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:01:50.542597 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 01:01:50.543044 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:01:50.542605 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 01:01:50.543044 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:01:50.542624 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75dc4ccdb6-67vrj: secret "image-registry-tls" not found Jul 10 01:01:50.543044 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:01:50.542660 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert podName:ed34c96b-f17b-40b0-88de-639790a23f79 nodeName:}" failed. No retries permitted until 2026-07-10 01:02:54.542644333 +0000 UTC m=+163.134125510 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-kkhf6" (UID: "ed34c96b-f17b-40b0-88de-639790a23f79") : secret "networking-console-plugin-cert" not found Jul 10 01:01:50.543044 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:01:50.542672 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls podName:8d5e8a39-1653-4164-9940-cd2fb9c7fee2 nodeName:}" failed. No retries permitted until 2026-07-10 01:02:54.542666385 +0000 UTC m=+163.134147562 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls") pod "image-registry-75dc4ccdb6-67vrj" (UID: "8d5e8a39-1653-4164-9940-cd2fb9c7fee2") : secret "image-registry-tls" not found Jul 10 01:01:50.643074 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:50.643032 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls\") pod \"dns-default-b4kzz\" (UID: \"666a82b2-f068-427d-8a98-6380178c6be9\") " pod="openshift-dns/dns-default-b4kzz" Jul 10 01:01:50.643289 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:01:50.643179 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 01:01:50.643289 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:01:50.643258 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls podName:666a82b2-f068-427d-8a98-6380178c6be9 nodeName:}" failed. No retries permitted until 2026-07-10 01:02:54.643241409 +0000 UTC m=+163.234722586 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls") pod "dns-default-b4kzz" (UID: "666a82b2-f068-427d-8a98-6380178c6be9") : secret "dns-default-metrics-tls" not found Jul 10 01:01:53.363503 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:01:53.363469 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9d9h6" Jul 10 01:02:20.747421 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:02:20.747369 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs\") pod \"network-metrics-daemon-qx5ln\" (UID: \"e76bc68e-d074-4131-8788-bfb781cc785a\") " pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:02:20.747903 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:02:20.747521 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 10 01:02:20.747903 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:02:20.747597 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs podName:e76bc68e-d074-4131-8788-bfb781cc785a nodeName:}" failed. No retries permitted until 2026-07-10 01:04:22.747579819 +0000 UTC m=+251.339061000 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs") pod "network-metrics-daemon-qx5ln" (UID: "e76bc68e-d074-4131-8788-bfb781cc785a") : secret "metrics-daemon-secret" not found Jul 10 01:02:49.719350 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:02:49.719295 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-kkhf6" podUID="ed34c96b-f17b-40b0-88de-639790a23f79" Jul 10 01:02:49.727443 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:02:49.727410 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" podUID="8d5e8a39-1653-4164-9940-cd2fb9c7fee2" Jul 10 01:02:49.744735 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:02:49.744707 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-b4kzz" podUID="666a82b2-f068-427d-8a98-6380178c6be9" Jul 10 01:02:50.036792 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:02:50.036686 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qx5ln" podUID="e76bc68e-d074-4131-8788-bfb781cc785a" Jul 10 01:02:50.562634 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:02:50.562606 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-kkhf6" Jul 10 01:02:50.562781 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:02:50.562606 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b4kzz" Jul 10 01:02:50.562820 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:02:50.562611 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:02:54.578807 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:02:54.578778 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:02:54.579208 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:02:54.578821 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kkhf6\" (UID: \"ed34c96b-f17b-40b0-88de-639790a23f79\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kkhf6" Jul 10 01:02:54.579208 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:02:54.578929 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 01:02:54.579208 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:02:54.578951 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75dc4ccdb6-67vrj: secret "image-registry-tls" not found Jul 10 01:02:54.579208 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:02:54.579011 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls podName:8d5e8a39-1653-4164-9940-cd2fb9c7fee2 nodeName:}" failed. No retries permitted until 2026-07-10 01:04:56.578995382 +0000 UTC m=+285.170476561 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls") pod "image-registry-75dc4ccdb6-67vrj" (UID: "8d5e8a39-1653-4164-9940-cd2fb9c7fee2") : secret "image-registry-tls" not found Jul 10 01:02:54.579208 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:02:54.578936 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 01:02:54.579208 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:02:54.579090 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert podName:ed34c96b-f17b-40b0-88de-639790a23f79 nodeName:}" failed. No retries permitted until 2026-07-10 01:04:56.579077477 +0000 UTC m=+285.170558654 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-kkhf6" (UID: "ed34c96b-f17b-40b0-88de-639790a23f79") : secret "networking-console-plugin-cert" not found Jul 10 01:02:54.679872 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:02:54.679842 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls\") pod \"dns-default-b4kzz\" (UID: \"666a82b2-f068-427d-8a98-6380178c6be9\") " pod="openshift-dns/dns-default-b4kzz" Jul 10 01:02:54.680013 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:02:54.679986 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 01:02:54.680057 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:02:54.680045 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls podName:666a82b2-f068-427d-8a98-6380178c6be9 nodeName:}" failed. No retries permitted until 2026-07-10 01:04:56.680030087 +0000 UTC m=+285.271511267 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls") pod "dns-default-b4kzz" (UID: "666a82b2-f068-427d-8a98-6380178c6be9") : secret "dns-default-metrics-tls" not found Jul 10 01:03:01.024341 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:03:01.024293 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:04:22.804288 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:22.804207 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs\") pod \"network-metrics-daemon-qx5ln\" (UID: \"e76bc68e-d074-4131-8788-bfb781cc785a\") " pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:04:22.804852 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:22.804382 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 10 01:04:22.804852 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:22.804478 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs podName:e76bc68e-d074-4131-8788-bfb781cc785a nodeName:}" failed. No retries permitted until 2026-07-10 01:06:24.804452139 +0000 UTC m=+373.395933320 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs") pod "network-metrics-daemon-qx5ln" (UID: "e76bc68e-d074-4131-8788-bfb781cc785a") : secret "metrics-daemon-secret" not found Jul 10 01:04:25.380498 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.380467 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-4454z"] Jul 10 01:04:25.383364 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.383324 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4454z" Jul 10 01:04:25.384948 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.384923 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4gk4g"] Jul 10 01:04:25.386368 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.386347 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-c5shm\"" Jul 10 01:04:25.388016 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.387998 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4xr95"] Jul 10 01:04:25.388141 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.388124 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4gk4g" Jul 10 01:04:25.392712 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.392681 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 10 01:04:25.393164 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.393143 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8cqxl\"" Jul 10 01:04:25.393326 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.393308 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 10 01:04:25.393394 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.393339 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4xr95" Jul 10 01:04:25.393518 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.393256 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xm9b"] Jul 10 01:04:25.393782 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.393188 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 10 01:04:25.397570 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.397543 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 10 01:04:25.397570 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.397557 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 10 01:04:25.397570 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.397570 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 10 01:04:25.397795 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.397621 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xlt5c\"" Jul 10 01:04:25.397956 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.397934 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xm9b" Jul 10 01:04:25.398087 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.398067 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 10 01:04:25.399336 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.399290 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-4454z"] Jul 10 01:04:25.402658 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.402631 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-njgm8\"" Jul 10 01:04:25.403118 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.403100 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 10 01:04:25.403557 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.403540 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 10 01:04:25.403879 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.403860 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 10 01:04:25.404025 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.403937 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 10 01:04:25.405777 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.405762 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xm9b"] Jul 10 01:04:25.406827 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.406806 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4gk4g"] Jul 10 01:04:25.423075 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.423027 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4xr95"] Jul 10 01:04:25.482625 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.482588 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ldnt9"] Jul 10 01:04:25.485586 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.485566 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ldnt9" Jul 10 01:04:25.489291 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.489269 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 10 01:04:25.490378 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.490361 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 10 01:04:25.490488 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.490471 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-29x6p\"" Jul 10 01:04:25.498510 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.498471 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ldnt9"] Jul 10 01:04:25.523059 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.523017 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6d4307e8-f279-4a1b-a2a3-72d28349cceb-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-4xr95\" (UID: \"6d4307e8-f279-4a1b-a2a3-72d28349cceb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4xr95" Jul 10 01:04:25.523059 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.523057 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d4307e8-f279-4a1b-a2a3-72d28349cceb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4xr95\" (UID: \"6d4307e8-f279-4a1b-a2a3-72d28349cceb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4xr95" Jul 10 01:04:25.523300 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.523116 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hz7p\" (UniqueName: \"kubernetes.io/projected/6d4307e8-f279-4a1b-a2a3-72d28349cceb-kube-api-access-5hz7p\") pod \"cluster-monitoring-operator-5f7f494dd4-4xr95\" (UID: \"6d4307e8-f279-4a1b-a2a3-72d28349cceb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4xr95" Jul 10 01:04:25.523300 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.523144 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1593eced-592b-4d30-910a-6816a8c4fbb4-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-4gk4g\" (UID: \"1593eced-592b-4d30-910a-6816a8c4fbb4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4gk4g" Jul 10 01:04:25.523300 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.523160 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhkjz\" (UniqueName: \"kubernetes.io/projected/92d12b46-a0b8-4a61-a518-9bd36ca219cf-kube-api-access-zhkjz\") pod \"kube-storage-version-migrator-operator-799cb7f958-6xm9b\" (UID: \"92d12b46-a0b8-4a61-a518-9bd36ca219cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xm9b" Jul 10 01:04:25.523300 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.523175 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq2lq\" (UniqueName: \"kubernetes.io/projected/6a62a569-789c-42b1-b401-411000e5b5c3-kube-api-access-kq2lq\") pod \"network-check-source-869dcfcdcd-4454z\" (UID: \"6a62a569-789c-42b1-b401-411000e5b5c3\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4454z" Jul 10 01:04:25.523300 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.523282 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s5x8\" (UniqueName: \"kubernetes.io/projected/1593eced-592b-4d30-910a-6816a8c4fbb4-kube-api-access-5s5x8\") pod \"cluster-samples-operator-65db858894-4gk4g\" (UID: \"1593eced-592b-4d30-910a-6816a8c4fbb4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4gk4g" Jul 10 01:04:25.523454 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.523321 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92d12b46-a0b8-4a61-a518-9bd36ca219cf-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-6xm9b\" (UID: \"92d12b46-a0b8-4a61-a518-9bd36ca219cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xm9b" Jul 10 01:04:25.523454 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.523343 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/92d12b46-a0b8-4a61-a518-9bd36ca219cf-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-6xm9b\" (UID: \"92d12b46-a0b8-4a61-a518-9bd36ca219cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xm9b" Jul 10 01:04:25.624402 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.624364 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s5x8\" (UniqueName: \"kubernetes.io/projected/1593eced-592b-4d30-910a-6816a8c4fbb4-kube-api-access-5s5x8\") pod \"cluster-samples-operator-65db858894-4gk4g\" (UID: \"1593eced-592b-4d30-910a-6816a8c4fbb4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4gk4g" Jul 10 01:04:25.624402 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.624403 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92d12b46-a0b8-4a61-a518-9bd36ca219cf-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-6xm9b\" (UID: \"92d12b46-a0b8-4a61-a518-9bd36ca219cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xm9b" Jul 10 01:04:25.624606 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.624431 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/92d12b46-a0b8-4a61-a518-9bd36ca219cf-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-6xm9b\" (UID: \"92d12b46-a0b8-4a61-a518-9bd36ca219cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xm9b" Jul 10 01:04:25.624606 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.624489 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znxk8\" (UniqueName: \"kubernetes.io/projected/eff54e11-2617-4e1f-b8e4-32ab3499b5d4-kube-api-access-znxk8\") pod \"volume-data-source-validator-78495597f6-ldnt9\" (UID: \"eff54e11-2617-4e1f-b8e4-32ab3499b5d4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ldnt9" Jul 10 01:04:25.624606 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.624535 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6d4307e8-f279-4a1b-a2a3-72d28349cceb-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-4xr95\" (UID: \"6d4307e8-f279-4a1b-a2a3-72d28349cceb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4xr95" Jul 10 01:04:25.624606 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.624555 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d4307e8-f279-4a1b-a2a3-72d28349cceb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4xr95\" (UID: \"6d4307e8-f279-4a1b-a2a3-72d28349cceb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4xr95" Jul 10 01:04:25.624960 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.624664 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hz7p\" (UniqueName: \"kubernetes.io/projected/6d4307e8-f279-4a1b-a2a3-72d28349cceb-kube-api-access-5hz7p\") pod \"cluster-monitoring-operator-5f7f494dd4-4xr95\" (UID: \"6d4307e8-f279-4a1b-a2a3-72d28349cceb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4xr95" Jul 10 01:04:25.624960 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:25.624683 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 01:04:25.624960 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.624718 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1593eced-592b-4d30-910a-6816a8c4fbb4-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-4gk4g\" (UID: \"1593eced-592b-4d30-910a-6816a8c4fbb4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4gk4g" Jul 10 01:04:25.624960 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:25.624741 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d4307e8-f279-4a1b-a2a3-72d28349cceb-cluster-monitoring-operator-tls podName:6d4307e8-f279-4a1b-a2a3-72d28349cceb nodeName:}" failed. No retries permitted until 2026-07-10 01:04:26.124721434 +0000 UTC m=+254.716202624 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d4307e8-f279-4a1b-a2a3-72d28349cceb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-4xr95" (UID: "6d4307e8-f279-4a1b-a2a3-72d28349cceb") : secret "cluster-monitoring-operator-tls" not found Jul 10 01:04:25.624960 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.624770 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhkjz\" (UniqueName: \"kubernetes.io/projected/92d12b46-a0b8-4a61-a518-9bd36ca219cf-kube-api-access-zhkjz\") pod \"kube-storage-version-migrator-operator-799cb7f958-6xm9b\" (UID: \"92d12b46-a0b8-4a61-a518-9bd36ca219cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xm9b" Jul 10 01:04:25.624960 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:25.624782 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 01:04:25.624960 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.624799 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq2lq\" (UniqueName: \"kubernetes.io/projected/6a62a569-789c-42b1-b401-411000e5b5c3-kube-api-access-kq2lq\") pod \"network-check-source-869dcfcdcd-4454z\" (UID: \"6a62a569-789c-42b1-b401-411000e5b5c3\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4454z" Jul 10 01:04:25.624960 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:25.624829 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1593eced-592b-4d30-910a-6816a8c4fbb4-samples-operator-tls podName:1593eced-592b-4d30-910a-6816a8c4fbb4 nodeName:}" failed. No retries permitted until 2026-07-10 01:04:26.124818431 +0000 UTC m=+254.716299621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1593eced-592b-4d30-910a-6816a8c4fbb4-samples-operator-tls") pod "cluster-samples-operator-65db858894-4gk4g" (UID: "1593eced-592b-4d30-910a-6816a8c4fbb4") : secret "samples-operator-tls" not found Jul 10 01:04:25.625287 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.625061 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/92d12b46-a0b8-4a61-a518-9bd36ca219cf-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-6xm9b\" (UID: \"92d12b46-a0b8-4a61-a518-9bd36ca219cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xm9b" Jul 10 01:04:25.625353 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.625337 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6d4307e8-f279-4a1b-a2a3-72d28349cceb-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-4xr95\" (UID: \"6d4307e8-f279-4a1b-a2a3-72d28349cceb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4xr95" Jul 10 01:04:25.626784 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.626763 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92d12b46-a0b8-4a61-a518-9bd36ca219cf-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-6xm9b\" (UID: \"92d12b46-a0b8-4a61-a518-9bd36ca219cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xm9b" Jul 10 01:04:25.633506 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.633446 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq2lq\" (UniqueName: \"kubernetes.io/projected/6a62a569-789c-42b1-b401-411000e5b5c3-kube-api-access-kq2lq\") pod \"network-check-source-869dcfcdcd-4454z\" (UID: \"6a62a569-789c-42b1-b401-411000e5b5c3\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4454z" Jul 10 01:04:25.633689 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.633662 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hz7p\" (UniqueName: \"kubernetes.io/projected/6d4307e8-f279-4a1b-a2a3-72d28349cceb-kube-api-access-5hz7p\") pod \"cluster-monitoring-operator-5f7f494dd4-4xr95\" (UID: \"6d4307e8-f279-4a1b-a2a3-72d28349cceb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4xr95" Jul 10 01:04:25.633789 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.633769 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhkjz\" (UniqueName: \"kubernetes.io/projected/92d12b46-a0b8-4a61-a518-9bd36ca219cf-kube-api-access-zhkjz\") pod \"kube-storage-version-migrator-operator-799cb7f958-6xm9b\" (UID: \"92d12b46-a0b8-4a61-a518-9bd36ca219cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xm9b" Jul 10 01:04:25.633842 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.633829 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s5x8\" (UniqueName: \"kubernetes.io/projected/1593eced-592b-4d30-910a-6816a8c4fbb4-kube-api-access-5s5x8\") pod \"cluster-samples-operator-65db858894-4gk4g\" (UID: \"1593eced-592b-4d30-910a-6816a8c4fbb4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4gk4g" Jul 10 01:04:25.695761 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.695719 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4454z" Jul 10 01:04:25.716234 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.716196 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xm9b" Jul 10 01:04:25.725725 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.725695 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znxk8\" (UniqueName: \"kubernetes.io/projected/eff54e11-2617-4e1f-b8e4-32ab3499b5d4-kube-api-access-znxk8\") pod \"volume-data-source-validator-78495597f6-ldnt9\" (UID: \"eff54e11-2617-4e1f-b8e4-32ab3499b5d4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ldnt9" Jul 10 01:04:25.736303 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.736269 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znxk8\" (UniqueName: \"kubernetes.io/projected/eff54e11-2617-4e1f-b8e4-32ab3499b5d4-kube-api-access-znxk8\") pod \"volume-data-source-validator-78495597f6-ldnt9\" (UID: \"eff54e11-2617-4e1f-b8e4-32ab3499b5d4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ldnt9" Jul 10 01:04:25.794406 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.794370 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ldnt9" Jul 10 01:04:25.831413 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.831388 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-4454z"] Jul 10 01:04:25.833397 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:04:25.833358 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a62a569_789c_42b1_b401_411000e5b5c3.slice/crio-b28d1f9c46e43bcc6bbe148c0f64aaca054aef2f5951f721a9e3b22bb3ce7ef5 WatchSource:0}: Error finding container b28d1f9c46e43bcc6bbe148c0f64aaca054aef2f5951f721a9e3b22bb3ce7ef5: Status 404 returned error can't find the container with id b28d1f9c46e43bcc6bbe148c0f64aaca054aef2f5951f721a9e3b22bb3ce7ef5 Jul 10 01:04:25.860332 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.860300 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xm9b"] Jul 10 01:04:25.864471 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:04:25.864434 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92d12b46_a0b8_4a61_a518_9bd36ca219cf.slice/crio-abad3f810da36351dde4624088908cc60bb864540d5b870df1a8d58a31fc8250 WatchSource:0}: Error finding container abad3f810da36351dde4624088908cc60bb864540d5b870df1a8d58a31fc8250: Status 404 returned error can't find the container with id abad3f810da36351dde4624088908cc60bb864540d5b870df1a8d58a31fc8250 Jul 10 01:04:25.930723 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:25.930689 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ldnt9"] Jul 10 01:04:25.935715 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:04:25.935683 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeff54e11_2617_4e1f_b8e4_32ab3499b5d4.slice/crio-63053f672a273ad07eba236e09f236c4adc6533685951af4647efaa418728dae WatchSource:0}: Error finding container 63053f672a273ad07eba236e09f236c4adc6533685951af4647efaa418728dae: Status 404 returned error can't find the container with id 63053f672a273ad07eba236e09f236c4adc6533685951af4647efaa418728dae Jul 10 01:04:26.129188 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:26.129142 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1593eced-592b-4d30-910a-6816a8c4fbb4-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-4gk4g\" (UID: \"1593eced-592b-4d30-910a-6816a8c4fbb4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4gk4g" Jul 10 01:04:26.129367 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:26.129237 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d4307e8-f279-4a1b-a2a3-72d28349cceb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4xr95\" (UID: \"6d4307e8-f279-4a1b-a2a3-72d28349cceb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4xr95" Jul 10 01:04:26.129367 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:26.129311 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 01:04:26.129438 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:26.129375 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 01:04:26.129438 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:26.129382 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1593eced-592b-4d30-910a-6816a8c4fbb4-samples-operator-tls podName:1593eced-592b-4d30-910a-6816a8c4fbb4 nodeName:}" failed. No retries permitted until 2026-07-10 01:04:27.129367113 +0000 UTC m=+255.720848290 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1593eced-592b-4d30-910a-6816a8c4fbb4-samples-operator-tls") pod "cluster-samples-operator-65db858894-4gk4g" (UID: "1593eced-592b-4d30-910a-6816a8c4fbb4") : secret "samples-operator-tls" not found Jul 10 01:04:26.129438 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:26.129437 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d4307e8-f279-4a1b-a2a3-72d28349cceb-cluster-monitoring-operator-tls podName:6d4307e8-f279-4a1b-a2a3-72d28349cceb nodeName:}" failed. No retries permitted until 2026-07-10 01:04:27.129419477 +0000 UTC m=+255.720900658 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d4307e8-f279-4a1b-a2a3-72d28349cceb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-4xr95" (UID: "6d4307e8-f279-4a1b-a2a3-72d28349cceb") : secret "cluster-monitoring-operator-tls" not found Jul 10 01:04:26.792749 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:26.792691 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xm9b" event={"ID":"92d12b46-a0b8-4a61-a518-9bd36ca219cf","Type":"ContainerStarted","Data":"abad3f810da36351dde4624088908cc60bb864540d5b870df1a8d58a31fc8250"} Jul 10 01:04:26.794557 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:26.794526 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4454z" event={"ID":"6a62a569-789c-42b1-b401-411000e5b5c3","Type":"ContainerStarted","Data":"8aa786f5f5c72067d387679e70501d9f36101d8f0fab822acca465466e14fb41"} Jul 10 01:04:26.794683 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:26.794577 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4454z" event={"ID":"6a62a569-789c-42b1-b401-411000e5b5c3","Type":"ContainerStarted","Data":"b28d1f9c46e43bcc6bbe148c0f64aaca054aef2f5951f721a9e3b22bb3ce7ef5"} Jul 10 01:04:26.795766 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:26.795739 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ldnt9" event={"ID":"eff54e11-2617-4e1f-b8e4-32ab3499b5d4","Type":"ContainerStarted","Data":"63053f672a273ad07eba236e09f236c4adc6533685951af4647efaa418728dae"} Jul 10 01:04:26.811265 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:26.811190 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4454z" podStartSLOduration=1.8111722879999999 podStartE2EDuration="1.811172288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:04:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:04:26.80988251 +0000 UTC m=+255.401363714" watchObservedRunningTime="2026-07-10 01:04:26.811172288 +0000 UTC m=+255.402653488" Jul 10 01:04:27.138935 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:27.138854 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d4307e8-f279-4a1b-a2a3-72d28349cceb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4xr95\" (UID: \"6d4307e8-f279-4a1b-a2a3-72d28349cceb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4xr95" Jul 10 01:04:27.139078 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:27.138977 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1593eced-592b-4d30-910a-6816a8c4fbb4-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-4gk4g\" (UID: \"1593eced-592b-4d30-910a-6816a8c4fbb4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4gk4g" Jul 10 01:04:27.139078 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:27.139020 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 01:04:27.139175 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:27.139091 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 01:04:27.139175 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:27.139094 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d4307e8-f279-4a1b-a2a3-72d28349cceb-cluster-monitoring-operator-tls podName:6d4307e8-f279-4a1b-a2a3-72d28349cceb nodeName:}" failed. No retries permitted until 2026-07-10 01:04:29.13907826 +0000 UTC m=+257.730559436 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d4307e8-f279-4a1b-a2a3-72d28349cceb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-4xr95" (UID: "6d4307e8-f279-4a1b-a2a3-72d28349cceb") : secret "cluster-monitoring-operator-tls" not found Jul 10 01:04:27.139175 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:27.139154 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1593eced-592b-4d30-910a-6816a8c4fbb4-samples-operator-tls podName:1593eced-592b-4d30-910a-6816a8c4fbb4 nodeName:}" failed. No retries permitted until 2026-07-10 01:04:29.139137483 +0000 UTC m=+257.730618666 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1593eced-592b-4d30-910a-6816a8c4fbb4-samples-operator-tls") pod "cluster-samples-operator-65db858894-4gk4g" (UID: "1593eced-592b-4d30-910a-6816a8c4fbb4") : secret "samples-operator-tls" not found Jul 10 01:04:28.804506 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:28.804467 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xm9b" event={"ID":"92d12b46-a0b8-4a61-a518-9bd36ca219cf","Type":"ContainerStarted","Data":"3d6569e1895562775097556e82277b25351727a92f83d85e7ff082c3229494ce"} Jul 10 01:04:28.805887 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:28.805864 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ldnt9" event={"ID":"eff54e11-2617-4e1f-b8e4-32ab3499b5d4","Type":"ContainerStarted","Data":"fd70e371892dccdaa8e4573781112894f670eac5bc277208a8741da5e8bc624f"} Jul 10 01:04:28.820798 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:28.820750 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xm9b" podStartSLOduration=1.611627396 podStartE2EDuration="3.820736932s" totalImagesPullingTime="2.209109536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:04:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:04:28.820086001 +0000 UTC m=+257.411567199" watchObservedRunningTime="2026-07-10 01:04:28.820736932 +0000 UTC m=+257.412218131" Jul 10 01:04:28.836422 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:28.836362 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ldnt9" podStartSLOduration=1.385324871 podStartE2EDuration="3.836341221s" totalImagesPullingTime="2.45101635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:04:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:04:28.834651192 +0000 UTC m=+257.426132392" watchObservedRunningTime="2026-07-10 01:04:28.836341221 +0000 UTC m=+257.427822421" Jul 10 01:04:29.157654 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:29.157562 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d4307e8-f279-4a1b-a2a3-72d28349cceb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4xr95\" (UID: \"6d4307e8-f279-4a1b-a2a3-72d28349cceb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4xr95" Jul 10 01:04:29.157654 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:29.157651 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1593eced-592b-4d30-910a-6816a8c4fbb4-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-4gk4g\" (UID: \"1593eced-592b-4d30-910a-6816a8c4fbb4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4gk4g" Jul 10 01:04:29.157854 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:29.157711 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 01:04:29.157854 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:29.157742 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 01:04:29.157854 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:29.157779 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d4307e8-f279-4a1b-a2a3-72d28349cceb-cluster-monitoring-operator-tls podName:6d4307e8-f279-4a1b-a2a3-72d28349cceb nodeName:}" failed. No retries permitted until 2026-07-10 01:04:33.157762775 +0000 UTC m=+261.749243955 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d4307e8-f279-4a1b-a2a3-72d28349cceb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-4xr95" (UID: "6d4307e8-f279-4a1b-a2a3-72d28349cceb") : secret "cluster-monitoring-operator-tls" not found Jul 10 01:04:29.157854 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:29.157793 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1593eced-592b-4d30-910a-6816a8c4fbb4-samples-operator-tls podName:1593eced-592b-4d30-910a-6816a8c4fbb4 nodeName:}" failed. No retries permitted until 2026-07-10 01:04:33.157787095 +0000 UTC m=+261.749268272 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1593eced-592b-4d30-910a-6816a8c4fbb4-samples-operator-tls") pod "cluster-samples-operator-65db858894-4gk4g" (UID: "1593eced-592b-4d30-910a-6816a8c4fbb4") : secret "samples-operator-tls" not found Jul 10 01:04:29.559490 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:29.559453 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-h4fjh"] Jul 10 01:04:29.562597 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:29.562580 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-h4fjh" Jul 10 01:04:29.566868 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:29.566841 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 10 01:04:29.566868 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:29.566841 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-j74rw\"" Jul 10 01:04:29.568597 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:29.568568 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 10 01:04:29.574051 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:29.574030 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-h4fjh"] Jul 10 01:04:29.661989 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:29.661951 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9g4q\" (UniqueName: \"kubernetes.io/projected/43134e21-e995-46c1-9af7-66d814cf5f8a-kube-api-access-t9g4q\") pod \"migrator-7f59b54f6c-h4fjh\" (UID: \"43134e21-e995-46c1-9af7-66d814cf5f8a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-h4fjh" Jul 10 01:04:29.763033 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:29.762996 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9g4q\" (UniqueName: \"kubernetes.io/projected/43134e21-e995-46c1-9af7-66d814cf5f8a-kube-api-access-t9g4q\") pod \"migrator-7f59b54f6c-h4fjh\" (UID: \"43134e21-e995-46c1-9af7-66d814cf5f8a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-h4fjh" Jul 10 01:04:29.772069 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:29.772048 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9g4q\" (UniqueName: \"kubernetes.io/projected/43134e21-e995-46c1-9af7-66d814cf5f8a-kube-api-access-t9g4q\") pod \"migrator-7f59b54f6c-h4fjh\" (UID: \"43134e21-e995-46c1-9af7-66d814cf5f8a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-h4fjh" Jul 10 01:04:29.871387 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:29.871282 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-h4fjh" Jul 10 01:04:30.004357 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:30.004333 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-h4fjh"] Jul 10 01:04:30.006607 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:04:30.006585 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43134e21_e995_46c1_9af7_66d814cf5f8a.slice/crio-54a3db891fe785d40fa7953d80c0705df42ceb51f1514c9d353727fd20b51361 WatchSource:0}: Error finding container 54a3db891fe785d40fa7953d80c0705df42ceb51f1514c9d353727fd20b51361: Status 404 returned error can't find the container with id 54a3db891fe785d40fa7953d80c0705df42ceb51f1514c9d353727fd20b51361 Jul 10 01:04:30.349415 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:30.349379 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xt5hg"] Jul 10 01:04:30.353641 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:30.353624 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xt5hg" Jul 10 01:04:30.358582 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:30.358382 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 10 01:04:30.358834 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:30.358775 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 10 01:04:30.358940 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:30.358843 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 10 01:04:30.358940 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:30.358860 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 10 01:04:30.359037 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:30.359018 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2x8rz\"" Jul 10 01:04:30.366035 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:30.366010 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xt5hg"] Jul 10 01:04:30.470022 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:30.469984 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0562244a-ce25-4bce-974e-c2c868371830-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xt5hg\" (UID: \"0562244a-ce25-4bce-974e-c2c868371830\") " pod="openshift-insights/insights-runtime-extractor-xt5hg" Jul 10 01:04:30.470197 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:30.470043 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0562244a-ce25-4bce-974e-c2c868371830-crio-socket\") pod \"insights-runtime-extractor-xt5hg\" (UID: \"0562244a-ce25-4bce-974e-c2c868371830\") " pod="openshift-insights/insights-runtime-extractor-xt5hg" Jul 10 01:04:30.470197 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:30.470109 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0562244a-ce25-4bce-974e-c2c868371830-data-volume\") pod \"insights-runtime-extractor-xt5hg\" (UID: \"0562244a-ce25-4bce-974e-c2c868371830\") " pod="openshift-insights/insights-runtime-extractor-xt5hg" Jul 10 01:04:30.470197 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:30.470155 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tp7p\" (UniqueName: \"kubernetes.io/projected/0562244a-ce25-4bce-974e-c2c868371830-kube-api-access-7tp7p\") pod \"insights-runtime-extractor-xt5hg\" (UID: \"0562244a-ce25-4bce-974e-c2c868371830\") " pod="openshift-insights/insights-runtime-extractor-xt5hg" Jul 10 01:04:30.470359 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:30.470214 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0562244a-ce25-4bce-974e-c2c868371830-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xt5hg\" (UID: \"0562244a-ce25-4bce-974e-c2c868371830\") " pod="openshift-insights/insights-runtime-extractor-xt5hg" Jul 10 01:04:30.570569 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:30.570541 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tp7p\" (UniqueName: \"kubernetes.io/projected/0562244a-ce25-4bce-974e-c2c868371830-kube-api-access-7tp7p\") pod \"insights-runtime-extractor-xt5hg\" (UID: \"0562244a-ce25-4bce-974e-c2c868371830\") " pod="openshift-insights/insights-runtime-extractor-xt5hg" Jul 10 01:04:30.570660 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:30.570616 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0562244a-ce25-4bce-974e-c2c868371830-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xt5hg\" (UID: \"0562244a-ce25-4bce-974e-c2c868371830\") " pod="openshift-insights/insights-runtime-extractor-xt5hg" Jul 10 01:04:30.570660 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:30.570642 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0562244a-ce25-4bce-974e-c2c868371830-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xt5hg\" (UID: \"0562244a-ce25-4bce-974e-c2c868371830\") " pod="openshift-insights/insights-runtime-extractor-xt5hg" Jul 10 01:04:30.570725 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:30.570680 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0562244a-ce25-4bce-974e-c2c868371830-crio-socket\") pod \"insights-runtime-extractor-xt5hg\" (UID: \"0562244a-ce25-4bce-974e-c2c868371830\") " pod="openshift-insights/insights-runtime-extractor-xt5hg" Jul 10 01:04:30.570758 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:30.570720 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 01:04:30.570809 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:30.570787 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 01:04:30.570852 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:30.570797 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0562244a-ce25-4bce-974e-c2c868371830-crio-socket\") pod \"insights-runtime-extractor-xt5hg\" (UID: \"0562244a-ce25-4bce-974e-c2c868371830\") " pod="openshift-insights/insights-runtime-extractor-xt5hg" Jul 10 01:04:30.570852 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:30.570723 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0562244a-ce25-4bce-974e-c2c868371830-data-volume\") pod \"insights-runtime-extractor-xt5hg\" (UID: \"0562244a-ce25-4bce-974e-c2c868371830\") " pod="openshift-insights/insights-runtime-extractor-xt5hg" Jul 10 01:04:30.570932 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:30.570800 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0562244a-ce25-4bce-974e-c2c868371830-insights-runtime-extractor-tls podName:0562244a-ce25-4bce-974e-c2c868371830 nodeName:}" failed. No retries permitted until 2026-07-10 01:04:31.070778701 +0000 UTC m=+259.662259883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0562244a-ce25-4bce-974e-c2c868371830-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xt5hg" (UID: "0562244a-ce25-4bce-974e-c2c868371830") : secret "insights-runtime-extractor-tls" not found Jul 10 01:04:30.570932 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:30.570897 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0562244a-ce25-4bce-974e-c2c868371830-kube-rbac-proxy-cm podName:0562244a-ce25-4bce-974e-c2c868371830 nodeName:}" failed. No retries permitted until 2026-07-10 01:04:31.070879351 +0000 UTC m=+259.662360531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0562244a-ce25-4bce-974e-c2c868371830-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xt5hg" (UID: "0562244a-ce25-4bce-974e-c2c868371830") : configmap "kube-rbac-proxy" not found Jul 10 01:04:30.571066 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:30.571051 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0562244a-ce25-4bce-974e-c2c868371830-data-volume\") pod \"insights-runtime-extractor-xt5hg\" (UID: \"0562244a-ce25-4bce-974e-c2c868371830\") " pod="openshift-insights/insights-runtime-extractor-xt5hg" Jul 10 01:04:30.579777 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:30.579752 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tp7p\" (UniqueName: \"kubernetes.io/projected/0562244a-ce25-4bce-974e-c2c868371830-kube-api-access-7tp7p\") pod \"insights-runtime-extractor-xt5hg\" (UID: \"0562244a-ce25-4bce-974e-c2c868371830\") " pod="openshift-insights/insights-runtime-extractor-xt5hg" Jul 10 01:04:30.814019 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:30.813987 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-h4fjh" event={"ID":"43134e21-e995-46c1-9af7-66d814cf5f8a","Type":"ContainerStarted","Data":"54a3db891fe785d40fa7953d80c0705df42ceb51f1514c9d353727fd20b51361"} Jul 10 01:04:31.075272 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:31.075156 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0562244a-ce25-4bce-974e-c2c868371830-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xt5hg\" (UID: \"0562244a-ce25-4bce-974e-c2c868371830\") " pod="openshift-insights/insights-runtime-extractor-xt5hg" Jul 10 01:04:31.075272 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:31.075207 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0562244a-ce25-4bce-974e-c2c868371830-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xt5hg\" (UID: \"0562244a-ce25-4bce-974e-c2c868371830\") " pod="openshift-insights/insights-runtime-extractor-xt5hg" Jul 10 01:04:31.075669 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:31.075357 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 01:04:31.075669 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:31.075433 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0562244a-ce25-4bce-974e-c2c868371830-kube-rbac-proxy-cm podName:0562244a-ce25-4bce-974e-c2c868371830 nodeName:}" failed. No retries permitted until 2026-07-10 01:04:32.075416641 +0000 UTC m=+260.666897822 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0562244a-ce25-4bce-974e-c2c868371830-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xt5hg" (UID: "0562244a-ce25-4bce-974e-c2c868371830") : configmap "kube-rbac-proxy" not found Jul 10 01:04:31.075669 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:31.075358 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 01:04:31.075669 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:31.075512 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0562244a-ce25-4bce-974e-c2c868371830-insights-runtime-extractor-tls podName:0562244a-ce25-4bce-974e-c2c868371830 nodeName:}" failed. No retries permitted until 2026-07-10 01:04:32.075498481 +0000 UTC m=+260.666979661 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0562244a-ce25-4bce-974e-c2c868371830-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xt5hg" (UID: "0562244a-ce25-4bce-974e-c2c868371830") : secret "insights-runtime-extractor-tls" not found Jul 10 01:04:32.082150 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:32.082109 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0562244a-ce25-4bce-974e-c2c868371830-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xt5hg\" (UID: \"0562244a-ce25-4bce-974e-c2c868371830\") " pod="openshift-insights/insights-runtime-extractor-xt5hg" Jul 10 01:04:32.082150 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:32.082149 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0562244a-ce25-4bce-974e-c2c868371830-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xt5hg\" (UID: \"0562244a-ce25-4bce-974e-c2c868371830\") " pod="openshift-insights/insights-runtime-extractor-xt5hg" Jul 10 01:04:32.082588 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:32.082281 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 01:04:32.082588 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:32.082284 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 01:04:32.082588 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:32.082348 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0562244a-ce25-4bce-974e-c2c868371830-insights-runtime-extractor-tls podName:0562244a-ce25-4bce-974e-c2c868371830 nodeName:}" failed. No retries permitted until 2026-07-10 01:04:34.082331905 +0000 UTC m=+262.673813081 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0562244a-ce25-4bce-974e-c2c868371830-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xt5hg" (UID: "0562244a-ce25-4bce-974e-c2c868371830") : secret "insights-runtime-extractor-tls" not found Jul 10 01:04:32.082588 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:32.082364 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0562244a-ce25-4bce-974e-c2c868371830-kube-rbac-proxy-cm podName:0562244a-ce25-4bce-974e-c2c868371830 nodeName:}" failed. No retries permitted until 2026-07-10 01:04:34.082357592 +0000 UTC m=+262.673838769 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0562244a-ce25-4bce-974e-c2c868371830-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xt5hg" (UID: "0562244a-ce25-4bce-974e-c2c868371830") : configmap "kube-rbac-proxy" not found Jul 10 01:04:32.822243 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:32.822189 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-h4fjh" event={"ID":"43134e21-e995-46c1-9af7-66d814cf5f8a","Type":"ContainerStarted","Data":"dabf9dec570f677c7425f66b01a381726205322dcf4d3b4755150d5a21601e6a"} Jul 10 01:04:32.822441 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:32.822268 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-h4fjh" event={"ID":"43134e21-e995-46c1-9af7-66d814cf5f8a","Type":"ContainerStarted","Data":"9805bd9cdad0e800549a91e2d8219425ae5214f8e378e1381c0f850466bac552"} Jul 10 01:04:32.837483 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:32.837435 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-h4fjh" podStartSLOduration=1.403803821 podStartE2EDuration="3.837419009s" totalImagesPullingTime="2.433615188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:04:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:04:32.836873159 +0000 UTC m=+261.428354357" watchObservedRunningTime="2026-07-10 01:04:32.837419009 +0000 UTC m=+261.428900207" Jul 10 01:04:33.191638 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:33.191542 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1593eced-592b-4d30-910a-6816a8c4fbb4-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-4gk4g\" (UID: \"1593eced-592b-4d30-910a-6816a8c4fbb4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4gk4g" Jul 10 01:04:33.192002 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:33.191645 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d4307e8-f279-4a1b-a2a3-72d28349cceb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4xr95\" (UID: \"6d4307e8-f279-4a1b-a2a3-72d28349cceb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4xr95" Jul 10 01:04:33.192002 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:33.191734 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 01:04:33.192002 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:33.191748 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 01:04:33.192002 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:33.191814 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1593eced-592b-4d30-910a-6816a8c4fbb4-samples-operator-tls podName:1593eced-592b-4d30-910a-6816a8c4fbb4 nodeName:}" failed. No retries permitted until 2026-07-10 01:04:41.191797717 +0000 UTC m=+269.783278897 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1593eced-592b-4d30-910a-6816a8c4fbb4-samples-operator-tls") pod "cluster-samples-operator-65db858894-4gk4g" (UID: "1593eced-592b-4d30-910a-6816a8c4fbb4") : secret "samples-operator-tls" not found Jul 10 01:04:33.192002 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:33.191829 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d4307e8-f279-4a1b-a2a3-72d28349cceb-cluster-monitoring-operator-tls podName:6d4307e8-f279-4a1b-a2a3-72d28349cceb nodeName:}" failed. No retries permitted until 2026-07-10 01:04:41.191822836 +0000 UTC m=+269.783304016 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d4307e8-f279-4a1b-a2a3-72d28349cceb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-4xr95" (UID: "6d4307e8-f279-4a1b-a2a3-72d28349cceb") : secret "cluster-monitoring-operator-tls" not found Jul 10 01:04:33.322194 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:33.322159 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-md6w5"] Jul 10 01:04:33.325109 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:33.325094 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-md6w5" Jul 10 01:04:33.327834 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:33.327811 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 10 01:04:33.327970 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:33.327865 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 10 01:04:33.327970 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:33.327874 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 10 01:04:33.328085 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:33.327904 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 10 01:04:33.328965 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:33.328949 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bzjxj\"" Jul 10 01:04:33.334442 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:33.334418 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-md6w5"] Jul 10 01:04:33.340655 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:33.340631 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tc8jw_09043fd5-e2a5-493e-82b8-f0ac9fa1f99b/dns-node-resolver/0.log" Jul 10 01:04:33.494057 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:33.494026 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b80b46c3-0c5e-46e5-88fc-f1f6068a944c-signing-cabundle\") pod \"service-ca-79f68b9f4f-md6w5\" (UID: \"b80b46c3-0c5e-46e5-88fc-f1f6068a944c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-md6w5" Jul 10 01:04:33.494276 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:33.494088 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh47b\" (UniqueName: \"kubernetes.io/projected/b80b46c3-0c5e-46e5-88fc-f1f6068a944c-kube-api-access-qh47b\") pod \"service-ca-79f68b9f4f-md6w5\" (UID: \"b80b46c3-0c5e-46e5-88fc-f1f6068a944c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-md6w5" Jul 10 01:04:33.494276 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:33.494109 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b80b46c3-0c5e-46e5-88fc-f1f6068a944c-signing-key\") pod \"service-ca-79f68b9f4f-md6w5\" (UID: \"b80b46c3-0c5e-46e5-88fc-f1f6068a944c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-md6w5" Jul 10 01:04:33.595197 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:33.595155 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b80b46c3-0c5e-46e5-88fc-f1f6068a944c-signing-cabundle\") pod \"service-ca-79f68b9f4f-md6w5\" (UID: \"b80b46c3-0c5e-46e5-88fc-f1f6068a944c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-md6w5" Jul 10 01:04:33.595407 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:33.595245 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh47b\" (UniqueName: \"kubernetes.io/projected/b80b46c3-0c5e-46e5-88fc-f1f6068a944c-kube-api-access-qh47b\") pod \"service-ca-79f68b9f4f-md6w5\" (UID: \"b80b46c3-0c5e-46e5-88fc-f1f6068a944c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-md6w5" Jul 10 01:04:33.595407 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:33.595271 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b80b46c3-0c5e-46e5-88fc-f1f6068a944c-signing-key\") pod \"service-ca-79f68b9f4f-md6w5\" (UID: \"b80b46c3-0c5e-46e5-88fc-f1f6068a944c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-md6w5" Jul 10 01:04:33.595821 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:33.595801 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b80b46c3-0c5e-46e5-88fc-f1f6068a944c-signing-cabundle\") pod \"service-ca-79f68b9f4f-md6w5\" (UID: \"b80b46c3-0c5e-46e5-88fc-f1f6068a944c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-md6w5" Jul 10 01:04:33.597580 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:33.597557 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b80b46c3-0c5e-46e5-88fc-f1f6068a944c-signing-key\") pod \"service-ca-79f68b9f4f-md6w5\" (UID: \"b80b46c3-0c5e-46e5-88fc-f1f6068a944c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-md6w5" Jul 10 01:04:33.603202 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:33.603174 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh47b\" (UniqueName: \"kubernetes.io/projected/b80b46c3-0c5e-46e5-88fc-f1f6068a944c-kube-api-access-qh47b\") pod \"service-ca-79f68b9f4f-md6w5\" (UID: \"b80b46c3-0c5e-46e5-88fc-f1f6068a944c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-md6w5" Jul 10 01:04:33.634198 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:33.634141 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-md6w5" Jul 10 01:04:33.759315 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:33.759187 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-md6w5"] Jul 10 01:04:33.762046 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:04:33.762015 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb80b46c3_0c5e_46e5_88fc_f1f6068a944c.slice/crio-c42615659f0f71a1481128782667290dcaaf6532beb5101bfd33cf914ee1efd3 WatchSource:0}: Error finding container c42615659f0f71a1481128782667290dcaaf6532beb5101bfd33cf914ee1efd3: Status 404 returned error can't find the container with id c42615659f0f71a1481128782667290dcaaf6532beb5101bfd33cf914ee1efd3 Jul 10 01:04:33.827829 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:33.827791 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-md6w5" event={"ID":"b80b46c3-0c5e-46e5-88fc-f1f6068a944c","Type":"ContainerStarted","Data":"c42615659f0f71a1481128782667290dcaaf6532beb5101bfd33cf914ee1efd3"} Jul 10 01:04:34.100544 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:34.100431 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0562244a-ce25-4bce-974e-c2c868371830-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xt5hg\" (UID: \"0562244a-ce25-4bce-974e-c2c868371830\") " pod="openshift-insights/insights-runtime-extractor-xt5hg" Jul 10 01:04:34.100544 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:34.100473 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0562244a-ce25-4bce-974e-c2c868371830-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xt5hg\" (UID: \"0562244a-ce25-4bce-974e-c2c868371830\") " pod="openshift-insights/insights-runtime-extractor-xt5hg" Jul 10 01:04:34.100544 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:34.100544 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 01:04:34.100783 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:34.100611 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0562244a-ce25-4bce-974e-c2c868371830-insights-runtime-extractor-tls podName:0562244a-ce25-4bce-974e-c2c868371830 nodeName:}" failed. No retries permitted until 2026-07-10 01:04:38.100596243 +0000 UTC m=+266.692077424 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0562244a-ce25-4bce-974e-c2c868371830-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xt5hg" (UID: "0562244a-ce25-4bce-974e-c2c868371830") : secret "insights-runtime-extractor-tls" not found Jul 10 01:04:34.100783 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:34.100615 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 01:04:34.100783 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:34.100693 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0562244a-ce25-4bce-974e-c2c868371830-kube-rbac-proxy-cm podName:0562244a-ce25-4bce-974e-c2c868371830 nodeName:}" failed. No retries permitted until 2026-07-10 01:04:38.10067556 +0000 UTC m=+266.692156738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0562244a-ce25-4bce-974e-c2c868371830-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xt5hg" (UID: "0562244a-ce25-4bce-974e-c2c868371830") : configmap "kube-rbac-proxy" not found Jul 10 01:04:34.141801 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:34.141769 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-thhvj_be8fc9c0-d919-4435-bc77-ddd249ad1a3c/node-ca/0.log" Jul 10 01:04:34.740640 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:34.740611 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7q7jk_77c25259-df3b-478e-ba40-7aa97d674ac3/serve-healthcheck-canary/0.log" Jul 10 01:04:35.349254 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:35.349206 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-h4fjh_43134e21-e995-46c1-9af7-66d814cf5f8a/migrator/0.log" Jul 10 01:04:35.541899 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:35.541869 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-h4fjh_43134e21-e995-46c1-9af7-66d814cf5f8a/graceful-termination/0.log" Jul 10 01:04:35.743526 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:35.743491 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-6xm9b_92d12b46-a0b8-4a61-a518-9bd36ca219cf/kube-storage-version-migrator-operator/0.log" Jul 10 01:04:36.838063 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:36.838030 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-md6w5" event={"ID":"b80b46c3-0c5e-46e5-88fc-f1f6068a944c","Type":"ContainerStarted","Data":"83a21c330e4a9a0d28da605d0dd10bb29f649001b41020a8ba5e87e0f8055710"} Jul 10 01:04:36.854950 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:36.854900 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-md6w5" podStartSLOduration=1.7670951499999998 podStartE2EDuration="3.854884235s" totalImagesPullingTime="2.087789085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:04:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:04:36.85327039 +0000 UTC m=+265.444751583" watchObservedRunningTime="2026-07-10 01:04:36.854884235 +0000 UTC m=+265.446365434" Jul 10 01:04:38.137494 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:38.137447 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0562244a-ce25-4bce-974e-c2c868371830-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xt5hg\" (UID: \"0562244a-ce25-4bce-974e-c2c868371830\") " pod="openshift-insights/insights-runtime-extractor-xt5hg" Jul 10 01:04:38.137494 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:38.137492 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0562244a-ce25-4bce-974e-c2c868371830-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xt5hg\" (UID: \"0562244a-ce25-4bce-974e-c2c868371830\") " pod="openshift-insights/insights-runtime-extractor-xt5hg" Jul 10 01:04:38.138037 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:38.137632 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 01:04:38.138037 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:38.137725 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0562244a-ce25-4bce-974e-c2c868371830-insights-runtime-extractor-tls podName:0562244a-ce25-4bce-974e-c2c868371830 nodeName:}" failed. No retries permitted until 2026-07-10 01:04:46.1377055 +0000 UTC m=+274.729186677 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0562244a-ce25-4bce-974e-c2c868371830-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xt5hg" (UID: "0562244a-ce25-4bce-974e-c2c868371830") : secret "insights-runtime-extractor-tls" not found Jul 10 01:04:38.138037 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:38.137632 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 01:04:38.138037 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:38.137778 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0562244a-ce25-4bce-974e-c2c868371830-kube-rbac-proxy-cm podName:0562244a-ce25-4bce-974e-c2c868371830 nodeName:}" failed. No retries permitted until 2026-07-10 01:04:46.137767285 +0000 UTC m=+274.729248477 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0562244a-ce25-4bce-974e-c2c868371830-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xt5hg" (UID: "0562244a-ce25-4bce-974e-c2c868371830") : configmap "kube-rbac-proxy" not found Jul 10 01:04:41.265360 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:41.265327 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1593eced-592b-4d30-910a-6816a8c4fbb4-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-4gk4g\" (UID: \"1593eced-592b-4d30-910a-6816a8c4fbb4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4gk4g" Jul 10 01:04:41.265771 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:41.265461 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d4307e8-f279-4a1b-a2a3-72d28349cceb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4xr95\" (UID: \"6d4307e8-f279-4a1b-a2a3-72d28349cceb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4xr95" Jul 10 01:04:41.265771 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:41.265578 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 01:04:41.265771 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:41.265649 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d4307e8-f279-4a1b-a2a3-72d28349cceb-cluster-monitoring-operator-tls podName:6d4307e8-f279-4a1b-a2a3-72d28349cceb nodeName:}" failed. No retries permitted until 2026-07-10 01:04:57.265628911 +0000 UTC m=+285.857110105 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d4307e8-f279-4a1b-a2a3-72d28349cceb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-4xr95" (UID: "6d4307e8-f279-4a1b-a2a3-72d28349cceb") : secret "cluster-monitoring-operator-tls" not found Jul 10 01:04:41.267733 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:41.267712 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1593eced-592b-4d30-910a-6816a8c4fbb4-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-4gk4g\" (UID: \"1593eced-592b-4d30-910a-6816a8c4fbb4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4gk4g" Jul 10 01:04:41.303292 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:41.303255 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4gk4g" Jul 10 01:04:41.433103 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:41.433073 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4gk4g"] Jul 10 01:04:41.854948 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:41.854907 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4gk4g" event={"ID":"1593eced-592b-4d30-910a-6816a8c4fbb4","Type":"ContainerStarted","Data":"72a809bd88a9c20d09893fec2501cfcc150edd5cc17c84effff052fc76bcf389"} Jul 10 01:04:43.862592 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:43.862557 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4gk4g" event={"ID":"1593eced-592b-4d30-910a-6816a8c4fbb4","Type":"ContainerStarted","Data":"91c99ab862c8046ac412026fafe535a564e4f0b62749e22057b52ee9be1a0353"} Jul 10 01:04:43.863042 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:43.862659 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4gk4g" event={"ID":"1593eced-592b-4d30-910a-6816a8c4fbb4","Type":"ContainerStarted","Data":"11f9e6f0165b19eb9c4e2632656497da3f59ddf530cb29dd42b985c5508da42f"} Jul 10 01:04:43.879187 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:43.879133 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4gk4g" podStartSLOduration=16.955361973 podStartE2EDuration="18.879117108s" totalImagesPullingTime="1.923755135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:04:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:04:43.878384273 +0000 UTC m=+272.469865472" watchObservedRunningTime="2026-07-10 01:04:43.879117108 +0000 UTC m=+272.470598306" Jul 10 01:04:46.208727 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:46.208691 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0562244a-ce25-4bce-974e-c2c868371830-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xt5hg\" (UID: \"0562244a-ce25-4bce-974e-c2c868371830\") " pod="openshift-insights/insights-runtime-extractor-xt5hg" Jul 10 01:04:46.208727 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:46.208730 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0562244a-ce25-4bce-974e-c2c868371830-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xt5hg\" (UID: \"0562244a-ce25-4bce-974e-c2c868371830\") " pod="openshift-insights/insights-runtime-extractor-xt5hg" Jul 10 01:04:46.209142 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:46.208842 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 01:04:46.209142 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:46.208918 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0562244a-ce25-4bce-974e-c2c868371830-insights-runtime-extractor-tls podName:0562244a-ce25-4bce-974e-c2c868371830 nodeName:}" failed. No retries permitted until 2026-07-10 01:05:02.208899839 +0000 UTC m=+290.800381026 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0562244a-ce25-4bce-974e-c2c868371830-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xt5hg" (UID: "0562244a-ce25-4bce-974e-c2c868371830") : secret "insights-runtime-extractor-tls" not found Jul 10 01:04:46.209370 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:46.209350 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0562244a-ce25-4bce-974e-c2c868371830-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xt5hg\" (UID: \"0562244a-ce25-4bce-974e-c2c868371830\") " pod="openshift-insights/insights-runtime-extractor-xt5hg" Jul 10 01:04:53.564048 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:53.563989 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-kkhf6" podUID="ed34c96b-f17b-40b0-88de-639790a23f79" Jul 10 01:04:53.564048 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:53.564011 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-b4kzz" podUID="666a82b2-f068-427d-8a98-6380178c6be9" Jul 10 01:04:53.564048 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:04:53.564018 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" podUID="8d5e8a39-1653-4164-9940-cd2fb9c7fee2" Jul 10 01:04:53.893416 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:53.893339 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:04:53.893416 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:53.893352 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-kkhf6" Jul 10 01:04:53.893416 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:53.893356 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b4kzz" Jul 10 01:04:56.588668 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:56.588630 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:04:56.589040 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:56.588709 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kkhf6\" (UID: \"ed34c96b-f17b-40b0-88de-639790a23f79\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kkhf6" Jul 10 01:04:56.591199 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:56.591165 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed34c96b-f17b-40b0-88de-639790a23f79-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kkhf6\" (UID: \"ed34c96b-f17b-40b0-88de-639790a23f79\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kkhf6" Jul 10 01:04:56.591330 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:56.591165 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls\") pod \"image-registry-75dc4ccdb6-67vrj\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:04:56.599885 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:56.599861 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-kc2m8\"" Jul 10 01:04:56.599885 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:56.599866 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ghnd6\"" Jul 10 01:04:56.604260 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:56.604240 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-kkhf6" Jul 10 01:04:56.604352 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:56.604281 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:04:56.689582 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:56.689552 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls\") pod \"dns-default-b4kzz\" (UID: \"666a82b2-f068-427d-8a98-6380178c6be9\") " pod="openshift-dns/dns-default-b4kzz" Jul 10 01:04:56.691732 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:56.691700 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/666a82b2-f068-427d-8a98-6380178c6be9-metrics-tls\") pod \"dns-default-b4kzz\" (UID: \"666a82b2-f068-427d-8a98-6380178c6be9\") " pod="openshift-dns/dns-default-b4kzz" Jul 10 01:04:56.740037 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:56.740013 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-kkhf6"] Jul 10 01:04:56.742276 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:04:56.742246 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded34c96b_f17b_40b0_88de_639790a23f79.slice/crio-54b5f5b9bf0dd1f1fd79be3a8df13a2d0059e7da16ea90cc78624404828ec609 WatchSource:0}: Error finding container 54b5f5b9bf0dd1f1fd79be3a8df13a2d0059e7da16ea90cc78624404828ec609: Status 404 returned error can't find the container with id 54b5f5b9bf0dd1f1fd79be3a8df13a2d0059e7da16ea90cc78624404828ec609 Jul 10 01:04:56.762614 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:04:56.762587 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d5e8a39_1653_4164_9940_cd2fb9c7fee2.slice/crio-b6eec58e7410a2f6064b259043993ac027f3acfe54ff2b90a7f0d0f0aa48b08f WatchSource:0}: Error finding container b6eec58e7410a2f6064b259043993ac027f3acfe54ff2b90a7f0d0f0aa48b08f: Status 404 returned error can't find the container with id b6eec58e7410a2f6064b259043993ac027f3acfe54ff2b90a7f0d0f0aa48b08f Jul 10 01:04:56.764017 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:56.763995 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75dc4ccdb6-67vrj"] Jul 10 01:04:56.897428 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:56.897344 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bmxj4\"" Jul 10 01:04:56.903672 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:56.903648 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" event={"ID":"8d5e8a39-1653-4164-9940-cd2fb9c7fee2","Type":"ContainerStarted","Data":"f7a1eb35c68df8c419c403235e965ecd3ccf233648607c504eb0eeefd92136b6"} Jul 10 01:04:56.903824 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:56.903692 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" event={"ID":"8d5e8a39-1653-4164-9940-cd2fb9c7fee2","Type":"ContainerStarted","Data":"b6eec58e7410a2f6064b259043993ac027f3acfe54ff2b90a7f0d0f0aa48b08f"} Jul 10 01:04:56.903824 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:56.903775 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:04:56.904648 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:56.904628 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b4kzz" Jul 10 01:04:56.904867 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:56.904850 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-kkhf6" event={"ID":"ed34c96b-f17b-40b0-88de-639790a23f79","Type":"ContainerStarted","Data":"54b5f5b9bf0dd1f1fd79be3a8df13a2d0059e7da16ea90cc78624404828ec609"} Jul 10 01:04:56.923855 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:56.923797 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" podStartSLOduration=273.923776645 podStartE2EDuration="4m33.923776645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:00:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:04:56.922882467 +0000 UTC m=+285.514363667" watchObservedRunningTime="2026-07-10 01:04:56.923776645 +0000 UTC m=+285.515257848" Jul 10 01:04:57.028052 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:57.028005 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b4kzz"] Jul 10 01:04:57.032171 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:04:57.032148 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod666a82b2_f068_427d_8a98_6380178c6be9.slice/crio-ca652a6da3f6f981657dd7929f5442aafaba60926a3272c2137448dea82c76da WatchSource:0}: Error finding container ca652a6da3f6f981657dd7929f5442aafaba60926a3272c2137448dea82c76da: Status 404 returned error can't find the container with id ca652a6da3f6f981657dd7929f5442aafaba60926a3272c2137448dea82c76da Jul 10 01:04:57.295234 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:57.295190 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d4307e8-f279-4a1b-a2a3-72d28349cceb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4xr95\" (UID: \"6d4307e8-f279-4a1b-a2a3-72d28349cceb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4xr95" Jul 10 01:04:57.297583 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:57.297553 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d4307e8-f279-4a1b-a2a3-72d28349cceb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4xr95\" (UID: \"6d4307e8-f279-4a1b-a2a3-72d28349cceb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4xr95" Jul 10 01:04:57.511034 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:57.510998 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4xr95" Jul 10 01:04:57.653261 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:57.653001 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4xr95"] Jul 10 01:04:57.655506 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:04:57.655477 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d4307e8_f279_4a1b_a2a3_72d28349cceb.slice/crio-70597230c4fcf7be423dc025123ecfa522c68541ebf2ff2d19363a69ab29e86b WatchSource:0}: Error finding container 70597230c4fcf7be423dc025123ecfa522c68541ebf2ff2d19363a69ab29e86b: Status 404 returned error can't find the container with id 70597230c4fcf7be423dc025123ecfa522c68541ebf2ff2d19363a69ab29e86b Jul 10 01:04:57.909428 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:57.909338 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4xr95" event={"ID":"6d4307e8-f279-4a1b-a2a3-72d28349cceb","Type":"ContainerStarted","Data":"70597230c4fcf7be423dc025123ecfa522c68541ebf2ff2d19363a69ab29e86b"} Jul 10 01:04:57.910405 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:04:57.910384 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b4kzz" event={"ID":"666a82b2-f068-427d-8a98-6380178c6be9","Type":"ContainerStarted","Data":"ca652a6da3f6f981657dd7929f5442aafaba60926a3272c2137448dea82c76da"} Jul 10 01:05:00.598983 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:00.598947 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-czn6v"] Jul 10 01:05:00.602078 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:00.602061 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-czn6v" Jul 10 01:05:00.605066 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:00.605050 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 10 01:05:00.605160 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:00.605107 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-ftzv8\"" Jul 10 01:05:00.611537 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:00.611515 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-czn6v"] Jul 10 01:05:00.723577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:00.723540 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c86e5a83-920e-468d-b2c8-ece1d5ee1b20-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-czn6v\" (UID: \"c86e5a83-920e-468d-b2c8-ece1d5ee1b20\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-czn6v" Jul 10 01:05:00.824601 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:00.824566 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c86e5a83-920e-468d-b2c8-ece1d5ee1b20-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-czn6v\" (UID: \"c86e5a83-920e-468d-b2c8-ece1d5ee1b20\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-czn6v" Jul 10 01:05:00.826919 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:00.826891 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c86e5a83-920e-468d-b2c8-ece1d5ee1b20-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-czn6v\" (UID: \"c86e5a83-920e-468d-b2c8-ece1d5ee1b20\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-czn6v" Jul 10 01:05:00.911321 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:00.911252 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-czn6v" Jul 10 01:05:00.925819 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:00.925790 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-kkhf6" event={"ID":"ed34c96b-f17b-40b0-88de-639790a23f79","Type":"ContainerStarted","Data":"32bc0b5d052942871ef25a93c7653289b2eb123f9ac8c622461eeb2168b88658"} Jul 10 01:05:00.927254 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:00.927207 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4xr95" event={"ID":"6d4307e8-f279-4a1b-a2a3-72d28349cceb","Type":"ContainerStarted","Data":"2beaf8a687870b56b9e7dad10ce7afcd783247331d06e889e5231c04b9312f5d"} Jul 10 01:05:00.928966 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:00.928943 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b4kzz" event={"ID":"666a82b2-f068-427d-8a98-6380178c6be9","Type":"ContainerStarted","Data":"00b77fad4c94984cae107e5e160833fef980528b8adba976e2506c408a7b8cd8"} Jul 10 01:05:00.929072 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:00.928988 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b4kzz" event={"ID":"666a82b2-f068-427d-8a98-6380178c6be9","Type":"ContainerStarted","Data":"67756d6675996de121d35fbc039011531fda2c685ccc2814e66cc80e13abd7b8"} Jul 10 01:05:00.929072 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:00.929067 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b4kzz" Jul 10 01:05:00.942523 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:00.942477 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-kkhf6" podStartSLOduration=272.594592654 podStartE2EDuration="4m35.942461136s" totalImagesPullingTime="3.347868482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:05:00.941633136 +0000 UTC m=+289.533114336" watchObservedRunningTime="2026-07-10 01:05:00.942461136 +0000 UTC m=+289.533942365" Jul 10 01:05:00.961079 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:00.960935 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-b4kzz" podStartSLOduration=251.897824994 podStartE2EDuration="4m14.960917167s" totalImagesPullingTime="3.063092173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:00:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:05:00.95985905 +0000 UTC m=+289.551340250" watchObservedRunningTime="2026-07-10 01:05:00.960917167 +0000 UTC m=+289.552398366" Jul 10 01:05:00.982641 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:00.982594 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4xr95" podStartSLOduration=33.546186621 podStartE2EDuration="35.982576323s" totalImagesPullingTime="2.436389702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:04:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:05:00.98223978 +0000 UTC m=+289.573720976" watchObservedRunningTime="2026-07-10 01:05:00.982576323 +0000 UTC m=+289.574057521" Jul 10 01:05:01.040271 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:01.040251 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-czn6v"] Jul 10 01:05:01.042499 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:05:01.042474 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc86e5a83_920e_468d_b2c8_ece1d5ee1b20.slice/crio-4f9d676c4426358eb52c0bc6e425c335565c6048ab736efba900e4a37fb04d70 WatchSource:0}: Error finding container 4f9d676c4426358eb52c0bc6e425c335565c6048ab736efba900e4a37fb04d70: Status 404 returned error can't find the container with id 4f9d676c4426358eb52c0bc6e425c335565c6048ab736efba900e4a37fb04d70 Jul 10 01:05:01.933620 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:01.933572 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-czn6v" event={"ID":"c86e5a83-920e-468d-b2c8-ece1d5ee1b20","Type":"ContainerStarted","Data":"4f9d676c4426358eb52c0bc6e425c335565c6048ab736efba900e4a37fb04d70"} Jul 10 01:05:02.236174 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:02.236132 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0562244a-ce25-4bce-974e-c2c868371830-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xt5hg\" (UID: \"0562244a-ce25-4bce-974e-c2c868371830\") " pod="openshift-insights/insights-runtime-extractor-xt5hg" Jul 10 01:05:02.238809 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:02.238783 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0562244a-ce25-4bce-974e-c2c868371830-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xt5hg\" (UID: \"0562244a-ce25-4bce-974e-c2c868371830\") " pod="openshift-insights/insights-runtime-extractor-xt5hg" Jul 10 01:05:02.467836 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:02.467797 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xt5hg" Jul 10 01:05:02.592203 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:02.592175 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xt5hg"] Jul 10 01:05:02.594819 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:05:02.594789 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0562244a_ce25_4bce_974e_c2c868371830.slice/crio-03c48af8368bfc511f11f6a44963ce0821d5c3177c25f001b189cf4febed1ed4 WatchSource:0}: Error finding container 03c48af8368bfc511f11f6a44963ce0821d5c3177c25f001b189cf4febed1ed4: Status 404 returned error can't find the container with id 03c48af8368bfc511f11f6a44963ce0821d5c3177c25f001b189cf4febed1ed4 Jul 10 01:05:02.938738 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:02.938645 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xt5hg" event={"ID":"0562244a-ce25-4bce-974e-c2c868371830","Type":"ContainerStarted","Data":"03c48af8368bfc511f11f6a44963ce0821d5c3177c25f001b189cf4febed1ed4"} Jul 10 01:05:02.940048 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:02.940020 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-czn6v" event={"ID":"c86e5a83-920e-468d-b2c8-ece1d5ee1b20","Type":"ContainerStarted","Data":"ea03edde5b336f7b98f093215679ad941443a08691cd5985131222880fb2f9a7"} Jul 10 01:05:02.940266 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:02.940246 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-czn6v" Jul 10 01:05:02.944911 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:02.944889 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-czn6v" Jul 10 01:05:02.955143 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:02.955097 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-czn6v" podStartSLOduration=1.672688723 podStartE2EDuration="2.955082312s" totalImagesPullingTime="1.282393589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:05:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:05:02.954425089 +0000 UTC m=+291.545906288" watchObservedRunningTime="2026-07-10 01:05:02.955082312 +0000 UTC m=+291.546563490" Jul 10 01:05:03.674457 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:03.674402 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-qkjn7"] Jul 10 01:05:03.676491 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:03.676475 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-qkjn7" Jul 10 01:05:03.680656 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:03.680627 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-htnrl\"" Jul 10 01:05:03.680656 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:03.680632 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 10 01:05:03.680846 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:03.680634 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 10 01:05:03.680846 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:03.680638 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 10 01:05:03.688827 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:03.688806 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-qkjn7"] Jul 10 01:05:03.747172 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:03.747135 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc07fd1a-981a-4d39-90c1-6b6bc2f02f20-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-qkjn7\" (UID: \"fc07fd1a-981a-4d39-90c1-6b6bc2f02f20\") " pod="openshift-monitoring/prometheus-operator-64785b6675-qkjn7" Jul 10 01:05:03.747172 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:03.747174 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc07fd1a-981a-4d39-90c1-6b6bc2f02f20-metrics-client-ca\") pod \"prometheus-operator-64785b6675-qkjn7\" (UID: \"fc07fd1a-981a-4d39-90c1-6b6bc2f02f20\") " pod="openshift-monitoring/prometheus-operator-64785b6675-qkjn7" Jul 10 01:05:03.747433 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:03.747191 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvgfx\" (UniqueName: \"kubernetes.io/projected/fc07fd1a-981a-4d39-90c1-6b6bc2f02f20-kube-api-access-mvgfx\") pod \"prometheus-operator-64785b6675-qkjn7\" (UID: \"fc07fd1a-981a-4d39-90c1-6b6bc2f02f20\") " pod="openshift-monitoring/prometheus-operator-64785b6675-qkjn7" Jul 10 01:05:03.747433 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:03.747238 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc07fd1a-981a-4d39-90c1-6b6bc2f02f20-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-qkjn7\" (UID: \"fc07fd1a-981a-4d39-90c1-6b6bc2f02f20\") " pod="openshift-monitoring/prometheus-operator-64785b6675-qkjn7" Jul 10 01:05:03.848650 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:03.848606 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc07fd1a-981a-4d39-90c1-6b6bc2f02f20-metrics-client-ca\") pod \"prometheus-operator-64785b6675-qkjn7\" (UID: \"fc07fd1a-981a-4d39-90c1-6b6bc2f02f20\") " pod="openshift-monitoring/prometheus-operator-64785b6675-qkjn7" Jul 10 01:05:03.848650 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:03.848652 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvgfx\" (UniqueName: \"kubernetes.io/projected/fc07fd1a-981a-4d39-90c1-6b6bc2f02f20-kube-api-access-mvgfx\") pod \"prometheus-operator-64785b6675-qkjn7\" (UID: \"fc07fd1a-981a-4d39-90c1-6b6bc2f02f20\") " pod="openshift-monitoring/prometheus-operator-64785b6675-qkjn7" Jul 10 01:05:03.848857 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:03.848684 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc07fd1a-981a-4d39-90c1-6b6bc2f02f20-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-qkjn7\" (UID: \"fc07fd1a-981a-4d39-90c1-6b6bc2f02f20\") " pod="openshift-monitoring/prometheus-operator-64785b6675-qkjn7" Jul 10 01:05:03.848857 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:03.848780 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc07fd1a-981a-4d39-90c1-6b6bc2f02f20-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-qkjn7\" (UID: \"fc07fd1a-981a-4d39-90c1-6b6bc2f02f20\") " pod="openshift-monitoring/prometheus-operator-64785b6675-qkjn7" Jul 10 01:05:03.849489 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:03.849471 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc07fd1a-981a-4d39-90c1-6b6bc2f02f20-metrics-client-ca\") pod \"prometheus-operator-64785b6675-qkjn7\" (UID: \"fc07fd1a-981a-4d39-90c1-6b6bc2f02f20\") " pod="openshift-monitoring/prometheus-operator-64785b6675-qkjn7" Jul 10 01:05:03.851138 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:03.851117 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc07fd1a-981a-4d39-90c1-6b6bc2f02f20-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-qkjn7\" (UID: \"fc07fd1a-981a-4d39-90c1-6b6bc2f02f20\") " pod="openshift-monitoring/prometheus-operator-64785b6675-qkjn7" Jul 10 01:05:03.851138 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:03.851125 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc07fd1a-981a-4d39-90c1-6b6bc2f02f20-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-qkjn7\" (UID: \"fc07fd1a-981a-4d39-90c1-6b6bc2f02f20\") " pod="openshift-monitoring/prometheus-operator-64785b6675-qkjn7" Jul 10 01:05:03.858998 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:03.858977 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvgfx\" (UniqueName: \"kubernetes.io/projected/fc07fd1a-981a-4d39-90c1-6b6bc2f02f20-kube-api-access-mvgfx\") pod \"prometheus-operator-64785b6675-qkjn7\" (UID: \"fc07fd1a-981a-4d39-90c1-6b6bc2f02f20\") " pod="openshift-monitoring/prometheus-operator-64785b6675-qkjn7" Jul 10 01:05:03.985846 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:03.985816 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-qkjn7" Jul 10 01:05:04.025393 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:05:04.025333 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qx5ln" podUID="e76bc68e-d074-4131-8788-bfb781cc785a" Jul 10 01:05:04.121836 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:04.121813 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-qkjn7"] Jul 10 01:05:04.123567 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:05:04.123536 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc07fd1a_981a_4d39_90c1_6b6bc2f02f20.slice/crio-607c1a152c2437f811dd50d4568cabb78850957cb60d30b12281f3732c260c90 WatchSource:0}: Error finding container 607c1a152c2437f811dd50d4568cabb78850957cb60d30b12281f3732c260c90: Status 404 returned error can't find the container with id 607c1a152c2437f811dd50d4568cabb78850957cb60d30b12281f3732c260c90 Jul 10 01:05:04.950916 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:04.950882 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-qkjn7" event={"ID":"fc07fd1a-981a-4d39-90c1-6b6bc2f02f20","Type":"ContainerStarted","Data":"607c1a152c2437f811dd50d4568cabb78850957cb60d30b12281f3732c260c90"} Jul 10 01:05:07.966795 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:07.966610 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-qkjn7" event={"ID":"fc07fd1a-981a-4d39-90c1-6b6bc2f02f20","Type":"ContainerStarted","Data":"2053aee4d41ec5fd80f744d88e0bf81b00dcbab2e3f42c60c922ba9eba080c76"} Jul 10 01:05:07.968079 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:07.968054 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xt5hg" event={"ID":"0562244a-ce25-4bce-974e-c2c868371830","Type":"ContainerStarted","Data":"68e89fac38946fd0dd5d8ef169657b04f69545658bd7561fb0f9a7ae5f212aef"} Jul 10 01:05:08.973061 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:08.973021 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-qkjn7" event={"ID":"fc07fd1a-981a-4d39-90c1-6b6bc2f02f20","Type":"ContainerStarted","Data":"1e0bb6f7b111cf75eb54e892b76463a8918bb587fbf0463b30e2fa64c8994631"} Jul 10 01:05:08.974612 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:08.974592 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xt5hg" event={"ID":"0562244a-ce25-4bce-974e-c2c868371830","Type":"ContainerStarted","Data":"4ac5b454cb20509fd7de2f62cbf6b1702e19c5a69c4a259ab3a8a8740ab619f1"} Jul 10 01:05:08.990893 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:08.990849 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-qkjn7" podStartSLOduration=2.25681446 podStartE2EDuration="5.990836484s" totalImagesPullingTime="3.734022024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:05:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:05:08.990525314 +0000 UTC m=+297.582006510" watchObservedRunningTime="2026-07-10 01:05:08.990836484 +0000 UTC m=+297.582317681" Jul 10 01:05:09.031406 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:09.031378 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-hccf2"] Jul 10 01:05:09.033526 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:09.033511 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-hccf2" Jul 10 01:05:09.036076 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:09.036056 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 10 01:05:09.036189 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:09.036168 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 10 01:05:09.036293 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:09.036278 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-78zlb\"" Jul 10 01:05:09.041856 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:09.041801 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-hccf2"] Jul 10 01:05:09.093282 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:09.093245 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9lmh\" (UniqueName: \"kubernetes.io/projected/d15d572c-b4d2-482e-8fb9-38977eac71e8-kube-api-access-b9lmh\") pod \"downloads-68c9cbb497-hccf2\" (UID: \"d15d572c-b4d2-482e-8fb9-38977eac71e8\") " pod="openshift-console/downloads-68c9cbb497-hccf2" Jul 10 01:05:09.194806 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:09.194767 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9lmh\" (UniqueName: \"kubernetes.io/projected/d15d572c-b4d2-482e-8fb9-38977eac71e8-kube-api-access-b9lmh\") pod \"downloads-68c9cbb497-hccf2\" (UID: \"d15d572c-b4d2-482e-8fb9-38977eac71e8\") " pod="openshift-console/downloads-68c9cbb497-hccf2" Jul 10 01:05:09.204778 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:09.204748 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9lmh\" (UniqueName: \"kubernetes.io/projected/d15d572c-b4d2-482e-8fb9-38977eac71e8-kube-api-access-b9lmh\") pod \"downloads-68c9cbb497-hccf2\" (UID: \"d15d572c-b4d2-482e-8fb9-38977eac71e8\") " pod="openshift-console/downloads-68c9cbb497-hccf2" Jul 10 01:05:09.343162 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:09.343070 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-hccf2" Jul 10 01:05:09.490657 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:09.490630 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-hccf2"] Jul 10 01:05:09.493206 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:05:09.493177 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd15d572c_b4d2_482e_8fb9_38977eac71e8.slice/crio-6abfc10b1b7af9b5627e19d308511d194383dfd3ef3d96914bc3eb70d0c57fa6 WatchSource:0}: Error finding container 6abfc10b1b7af9b5627e19d308511d194383dfd3ef3d96914bc3eb70d0c57fa6: Status 404 returned error can't find the container with id 6abfc10b1b7af9b5627e19d308511d194383dfd3ef3d96914bc3eb70d0c57fa6 Jul 10 01:05:09.979392 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:09.979361 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-hccf2" event={"ID":"d15d572c-b4d2-482e-8fb9-38977eac71e8","Type":"ContainerStarted","Data":"6abfc10b1b7af9b5627e19d308511d194383dfd3ef3d96914bc3eb70d0c57fa6"} Jul 10 01:05:10.936791 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:10.936175 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-b4kzz" Jul 10 01:05:11.045851 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.045758 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ttl82"] Jul 10 01:05:11.057482 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.057452 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:11.060432 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.060407 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 10 01:05:11.060741 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.060716 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-h87x4\"" Jul 10 01:05:11.060915 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.060900 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 10 01:05:11.061125 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.061111 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 10 01:05:11.108618 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.108581 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc600c03-9db7-4ff5-8d20-edd40cea75b6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:11.108791 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.108631 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgv6q\" (UniqueName: \"kubernetes.io/projected/cc600c03-9db7-4ff5-8d20-edd40cea75b6-kube-api-access-qgv6q\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:11.108791 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.108661 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cc600c03-9db7-4ff5-8d20-edd40cea75b6-node-exporter-wtmp\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:11.108791 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.108741 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc600c03-9db7-4ff5-8d20-edd40cea75b6-sys\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:11.108949 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.108799 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cc600c03-9db7-4ff5-8d20-edd40cea75b6-node-exporter-textfile\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:11.108949 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.108831 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cc600c03-9db7-4ff5-8d20-edd40cea75b6-node-exporter-tls\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:11.108949 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.108870 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc600c03-9db7-4ff5-8d20-edd40cea75b6-metrics-client-ca\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:11.108949 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.108924 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cc600c03-9db7-4ff5-8d20-edd40cea75b6-root\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:11.109204 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.108991 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cc600c03-9db7-4ff5-8d20-edd40cea75b6-node-exporter-accelerators-collector-config\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:11.209895 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.209861 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cc600c03-9db7-4ff5-8d20-edd40cea75b6-node-exporter-accelerators-collector-config\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:11.210025 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.209917 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc600c03-9db7-4ff5-8d20-edd40cea75b6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:11.210025 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.209946 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgv6q\" (UniqueName: \"kubernetes.io/projected/cc600c03-9db7-4ff5-8d20-edd40cea75b6-kube-api-access-qgv6q\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:11.210025 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.209977 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cc600c03-9db7-4ff5-8d20-edd40cea75b6-node-exporter-wtmp\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:11.210025 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.210012 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc600c03-9db7-4ff5-8d20-edd40cea75b6-sys\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:11.210256 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.210040 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cc600c03-9db7-4ff5-8d20-edd40cea75b6-node-exporter-textfile\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:11.210256 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.210064 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cc600c03-9db7-4ff5-8d20-edd40cea75b6-node-exporter-tls\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:11.210256 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.210096 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc600c03-9db7-4ff5-8d20-edd40cea75b6-metrics-client-ca\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:11.210256 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.210134 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cc600c03-9db7-4ff5-8d20-edd40cea75b6-root\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:11.210256 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.210213 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cc600c03-9db7-4ff5-8d20-edd40cea75b6-root\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:11.210722 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.210528 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cc600c03-9db7-4ff5-8d20-edd40cea75b6-node-exporter-accelerators-collector-config\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:11.210722 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:05:11.210570 2554 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 10 01:05:11.210722 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:05:11.210624 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc600c03-9db7-4ff5-8d20-edd40cea75b6-node-exporter-tls podName:cc600c03-9db7-4ff5-8d20-edd40cea75b6 nodeName:}" failed. No retries permitted until 2026-07-10 01:05:11.710604971 +0000 UTC m=+300.302086151 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/cc600c03-9db7-4ff5-8d20-edd40cea75b6-node-exporter-tls") pod "node-exporter-ttl82" (UID: "cc600c03-9db7-4ff5-8d20-edd40cea75b6") : secret "node-exporter-tls" not found Jul 10 01:05:11.210722 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.210640 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cc600c03-9db7-4ff5-8d20-edd40cea75b6-node-exporter-textfile\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:11.210722 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.210677 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cc600c03-9db7-4ff5-8d20-edd40cea75b6-node-exporter-wtmp\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:11.210722 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.210702 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc600c03-9db7-4ff5-8d20-edd40cea75b6-sys\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:11.211081 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.210949 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc600c03-9db7-4ff5-8d20-edd40cea75b6-metrics-client-ca\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:11.212696 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.212675 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc600c03-9db7-4ff5-8d20-edd40cea75b6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:11.225161 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.225097 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgv6q\" (UniqueName: \"kubernetes.io/projected/cc600c03-9db7-4ff5-8d20-edd40cea75b6-kube-api-access-qgv6q\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:11.715199 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.715161 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cc600c03-9db7-4ff5-8d20-edd40cea75b6-node-exporter-tls\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:11.715396 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:05:11.715338 2554 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 10 01:05:11.715438 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:05:11.715402 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc600c03-9db7-4ff5-8d20-edd40cea75b6-node-exporter-tls podName:cc600c03-9db7-4ff5-8d20-edd40cea75b6 nodeName:}" failed. No retries permitted until 2026-07-10 01:05:12.71538479 +0000 UTC m=+301.306865971 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/cc600c03-9db7-4ff5-8d20-edd40cea75b6-node-exporter-tls") pod "node-exporter-ttl82" (UID: "cc600c03-9db7-4ff5-8d20-edd40cea75b6") : secret "node-exporter-tls" not found Jul 10 01:05:11.969669 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.969001 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsbgv_38689ba6-fbae-4092-b63e-3488ce589912/ovn-acl-logging/0.log" Jul 10 01:05:11.970721 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.970695 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsbgv_38689ba6-fbae-4092-b63e-3488ce589912/ovn-acl-logging/0.log" Jul 10 01:05:11.990046 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:11.989992 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xt5hg" event={"ID":"0562244a-ce25-4bce-974e-c2c868371830","Type":"ContainerStarted","Data":"ae083050b27b8fc90055e9968ce519b483f9a1a59f54e8176afd8b5420b4ad30"} Jul 10 01:05:12.009609 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:12.009395 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xt5hg" podStartSLOduration=33.525753436 podStartE2EDuration="42.009374085s" totalImagesPullingTime="8.483620649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 01:04:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:05:12.009050074 +0000 UTC m=+300.600531266" watchObservedRunningTime="2026-07-10 01:05:12.009374085 +0000 UTC m=+300.600855288" Jul 10 01:05:12.725136 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:12.725098 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cc600c03-9db7-4ff5-8d20-edd40cea75b6-node-exporter-tls\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:12.727901 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:12.727873 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cc600c03-9db7-4ff5-8d20-edd40cea75b6-node-exporter-tls\") pod \"node-exporter-ttl82\" (UID: \"cc600c03-9db7-4ff5-8d20-edd40cea75b6\") " pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:12.873207 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:12.873177 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-h87x4\"" Jul 10 01:05:12.881370 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:12.881342 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ttl82" Jul 10 01:05:12.891757 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:05:12.891726 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc600c03_9db7_4ff5_8d20_edd40cea75b6.slice/crio-ee7202c81f3a9f9ba8dc5464c778019e8a42b86ed37a0ed4cb35d4a98d22b0c0 WatchSource:0}: Error finding container ee7202c81f3a9f9ba8dc5464c778019e8a42b86ed37a0ed4cb35d4a98d22b0c0: Status 404 returned error can't find the container with id ee7202c81f3a9f9ba8dc5464c778019e8a42b86ed37a0ed4cb35d4a98d22b0c0 Jul 10 01:05:12.996131 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:12.996030 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ttl82" event={"ID":"cc600c03-9db7-4ff5-8d20-edd40cea75b6","Type":"ContainerStarted","Data":"ee7202c81f3a9f9ba8dc5464c778019e8a42b86ed37a0ed4cb35d4a98d22b0c0"} Jul 10 01:05:14.875939 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:14.875903 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75dc4ccdb6-67vrj"] Jul 10 01:05:14.881408 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:14.881370 2554 patch_prober.go:28] interesting pod/image-registry-75dc4ccdb6-67vrj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 10 01:05:14.881618 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:14.881447 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" podUID="8d5e8a39-1653-4164-9940-cd2fb9c7fee2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 01:05:15.006376 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:15.006328 2554 generic.go:356] "Generic (PLEG): container finished" podID="cc600c03-9db7-4ff5-8d20-edd40cea75b6" containerID="79229fc35c86d1882c7da8a4dd79b38e3120ccfe948e12e5b3d8a78f1eb2b103" exitCode=0 Jul 10 01:05:15.006573 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:15.006411 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ttl82" event={"ID":"cc600c03-9db7-4ff5-8d20-edd40cea75b6","Type":"ContainerDied","Data":"79229fc35c86d1882c7da8a4dd79b38e3120ccfe948e12e5b3d8a78f1eb2b103"} Jul 10 01:05:15.024630 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:15.024603 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:05:15.802627 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:15.802590 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-8rvgb"] Jul 10 01:05:15.806144 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:15.806117 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8rvgb" Jul 10 01:05:15.808876 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:15.808850 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-qh5v9\"" Jul 10 01:05:15.809571 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:15.809547 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 10 01:05:15.818842 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:15.818816 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-8rvgb"] Jul 10 01:05:15.955788 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:15.955749 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc106d42-71ca-432d-b6a2-64f37ba4f14c-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-8rvgb\" (UID: \"fc106d42-71ca-432d-b6a2-64f37ba4f14c\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8rvgb" Jul 10 01:05:15.956272 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:15.955925 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qrzq\" (UniqueName: \"kubernetes.io/projected/fc106d42-71ca-432d-b6a2-64f37ba4f14c-kube-api-access-8qrzq\") pod \"monitoring-plugin-5f68df7f58-8rvgb\" (UID: \"fc106d42-71ca-432d-b6a2-64f37ba4f14c\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8rvgb" Jul 10 01:05:16.013165 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:16.013054 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ttl82" event={"ID":"cc600c03-9db7-4ff5-8d20-edd40cea75b6","Type":"ContainerStarted","Data":"6867b713477c56b951f4b018286d2d3ae1266014fde72295012a956da2ff4517"} Jul 10 01:05:16.013165 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:16.013123 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ttl82" event={"ID":"cc600c03-9db7-4ff5-8d20-edd40cea75b6","Type":"ContainerStarted","Data":"60f7c24b28c8b775da5372a37780807f68955dcbcbf1ea72ff614fb5db99f3c4"} Jul 10 01:05:16.033157 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:16.033086 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ttl82" podStartSLOduration=3.8878280849999998 podStartE2EDuration="5.033070244s" totalImagesPullingTime="1.063706478s" totalInitContainerRuntime="81.535681ms" isStatefulPod=true podCreationTimestamp="2026-07-10 01:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:05:16.032618347 +0000 UTC m=+304.624099545" watchObservedRunningTime="2026-07-10 01:05:16.033070244 +0000 UTC m=+304.624551443" Jul 10 01:05:16.057085 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:16.056998 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qrzq\" (UniqueName: \"kubernetes.io/projected/fc106d42-71ca-432d-b6a2-64f37ba4f14c-kube-api-access-8qrzq\") pod \"monitoring-plugin-5f68df7f58-8rvgb\" (UID: \"fc106d42-71ca-432d-b6a2-64f37ba4f14c\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8rvgb" Jul 10 01:05:16.057085 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:16.057063 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc106d42-71ca-432d-b6a2-64f37ba4f14c-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-8rvgb\" (UID: \"fc106d42-71ca-432d-b6a2-64f37ba4f14c\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8rvgb" Jul 10 01:05:16.057346 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:05:16.057165 2554 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 10 01:05:16.057346 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:05:16.057264 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc106d42-71ca-432d-b6a2-64f37ba4f14c-monitoring-plugin-cert podName:fc106d42-71ca-432d-b6a2-64f37ba4f14c nodeName:}" failed. No retries permitted until 2026-07-10 01:05:16.557239011 +0000 UTC m=+305.148720203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/fc106d42-71ca-432d-b6a2-64f37ba4f14c-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-8rvgb" (UID: "fc106d42-71ca-432d-b6a2-64f37ba4f14c") : secret "monitoring-plugin-cert" not found Jul 10 01:05:16.068302 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:16.068274 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qrzq\" (UniqueName: \"kubernetes.io/projected/fc106d42-71ca-432d-b6a2-64f37ba4f14c-kube-api-access-8qrzq\") pod \"monitoring-plugin-5f68df7f58-8rvgb\" (UID: \"fc106d42-71ca-432d-b6a2-64f37ba4f14c\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8rvgb" Jul 10 01:05:16.561643 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:16.561608 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc106d42-71ca-432d-b6a2-64f37ba4f14c-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-8rvgb\" (UID: \"fc106d42-71ca-432d-b6a2-64f37ba4f14c\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8rvgb" Jul 10 01:05:16.564550 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:16.564521 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc106d42-71ca-432d-b6a2-64f37ba4f14c-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-8rvgb\" (UID: \"fc106d42-71ca-432d-b6a2-64f37ba4f14c\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8rvgb" Jul 10 01:05:16.718487 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:16.718449 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8rvgb" Jul 10 01:05:16.866202 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:16.866156 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-8rvgb"] Jul 10 01:05:16.868629 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:05:16.868596 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc106d42_71ca_432d_b6a2_64f37ba4f14c.slice/crio-e2e2d729ea603ea6f7a2de110a71b2cd4d633360962393731cc578c7588132c2 WatchSource:0}: Error finding container e2e2d729ea603ea6f7a2de110a71b2cd4d633360962393731cc578c7588132c2: Status 404 returned error can't find the container with id e2e2d729ea603ea6f7a2de110a71b2cd4d633360962393731cc578c7588132c2 Jul 10 01:05:16.871454 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:16.871436 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 01:05:17.018785 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.018749 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8rvgb" event={"ID":"fc106d42-71ca-432d-b6a2-64f37ba4f14c","Type":"ContainerStarted","Data":"e2e2d729ea603ea6f7a2de110a71b2cd4d633360962393731cc578c7588132c2"} Jul 10 01:05:17.286069 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.286033 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 01:05:17.292333 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.291584 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.294956 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.294736 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 10 01:05:17.294956 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.294771 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 10 01:05:17.294956 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.294904 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 10 01:05:17.295290 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.295156 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2gghii6lgd7da\"" Jul 10 01:05:17.295290 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.295164 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 10 01:05:17.295534 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.295513 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 10 01:05:17.295637 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.295532 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 10 01:05:17.296266 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.296247 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 10 01:05:17.296411 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.296392 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 10 01:05:17.296834 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.296494 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-l5djl\"" Jul 10 01:05:17.296834 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.296752 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 10 01:05:17.296834 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.296784 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 10 01:05:17.297112 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.297030 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 10 01:05:17.297112 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.297049 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 10 01:05:17.297645 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.297625 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 10 01:05:17.298637 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.298609 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 10 01:05:17.298990 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.298971 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 10 01:05:17.307208 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.307185 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 01:05:17.369903 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.369867 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.370071 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.369926 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-config\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.370071 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.369986 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.374262 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.370280 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.374262 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.370321 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.374262 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.370363 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.374262 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.370401 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-web-config\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.374262 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.370429 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.374262 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.370469 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.374262 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.370496 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.374262 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.370529 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.374262 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.370560 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.374262 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.370597 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.374262 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.370634 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.374262 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.370663 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.374262 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.370703 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.374262 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.370732 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlqnp\" (UniqueName: \"kubernetes.io/projected/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-kube-api-access-jlqnp\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.374262 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.370776 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-config-out\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.374262 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.370810 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.377770 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.370839 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.472392 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.472349 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.472392 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.472394 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.472977 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.472433 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.472977 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.472462 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-config\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.472977 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.472505 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.472977 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.472547 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.472977 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.472572 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.472977 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.472604 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.472977 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.472629 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-web-config\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.472977 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.472649 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.472977 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.472684 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.472977 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.472707 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.472977 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.472743 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.472977 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.472781 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.472977 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.472811 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.472977 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.472849 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.472977 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.472876 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.472977 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.472910 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.472977 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.472936 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlqnp\" (UniqueName: \"kubernetes.io/projected/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-kube-api-access-jlqnp\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.473863 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.472967 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-config-out\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.474593 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.474565 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.474704 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.474616 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.475291 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.475235 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.477244 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.477181 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.477812 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.477715 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.479184 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.478804 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.480036 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.479662 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.480036 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.480000 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.480666 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.480621 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.481203 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.481161 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-config\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.481203 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.481176 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.481826 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.481802 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.482732 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.482684 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-web-config\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.482732 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.482705 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.482880 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.482754 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.483003 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.482980 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-config-out\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.483170 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.483151 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.483376 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.483352 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.483711 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.483672 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.487721 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.487696 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlqnp\" (UniqueName: \"kubernetes.io/projected/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-kube-api-access-jlqnp\") pod \"prometheus-k8s-0\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.607908 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.607800 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:17.776813 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:17.776675 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 01:05:17.780878 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:05:17.780845 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd60e5822_9d6b_46d6_9d95_2d2848c8c6a1.slice/crio-dd6c3d211480ad62ddf16306397fffb2d3761a5c0f40bf3c2eaf735beb91b3bc WatchSource:0}: Error finding container dd6c3d211480ad62ddf16306397fffb2d3761a5c0f40bf3c2eaf735beb91b3bc: Status 404 returned error can't find the container with id dd6c3d211480ad62ddf16306397fffb2d3761a5c0f40bf3c2eaf735beb91b3bc Jul 10 01:05:18.031235 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:18.031135 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1","Type":"ContainerStarted","Data":"dd6c3d211480ad62ddf16306397fffb2d3761a5c0f40bf3c2eaf735beb91b3bc"} Jul 10 01:05:20.034606 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:20.034565 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8rvgb" event={"ID":"fc106d42-71ca-432d-b6a2-64f37ba4f14c","Type":"ContainerStarted","Data":"d34bc20d2005aa8d6284154e8cb978f9556310fa6220210071bc6d0e5460b3f9"} Jul 10 01:05:20.035041 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:20.034805 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8rvgb" Jul 10 01:05:20.036616 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:20.036588 2554 generic.go:356] "Generic (PLEG): container finished" podID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerID="9bd54294e0e21f3928073902bcadcd90f861c3fb0a78f391dc70355996f44b15" exitCode=0 Jul 10 01:05:20.036724 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:20.036618 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1","Type":"ContainerDied","Data":"9bd54294e0e21f3928073902bcadcd90f861c3fb0a78f391dc70355996f44b15"} Jul 10 01:05:20.041145 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:20.041123 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8rvgb" Jul 10 01:05:20.050832 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:20.050788 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8rvgb" podStartSLOduration=2.874631925 podStartE2EDuration="5.050773337s" totalImagesPullingTime="2.176141412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:05:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:05:20.049012969 +0000 UTC m=+308.640494168" watchObservedRunningTime="2026-07-10 01:05:20.050773337 +0000 UTC m=+308.642254535" Jul 10 01:05:24.881988 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:24.881959 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:05:32.094694 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:32.094481 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1","Type":"ContainerStarted","Data":"fa96bdfdabaa41ef2ea5567d69bba0aabeaae913d20dcd88a55cdb0a13422019"} Jul 10 01:05:32.094694 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:32.094574 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1","Type":"ContainerStarted","Data":"f46d15fc94f92fcef2e58484dcc7a4fbf43e0cae2641ecdefebb989700cfbca9"} Jul 10 01:05:32.099313 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:32.097268 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-hccf2" event={"ID":"d15d572c-b4d2-482e-8fb9-38977eac71e8","Type":"ContainerStarted","Data":"31bcb1259822cf5e8473ef76d18ac936ae37c6d328747235e51742417d9829bf"} Jul 10 01:05:32.099313 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:32.098445 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-hccf2" Jul 10 01:05:32.099829 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:32.099763 2554 patch_prober.go:28] interesting pod/downloads-68c9cbb497-hccf2 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.20:8080/\": dial tcp 10.133.0.20:8080: connect: connection refused" start-of-body= Jul 10 01:05:32.100024 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:32.100001 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-68c9cbb497-hccf2" podUID="d15d572c-b4d2-482e-8fb9-38977eac71e8" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.20:8080/\": dial tcp 10.133.0.20:8080: connect: connection refused" Jul 10 01:05:32.120691 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:32.120619 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-hccf2" podStartSLOduration=0.731575352 podStartE2EDuration="23.120598377s" totalImagesPullingTime="22.389023025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:05:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:05:32.119881096 +0000 UTC m=+320.711362295" watchObservedRunningTime="2026-07-10 01:05:32.120598377 +0000 UTC m=+320.712079573" Jul 10 01:05:33.113519 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:33.113456 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-hccf2" Jul 10 01:05:35.117522 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:35.117436 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1","Type":"ContainerStarted","Data":"9f640af7f4afb06fbb50d79b6c4f61280025b4d793bc7e4884b1cbf452bc8f05"} Jul 10 01:05:35.117959 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:35.117522 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1","Type":"ContainerStarted","Data":"d6724bf37ee411aa2f0978cdef710fe67de827ca85d7ac199bb32826f154c4db"} Jul 10 01:05:35.117959 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:35.117568 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1","Type":"ContainerStarted","Data":"f7bf87cb03aea8532200a0fd7f3221347cbc935d9ca68dbd155da65ec14ef839"} Jul 10 01:05:35.117959 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:35.117605 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1","Type":"ContainerStarted","Data":"5f1f669cf380669da8d62956e251d3e86b7c9febba6812d6f1fb4fbc5e01027b"} Jul 10 01:05:35.147792 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:35.147721 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.529070322 podStartE2EDuration="18.147700487s" totalImagesPullingTime="15.596103246s" totalInitContainerRuntime="22.526919ms" isStatefulPod=false podCreationTimestamp="2026-07-10 01:05:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:05:35.145680259 +0000 UTC m=+323.737161496" watchObservedRunningTime="2026-07-10 01:05:35.147700487 +0000 UTC m=+323.739181687" Jul 10 01:05:37.608636 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:37.608595 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:05:39.902574 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:39.902522 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" podUID="8d5e8a39-1653-4164-9940-cd2fb9c7fee2" containerName="registry" containerID="cri-o://f7a1eb35c68df8c419c403235e965ecd3ccf233648607c504eb0eeefd92136b6" gracePeriod=30 Jul 10 01:05:40.142492 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:40.142455 2554 generic.go:356] "Generic (PLEG): container finished" podID="8d5e8a39-1653-4164-9940-cd2fb9c7fee2" containerID="f7a1eb35c68df8c419c403235e965ecd3ccf233648607c504eb0eeefd92136b6" exitCode=0 Jul 10 01:05:40.142658 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:40.142536 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" event={"ID":"8d5e8a39-1653-4164-9940-cd2fb9c7fee2","Type":"ContainerDied","Data":"f7a1eb35c68df8c419c403235e965ecd3ccf233648607c504eb0eeefd92136b6"} Jul 10 01:05:40.200297 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:40.200262 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:05:40.298286 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:40.298247 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-bound-sa-token\") pod \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " Jul 10 01:05:40.298469 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:40.298301 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-certificates\") pod \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " Jul 10 01:05:40.298469 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:40.298335 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-installation-pull-secrets\") pod \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " Jul 10 01:05:40.298469 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:40.298361 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls\") pod \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " Jul 10 01:05:40.298469 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:40.298385 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cthh\" (UniqueName: \"kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-kube-api-access-6cthh\") pod \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " Jul 10 01:05:40.298469 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:40.298428 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-ca-trust-extracted\") pod \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " Jul 10 01:05:40.298744 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:40.298695 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8d5e8a39-1653-4164-9940-cd2fb9c7fee2" (UID: "8d5e8a39-1653-4164-9940-cd2fb9c7fee2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 01:05:40.298896 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:40.298872 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-image-registry-private-configuration\") pod \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " Jul 10 01:05:40.298991 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:40.298967 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-trusted-ca\") pod \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\" (UID: \"8d5e8a39-1653-4164-9940-cd2fb9c7fee2\") " Jul 10 01:05:40.299309 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:40.299274 2554 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-certificates\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:05:40.299616 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:40.299480 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8d5e8a39-1653-4164-9940-cd2fb9c7fee2" (UID: "8d5e8a39-1653-4164-9940-cd2fb9c7fee2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 01:05:40.301535 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:40.301487 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8d5e8a39-1653-4164-9940-cd2fb9c7fee2" (UID: "8d5e8a39-1653-4164-9940-cd2fb9c7fee2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 01:05:40.301958 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:40.301858 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8d5e8a39-1653-4164-9940-cd2fb9c7fee2" (UID: "8d5e8a39-1653-4164-9940-cd2fb9c7fee2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 01:05:40.301958 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:40.301891 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8d5e8a39-1653-4164-9940-cd2fb9c7fee2" (UID: "8d5e8a39-1653-4164-9940-cd2fb9c7fee2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 01:05:40.301958 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:40.301909 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8d5e8a39-1653-4164-9940-cd2fb9c7fee2" (UID: "8d5e8a39-1653-4164-9940-cd2fb9c7fee2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 01:05:40.302170 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:40.301969 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-kube-api-access-6cthh" (OuterVolumeSpecName: "kube-api-access-6cthh") pod "8d5e8a39-1653-4164-9940-cd2fb9c7fee2" (UID: "8d5e8a39-1653-4164-9940-cd2fb9c7fee2"). InnerVolumeSpecName "kube-api-access-6cthh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 01:05:40.311300 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:40.311255 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8d5e8a39-1653-4164-9940-cd2fb9c7fee2" (UID: "8d5e8a39-1653-4164-9940-cd2fb9c7fee2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 01:05:40.400268 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:40.400208 2554 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-bound-sa-token\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:05:40.400268 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:40.400265 2554 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-installation-pull-secrets\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:05:40.400484 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:40.400283 2554 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-registry-tls\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:05:40.400484 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:40.400297 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cthh\" (UniqueName: \"kubernetes.io/projected/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-kube-api-access-6cthh\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:05:40.400484 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:40.400312 2554 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-ca-trust-extracted\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:05:40.400484 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:40.400327 2554 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-image-registry-private-configuration\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:05:40.400484 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:40.400338 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8d5e8a39-1653-4164-9940-cd2fb9c7fee2-trusted-ca\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:05:41.147237 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:41.147179 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" event={"ID":"8d5e8a39-1653-4164-9940-cd2fb9c7fee2","Type":"ContainerDied","Data":"b6eec58e7410a2f6064b259043993ac027f3acfe54ff2b90a7f0d0f0aa48b08f"} Jul 10 01:05:41.147237 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:41.147210 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75dc4ccdb6-67vrj" Jul 10 01:05:41.147714 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:41.147272 2554 scope.go:117] "RemoveContainer" containerID="f7a1eb35c68df8c419c403235e965ecd3ccf233648607c504eb0eeefd92136b6" Jul 10 01:05:41.168826 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:41.168794 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75dc4ccdb6-67vrj"] Jul 10 01:05:41.171981 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:41.171953 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-75dc4ccdb6-67vrj"] Jul 10 01:05:42.029924 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:42.029892 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d5e8a39-1653-4164-9940-cd2fb9c7fee2" path="/var/lib/kubelet/pods/8d5e8a39-1653-4164-9940-cd2fb9c7fee2/volumes" Jul 10 01:05:54.197381 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:54.197297 2554 generic.go:356] "Generic (PLEG): container finished" podID="92d12b46-a0b8-4a61-a518-9bd36ca219cf" containerID="3d6569e1895562775097556e82277b25351727a92f83d85e7ff082c3229494ce" exitCode=0 Jul 10 01:05:54.197767 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:54.197372 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xm9b" event={"ID":"92d12b46-a0b8-4a61-a518-9bd36ca219cf","Type":"ContainerDied","Data":"3d6569e1895562775097556e82277b25351727a92f83d85e7ff082c3229494ce"} Jul 10 01:05:54.197767 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:54.197711 2554 scope.go:117] "RemoveContainer" containerID="3d6569e1895562775097556e82277b25351727a92f83d85e7ff082c3229494ce" Jul 10 01:05:55.203151 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:05:55.203117 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xm9b" event={"ID":"92d12b46-a0b8-4a61-a518-9bd36ca219cf","Type":"ContainerStarted","Data":"a09c4ff8c8fe119e5aec356855f55a18451147916931e7a5bfe7c3133cfaeb36"} Jul 10 01:06:17.608580 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:17.608542 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:17.671587 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:17.671559 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:18.304526 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:18.304498 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:24.877632 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:24.877592 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs\") pod \"network-metrics-daemon-qx5ln\" (UID: \"e76bc68e-d074-4131-8788-bfb781cc785a\") " pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:06:24.879854 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:24.879829 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e76bc68e-d074-4131-8788-bfb781cc785a-metrics-certs\") pod \"network-metrics-daemon-qx5ln\" (UID: \"e76bc68e-d074-4131-8788-bfb781cc785a\") " pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:06:24.928751 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:24.928719 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jjnvz\"" Jul 10 01:06:24.936001 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:24.935983 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx5ln" Jul 10 01:06:25.058979 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:25.058955 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qx5ln"] Jul 10 01:06:25.061080 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:06:25.061048 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode76bc68e_d074_4131_8788_bfb781cc785a.slice/crio-93724dd7b4ec5d320b63cec670cf36fcc434451cc22be6c697fb2f69d977b492 WatchSource:0}: Error finding container 93724dd7b4ec5d320b63cec670cf36fcc434451cc22be6c697fb2f69d977b492: Status 404 returned error can't find the container with id 93724dd7b4ec5d320b63cec670cf36fcc434451cc22be6c697fb2f69d977b492 Jul 10 01:06:25.314629 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:25.314592 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qx5ln" event={"ID":"e76bc68e-d074-4131-8788-bfb781cc785a","Type":"ContainerStarted","Data":"93724dd7b4ec5d320b63cec670cf36fcc434451cc22be6c697fb2f69d977b492"} Jul 10 01:06:26.320503 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:26.320464 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qx5ln" event={"ID":"e76bc68e-d074-4131-8788-bfb781cc785a","Type":"ContainerStarted","Data":"66db9f33f0925f6e1f601108fc0e0323e59f1c8f02442a43a3cbd208dc19d570"} Jul 10 01:06:26.320913 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:26.320519 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qx5ln" event={"ID":"e76bc68e-d074-4131-8788-bfb781cc785a","Type":"ContainerStarted","Data":"dceda8476768a645de35d91c1789baec72f9c938ed77945d1e8b6e7a37ee8d5f"} Jul 10 01:06:26.337301 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:26.337249 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qx5ln" podStartSLOduration=373.488742204 podStartE2EDuration="6m14.33721286s" totalImagesPullingTime="848.470656ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:06:26.335472315 +0000 UTC m=+374.926953513" watchObservedRunningTime="2026-07-10 01:06:26.33721286 +0000 UTC m=+374.928694092" Jul 10 01:06:35.619375 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:35.619339 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 01:06:35.619785 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:35.619617 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerName="prometheus" containerID="cri-o://f46d15fc94f92fcef2e58484dcc7a4fbf43e0cae2641ecdefebb989700cfbca9" gracePeriod=600 Jul 10 01:06:35.619785 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:35.619633 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerName="kube-rbac-proxy" containerID="cri-o://d6724bf37ee411aa2f0978cdef710fe67de827ca85d7ac199bb32826f154c4db" gracePeriod=600 Jul 10 01:06:35.619785 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:35.619677 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerName="thanos-sidecar" containerID="cri-o://5f1f669cf380669da8d62956e251d3e86b7c9febba6812d6f1fb4fbc5e01027b" gracePeriod=600 Jul 10 01:06:35.619785 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:35.619718 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerName="config-reloader" containerID="cri-o://fa96bdfdabaa41ef2ea5567d69bba0aabeaae913d20dcd88a55cdb0a13422019" gracePeriod=600 Jul 10 01:06:35.619785 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:35.619724 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9f640af7f4afb06fbb50d79b6c4f61280025b4d793bc7e4884b1cbf452bc8f05" gracePeriod=600 Jul 10 01:06:35.619785 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:35.619689 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerName="kube-rbac-proxy-web" containerID="cri-o://f7bf87cb03aea8532200a0fd7f3221347cbc935d9ca68dbd155da65ec14ef839" gracePeriod=600 Jul 10 01:06:36.362192 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.362161 2554 generic.go:356] "Generic (PLEG): container finished" podID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerID="9f640af7f4afb06fbb50d79b6c4f61280025b4d793bc7e4884b1cbf452bc8f05" exitCode=0 Jul 10 01:06:36.362192 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.362187 2554 generic.go:356] "Generic (PLEG): container finished" podID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerID="d6724bf37ee411aa2f0978cdef710fe67de827ca85d7ac199bb32826f154c4db" exitCode=0 Jul 10 01:06:36.362192 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.362195 2554 generic.go:356] "Generic (PLEG): container finished" podID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerID="5f1f669cf380669da8d62956e251d3e86b7c9febba6812d6f1fb4fbc5e01027b" exitCode=0 Jul 10 01:06:36.362192 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.362202 2554 generic.go:356] "Generic (PLEG): container finished" podID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerID="fa96bdfdabaa41ef2ea5567d69bba0aabeaae913d20dcd88a55cdb0a13422019" exitCode=0 Jul 10 01:06:36.362192 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.362207 2554 generic.go:356] "Generic (PLEG): container finished" podID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerID="f46d15fc94f92fcef2e58484dcc7a4fbf43e0cae2641ecdefebb989700cfbca9" exitCode=0 Jul 10 01:06:36.362497 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.362250 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1","Type":"ContainerDied","Data":"9f640af7f4afb06fbb50d79b6c4f61280025b4d793bc7e4884b1cbf452bc8f05"} Jul 10 01:06:36.362497 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.362336 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1","Type":"ContainerDied","Data":"d6724bf37ee411aa2f0978cdef710fe67de827ca85d7ac199bb32826f154c4db"} Jul 10 01:06:36.362497 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.362369 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1","Type":"ContainerDied","Data":"5f1f669cf380669da8d62956e251d3e86b7c9febba6812d6f1fb4fbc5e01027b"} Jul 10 01:06:36.362497 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.362395 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1","Type":"ContainerDied","Data":"fa96bdfdabaa41ef2ea5567d69bba0aabeaae913d20dcd88a55cdb0a13422019"} Jul 10 01:06:36.362497 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.362417 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1","Type":"ContainerDied","Data":"f46d15fc94f92fcef2e58484dcc7a4fbf43e0cae2641ecdefebb989700cfbca9"} Jul 10 01:06:36.851858 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.851835 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:36.976811 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.976762 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-thanos-prometheus-http-client-file\") pod \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " Jul 10 01:06:36.977000 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.976832 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-configmap-metrics-client-ca\") pod \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " Jul 10 01:06:36.977000 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.976856 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-grpc-tls\") pod \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " Jul 10 01:06:36.977000 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.976884 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-trusted-ca-bundle\") pod \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " Jul 10 01:06:36.977000 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.976914 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-tls-assets\") pod \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " Jul 10 01:06:36.977000 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.976939 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-config\") pod \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " Jul 10 01:06:36.977000 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.976962 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-configmap-kubelet-serving-ca-bundle\") pod \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " Jul 10 01:06:36.977327 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.977015 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-config-out\") pod \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " Jul 10 01:06:36.977327 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.977053 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-web-config\") pod \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " Jul 10 01:06:36.977327 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.977085 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-k8s-rulefiles-0\") pod \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " Jul 10 01:06:36.977327 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.977114 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlqnp\" (UniqueName: \"kubernetes.io/projected/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-kube-api-access-jlqnp\") pod \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " Jul 10 01:06:36.977327 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.977142 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-k8s-db\") pod \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " Jul 10 01:06:36.977327 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.977171 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-k8s-rulefiles-1\") pod \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " Jul 10 01:06:36.977327 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.977199 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " Jul 10 01:06:36.977327 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.977255 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-k8s-rulefiles-2\") pod \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " Jul 10 01:06:36.977327 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.977285 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " Jul 10 01:06:36.977327 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.977311 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-kube-rbac-proxy\") pod \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " Jul 10 01:06:36.977754 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.977358 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-configmap-serving-certs-ca-bundle\") pod \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " Jul 10 01:06:36.977754 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.977351 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" (UID: "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 01:06:36.977754 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.977382 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-metrics-client-certs\") pod \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " Jul 10 01:06:36.977754 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.977386 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" (UID: "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 01:06:36.977754 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.977420 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-prometheus-k8s-tls\") pod \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\" (UID: \"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1\") " Jul 10 01:06:36.977754 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.977630 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-configmap-metrics-client-ca\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:06:36.977754 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.977646 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:06:36.978088 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.977779 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" (UID: "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 01:06:36.979727 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.979505 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" (UID: "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 01:06:36.979727 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.979692 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" (UID: "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 01:06:36.979727 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.979712 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" (UID: "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 01:06:36.980428 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.980398 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" (UID: "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 01:06:36.980934 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.980600 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" (UID: "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 01:06:36.980934 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.980669 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" (UID: "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 01:06:36.980934 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.980723 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-config" (OuterVolumeSpecName: "config") pod "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" (UID: "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 01:06:36.980934 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.980777 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" (UID: "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 01:06:36.981193 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.981126 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" (UID: "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 01:06:36.981673 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.981632 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" (UID: "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 01:06:36.981764 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.981741 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" (UID: "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 01:06:36.982016 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.981994 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" (UID: "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 01:06:36.982016 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.982003 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-config-out" (OuterVolumeSpecName: "config-out") pod "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" (UID: "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 01:06:36.982016 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.982008 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-kube-api-access-jlqnp" (OuterVolumeSpecName: "kube-api-access-jlqnp") pod "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" (UID: "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1"). InnerVolumeSpecName "kube-api-access-jlqnp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 01:06:36.982452 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.982427 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" (UID: "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 01:06:36.982633 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.982613 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" (UID: "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 01:06:36.992317 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:36.992289 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-web-config" (OuterVolumeSpecName: "web-config") pod "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" (UID: "d60e5822-9d6b-46d6-9d95-2d2848c8c6a1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 01:06:37.078012 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.077973 2554 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-grpc-tls\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:06:37.078012 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.078008 2554 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-tls-assets\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:06:37.078012 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.078020 2554 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-config\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:06:37.078307 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.078033 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:06:37.078307 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.078047 2554 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-config-out\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:06:37.078307 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.078059 2554 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-web-config\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:06:37.078307 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.078070 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:06:37.078307 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.078083 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlqnp\" (UniqueName: \"kubernetes.io/projected/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-kube-api-access-jlqnp\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:06:37.078307 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.078096 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-k8s-db\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:06:37.078307 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.078108 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:06:37.078307 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.078122 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:06:37.078307 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.078139 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:06:37.078307 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.078153 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:06:37.078307 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.078167 2554 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-kube-rbac-proxy\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:06:37.078307 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.078182 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:06:37.078307 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.078197 2554 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-metrics-client-certs\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:06:37.078307 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.078211 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:06:37.078307 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.078248 2554 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:06:37.368899 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.368817 2554 generic.go:356] "Generic (PLEG): container finished" podID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerID="f7bf87cb03aea8532200a0fd7f3221347cbc935d9ca68dbd155da65ec14ef839" exitCode=0 Jul 10 01:06:37.368899 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.368854 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1","Type":"ContainerDied","Data":"f7bf87cb03aea8532200a0fd7f3221347cbc935d9ca68dbd155da65ec14ef839"} Jul 10 01:06:37.368899 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.368895 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.369096 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.368910 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60e5822-9d6b-46d6-9d95-2d2848c8c6a1","Type":"ContainerDied","Data":"dd6c3d211480ad62ddf16306397fffb2d3761a5c0f40bf3c2eaf735beb91b3bc"} Jul 10 01:06:37.369096 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.368955 2554 scope.go:117] "RemoveContainer" containerID="9f640af7f4afb06fbb50d79b6c4f61280025b4d793bc7e4884b1cbf452bc8f05" Jul 10 01:06:37.376625 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.376605 2554 scope.go:117] "RemoveContainer" containerID="d6724bf37ee411aa2f0978cdef710fe67de827ca85d7ac199bb32826f154c4db" Jul 10 01:06:37.383409 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.383391 2554 scope.go:117] "RemoveContainer" containerID="f7bf87cb03aea8532200a0fd7f3221347cbc935d9ca68dbd155da65ec14ef839" Jul 10 01:06:37.389490 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.389475 2554 scope.go:117] "RemoveContainer" containerID="5f1f669cf380669da8d62956e251d3e86b7c9febba6812d6f1fb4fbc5e01027b" Jul 10 01:06:37.393576 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.393559 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 01:06:37.396841 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.396820 2554 scope.go:117] "RemoveContainer" containerID="fa96bdfdabaa41ef2ea5567d69bba0aabeaae913d20dcd88a55cdb0a13422019" Jul 10 01:06:37.399617 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.399595 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 01:06:37.404312 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.404295 2554 scope.go:117] "RemoveContainer" containerID="f46d15fc94f92fcef2e58484dcc7a4fbf43e0cae2641ecdefebb989700cfbca9" Jul 10 01:06:37.411098 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.411073 2554 scope.go:117] "RemoveContainer" containerID="9bd54294e0e21f3928073902bcadcd90f861c3fb0a78f391dc70355996f44b15" Jul 10 01:06:37.417484 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.417469 2554 scope.go:117] "RemoveContainer" containerID="9f640af7f4afb06fbb50d79b6c4f61280025b4d793bc7e4884b1cbf452bc8f05" Jul 10 01:06:37.417753 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:06:37.417730 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f640af7f4afb06fbb50d79b6c4f61280025b4d793bc7e4884b1cbf452bc8f05\": container with ID starting with 9f640af7f4afb06fbb50d79b6c4f61280025b4d793bc7e4884b1cbf452bc8f05 not found: ID does not exist" containerID="9f640af7f4afb06fbb50d79b6c4f61280025b4d793bc7e4884b1cbf452bc8f05" Jul 10 01:06:37.417799 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.417767 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f640af7f4afb06fbb50d79b6c4f61280025b4d793bc7e4884b1cbf452bc8f05"} err="failed to get container status \"9f640af7f4afb06fbb50d79b6c4f61280025b4d793bc7e4884b1cbf452bc8f05\": rpc error: code = NotFound desc = could not find container \"9f640af7f4afb06fbb50d79b6c4f61280025b4d793bc7e4884b1cbf452bc8f05\": container with ID starting with 9f640af7f4afb06fbb50d79b6c4f61280025b4d793bc7e4884b1cbf452bc8f05 not found: ID does not exist" Jul 10 01:06:37.417842 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.417801 2554 scope.go:117] "RemoveContainer" containerID="d6724bf37ee411aa2f0978cdef710fe67de827ca85d7ac199bb32826f154c4db" Jul 10 01:06:37.418033 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:06:37.418015 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6724bf37ee411aa2f0978cdef710fe67de827ca85d7ac199bb32826f154c4db\": container with ID starting with d6724bf37ee411aa2f0978cdef710fe67de827ca85d7ac199bb32826f154c4db not found: ID does not exist" containerID="d6724bf37ee411aa2f0978cdef710fe67de827ca85d7ac199bb32826f154c4db" Jul 10 01:06:37.418101 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.418041 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6724bf37ee411aa2f0978cdef710fe67de827ca85d7ac199bb32826f154c4db"} err="failed to get container status \"d6724bf37ee411aa2f0978cdef710fe67de827ca85d7ac199bb32826f154c4db\": rpc error: code = NotFound desc = could not find container \"d6724bf37ee411aa2f0978cdef710fe67de827ca85d7ac199bb32826f154c4db\": container with ID starting with d6724bf37ee411aa2f0978cdef710fe67de827ca85d7ac199bb32826f154c4db not found: ID does not exist" Jul 10 01:06:37.418101 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.418064 2554 scope.go:117] "RemoveContainer" containerID="f7bf87cb03aea8532200a0fd7f3221347cbc935d9ca68dbd155da65ec14ef839" Jul 10 01:06:37.418316 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:06:37.418299 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7bf87cb03aea8532200a0fd7f3221347cbc935d9ca68dbd155da65ec14ef839\": container with ID starting with f7bf87cb03aea8532200a0fd7f3221347cbc935d9ca68dbd155da65ec14ef839 not found: ID does not exist" containerID="f7bf87cb03aea8532200a0fd7f3221347cbc935d9ca68dbd155da65ec14ef839" Jul 10 01:06:37.418381 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.418321 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7bf87cb03aea8532200a0fd7f3221347cbc935d9ca68dbd155da65ec14ef839"} err="failed to get container status \"f7bf87cb03aea8532200a0fd7f3221347cbc935d9ca68dbd155da65ec14ef839\": rpc error: code = NotFound desc = could not find container \"f7bf87cb03aea8532200a0fd7f3221347cbc935d9ca68dbd155da65ec14ef839\": container with ID starting with f7bf87cb03aea8532200a0fd7f3221347cbc935d9ca68dbd155da65ec14ef839 not found: ID does not exist" Jul 10 01:06:37.418381 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.418336 2554 scope.go:117] "RemoveContainer" containerID="5f1f669cf380669da8d62956e251d3e86b7c9febba6812d6f1fb4fbc5e01027b" Jul 10 01:06:37.418585 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:06:37.418569 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f1f669cf380669da8d62956e251d3e86b7c9febba6812d6f1fb4fbc5e01027b\": container with ID starting with 5f1f669cf380669da8d62956e251d3e86b7c9febba6812d6f1fb4fbc5e01027b not found: ID does not exist" containerID="5f1f669cf380669da8d62956e251d3e86b7c9febba6812d6f1fb4fbc5e01027b" Jul 10 01:06:37.418639 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.418589 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f1f669cf380669da8d62956e251d3e86b7c9febba6812d6f1fb4fbc5e01027b"} err="failed to get container status \"5f1f669cf380669da8d62956e251d3e86b7c9febba6812d6f1fb4fbc5e01027b\": rpc error: code = NotFound desc = could not find container \"5f1f669cf380669da8d62956e251d3e86b7c9febba6812d6f1fb4fbc5e01027b\": container with ID starting with 5f1f669cf380669da8d62956e251d3e86b7c9febba6812d6f1fb4fbc5e01027b not found: ID does not exist" Jul 10 01:06:37.418639 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.418606 2554 scope.go:117] "RemoveContainer" containerID="fa96bdfdabaa41ef2ea5567d69bba0aabeaae913d20dcd88a55cdb0a13422019" Jul 10 01:06:37.418805 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:06:37.418788 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa96bdfdabaa41ef2ea5567d69bba0aabeaae913d20dcd88a55cdb0a13422019\": container with ID starting with fa96bdfdabaa41ef2ea5567d69bba0aabeaae913d20dcd88a55cdb0a13422019 not found: ID does not exist" containerID="fa96bdfdabaa41ef2ea5567d69bba0aabeaae913d20dcd88a55cdb0a13422019" Jul 10 01:06:37.418864 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.418811 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa96bdfdabaa41ef2ea5567d69bba0aabeaae913d20dcd88a55cdb0a13422019"} err="failed to get container status \"fa96bdfdabaa41ef2ea5567d69bba0aabeaae913d20dcd88a55cdb0a13422019\": rpc error: code = NotFound desc = could not find container \"fa96bdfdabaa41ef2ea5567d69bba0aabeaae913d20dcd88a55cdb0a13422019\": container with ID starting with fa96bdfdabaa41ef2ea5567d69bba0aabeaae913d20dcd88a55cdb0a13422019 not found: ID does not exist" Jul 10 01:06:37.418864 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.418830 2554 scope.go:117] "RemoveContainer" containerID="f46d15fc94f92fcef2e58484dcc7a4fbf43e0cae2641ecdefebb989700cfbca9" Jul 10 01:06:37.419029 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:06:37.419011 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f46d15fc94f92fcef2e58484dcc7a4fbf43e0cae2641ecdefebb989700cfbca9\": container with ID starting with f46d15fc94f92fcef2e58484dcc7a4fbf43e0cae2641ecdefebb989700cfbca9 not found: ID does not exist" containerID="f46d15fc94f92fcef2e58484dcc7a4fbf43e0cae2641ecdefebb989700cfbca9" Jul 10 01:06:37.419069 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.419035 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f46d15fc94f92fcef2e58484dcc7a4fbf43e0cae2641ecdefebb989700cfbca9"} err="failed to get container status \"f46d15fc94f92fcef2e58484dcc7a4fbf43e0cae2641ecdefebb989700cfbca9\": rpc error: code = NotFound desc = could not find container \"f46d15fc94f92fcef2e58484dcc7a4fbf43e0cae2641ecdefebb989700cfbca9\": container with ID starting with f46d15fc94f92fcef2e58484dcc7a4fbf43e0cae2641ecdefebb989700cfbca9 not found: ID does not exist" Jul 10 01:06:37.419069 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.419052 2554 scope.go:117] "RemoveContainer" containerID="9bd54294e0e21f3928073902bcadcd90f861c3fb0a78f391dc70355996f44b15" Jul 10 01:06:37.419299 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:06:37.419278 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bd54294e0e21f3928073902bcadcd90f861c3fb0a78f391dc70355996f44b15\": container with ID starting with 9bd54294e0e21f3928073902bcadcd90f861c3fb0a78f391dc70355996f44b15 not found: ID does not exist" containerID="9bd54294e0e21f3928073902bcadcd90f861c3fb0a78f391dc70355996f44b15" Jul 10 01:06:37.419346 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.419305 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bd54294e0e21f3928073902bcadcd90f861c3fb0a78f391dc70355996f44b15"} err="failed to get container status \"9bd54294e0e21f3928073902bcadcd90f861c3fb0a78f391dc70355996f44b15\": rpc error: code = NotFound desc = could not find container \"9bd54294e0e21f3928073902bcadcd90f861c3fb0a78f391dc70355996f44b15\": container with ID starting with 9bd54294e0e21f3928073902bcadcd90f861c3fb0a78f391dc70355996f44b15 not found: ID does not exist" Jul 10 01:06:37.421435 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.421414 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 01:06:37.421714 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.421699 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d5e8a39-1653-4164-9940-cd2fb9c7fee2" containerName="registry" Jul 10 01:06:37.421776 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.421717 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d5e8a39-1653-4164-9940-cd2fb9c7fee2" containerName="registry" Jul 10 01:06:37.421776 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.421741 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerName="config-reloader" Jul 10 01:06:37.421776 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.421750 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerName="config-reloader" Jul 10 01:06:37.421776 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.421767 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerName="prometheus" Jul 10 01:06:37.421776 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.421775 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerName="prometheus" Jul 10 01:06:37.422026 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.421787 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerName="thanos-sidecar" Jul 10 01:06:37.422026 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.421796 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerName="thanos-sidecar" Jul 10 01:06:37.422026 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.421805 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerName="kube-rbac-proxy-web" Jul 10 01:06:37.422026 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.421813 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerName="kube-rbac-proxy-web" Jul 10 01:06:37.422026 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.421823 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerName="kube-rbac-proxy" Jul 10 01:06:37.422026 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.421832 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerName="kube-rbac-proxy" Jul 10 01:06:37.422026 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.421841 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerName="init-config-reloader" Jul 10 01:06:37.422026 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.421848 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerName="init-config-reloader" Jul 10 01:06:37.422026 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.421857 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerName="kube-rbac-proxy-thanos" Jul 10 01:06:37.422026 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.421866 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerName="kube-rbac-proxy-thanos" Jul 10 01:06:37.422026 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.421938 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d5e8a39-1653-4164-9940-cd2fb9c7fee2" containerName="registry" Jul 10 01:06:37.422026 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.421951 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerName="config-reloader" Jul 10 01:06:37.422026 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.421960 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerName="kube-rbac-proxy-web" Jul 10 01:06:37.422026 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.421969 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerName="kube-rbac-proxy-thanos" Jul 10 01:06:37.422026 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.421979 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerName="thanos-sidecar" Jul 10 01:06:37.422026 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.421990 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerName="prometheus" Jul 10 01:06:37.422026 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.421999 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" containerName="kube-rbac-proxy" Jul 10 01:06:37.425881 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.425864 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.429205 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.428715 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 10 01:06:37.429205 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.428987 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 10 01:06:37.429338 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.429211 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 10 01:06:37.429742 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.429492 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2gghii6lgd7da\"" Jul 10 01:06:37.429742 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.429502 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 10 01:06:37.429742 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.429521 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 10 01:06:37.429742 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.429606 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 10 01:06:37.429742 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.429638 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 10 01:06:37.430022 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.429859 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 10 01:06:37.430022 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.429876 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 10 01:06:37.430022 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.429987 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 10 01:06:37.430165 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.430024 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 10 01:06:37.430165 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.429650 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 10 01:06:37.430278 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.430171 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 10 01:06:37.430327 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.430278 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-l5djl\"" Jul 10 01:06:37.433022 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.433003 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 10 01:06:37.434485 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.434470 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 10 01:06:37.439827 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.439797 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 01:06:37.481209 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.481182 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/87dbbaad-687e-468d-b9d0-5026ea79fa05-web-config\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.481362 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.481210 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f8kk\" (UniqueName: \"kubernetes.io/projected/87dbbaad-687e-468d-b9d0-5026ea79fa05-kube-api-access-6f8kk\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.481362 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.481248 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/87dbbaad-687e-468d-b9d0-5026ea79fa05-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.481362 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.481270 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/87dbbaad-687e-468d-b9d0-5026ea79fa05-config\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.481362 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.481306 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/87dbbaad-687e-468d-b9d0-5026ea79fa05-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.481478 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.481359 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/87dbbaad-687e-468d-b9d0-5026ea79fa05-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.481478 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.481388 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/87dbbaad-687e-468d-b9d0-5026ea79fa05-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.481478 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.481414 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/87dbbaad-687e-468d-b9d0-5026ea79fa05-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.481478 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.481452 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/87dbbaad-687e-468d-b9d0-5026ea79fa05-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.481478 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.481476 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/87dbbaad-687e-468d-b9d0-5026ea79fa05-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.481616 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.481498 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/87dbbaad-687e-468d-b9d0-5026ea79fa05-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.481616 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.481532 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87dbbaad-687e-468d-b9d0-5026ea79fa05-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.481616 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.481554 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/87dbbaad-687e-468d-b9d0-5026ea79fa05-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.481616 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.481575 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87dbbaad-687e-468d-b9d0-5026ea79fa05-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.481616 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.481603 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87dbbaad-687e-468d-b9d0-5026ea79fa05-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.481753 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.481619 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/87dbbaad-687e-468d-b9d0-5026ea79fa05-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.481753 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.481635 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87dbbaad-687e-468d-b9d0-5026ea79fa05-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.481753 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.481650 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/87dbbaad-687e-468d-b9d0-5026ea79fa05-config-out\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.481753 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.481692 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/87dbbaad-687e-468d-b9d0-5026ea79fa05-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.481753 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.481712 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/87dbbaad-687e-468d-b9d0-5026ea79fa05-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.583023 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.582989 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/87dbbaad-687e-468d-b9d0-5026ea79fa05-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.583023 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.583028 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/87dbbaad-687e-468d-b9d0-5026ea79fa05-config\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.583256 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.583046 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/87dbbaad-687e-468d-b9d0-5026ea79fa05-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.583256 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.583070 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/87dbbaad-687e-468d-b9d0-5026ea79fa05-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.583256 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.583098 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/87dbbaad-687e-468d-b9d0-5026ea79fa05-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.583256 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.583118 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/87dbbaad-687e-468d-b9d0-5026ea79fa05-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.583256 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.583141 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/87dbbaad-687e-468d-b9d0-5026ea79fa05-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.583256 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.583168 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/87dbbaad-687e-468d-b9d0-5026ea79fa05-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.583256 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.583194 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/87dbbaad-687e-468d-b9d0-5026ea79fa05-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.583256 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.583244 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87dbbaad-687e-468d-b9d0-5026ea79fa05-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.583626 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.583268 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/87dbbaad-687e-468d-b9d0-5026ea79fa05-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.583626 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.583293 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87dbbaad-687e-468d-b9d0-5026ea79fa05-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.583626 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.583317 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87dbbaad-687e-468d-b9d0-5026ea79fa05-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.583626 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.583340 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/87dbbaad-687e-468d-b9d0-5026ea79fa05-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.583626 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.583368 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87dbbaad-687e-468d-b9d0-5026ea79fa05-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.583626 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.583393 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/87dbbaad-687e-468d-b9d0-5026ea79fa05-config-out\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.583626 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.583425 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/87dbbaad-687e-468d-b9d0-5026ea79fa05-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.583961 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.583919 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/87dbbaad-687e-468d-b9d0-5026ea79fa05-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.583961 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.583435 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/87dbbaad-687e-468d-b9d0-5026ea79fa05-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.584070 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.583982 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/87dbbaad-687e-468d-b9d0-5026ea79fa05-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.584070 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.584013 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/87dbbaad-687e-468d-b9d0-5026ea79fa05-web-config\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.584070 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.584038 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f8kk\" (UniqueName: \"kubernetes.io/projected/87dbbaad-687e-468d-b9d0-5026ea79fa05-kube-api-access-6f8kk\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.584070 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.584061 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87dbbaad-687e-468d-b9d0-5026ea79fa05-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.585214 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.585182 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87dbbaad-687e-468d-b9d0-5026ea79fa05-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.585891 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.585864 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87dbbaad-687e-468d-b9d0-5026ea79fa05-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.586277 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.586250 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/87dbbaad-687e-468d-b9d0-5026ea79fa05-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.586454 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.586435 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/87dbbaad-687e-468d-b9d0-5026ea79fa05-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.586519 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.586443 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/87dbbaad-687e-468d-b9d0-5026ea79fa05-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.587132 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.586673 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/87dbbaad-687e-468d-b9d0-5026ea79fa05-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.587132 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.586715 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/87dbbaad-687e-468d-b9d0-5026ea79fa05-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.587132 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.587056 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87dbbaad-687e-468d-b9d0-5026ea79fa05-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.587132 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.587069 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/87dbbaad-687e-468d-b9d0-5026ea79fa05-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.587430 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.587242 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/87dbbaad-687e-468d-b9d0-5026ea79fa05-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.587430 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.587330 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/87dbbaad-687e-468d-b9d0-5026ea79fa05-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.588318 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.588300 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/87dbbaad-687e-468d-b9d0-5026ea79fa05-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.588626 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.588589 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/87dbbaad-687e-468d-b9d0-5026ea79fa05-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.588705 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.588688 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/87dbbaad-687e-468d-b9d0-5026ea79fa05-config\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.588736 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.588722 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/87dbbaad-687e-468d-b9d0-5026ea79fa05-config-out\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.589105 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.589090 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/87dbbaad-687e-468d-b9d0-5026ea79fa05-web-config\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.592383 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.592362 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f8kk\" (UniqueName: \"kubernetes.io/projected/87dbbaad-687e-468d-b9d0-5026ea79fa05-kube-api-access-6f8kk\") pod \"prometheus-k8s-0\" (UID: \"87dbbaad-687e-468d-b9d0-5026ea79fa05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.736663 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.736630 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:06:37.869802 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:37.869744 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 01:06:37.873281 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:06:37.873249 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87dbbaad_687e_468d_b9d0_5026ea79fa05.slice/crio-82547b5c1200f387378ee944cd12abee0b7903a7db09878dc0c894d074d0bfad WatchSource:0}: Error finding container 82547b5c1200f387378ee944cd12abee0b7903a7db09878dc0c894d074d0bfad: Status 404 returned error can't find the container with id 82547b5c1200f387378ee944cd12abee0b7903a7db09878dc0c894d074d0bfad Jul 10 01:06:38.029862 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:38.029828 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d60e5822-9d6b-46d6-9d95-2d2848c8c6a1" path="/var/lib/kubelet/pods/d60e5822-9d6b-46d6-9d95-2d2848c8c6a1/volumes" Jul 10 01:06:38.380466 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:38.380381 2554 generic.go:356] "Generic (PLEG): container finished" podID="87dbbaad-687e-468d-b9d0-5026ea79fa05" containerID="bc285f06b2ba4f0bd98db901b37d276224b9ec48866cab219f4241171c23de40" exitCode=0 Jul 10 01:06:38.380604 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:38.380466 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"87dbbaad-687e-468d-b9d0-5026ea79fa05","Type":"ContainerDied","Data":"bc285f06b2ba4f0bd98db901b37d276224b9ec48866cab219f4241171c23de40"} Jul 10 01:06:38.380604 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:38.380542 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"87dbbaad-687e-468d-b9d0-5026ea79fa05","Type":"ContainerStarted","Data":"82547b5c1200f387378ee944cd12abee0b7903a7db09878dc0c894d074d0bfad"} Jul 10 01:06:39.387198 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:39.387165 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"87dbbaad-687e-468d-b9d0-5026ea79fa05","Type":"ContainerStarted","Data":"5d3bfe1f8ded69beba520f86a10893efce49da113b2e2ac1bfa77d6db3683357"} Jul 10 01:06:39.387588 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:39.387249 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"87dbbaad-687e-468d-b9d0-5026ea79fa05","Type":"ContainerStarted","Data":"67b49e1afe9c0d9e3b00ea6d250d7ac2ecd7e7974244fad7e3e47b481e23cbd8"} Jul 10 01:06:39.387588 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:39.387276 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"87dbbaad-687e-468d-b9d0-5026ea79fa05","Type":"ContainerStarted","Data":"2d0ce6c2b41bff5a34e8912cb3289069399317c70ad029e74871874f9d9f1dbe"} Jul 10 01:06:39.387588 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:39.387298 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"87dbbaad-687e-468d-b9d0-5026ea79fa05","Type":"ContainerStarted","Data":"532d3063915c319f3241e6f006979926f1fa899cc5ee4e222fd7942264b0e215"} Jul 10 01:06:39.387588 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:39.387320 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"87dbbaad-687e-468d-b9d0-5026ea79fa05","Type":"ContainerStarted","Data":"8dbf904b3862e0758499516063224bf0f949b5b71e0f833bbbdcf3aa18467855"} Jul 10 01:06:39.387588 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:39.387342 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"87dbbaad-687e-468d-b9d0-5026ea79fa05","Type":"ContainerStarted","Data":"88e756dd54eb57edf71902128a70f3066fd6957011dcdb1ead89758ed0a92d02"} Jul 10 01:06:39.416478 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:39.416425 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.397685537 podStartE2EDuration="2.416410708s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.725171ms" isStatefulPod=false podCreationTimestamp="2026-07-10 01:06:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:06:39.413814458 +0000 UTC m=+388.005295688" watchObservedRunningTime="2026-07-10 01:06:39.416410708 +0000 UTC m=+388.007891905" Jul 10 01:06:42.737505 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:06:42.737465 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:07:37.737734 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:07:37.737676 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:07:37.753190 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:07:37.753163 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:07:38.630049 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:07:38.630021 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 01:07:48.120292 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:07:48.120251 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-446ls"] Jul 10 01:07:48.123723 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:07:48.123704 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-446ls" Jul 10 01:07:48.126606 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:07:48.126579 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 10 01:07:48.126736 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:07:48.126583 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 10 01:07:48.127751 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:07:48.127722 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-x2nss\"" Jul 10 01:07:48.131771 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:07:48.131748 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-446ls"] Jul 10 01:07:48.265839 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:07:48.265802 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/83f5923c-fb56-4988-a941-8081491924f0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-446ls\" (UID: \"83f5923c-fb56-4988-a941-8081491924f0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-446ls" Jul 10 01:07:48.266008 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:07:48.265856 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc9zz\" (UniqueName: \"kubernetes.io/projected/83f5923c-fb56-4988-a941-8081491924f0-kube-api-access-xc9zz\") pod \"cert-manager-webhook-6486ffd997-446ls\" (UID: \"83f5923c-fb56-4988-a941-8081491924f0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-446ls" Jul 10 01:07:48.366825 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:07:48.366794 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc9zz\" (UniqueName: \"kubernetes.io/projected/83f5923c-fb56-4988-a941-8081491924f0-kube-api-access-xc9zz\") pod \"cert-manager-webhook-6486ffd997-446ls\" (UID: \"83f5923c-fb56-4988-a941-8081491924f0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-446ls" Jul 10 01:07:48.366986 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:07:48.366855 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/83f5923c-fb56-4988-a941-8081491924f0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-446ls\" (UID: \"83f5923c-fb56-4988-a941-8081491924f0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-446ls" Jul 10 01:07:48.375858 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:07:48.375776 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/83f5923c-fb56-4988-a941-8081491924f0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-446ls\" (UID: \"83f5923c-fb56-4988-a941-8081491924f0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-446ls" Jul 10 01:07:48.375858 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:07:48.375847 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc9zz\" (UniqueName: \"kubernetes.io/projected/83f5923c-fb56-4988-a941-8081491924f0-kube-api-access-xc9zz\") pod \"cert-manager-webhook-6486ffd997-446ls\" (UID: \"83f5923c-fb56-4988-a941-8081491924f0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-446ls" Jul 10 01:07:48.442695 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:07:48.442656 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-446ls" Jul 10 01:07:48.574569 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:07:48.574534 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-446ls"] Jul 10 01:07:48.577445 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:07:48.577415 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83f5923c_fb56_4988_a941_8081491924f0.slice/crio-de9c34bcb131d1ea7b5fa8b59ff0a6ac66fcf261addb506d73eb9b690eb9f83b WatchSource:0}: Error finding container de9c34bcb131d1ea7b5fa8b59ff0a6ac66fcf261addb506d73eb9b690eb9f83b: Status 404 returned error can't find the container with id de9c34bcb131d1ea7b5fa8b59ff0a6ac66fcf261addb506d73eb9b690eb9f83b Jul 10 01:07:48.655496 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:07:48.655410 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-446ls" event={"ID":"83f5923c-fb56-4988-a941-8081491924f0","Type":"ContainerStarted","Data":"de9c34bcb131d1ea7b5fa8b59ff0a6ac66fcf261addb506d73eb9b690eb9f83b"} Jul 10 01:07:51.669618 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:07:51.669507 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-446ls" event={"ID":"83f5923c-fb56-4988-a941-8081491924f0","Type":"ContainerStarted","Data":"a91724301df5a68b2271b5de906a8dbf909006c32b8459651acc1832ecb134b2"} Jul 10 01:07:51.670024 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:07:51.669639 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-446ls" Jul 10 01:07:51.685955 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:07:51.685903 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-446ls" podStartSLOduration=0.886151194 podStartE2EDuration="3.685886993s" totalImagesPullingTime="2.799735799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:07:51.684324018 +0000 UTC m=+460.275805213" watchObservedRunningTime="2026-07-10 01:07:51.685886993 +0000 UTC m=+460.277368191" Jul 10 01:07:57.676246 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:07:57.676193 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-446ls" Jul 10 01:08:01.247163 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:01.247124 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-h5td7"] Jul 10 01:08:01.250449 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:01.250430 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-h5td7" Jul 10 01:08:01.253041 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:01.253021 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-tl44g\"" Jul 10 01:08:01.259999 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:01.259977 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-h5td7"] Jul 10 01:08:01.379014 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:01.378969 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6988893-a2e6-4418-ac5e-c98b342dbc67-bound-sa-token\") pod \"cert-manager-55b4d954d5-h5td7\" (UID: \"e6988893-a2e6-4418-ac5e-c98b342dbc67\") " pod="cert-manager/cert-manager-55b4d954d5-h5td7" Jul 10 01:08:01.379014 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:01.379018 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4r6c\" (UniqueName: \"kubernetes.io/projected/e6988893-a2e6-4418-ac5e-c98b342dbc67-kube-api-access-w4r6c\") pod \"cert-manager-55b4d954d5-h5td7\" (UID: \"e6988893-a2e6-4418-ac5e-c98b342dbc67\") " pod="cert-manager/cert-manager-55b4d954d5-h5td7" Jul 10 01:08:01.479871 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:01.479835 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6988893-a2e6-4418-ac5e-c98b342dbc67-bound-sa-token\") pod \"cert-manager-55b4d954d5-h5td7\" (UID: \"e6988893-a2e6-4418-ac5e-c98b342dbc67\") " pod="cert-manager/cert-manager-55b4d954d5-h5td7" Jul 10 01:08:01.479970 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:01.479877 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4r6c\" (UniqueName: \"kubernetes.io/projected/e6988893-a2e6-4418-ac5e-c98b342dbc67-kube-api-access-w4r6c\") pod \"cert-manager-55b4d954d5-h5td7\" (UID: \"e6988893-a2e6-4418-ac5e-c98b342dbc67\") " pod="cert-manager/cert-manager-55b4d954d5-h5td7" Jul 10 01:08:01.489511 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:01.489483 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6988893-a2e6-4418-ac5e-c98b342dbc67-bound-sa-token\") pod \"cert-manager-55b4d954d5-h5td7\" (UID: \"e6988893-a2e6-4418-ac5e-c98b342dbc67\") " pod="cert-manager/cert-manager-55b4d954d5-h5td7" Jul 10 01:08:01.489634 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:01.489624 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4r6c\" (UniqueName: \"kubernetes.io/projected/e6988893-a2e6-4418-ac5e-c98b342dbc67-kube-api-access-w4r6c\") pod \"cert-manager-55b4d954d5-h5td7\" (UID: \"e6988893-a2e6-4418-ac5e-c98b342dbc67\") " pod="cert-manager/cert-manager-55b4d954d5-h5td7" Jul 10 01:08:01.559861 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:01.559759 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-h5td7" Jul 10 01:08:01.689273 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:01.689117 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-h5td7"] Jul 10 01:08:01.691916 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:08:01.691890 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6988893_a2e6_4418_ac5e_c98b342dbc67.slice/crio-7a7cb178db98f159decdcde2d96ca0e4086a44bc30a2a70f21d6033166591f1e WatchSource:0}: Error finding container 7a7cb178db98f159decdcde2d96ca0e4086a44bc30a2a70f21d6033166591f1e: Status 404 returned error can't find the container with id 7a7cb178db98f159decdcde2d96ca0e4086a44bc30a2a70f21d6033166591f1e Jul 10 01:08:01.709377 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:01.709345 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-h5td7" event={"ID":"e6988893-a2e6-4418-ac5e-c98b342dbc67","Type":"ContainerStarted","Data":"7a7cb178db98f159decdcde2d96ca0e4086a44bc30a2a70f21d6033166591f1e"} Jul 10 01:08:02.714483 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:02.714444 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-h5td7" event={"ID":"e6988893-a2e6-4418-ac5e-c98b342dbc67","Type":"ContainerStarted","Data":"9903a68cf4e155585b9aedeae08513d0e22605928bf529a82726a5bcc1ba0565"} Jul 10 01:08:02.729291 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:02.729236 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-h5td7" podStartSLOduration=1.729200582 podStartE2EDuration="1.729200582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:08:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:08:02.728704805 +0000 UTC m=+471.320186004" watchObservedRunningTime="2026-07-10 01:08:02.729200582 +0000 UTC m=+471.320681781" Jul 10 01:08:16.883580 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:16.883549 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9c74cbdcf-n97p8"] Jul 10 01:08:16.888544 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:16.888522 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9c74cbdcf-n97p8" Jul 10 01:08:16.892306 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:16.892284 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 10 01:08:16.894367 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:16.894345 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 10 01:08:16.894796 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:16.894771 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 10 01:08:16.895768 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:16.895753 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 10 01:08:16.897465 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:16.897447 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fvs8j\"" Jul 10 01:08:16.907354 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:16.907329 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qxwx\" (UniqueName: \"kubernetes.io/projected/0193e26c-a49c-4167-90d6-b98a44ffcf45-kube-api-access-7qxwx\") pod \"opendatahub-operator-controller-manager-9c74cbdcf-n97p8\" (UID: \"0193e26c-a49c-4167-90d6-b98a44ffcf45\") " pod="opendatahub/opendatahub-operator-controller-manager-9c74cbdcf-n97p8" Jul 10 01:08:16.907465 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:16.907364 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0193e26c-a49c-4167-90d6-b98a44ffcf45-tmp\") pod \"opendatahub-operator-controller-manager-9c74cbdcf-n97p8\" (UID: \"0193e26c-a49c-4167-90d6-b98a44ffcf45\") " pod="opendatahub/opendatahub-operator-controller-manager-9c74cbdcf-n97p8" Jul 10 01:08:16.907465 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:16.907401 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0193e26c-a49c-4167-90d6-b98a44ffcf45-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9c74cbdcf-n97p8\" (UID: \"0193e26c-a49c-4167-90d6-b98a44ffcf45\") " pod="opendatahub/opendatahub-operator-controller-manager-9c74cbdcf-n97p8" Jul 10 01:08:16.907465 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:16.907425 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0193e26c-a49c-4167-90d6-b98a44ffcf45-webhook-cert\") pod \"opendatahub-operator-controller-manager-9c74cbdcf-n97p8\" (UID: \"0193e26c-a49c-4167-90d6-b98a44ffcf45\") " pod="opendatahub/opendatahub-operator-controller-manager-9c74cbdcf-n97p8" Jul 10 01:08:16.907465 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:16.907444 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0193e26c-a49c-4167-90d6-b98a44ffcf45-manifests\") pod \"opendatahub-operator-controller-manager-9c74cbdcf-n97p8\" (UID: \"0193e26c-a49c-4167-90d6-b98a44ffcf45\") " pod="opendatahub/opendatahub-operator-controller-manager-9c74cbdcf-n97p8" Jul 10 01:08:16.919296 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:16.919266 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9c74cbdcf-n97p8"] Jul 10 01:08:17.007886 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:17.007844 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qxwx\" (UniqueName: \"kubernetes.io/projected/0193e26c-a49c-4167-90d6-b98a44ffcf45-kube-api-access-7qxwx\") pod \"opendatahub-operator-controller-manager-9c74cbdcf-n97p8\" (UID: \"0193e26c-a49c-4167-90d6-b98a44ffcf45\") " pod="opendatahub/opendatahub-operator-controller-manager-9c74cbdcf-n97p8" Jul 10 01:08:17.007886 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:17.007886 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0193e26c-a49c-4167-90d6-b98a44ffcf45-tmp\") pod \"opendatahub-operator-controller-manager-9c74cbdcf-n97p8\" (UID: \"0193e26c-a49c-4167-90d6-b98a44ffcf45\") " pod="opendatahub/opendatahub-operator-controller-manager-9c74cbdcf-n97p8" Jul 10 01:08:17.008110 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:17.007927 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0193e26c-a49c-4167-90d6-b98a44ffcf45-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9c74cbdcf-n97p8\" (UID: \"0193e26c-a49c-4167-90d6-b98a44ffcf45\") " pod="opendatahub/opendatahub-operator-controller-manager-9c74cbdcf-n97p8" Jul 10 01:08:17.008110 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:17.007954 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0193e26c-a49c-4167-90d6-b98a44ffcf45-webhook-cert\") pod \"opendatahub-operator-controller-manager-9c74cbdcf-n97p8\" (UID: \"0193e26c-a49c-4167-90d6-b98a44ffcf45\") " pod="opendatahub/opendatahub-operator-controller-manager-9c74cbdcf-n97p8" Jul 10 01:08:17.008110 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:17.007986 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0193e26c-a49c-4167-90d6-b98a44ffcf45-manifests\") pod \"opendatahub-operator-controller-manager-9c74cbdcf-n97p8\" (UID: \"0193e26c-a49c-4167-90d6-b98a44ffcf45\") " pod="opendatahub/opendatahub-operator-controller-manager-9c74cbdcf-n97p8" Jul 10 01:08:17.008490 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:17.008471 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0193e26c-a49c-4167-90d6-b98a44ffcf45-manifests\") pod \"opendatahub-operator-controller-manager-9c74cbdcf-n97p8\" (UID: \"0193e26c-a49c-4167-90d6-b98a44ffcf45\") " pod="opendatahub/opendatahub-operator-controller-manager-9c74cbdcf-n97p8" Jul 10 01:08:17.010386 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:17.010357 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0193e26c-a49c-4167-90d6-b98a44ffcf45-tmp\") pod \"opendatahub-operator-controller-manager-9c74cbdcf-n97p8\" (UID: \"0193e26c-a49c-4167-90d6-b98a44ffcf45\") " pod="opendatahub/opendatahub-operator-controller-manager-9c74cbdcf-n97p8" Jul 10 01:08:17.010505 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:17.010484 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0193e26c-a49c-4167-90d6-b98a44ffcf45-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9c74cbdcf-n97p8\" (UID: \"0193e26c-a49c-4167-90d6-b98a44ffcf45\") " pod="opendatahub/opendatahub-operator-controller-manager-9c74cbdcf-n97p8" Jul 10 01:08:17.010597 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:17.010575 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0193e26c-a49c-4167-90d6-b98a44ffcf45-webhook-cert\") pod \"opendatahub-operator-controller-manager-9c74cbdcf-n97p8\" (UID: \"0193e26c-a49c-4167-90d6-b98a44ffcf45\") " pod="opendatahub/opendatahub-operator-controller-manager-9c74cbdcf-n97p8" Jul 10 01:08:17.020918 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:17.020893 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qxwx\" (UniqueName: \"kubernetes.io/projected/0193e26c-a49c-4167-90d6-b98a44ffcf45-kube-api-access-7qxwx\") pod \"opendatahub-operator-controller-manager-9c74cbdcf-n97p8\" (UID: \"0193e26c-a49c-4167-90d6-b98a44ffcf45\") " pod="opendatahub/opendatahub-operator-controller-manager-9c74cbdcf-n97p8" Jul 10 01:08:17.198565 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:17.198470 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9c74cbdcf-n97p8" Jul 10 01:08:17.341163 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:17.341134 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9c74cbdcf-n97p8"] Jul 10 01:08:17.343929 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:08:17.343898 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0193e26c_a49c_4167_90d6_b98a44ffcf45.slice/crio-4fea185e3e0ace12ab04aed96024694a432563cd9b75eec878cce28426b5ffac WatchSource:0}: Error finding container 4fea185e3e0ace12ab04aed96024694a432563cd9b75eec878cce28426b5ffac: Status 404 returned error can't find the container with id 4fea185e3e0ace12ab04aed96024694a432563cd9b75eec878cce28426b5ffac Jul 10 01:08:17.774764 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:17.774729 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9c74cbdcf-n97p8" event={"ID":"0193e26c-a49c-4167-90d6-b98a44ffcf45","Type":"ContainerStarted","Data":"4fea185e3e0ace12ab04aed96024694a432563cd9b75eec878cce28426b5ffac"} Jul 10 01:08:20.792127 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:20.792088 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9c74cbdcf-n97p8" event={"ID":"0193e26c-a49c-4167-90d6-b98a44ffcf45","Type":"ContainerStarted","Data":"be3d55322adc066a080c2750e9a4ba3c36db54b636fa18a72acde1c36b57552b"} Jul 10 01:08:21.798136 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:21.798096 2554 generic.go:356] "Generic (PLEG): container finished" podID="0193e26c-a49c-4167-90d6-b98a44ffcf45" containerID="be3d55322adc066a080c2750e9a4ba3c36db54b636fa18a72acde1c36b57552b" exitCode=0 Jul 10 01:08:21.798556 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:21.798160 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9c74cbdcf-n97p8" event={"ID":"0193e26c-a49c-4167-90d6-b98a44ffcf45","Type":"ContainerDied","Data":"be3d55322adc066a080c2750e9a4ba3c36db54b636fa18a72acde1c36b57552b"} Jul 10 01:08:22.804872 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:22.804840 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9c74cbdcf-n97p8" event={"ID":"0193e26c-a49c-4167-90d6-b98a44ffcf45","Type":"ContainerStarted","Data":"35c92132b77618efaec394190e2b0b1154f1e3280887b0d66bc5520ca156728f"} Jul 10 01:08:22.805331 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:22.804949 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9c74cbdcf-n97p8" Jul 10 01:08:22.827962 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:22.827910 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9c74cbdcf-n97p8" podStartSLOduration=2.459241603 podStartE2EDuration="6.827892829s" totalImagesPullingTime="3.28440867s" totalInitContainerRuntime="1.084242556s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:08:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:08:22.82555211 +0000 UTC m=+491.417033310" watchObservedRunningTime="2026-07-10 01:08:22.827892829 +0000 UTC m=+491.419374028" Jul 10 01:08:33.812052 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:33.812017 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9c74cbdcf-n97p8" Jul 10 01:08:43.696787 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:43.696749 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7476f9c699-xz7jl"] Jul 10 01:08:43.700365 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:43.700341 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7476f9c699-xz7jl" Jul 10 01:08:43.703146 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:43.703123 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 10 01:08:43.703293 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:43.703278 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 10 01:08:43.704496 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:43.704480 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 10 01:08:43.704634 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:43.704550 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 10 01:08:43.704763 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:43.704744 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 10 01:08:43.704867 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:43.704814 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-dbtmb\"" Jul 10 01:08:43.710124 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:43.710100 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7476f9c699-xz7jl"] Jul 10 01:08:43.818721 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:43.818685 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjlpm\" (UniqueName: \"kubernetes.io/projected/047f61be-da93-4836-bc15-6541cbe48b4a-kube-api-access-tjlpm\") pod \"lws-controller-manager-7476f9c699-xz7jl\" (UID: \"047f61be-da93-4836-bc15-6541cbe48b4a\") " pod="openshift-lws-operator/lws-controller-manager-7476f9c699-xz7jl" Jul 10 01:08:43.818721 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:43.818722 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/047f61be-da93-4836-bc15-6541cbe48b4a-cert\") pod \"lws-controller-manager-7476f9c699-xz7jl\" (UID: \"047f61be-da93-4836-bc15-6541cbe48b4a\") " pod="openshift-lws-operator/lws-controller-manager-7476f9c699-xz7jl" Jul 10 01:08:43.818964 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:43.818742 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/047f61be-da93-4836-bc15-6541cbe48b4a-metrics-cert\") pod \"lws-controller-manager-7476f9c699-xz7jl\" (UID: \"047f61be-da93-4836-bc15-6541cbe48b4a\") " pod="openshift-lws-operator/lws-controller-manager-7476f9c699-xz7jl" Jul 10 01:08:43.818964 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:43.818867 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/047f61be-da93-4836-bc15-6541cbe48b4a-manager-config\") pod \"lws-controller-manager-7476f9c699-xz7jl\" (UID: \"047f61be-da93-4836-bc15-6541cbe48b4a\") " pod="openshift-lws-operator/lws-controller-manager-7476f9c699-xz7jl" Jul 10 01:08:43.920032 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:43.919999 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjlpm\" (UniqueName: \"kubernetes.io/projected/047f61be-da93-4836-bc15-6541cbe48b4a-kube-api-access-tjlpm\") pod \"lws-controller-manager-7476f9c699-xz7jl\" (UID: \"047f61be-da93-4836-bc15-6541cbe48b4a\") " pod="openshift-lws-operator/lws-controller-manager-7476f9c699-xz7jl" Jul 10 01:08:43.920032 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:43.920037 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/047f61be-da93-4836-bc15-6541cbe48b4a-cert\") pod \"lws-controller-manager-7476f9c699-xz7jl\" (UID: \"047f61be-da93-4836-bc15-6541cbe48b4a\") " pod="openshift-lws-operator/lws-controller-manager-7476f9c699-xz7jl" Jul 10 01:08:43.920300 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:43.920057 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/047f61be-da93-4836-bc15-6541cbe48b4a-metrics-cert\") pod \"lws-controller-manager-7476f9c699-xz7jl\" (UID: \"047f61be-da93-4836-bc15-6541cbe48b4a\") " pod="openshift-lws-operator/lws-controller-manager-7476f9c699-xz7jl" Jul 10 01:08:43.920300 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:43.920117 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/047f61be-da93-4836-bc15-6541cbe48b4a-manager-config\") pod \"lws-controller-manager-7476f9c699-xz7jl\" (UID: \"047f61be-da93-4836-bc15-6541cbe48b4a\") " pod="openshift-lws-operator/lws-controller-manager-7476f9c699-xz7jl" Jul 10 01:08:43.920935 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:43.920901 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/047f61be-da93-4836-bc15-6541cbe48b4a-manager-config\") pod \"lws-controller-manager-7476f9c699-xz7jl\" (UID: \"047f61be-da93-4836-bc15-6541cbe48b4a\") " pod="openshift-lws-operator/lws-controller-manager-7476f9c699-xz7jl" Jul 10 01:08:43.922704 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:43.922678 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/047f61be-da93-4836-bc15-6541cbe48b4a-cert\") pod \"lws-controller-manager-7476f9c699-xz7jl\" (UID: \"047f61be-da93-4836-bc15-6541cbe48b4a\") " pod="openshift-lws-operator/lws-controller-manager-7476f9c699-xz7jl" Jul 10 01:08:43.922940 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:43.922922 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/047f61be-da93-4836-bc15-6541cbe48b4a-metrics-cert\") pod \"lws-controller-manager-7476f9c699-xz7jl\" (UID: \"047f61be-da93-4836-bc15-6541cbe48b4a\") " pod="openshift-lws-operator/lws-controller-manager-7476f9c699-xz7jl" Jul 10 01:08:43.935641 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:43.935612 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q"] Jul 10 01:08:43.938957 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:43.938931 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:43.941214 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:43.941181 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjlpm\" (UniqueName: \"kubernetes.io/projected/047f61be-da93-4836-bc15-6541cbe48b4a-kube-api-access-tjlpm\") pod \"lws-controller-manager-7476f9c699-xz7jl\" (UID: \"047f61be-da93-4836-bc15-6541cbe48b4a\") " pod="openshift-lws-operator/lws-controller-manager-7476f9c699-xz7jl" Jul 10 01:08:43.942128 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:43.942108 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 10 01:08:43.942314 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:43.942297 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-9g6zd\"" Jul 10 01:08:43.942742 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:43.942724 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 10 01:08:43.943033 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:43.943017 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 10 01:08:43.961751 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:43.961720 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q"] Jul 10 01:08:44.010844 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.010813 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7476f9c699-xz7jl" Jul 10 01:08:44.021065 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.021029 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69vpf\" (UniqueName: \"kubernetes.io/projected/ee071eda-5bec-47db-8df7-cbd62724f7ab-kube-api-access-69vpf\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:44.021185 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.021080 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:44.021185 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.021113 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:44.021185 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.021158 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee071eda-5bec-47db-8df7-cbd62724f7ab-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:44.021346 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.021195 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee071eda-5bec-47db-8df7-cbd62724f7ab-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:44.021346 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.021238 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:44.021426 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.021367 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:44.021426 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.021404 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee071eda-5bec-47db-8df7-cbd62724f7ab-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:44.021531 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.021462 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:44.085970 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.085937 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6"] Jul 10 01:08:44.089506 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.089483 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.100386 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.100358 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6"] Jul 10 01:08:44.122383 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.122346 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:44.122618 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.122404 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/376c59ea-dd4d-444c-ac3b-fbe1788bdebd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42xsg6\" (UID: \"376c59ea-dd4d-444c-ac3b-fbe1788bdebd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.122618 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.122446 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/376c59ea-dd4d-444c-ac3b-fbe1788bdebd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42xsg6\" (UID: \"376c59ea-dd4d-444c-ac3b-fbe1788bdebd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.122618 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.122479 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee071eda-5bec-47db-8df7-cbd62724f7ab-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:44.122618 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.122559 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/376c59ea-dd4d-444c-ac3b-fbe1788bdebd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42xsg6\" (UID: \"376c59ea-dd4d-444c-ac3b-fbe1788bdebd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.122618 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.122598 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/376c59ea-dd4d-444c-ac3b-fbe1788bdebd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42xsg6\" (UID: \"376c59ea-dd4d-444c-ac3b-fbe1788bdebd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.123528 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.122637 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee071eda-5bec-47db-8df7-cbd62724f7ab-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:44.123528 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.122669 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:44.123528 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.122736 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/376c59ea-dd4d-444c-ac3b-fbe1788bdebd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42xsg6\" (UID: \"376c59ea-dd4d-444c-ac3b-fbe1788bdebd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.123528 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.122767 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:44.123528 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.122789 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:44.123528 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.122793 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee071eda-5bec-47db-8df7-cbd62724f7ab-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:44.123528 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.123101 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/376c59ea-dd4d-444c-ac3b-fbe1788bdebd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42xsg6\" (UID: \"376c59ea-dd4d-444c-ac3b-fbe1788bdebd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.123528 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.123134 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:44.123528 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.123151 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:44.123528 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.123185 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee071eda-5bec-47db-8df7-cbd62724f7ab-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:44.123528 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.123260 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/376c59ea-dd4d-444c-ac3b-fbe1788bdebd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42xsg6\" (UID: \"376c59ea-dd4d-444c-ac3b-fbe1788bdebd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.123528 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.123325 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69vpf\" (UniqueName: \"kubernetes.io/projected/ee071eda-5bec-47db-8df7-cbd62724f7ab-kube-api-access-69vpf\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:44.123528 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.123362 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9hsg\" (UniqueName: \"kubernetes.io/projected/376c59ea-dd4d-444c-ac3b-fbe1788bdebd-kube-api-access-d9hsg\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42xsg6\" (UID: \"376c59ea-dd4d-444c-ac3b-fbe1788bdebd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.123528 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.123398 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:44.124246 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.123410 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:44.124246 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.123426 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/376c59ea-dd4d-444c-ac3b-fbe1788bdebd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42xsg6\" (UID: \"376c59ea-dd4d-444c-ac3b-fbe1788bdebd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.124246 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.123891 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:44.126115 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.126072 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:44.126409 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.126388 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee071eda-5bec-47db-8df7-cbd62724f7ab-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:44.133649 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.133620 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee071eda-5bec-47db-8df7-cbd62724f7ab-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:44.133932 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.133910 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69vpf\" (UniqueName: \"kubernetes.io/projected/ee071eda-5bec-47db-8df7-cbd62724f7ab-kube-api-access-69vpf\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:44.163525 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.163495 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7476f9c699-xz7jl"] Jul 10 01:08:44.165386 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:08:44.165356 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod047f61be_da93_4836_bc15_6541cbe48b4a.slice/crio-dbb90504c3b92531c7f0576e003e5fe6060740c977c7e3789b805d97e5e3797d WatchSource:0}: Error finding container dbb90504c3b92531c7f0576e003e5fe6060740c977c7e3789b805d97e5e3797d: Status 404 returned error can't find the container with id dbb90504c3b92531c7f0576e003e5fe6060740c977c7e3789b805d97e5e3797d Jul 10 01:08:44.224164 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.224129 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/376c59ea-dd4d-444c-ac3b-fbe1788bdebd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42xsg6\" (UID: \"376c59ea-dd4d-444c-ac3b-fbe1788bdebd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.224402 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.224181 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/376c59ea-dd4d-444c-ac3b-fbe1788bdebd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42xsg6\" (UID: \"376c59ea-dd4d-444c-ac3b-fbe1788bdebd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.224402 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.224249 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/376c59ea-dd4d-444c-ac3b-fbe1788bdebd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42xsg6\" (UID: \"376c59ea-dd4d-444c-ac3b-fbe1788bdebd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.224402 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.224272 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/376c59ea-dd4d-444c-ac3b-fbe1788bdebd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42xsg6\" (UID: \"376c59ea-dd4d-444c-ac3b-fbe1788bdebd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.224402 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.224332 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/376c59ea-dd4d-444c-ac3b-fbe1788bdebd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42xsg6\" (UID: \"376c59ea-dd4d-444c-ac3b-fbe1788bdebd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.224402 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.224358 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/376c59ea-dd4d-444c-ac3b-fbe1788bdebd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42xsg6\" (UID: \"376c59ea-dd4d-444c-ac3b-fbe1788bdebd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.224695 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.224603 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/376c59ea-dd4d-444c-ac3b-fbe1788bdebd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42xsg6\" (UID: \"376c59ea-dd4d-444c-ac3b-fbe1788bdebd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.224695 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.224629 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/376c59ea-dd4d-444c-ac3b-fbe1788bdebd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42xsg6\" (UID: \"376c59ea-dd4d-444c-ac3b-fbe1788bdebd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.224695 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.224655 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/376c59ea-dd4d-444c-ac3b-fbe1788bdebd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42xsg6\" (UID: \"376c59ea-dd4d-444c-ac3b-fbe1788bdebd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.224695 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.224686 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9hsg\" (UniqueName: \"kubernetes.io/projected/376c59ea-dd4d-444c-ac3b-fbe1788bdebd-kube-api-access-d9hsg\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42xsg6\" (UID: \"376c59ea-dd4d-444c-ac3b-fbe1788bdebd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.224852 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.224711 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/376c59ea-dd4d-444c-ac3b-fbe1788bdebd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42xsg6\" (UID: \"376c59ea-dd4d-444c-ac3b-fbe1788bdebd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.224852 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.224779 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/376c59ea-dd4d-444c-ac3b-fbe1788bdebd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42xsg6\" (UID: \"376c59ea-dd4d-444c-ac3b-fbe1788bdebd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.225042 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.225018 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/376c59ea-dd4d-444c-ac3b-fbe1788bdebd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42xsg6\" (UID: \"376c59ea-dd4d-444c-ac3b-fbe1788bdebd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.225042 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.225035 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/376c59ea-dd4d-444c-ac3b-fbe1788bdebd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42xsg6\" (UID: \"376c59ea-dd4d-444c-ac3b-fbe1788bdebd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.226815 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.226797 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/376c59ea-dd4d-444c-ac3b-fbe1788bdebd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42xsg6\" (UID: \"376c59ea-dd4d-444c-ac3b-fbe1788bdebd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.226937 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.226919 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/376c59ea-dd4d-444c-ac3b-fbe1788bdebd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42xsg6\" (UID: \"376c59ea-dd4d-444c-ac3b-fbe1788bdebd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.233162 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.233134 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/376c59ea-dd4d-444c-ac3b-fbe1788bdebd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42xsg6\" (UID: \"376c59ea-dd4d-444c-ac3b-fbe1788bdebd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.233540 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.233520 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9hsg\" (UniqueName: \"kubernetes.io/projected/376c59ea-dd4d-444c-ac3b-fbe1788bdebd-kube-api-access-d9hsg\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42xsg6\" (UID: \"376c59ea-dd4d-444c-ac3b-fbe1788bdebd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.256507 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.256479 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:44.403576 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.403542 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:44.476740 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.476644 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q"] Jul 10 01:08:44.500934 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:08:44.500897 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee071eda_5bec_47db_8df7_cbd62724f7ab.slice/crio-b96f8fd324a2fedcb62da811082d7947a9ae772dcb2e3ba2704e7ded47254500 WatchSource:0}: Error finding container b96f8fd324a2fedcb62da811082d7947a9ae772dcb2e3ba2704e7ded47254500: Status 404 returned error can't find the container with id b96f8fd324a2fedcb62da811082d7947a9ae772dcb2e3ba2704e7ded47254500 Jul 10 01:08:44.577497 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:08:44.577450 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod376c59ea_dd4d_444c_ac3b_fbe1788bdebd.slice/crio-a0b8b9840ad5ffcd81065ba82045a5fc17d94b289ccdea99aff84d3779d06d62 WatchSource:0}: Error finding container a0b8b9840ad5ffcd81065ba82045a5fc17d94b289ccdea99aff84d3779d06d62: Status 404 returned error can't find the container with id a0b8b9840ad5ffcd81065ba82045a5fc17d94b289ccdea99aff84d3779d06d62 Jul 10 01:08:44.586566 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.586542 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6"] Jul 10 01:08:44.918533 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.918388 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7476f9c699-xz7jl" event={"ID":"047f61be-da93-4836-bc15-6541cbe48b4a","Type":"ContainerStarted","Data":"dbb90504c3b92531c7f0576e003e5fe6060740c977c7e3789b805d97e5e3797d"} Jul 10 01:08:44.920954 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.920905 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" event={"ID":"ee071eda-5bec-47db-8df7-cbd62724f7ab","Type":"ContainerStarted","Data":"b96f8fd324a2fedcb62da811082d7947a9ae772dcb2e3ba2704e7ded47254500"} Jul 10 01:08:44.924000 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:44.923937 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" event={"ID":"376c59ea-dd4d-444c-ac3b-fbe1788bdebd","Type":"ContainerStarted","Data":"a0b8b9840ad5ffcd81065ba82045a5fc17d94b289ccdea99aff84d3779d06d62"} Jul 10 01:08:47.587178 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:47.587147 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-hvmbr"] Jul 10 01:08:47.594308 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:47.594238 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hvmbr" Jul 10 01:08:47.599440 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:47.599411 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 10 01:08:47.601235 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:47.601197 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-72zfv\"" Jul 10 01:08:47.609579 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:47.609429 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-hvmbr"] Jul 10 01:08:47.659670 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:47.659632 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9faf217e-b7d5-417a-9b0c-c07cf4e3b2ce-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hvmbr\" (UID: \"9faf217e-b7d5-417a-9b0c-c07cf4e3b2ce\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hvmbr" Jul 10 01:08:47.659871 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:47.659697 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khxs4\" (UniqueName: \"kubernetes.io/projected/9faf217e-b7d5-417a-9b0c-c07cf4e3b2ce-kube-api-access-khxs4\") pod \"llmisvc-controller-manager-777c6bd7d5-hvmbr\" (UID: \"9faf217e-b7d5-417a-9b0c-c07cf4e3b2ce\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hvmbr" Jul 10 01:08:47.761436 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:47.761385 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9faf217e-b7d5-417a-9b0c-c07cf4e3b2ce-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hvmbr\" (UID: \"9faf217e-b7d5-417a-9b0c-c07cf4e3b2ce\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hvmbr" Jul 10 01:08:47.761629 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:47.761455 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khxs4\" (UniqueName: \"kubernetes.io/projected/9faf217e-b7d5-417a-9b0c-c07cf4e3b2ce-kube-api-access-khxs4\") pod \"llmisvc-controller-manager-777c6bd7d5-hvmbr\" (UID: \"9faf217e-b7d5-417a-9b0c-c07cf4e3b2ce\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hvmbr" Jul 10 01:08:47.765420 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:47.765385 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9faf217e-b7d5-417a-9b0c-c07cf4e3b2ce-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hvmbr\" (UID: \"9faf217e-b7d5-417a-9b0c-c07cf4e3b2ce\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hvmbr" Jul 10 01:08:47.774753 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:47.774694 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khxs4\" (UniqueName: \"kubernetes.io/projected/9faf217e-b7d5-417a-9b0c-c07cf4e3b2ce-kube-api-access-khxs4\") pod \"llmisvc-controller-manager-777c6bd7d5-hvmbr\" (UID: \"9faf217e-b7d5-417a-9b0c-c07cf4e3b2ce\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hvmbr" Jul 10 01:08:47.914619 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:47.914534 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hvmbr" Jul 10 01:08:48.254022 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:48.253980 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 01:08:48.254143 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:48.254077 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 01:08:48.254143 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:48.254120 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 01:08:48.263058 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:48.263027 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 01:08:48.263313 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:48.263097 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 01:08:48.263313 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:48.263130 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 01:08:48.394790 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:48.394578 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-hvmbr"] Jul 10 01:08:48.397443 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:08:48.397411 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9faf217e_b7d5_417a_9b0c_c07cf4e3b2ce.slice/crio-57dfa67223e54db96e308214dc414506ef95637aa095fc4e9dc904e7e8ec0ed3 WatchSource:0}: Error finding container 57dfa67223e54db96e308214dc414506ef95637aa095fc4e9dc904e7e8ec0ed3: Status 404 returned error can't find the container with id 57dfa67223e54db96e308214dc414506ef95637aa095fc4e9dc904e7e8ec0ed3 Jul 10 01:08:48.946499 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:48.946460 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7476f9c699-xz7jl" event={"ID":"047f61be-da93-4836-bc15-6541cbe48b4a","Type":"ContainerStarted","Data":"10ef4b18a986958844c52914b1644c598fbc62a13884cfd7f78798994bad09b2"} Jul 10 01:08:48.947035 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:48.946579 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7476f9c699-xz7jl" Jul 10 01:08:48.947718 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:48.947693 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hvmbr" event={"ID":"9faf217e-b7d5-417a-9b0c-c07cf4e3b2ce","Type":"ContainerStarted","Data":"57dfa67223e54db96e308214dc414506ef95637aa095fc4e9dc904e7e8ec0ed3"} Jul 10 01:08:48.949071 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:48.949042 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" event={"ID":"ee071eda-5bec-47db-8df7-cbd62724f7ab","Type":"ContainerStarted","Data":"350a0a1a6141bbf62a6f36028196c292e5ff46f28e486072be93226da5d5fc72"} Jul 10 01:08:48.950536 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:48.950516 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" event={"ID":"376c59ea-dd4d-444c-ac3b-fbe1788bdebd","Type":"ContainerStarted","Data":"130b1a5af076a5f92ba2d6d03973cc8d7db1f0fbbcc2bc95d2b0dbdc100d15da"} Jul 10 01:08:48.965514 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:48.965454 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7476f9c699-xz7jl" podStartSLOduration=1.879041121 podStartE2EDuration="5.965434152s" totalImagesPullingTime="4.086393031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:08:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:08:48.965319642 +0000 UTC m=+517.556800840" watchObservedRunningTime="2026-07-10 01:08:48.965434152 +0000 UTC m=+517.556915351" Jul 10 01:08:48.985549 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:48.985490 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" podStartSLOduration=1.302176376 podStartE2EDuration="4.98547665s" totalImagesPullingTime="3.683300274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:08:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:08:48.98535305 +0000 UTC m=+517.576834250" watchObservedRunningTime="2026-07-10 01:08:48.98547665 +0000 UTC m=+517.576957848" Jul 10 01:08:49.006865 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:49.006810 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" podStartSLOduration=2.256508457 podStartE2EDuration="6.006792844s" totalImagesPullingTime="3.750284387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:08:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:08:49.005650138 +0000 UTC m=+517.597131339" watchObservedRunningTime="2026-07-10 01:08:49.006792844 +0000 UTC m=+517.598274042" Jul 10 01:08:49.256913 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:49.256877 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:49.258416 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:49.258392 2554 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 10 01:08:49.258481 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:49.258458 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" podUID="ee071eda-5bec-47db-8df7-cbd62724f7ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 10 01:08:49.404310 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:49.404269 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:49.409654 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:49.409625 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:49.955791 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:49.955759 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:49.956674 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:49.956652 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42xsg6" Jul 10 01:08:50.008343 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:50.008311 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q"] Jul 10 01:08:50.257515 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:50.257474 2554 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 10 01:08:50.257702 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:50.257565 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" podUID="ee071eda-5bec-47db-8df7-cbd62724f7ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 10 01:08:51.257242 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:51.257194 2554 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 10 01:08:51.257658 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:51.257284 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" podUID="ee071eda-5bec-47db-8df7-cbd62724f7ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 10 01:08:51.964789 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:51.964751 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" podUID="ee071eda-5bec-47db-8df7-cbd62724f7ab" containerName="istio-proxy" containerID="cri-o://350a0a1a6141bbf62a6f36028196c292e5ff46f28e486072be93226da5d5fc72" gracePeriod=30 Jul 10 01:08:52.970871 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:52.970828 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hvmbr" event={"ID":"9faf217e-b7d5-417a-9b0c-c07cf4e3b2ce","Type":"ContainerStarted","Data":"147426562c3bfd1bef2a3cbcfeeb2bcc6a0549ffa126d818310305be1edec2d7"} Jul 10 01:08:52.971312 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:52.970967 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hvmbr" Jul 10 01:08:52.988729 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:52.988677 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hvmbr" podStartSLOduration=2.193365527 podStartE2EDuration="5.988663016s" totalImagesPullingTime="3.795297489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:08:52.987494165 +0000 UTC m=+521.578975364" watchObservedRunningTime="2026-07-10 01:08:52.988663016 +0000 UTC m=+521.580144215" Jul 10 01:08:57.211091 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.211066 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:57.348907 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.348825 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-credential-socket\") pod \"ee071eda-5bec-47db-8df7-cbd62724f7ab\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " Jul 10 01:08:57.348907 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.348871 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee071eda-5bec-47db-8df7-cbd62724f7ab-istio-podinfo\") pod \"ee071eda-5bec-47db-8df7-cbd62724f7ab\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " Jul 10 01:08:57.348907 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.348895 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee071eda-5bec-47db-8df7-cbd62724f7ab-istio-token\") pod \"ee071eda-5bec-47db-8df7-cbd62724f7ab\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " Jul 10 01:08:57.349174 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.348922 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-istio-data\") pod \"ee071eda-5bec-47db-8df7-cbd62724f7ab\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " Jul 10 01:08:57.349174 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.348940 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-workload-socket\") pod \"ee071eda-5bec-47db-8df7-cbd62724f7ab\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " Jul 10 01:08:57.349174 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.348959 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69vpf\" (UniqueName: \"kubernetes.io/projected/ee071eda-5bec-47db-8df7-cbd62724f7ab-kube-api-access-69vpf\") pod \"ee071eda-5bec-47db-8df7-cbd62724f7ab\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " Jul 10 01:08:57.349174 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.348991 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee071eda-5bec-47db-8df7-cbd62724f7ab-istiod-ca-cert\") pod \"ee071eda-5bec-47db-8df7-cbd62724f7ab\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " Jul 10 01:08:57.349174 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.349007 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-istio-envoy\") pod \"ee071eda-5bec-47db-8df7-cbd62724f7ab\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " Jul 10 01:08:57.349174 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.349094 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-workload-certs\") pod \"ee071eda-5bec-47db-8df7-cbd62724f7ab\" (UID: \"ee071eda-5bec-47db-8df7-cbd62724f7ab\") " Jul 10 01:08:57.349174 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.349132 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ee071eda-5bec-47db-8df7-cbd62724f7ab" (UID: "ee071eda-5bec-47db-8df7-cbd62724f7ab"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 01:08:57.349539 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.349333 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ee071eda-5bec-47db-8df7-cbd62724f7ab" (UID: "ee071eda-5bec-47db-8df7-cbd62724f7ab"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 01:08:57.349539 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.349344 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-credential-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:08:57.349636 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.349554 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ee071eda-5bec-47db-8df7-cbd62724f7ab" (UID: "ee071eda-5bec-47db-8df7-cbd62724f7ab"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 01:08:57.349636 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.349571 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee071eda-5bec-47db-8df7-cbd62724f7ab-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ee071eda-5bec-47db-8df7-cbd62724f7ab" (UID: "ee071eda-5bec-47db-8df7-cbd62724f7ab"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 01:08:57.349743 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.349661 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-istio-data" (OuterVolumeSpecName: "istio-data") pod "ee071eda-5bec-47db-8df7-cbd62724f7ab" (UID: "ee071eda-5bec-47db-8df7-cbd62724f7ab"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 01:08:57.351404 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.351365 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ee071eda-5bec-47db-8df7-cbd62724f7ab-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ee071eda-5bec-47db-8df7-cbd62724f7ab" (UID: "ee071eda-5bec-47db-8df7-cbd62724f7ab"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 01:08:57.351513 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.351425 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ee071eda-5bec-47db-8df7-cbd62724f7ab" (UID: "ee071eda-5bec-47db-8df7-cbd62724f7ab"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 01:08:57.351627 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.351606 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee071eda-5bec-47db-8df7-cbd62724f7ab-kube-api-access-69vpf" (OuterVolumeSpecName: "kube-api-access-69vpf") pod "ee071eda-5bec-47db-8df7-cbd62724f7ab" (UID: "ee071eda-5bec-47db-8df7-cbd62724f7ab"). InnerVolumeSpecName "kube-api-access-69vpf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 01:08:57.351680 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.351628 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee071eda-5bec-47db-8df7-cbd62724f7ab-istio-token" (OuterVolumeSpecName: "istio-token") pod "ee071eda-5bec-47db-8df7-cbd62724f7ab" (UID: "ee071eda-5bec-47db-8df7-cbd62724f7ab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 01:08:57.450469 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.450428 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-workload-certs\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:08:57.450469 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.450459 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee071eda-5bec-47db-8df7-cbd62724f7ab-istio-podinfo\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:08:57.450469 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.450469 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee071eda-5bec-47db-8df7-cbd62724f7ab-istio-token\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:08:57.450469 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.450478 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-istio-data\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:08:57.450751 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.450485 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-workload-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:08:57.450751 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.450495 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69vpf\" (UniqueName: \"kubernetes.io/projected/ee071eda-5bec-47db-8df7-cbd62724f7ab-kube-api-access-69vpf\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:08:57.450751 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.450504 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee071eda-5bec-47db-8df7-cbd62724f7ab-istiod-ca-cert\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:08:57.450751 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.450512 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee071eda-5bec-47db-8df7-cbd62724f7ab-istio-envoy\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:08:57.997668 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.997636 2554 generic.go:356] "Generic (PLEG): container finished" podID="ee071eda-5bec-47db-8df7-cbd62724f7ab" containerID="350a0a1a6141bbf62a6f36028196c292e5ff46f28e486072be93226da5d5fc72" exitCode=0 Jul 10 01:08:57.997822 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.997683 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" event={"ID":"ee071eda-5bec-47db-8df7-cbd62724f7ab","Type":"ContainerDied","Data":"350a0a1a6141bbf62a6f36028196c292e5ff46f28e486072be93226da5d5fc72"} Jul 10 01:08:57.997822 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.997721 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" event={"ID":"ee071eda-5bec-47db-8df7-cbd62724f7ab","Type":"ContainerDied","Data":"b96f8fd324a2fedcb62da811082d7947a9ae772dcb2e3ba2704e7ded47254500"} Jul 10 01:08:57.997822 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.997742 2554 scope.go:117] "RemoveContainer" containerID="350a0a1a6141bbf62a6f36028196c292e5ff46f28e486072be93226da5d5fc72" Jul 10 01:08:57.997822 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:57.997684 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q" Jul 10 01:08:58.013773 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:58.013750 2554 scope.go:117] "RemoveContainer" containerID="350a0a1a6141bbf62a6f36028196c292e5ff46f28e486072be93226da5d5fc72" Jul 10 01:08:58.014057 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:08:58.014026 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"350a0a1a6141bbf62a6f36028196c292e5ff46f28e486072be93226da5d5fc72\": container with ID starting with 350a0a1a6141bbf62a6f36028196c292e5ff46f28e486072be93226da5d5fc72 not found: ID does not exist" containerID="350a0a1a6141bbf62a6f36028196c292e5ff46f28e486072be93226da5d5fc72" Jul 10 01:08:58.014148 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:58.014067 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"350a0a1a6141bbf62a6f36028196c292e5ff46f28e486072be93226da5d5fc72"} err="failed to get container status \"350a0a1a6141bbf62a6f36028196c292e5ff46f28e486072be93226da5d5fc72\": rpc error: code = NotFound desc = could not find container \"350a0a1a6141bbf62a6f36028196c292e5ff46f28e486072be93226da5d5fc72\": container with ID starting with 350a0a1a6141bbf62a6f36028196c292e5ff46f28e486072be93226da5d5fc72 not found: ID does not exist" Jul 10 01:08:58.024215 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:58.024189 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q"] Jul 10 01:08:58.030094 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:58.030073 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-dbn6q"] Jul 10 01:08:59.957171 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:08:59.957140 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7476f9c699-xz7jl" Jul 10 01:09:00.030259 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:09:00.030210 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee071eda-5bec-47db-8df7-cbd62724f7ab" path="/var/lib/kubelet/pods/ee071eda-5bec-47db-8df7-cbd62724f7ab/volumes" Jul 10 01:09:23.978204 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:09:23.978162 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hvmbr" Jul 10 01:10:05.766675 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:05.766639 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-r88kj"] Jul 10 01:10:05.767159 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:05.766985 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee071eda-5bec-47db-8df7-cbd62724f7ab" containerName="istio-proxy" Jul 10 01:10:05.767159 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:05.766997 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee071eda-5bec-47db-8df7-cbd62724f7ab" containerName="istio-proxy" Jul 10 01:10:05.767159 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:05.767060 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee071eda-5bec-47db-8df7-cbd62724f7ab" containerName="istio-proxy" Jul 10 01:10:05.769815 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:05.769799 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r88kj" Jul 10 01:10:05.773261 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:05.773240 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 10 01:10:05.773261 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:05.773249 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 10 01:10:05.773421 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:05.773252 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 10 01:10:05.774666 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:05.774647 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-69gst\"" Jul 10 01:10:05.781370 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:05.781351 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-r88kj"] Jul 10 01:10:05.843154 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:05.843125 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6d2p\" (UniqueName: \"kubernetes.io/projected/1f21f226-7331-4f96-a12f-71d01443df63-kube-api-access-q6d2p\") pod \"dns-operator-controller-manager-864dd78c4c-r88kj\" (UID: \"1f21f226-7331-4f96-a12f-71d01443df63\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r88kj" Jul 10 01:10:05.943811 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:05.943767 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6d2p\" (UniqueName: \"kubernetes.io/projected/1f21f226-7331-4f96-a12f-71d01443df63-kube-api-access-q6d2p\") pod \"dns-operator-controller-manager-864dd78c4c-r88kj\" (UID: \"1f21f226-7331-4f96-a12f-71d01443df63\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r88kj" Jul 10 01:10:05.952488 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:05.952462 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6d2p\" (UniqueName: \"kubernetes.io/projected/1f21f226-7331-4f96-a12f-71d01443df63-kube-api-access-q6d2p\") pod \"dns-operator-controller-manager-864dd78c4c-r88kj\" (UID: \"1f21f226-7331-4f96-a12f-71d01443df63\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r88kj" Jul 10 01:10:06.079867 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:06.079783 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r88kj" Jul 10 01:10:06.209503 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:06.209354 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-r88kj"] Jul 10 01:10:06.298012 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:06.297976 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r88kj" event={"ID":"1f21f226-7331-4f96-a12f-71d01443df63","Type":"ContainerStarted","Data":"9214137ecfecc37e7eed1153a37cefad6eb9bd2323be2f0b4bf559f934e57518"} Jul 10 01:10:09.315952 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:09.315915 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r88kj" event={"ID":"1f21f226-7331-4f96-a12f-71d01443df63","Type":"ContainerStarted","Data":"dfb27cb774d8fd3625d56c4c3cb39a3a8ec5df10f4d6f79b313ae43668b3fecb"} Jul 10 01:10:09.316441 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:09.316034 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r88kj" Jul 10 01:10:09.333880 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:09.333827 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r88kj" podStartSLOduration=2.286943686 podStartE2EDuration="4.333811365s" totalImagesPullingTime="2.046867679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:10:09.331490408 +0000 UTC m=+597.922971607" watchObservedRunningTime="2026-07-10 01:10:09.333811365 +0000 UTC m=+597.925292602" Jul 10 01:10:12.003887 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:12.003861 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsbgv_38689ba6-fbae-4092-b63e-3488ce589912/ovn-acl-logging/0.log" Jul 10 01:10:12.004447 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:12.004432 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsbgv_38689ba6-fbae-4092-b63e-3488ce589912/ovn-acl-logging/0.log" Jul 10 01:10:14.935943 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:14.935908 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brdmx"] Jul 10 01:10:14.939164 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:14.939149 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brdmx" Jul 10 01:10:14.942180 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:14.942162 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8l2z5\"" Jul 10 01:10:14.953118 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:14.953094 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brdmx"] Jul 10 01:10:15.020737 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:15.020700 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31878f46-bba3-4956-9294-5412f2c684b9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-brdmx\" (UID: \"31878f46-bba3-4956-9294-5412f2c684b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brdmx" Jul 10 01:10:15.020737 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:15.020751 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4tj8\" (UniqueName: \"kubernetes.io/projected/31878f46-bba3-4956-9294-5412f2c684b9-kube-api-access-n4tj8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-brdmx\" (UID: \"31878f46-bba3-4956-9294-5412f2c684b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brdmx" Jul 10 01:10:15.122160 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:15.122126 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31878f46-bba3-4956-9294-5412f2c684b9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-brdmx\" (UID: \"31878f46-bba3-4956-9294-5412f2c684b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brdmx" Jul 10 01:10:15.122368 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:15.122169 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4tj8\" (UniqueName: \"kubernetes.io/projected/31878f46-bba3-4956-9294-5412f2c684b9-kube-api-access-n4tj8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-brdmx\" (UID: \"31878f46-bba3-4956-9294-5412f2c684b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brdmx" Jul 10 01:10:15.122563 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:15.122542 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31878f46-bba3-4956-9294-5412f2c684b9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-brdmx\" (UID: \"31878f46-bba3-4956-9294-5412f2c684b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brdmx" Jul 10 01:10:15.130788 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:15.130761 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4tj8\" (UniqueName: \"kubernetes.io/projected/31878f46-bba3-4956-9294-5412f2c684b9-kube-api-access-n4tj8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-brdmx\" (UID: \"31878f46-bba3-4956-9294-5412f2c684b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brdmx" Jul 10 01:10:15.249697 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:15.249666 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brdmx" Jul 10 01:10:15.386510 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:15.386487 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brdmx"] Jul 10 01:10:15.388719 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:10:15.388693 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31878f46_bba3_4956_9294_5412f2c684b9.slice/crio-f172cab38898685931c9804ef0f39ceaeb1883400877bc7be1f3df6e414c6891 WatchSource:0}: Error finding container f172cab38898685931c9804ef0f39ceaeb1883400877bc7be1f3df6e414c6891: Status 404 returned error can't find the container with id f172cab38898685931c9804ef0f39ceaeb1883400877bc7be1f3df6e414c6891 Jul 10 01:10:16.348208 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:16.348165 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brdmx" event={"ID":"31878f46-bba3-4956-9294-5412f2c684b9","Type":"ContainerStarted","Data":"f172cab38898685931c9804ef0f39ceaeb1883400877bc7be1f3df6e414c6891"} Jul 10 01:10:17.356293 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:17.356255 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqqqs"] Jul 10 01:10:17.360089 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:17.360070 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqqqs" Jul 10 01:10:17.367916 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:17.367888 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-r2qvt\"" Jul 10 01:10:17.368627 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:17.368600 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqqqs"] Jul 10 01:10:17.440799 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:17.440760 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-752z6\" (UniqueName: \"kubernetes.io/projected/4570d910-2e23-4b1a-9342-60402ef2633e-kube-api-access-752z6\") pod \"limitador-operator-controller-manager-859d7b78bd-fqqqs\" (UID: \"4570d910-2e23-4b1a-9342-60402ef2633e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqqqs" Jul 10 01:10:17.541934 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:17.541893 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-752z6\" (UniqueName: \"kubernetes.io/projected/4570d910-2e23-4b1a-9342-60402ef2633e-kube-api-access-752z6\") pod \"limitador-operator-controller-manager-859d7b78bd-fqqqs\" (UID: \"4570d910-2e23-4b1a-9342-60402ef2633e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqqqs" Jul 10 01:10:17.551856 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:17.551827 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-752z6\" (UniqueName: \"kubernetes.io/projected/4570d910-2e23-4b1a-9342-60402ef2633e-kube-api-access-752z6\") pod \"limitador-operator-controller-manager-859d7b78bd-fqqqs\" (UID: \"4570d910-2e23-4b1a-9342-60402ef2633e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqqqs" Jul 10 01:10:17.672587 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:17.672495 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqqqs" Jul 10 01:10:17.823897 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:17.823874 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqqqs"] Jul 10 01:10:17.825877 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:10:17.825844 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4570d910_2e23_4b1a_9342_60402ef2633e.slice/crio-c83b22bb855fbf6019ae428933be0987c5c2d336c2c0f082fcf37e129d28ffcb WatchSource:0}: Error finding container c83b22bb855fbf6019ae428933be0987c5c2d336c2c0f082fcf37e129d28ffcb: Status 404 returned error can't find the container with id c83b22bb855fbf6019ae428933be0987c5c2d336c2c0f082fcf37e129d28ffcb Jul 10 01:10:17.828428 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:17.828412 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 01:10:18.359856 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:18.359824 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqqqs" event={"ID":"4570d910-2e23-4b1a-9342-60402ef2633e","Type":"ContainerStarted","Data":"c83b22bb855fbf6019ae428933be0987c5c2d336c2c0f082fcf37e129d28ffcb"} Jul 10 01:10:20.323078 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:20.323047 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r88kj" Jul 10 01:10:20.372198 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:20.372157 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqqqs" event={"ID":"4570d910-2e23-4b1a-9342-60402ef2633e","Type":"ContainerStarted","Data":"e3206e1f3d26676fa44a3c3f182e807f74d5285333fa5ff9f38313b98c4041bf"} Jul 10 01:10:20.372368 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:20.372261 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqqqs" Jul 10 01:10:20.389763 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:20.389717 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqqqs" podStartSLOduration=1.52410251 podStartE2EDuration="3.389701834s" totalImagesPullingTime="1.865599324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:10:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:10:20.387877447 +0000 UTC m=+608.979358646" watchObservedRunningTime="2026-07-10 01:10:20.389701834 +0000 UTC m=+608.981183032" Jul 10 01:10:22.386810 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:22.386776 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brdmx" event={"ID":"31878f46-bba3-4956-9294-5412f2c684b9","Type":"ContainerStarted","Data":"a4660e67d72b82ca52ea925b29c2661a6d05ef74abf3cf7a44f2da2f05045946"} Jul 10 01:10:22.387188 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:22.386867 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brdmx" Jul 10 01:10:22.408407 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:22.408361 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brdmx" podStartSLOduration=1.515342105 podStartE2EDuration="8.408345509s" totalImagesPullingTime="6.893003404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:10:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:10:22.406144492 +0000 UTC m=+610.997625712" watchObservedRunningTime="2026-07-10 01:10:22.408345509 +0000 UTC m=+610.999826706" Jul 10 01:10:31.380295 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:31.380264 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqqqs" Jul 10 01:10:33.393819 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:33.393788 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brdmx" Jul 10 01:10:35.261558 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.261520 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brdmx"] Jul 10 01:10:35.262011 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.261757 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brdmx" podUID="31878f46-bba3-4956-9294-5412f2c684b9" containerName="manager" containerID="cri-o://a4660e67d72b82ca52ea925b29c2661a6d05ef74abf3cf7a44f2da2f05045946" gracePeriod=2 Jul 10 01:10:35.263285 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.263261 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brdmx"] Jul 10 01:10:35.264038 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:10:35.264013 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-brdmx\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="31878f46-bba3-4956-9294-5412f2c684b9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brdmx" Jul 10 01:10:35.274023 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.273992 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqqqs"] Jul 10 01:10:35.274269 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.274239 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqqqs" podUID="4570d910-2e23-4b1a-9342-60402ef2633e" containerName="manager" containerID="cri-o://e3206e1f3d26676fa44a3c3f182e807f74d5285333fa5ff9f38313b98c4041bf" gracePeriod=2 Jul 10 01:10:35.282862 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.282825 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqqqs"] Jul 10 01:10:35.287121 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:10:35.287069 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-brdmx\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="31878f46-bba3-4956-9294-5412f2c684b9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brdmx" Jul 10 01:10:35.289709 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.289684 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdtrr"] Jul 10 01:10:35.290186 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.290171 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4570d910-2e23-4b1a-9342-60402ef2633e" containerName="manager" Jul 10 01:10:35.290241 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.290190 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="4570d910-2e23-4b1a-9342-60402ef2633e" containerName="manager" Jul 10 01:10:35.290241 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.290209 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31878f46-bba3-4956-9294-5412f2c684b9" containerName="manager" Jul 10 01:10:35.290241 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.290236 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="31878f46-bba3-4956-9294-5412f2c684b9" containerName="manager" Jul 10 01:10:35.290374 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.290363 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="4570d910-2e23-4b1a-9342-60402ef2633e" containerName="manager" Jul 10 01:10:35.290410 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.290384 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="31878f46-bba3-4956-9294-5412f2c684b9" containerName="manager" Jul 10 01:10:35.294719 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.294701 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdtrr" Jul 10 01:10:35.298270 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:10:35.298210 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-brdmx\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="31878f46-bba3-4956-9294-5412f2c684b9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brdmx" Jul 10 01:10:35.301856 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.301831 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vzbqh"] Jul 10 01:10:35.305587 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.305569 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vzbqh" Jul 10 01:10:35.308997 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.308974 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdtrr"] Jul 10 01:10:35.315141 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.315120 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vzbqh"] Jul 10 01:10:35.323705 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:10:35.323675 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fqqqs\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="4570d910-2e23-4b1a-9342-60402ef2633e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqqqs" Jul 10 01:10:35.325978 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:10:35.325953 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-brdmx\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="31878f46-bba3-4956-9294-5412f2c684b9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brdmx" Jul 10 01:10:35.349857 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:10:35.349824 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fqqqs\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="4570d910-2e23-4b1a-9342-60402ef2633e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqqqs" Jul 10 01:10:35.401148 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.401110 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldhn2\" (UniqueName: \"kubernetes.io/projected/0aafefa8-4e81-4417-9c1a-7152b9cbf5d9-kube-api-access-ldhn2\") pod \"limitador-operator-controller-manager-859d7b78bd-vzbqh\" (UID: \"0aafefa8-4e81-4417-9c1a-7152b9cbf5d9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vzbqh" Jul 10 01:10:35.401298 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.401182 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js9v8\" (UniqueName: \"kubernetes.io/projected/12176f77-1c04-46fe-a3a0-c0a763bb9b0d-kube-api-access-js9v8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rdtrr\" (UID: \"12176f77-1c04-46fe-a3a0-c0a763bb9b0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdtrr" Jul 10 01:10:35.401298 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.401254 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12176f77-1c04-46fe-a3a0-c0a763bb9b0d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rdtrr\" (UID: \"12176f77-1c04-46fe-a3a0-c0a763bb9b0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdtrr" Jul 10 01:10:35.451999 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.451961 2554 generic.go:356] "Generic (PLEG): container finished" podID="31878f46-bba3-4956-9294-5412f2c684b9" containerID="a4660e67d72b82ca52ea925b29c2661a6d05ef74abf3cf7a44f2da2f05045946" exitCode=0 Jul 10 01:10:35.454434 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.454406 2554 generic.go:356] "Generic (PLEG): container finished" podID="4570d910-2e23-4b1a-9342-60402ef2633e" containerID="e3206e1f3d26676fa44a3c3f182e807f74d5285333fa5ff9f38313b98c4041bf" exitCode=0 Jul 10 01:10:35.501839 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.501810 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js9v8\" (UniqueName: \"kubernetes.io/projected/12176f77-1c04-46fe-a3a0-c0a763bb9b0d-kube-api-access-js9v8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rdtrr\" (UID: \"12176f77-1c04-46fe-a3a0-c0a763bb9b0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdtrr" Jul 10 01:10:35.501959 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.501862 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12176f77-1c04-46fe-a3a0-c0a763bb9b0d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rdtrr\" (UID: \"12176f77-1c04-46fe-a3a0-c0a763bb9b0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdtrr" Jul 10 01:10:35.502019 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.501954 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldhn2\" (UniqueName: \"kubernetes.io/projected/0aafefa8-4e81-4417-9c1a-7152b9cbf5d9-kube-api-access-ldhn2\") pod \"limitador-operator-controller-manager-859d7b78bd-vzbqh\" (UID: \"0aafefa8-4e81-4417-9c1a-7152b9cbf5d9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vzbqh" Jul 10 01:10:35.502263 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.502216 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12176f77-1c04-46fe-a3a0-c0a763bb9b0d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rdtrr\" (UID: \"12176f77-1c04-46fe-a3a0-c0a763bb9b0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdtrr" Jul 10 01:10:35.515881 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.515829 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldhn2\" (UniqueName: \"kubernetes.io/projected/0aafefa8-4e81-4417-9c1a-7152b9cbf5d9-kube-api-access-ldhn2\") pod \"limitador-operator-controller-manager-859d7b78bd-vzbqh\" (UID: \"0aafefa8-4e81-4417-9c1a-7152b9cbf5d9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vzbqh" Jul 10 01:10:35.517125 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.517103 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js9v8\" (UniqueName: \"kubernetes.io/projected/12176f77-1c04-46fe-a3a0-c0a763bb9b0d-kube-api-access-js9v8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rdtrr\" (UID: \"12176f77-1c04-46fe-a3a0-c0a763bb9b0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdtrr" Jul 10 01:10:35.519315 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.519291 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brdmx" Jul 10 01:10:35.521728 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:10:35.521706 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fqqqs\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="4570d910-2e23-4b1a-9342-60402ef2633e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqqqs" Jul 10 01:10:35.521850 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.521835 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqqqs" Jul 10 01:10:35.523959 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:10:35.523936 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-brdmx\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="31878f46-bba3-4956-9294-5412f2c684b9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brdmx" Jul 10 01:10:35.526271 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:10:35.526251 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fqqqs\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="4570d910-2e23-4b1a-9342-60402ef2633e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqqqs" Jul 10 01:10:35.528443 ip-10-0-138-251 kubenswrapper[2554]: E0710 01:10:35.528424 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-brdmx\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="31878f46-bba3-4956-9294-5412f2c684b9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brdmx" Jul 10 01:10:35.602950 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.602909 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31878f46-bba3-4956-9294-5412f2c684b9-extensions-socket-volume\") pod \"31878f46-bba3-4956-9294-5412f2c684b9\" (UID: \"31878f46-bba3-4956-9294-5412f2c684b9\") " Jul 10 01:10:35.602950 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.602948 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4tj8\" (UniqueName: \"kubernetes.io/projected/31878f46-bba3-4956-9294-5412f2c684b9-kube-api-access-n4tj8\") pod \"31878f46-bba3-4956-9294-5412f2c684b9\" (UID: \"31878f46-bba3-4956-9294-5412f2c684b9\") " Jul 10 01:10:35.603153 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.602993 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-752z6\" (UniqueName: \"kubernetes.io/projected/4570d910-2e23-4b1a-9342-60402ef2633e-kube-api-access-752z6\") pod \"4570d910-2e23-4b1a-9342-60402ef2633e\" (UID: \"4570d910-2e23-4b1a-9342-60402ef2633e\") " Jul 10 01:10:35.603514 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.603488 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31878f46-bba3-4956-9294-5412f2c684b9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "31878f46-bba3-4956-9294-5412f2c684b9" (UID: "31878f46-bba3-4956-9294-5412f2c684b9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 01:10:35.605082 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.605062 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4570d910-2e23-4b1a-9342-60402ef2633e-kube-api-access-752z6" (OuterVolumeSpecName: "kube-api-access-752z6") pod "4570d910-2e23-4b1a-9342-60402ef2633e" (UID: "4570d910-2e23-4b1a-9342-60402ef2633e"). InnerVolumeSpecName "kube-api-access-752z6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 01:10:35.605153 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.605091 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31878f46-bba3-4956-9294-5412f2c684b9-kube-api-access-n4tj8" (OuterVolumeSpecName: "kube-api-access-n4tj8") pod "31878f46-bba3-4956-9294-5412f2c684b9" (UID: "31878f46-bba3-4956-9294-5412f2c684b9"). InnerVolumeSpecName "kube-api-access-n4tj8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 01:10:35.693712 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.693677 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdtrr" Jul 10 01:10:35.701685 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.701664 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vzbqh" Jul 10 01:10:35.704147 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.704125 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31878f46-bba3-4956-9294-5412f2c684b9-extensions-socket-volume\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:10:35.704188 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.704154 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4tj8\" (UniqueName: \"kubernetes.io/projected/31878f46-bba3-4956-9294-5412f2c684b9-kube-api-access-n4tj8\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:10:35.704188 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.704172 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-752z6\" (UniqueName: \"kubernetes.io/projected/4570d910-2e23-4b1a-9342-60402ef2633e-kube-api-access-752z6\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:10:35.836167 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.836111 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdtrr"] Jul 10 01:10:35.838377 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:10:35.838354 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12176f77_1c04_46fe_a3a0_c0a763bb9b0d.slice/crio-0a7eeeeb1734dc0a36b7ff35066062d179c23dddeb90d8ec888d1396a832eb50 WatchSource:0}: Error finding container 0a7eeeeb1734dc0a36b7ff35066062d179c23dddeb90d8ec888d1396a832eb50: Status 404 returned error can't find the container with id 0a7eeeeb1734dc0a36b7ff35066062d179c23dddeb90d8ec888d1396a832eb50 Jul 10 01:10:35.859207 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:35.859184 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vzbqh"] Jul 10 01:10:35.862820 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:10:35.862794 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aafefa8_4e81_4417_9c1a_7152b9cbf5d9.slice/crio-30348a481646e9b6067325d9a23bd9d7cd5c344a218213e73feb30edfabcf8d4 WatchSource:0}: Error finding container 30348a481646e9b6067325d9a23bd9d7cd5c344a218213e73feb30edfabcf8d4: Status 404 returned error can't find the container with id 30348a481646e9b6067325d9a23bd9d7cd5c344a218213e73feb30edfabcf8d4 Jul 10 01:10:36.031034 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:36.030958 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31878f46-bba3-4956-9294-5412f2c684b9" path="/var/lib/kubelet/pods/31878f46-bba3-4956-9294-5412f2c684b9/volumes" Jul 10 01:10:36.031340 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:36.031326 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4570d910-2e23-4b1a-9342-60402ef2633e" path="/var/lib/kubelet/pods/4570d910-2e23-4b1a-9342-60402ef2633e/volumes" Jul 10 01:10:36.465737 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:36.465707 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brdmx" Jul 10 01:10:36.466205 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:36.465748 2554 scope.go:117] "RemoveContainer" containerID="a4660e67d72b82ca52ea925b29c2661a6d05ef74abf3cf7a44f2da2f05045946" Jul 10 01:10:36.467577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:36.467454 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdtrr" event={"ID":"12176f77-1c04-46fe-a3a0-c0a763bb9b0d","Type":"ContainerStarted","Data":"11338934d7c45bd38e1e2cdffb10b5ffd1aa327cec1fdd3f54b2669bdbe43134"} Jul 10 01:10:36.467577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:36.467543 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdtrr" event={"ID":"12176f77-1c04-46fe-a3a0-c0a763bb9b0d","Type":"ContainerStarted","Data":"0a7eeeeb1734dc0a36b7ff35066062d179c23dddeb90d8ec888d1396a832eb50"} Jul 10 01:10:36.467577 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:36.467573 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdtrr" Jul 10 01:10:36.469153 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:36.469133 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqqqs" Jul 10 01:10:36.470546 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:36.470522 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vzbqh" event={"ID":"0aafefa8-4e81-4417-9c1a-7152b9cbf5d9","Type":"ContainerStarted","Data":"2a544878019da94bedca30c797f0f09cd1edb3466ff6c09db2fe596a6263a6d0"} Jul 10 01:10:36.470654 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:36.470565 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vzbqh" event={"ID":"0aafefa8-4e81-4417-9c1a-7152b9cbf5d9","Type":"ContainerStarted","Data":"30348a481646e9b6067325d9a23bd9d7cd5c344a218213e73feb30edfabcf8d4"} Jul 10 01:10:36.470654 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:36.470606 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vzbqh" Jul 10 01:10:36.475183 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:36.475168 2554 scope.go:117] "RemoveContainer" containerID="e3206e1f3d26676fa44a3c3f182e807f74d5285333fa5ff9f38313b98c4041bf" Jul 10 01:10:36.488950 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:36.488906 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdtrr" podStartSLOduration=1.488890663 podStartE2EDuration="1.488890663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:10:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:10:36.486132829 +0000 UTC m=+625.077614027" watchObservedRunningTime="2026-07-10 01:10:36.488890663 +0000 UTC m=+625.080371860" Jul 10 01:10:36.504365 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:36.504325 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vzbqh" podStartSLOduration=1.504311848 podStartE2EDuration="1.504311848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:10:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:10:36.503316624 +0000 UTC m=+625.094797822" watchObservedRunningTime="2026-07-10 01:10:36.504311848 +0000 UTC m=+625.095793045" Jul 10 01:10:47.480067 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:47.480039 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdtrr" Jul 10 01:10:47.480593 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:47.480105 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vzbqh" Jul 10 01:10:51.376128 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:51.376096 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdtrr"] Jul 10 01:10:51.376531 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:51.376315 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdtrr" podUID="12176f77-1c04-46fe-a3a0-c0a763bb9b0d" containerName="manager" containerID="cri-o://11338934d7c45bd38e1e2cdffb10b5ffd1aa327cec1fdd3f54b2669bdbe43134" gracePeriod=10 Jul 10 01:10:51.547162 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:51.547128 2554 generic.go:356] "Generic (PLEG): container finished" podID="12176f77-1c04-46fe-a3a0-c0a763bb9b0d" containerID="11338934d7c45bd38e1e2cdffb10b5ffd1aa327cec1fdd3f54b2669bdbe43134" exitCode=0 Jul 10 01:10:51.547325 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:51.547175 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdtrr" event={"ID":"12176f77-1c04-46fe-a3a0-c0a763bb9b0d","Type":"ContainerDied","Data":"11338934d7c45bd38e1e2cdffb10b5ffd1aa327cec1fdd3f54b2669bdbe43134"} Jul 10 01:10:51.618321 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:51.618285 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdtrr" Jul 10 01:10:51.630272 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:51.630189 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4xcz"] Jul 10 01:10:51.630553 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:51.630540 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12176f77-1c04-46fe-a3a0-c0a763bb9b0d" containerName="manager" Jul 10 01:10:51.630597 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:51.630555 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="12176f77-1c04-46fe-a3a0-c0a763bb9b0d" containerName="manager" Jul 10 01:10:51.630630 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:51.630621 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="12176f77-1c04-46fe-a3a0-c0a763bb9b0d" containerName="manager" Jul 10 01:10:51.633512 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:51.633497 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4xcz" Jul 10 01:10:51.648048 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:51.648022 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4xcz"] Jul 10 01:10:51.737794 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:51.737760 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12176f77-1c04-46fe-a3a0-c0a763bb9b0d-extensions-socket-volume\") pod \"12176f77-1c04-46fe-a3a0-c0a763bb9b0d\" (UID: \"12176f77-1c04-46fe-a3a0-c0a763bb9b0d\") " Jul 10 01:10:51.737956 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:51.737851 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-js9v8\" (UniqueName: \"kubernetes.io/projected/12176f77-1c04-46fe-a3a0-c0a763bb9b0d-kube-api-access-js9v8\") pod \"12176f77-1c04-46fe-a3a0-c0a763bb9b0d\" (UID: \"12176f77-1c04-46fe-a3a0-c0a763bb9b0d\") " Jul 10 01:10:51.737995 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:51.737975 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24jvr\" (UniqueName: \"kubernetes.io/projected/615cb2ca-8c1a-4866-a405-2ec892d5f2f9-kube-api-access-24jvr\") pod \"kuadrant-operator-controller-manager-86878c769f-f4xcz\" (UID: \"615cb2ca-8c1a-4866-a405-2ec892d5f2f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4xcz" Jul 10 01:10:51.738029 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:51.738009 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/615cb2ca-8c1a-4866-a405-2ec892d5f2f9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-f4xcz\" (UID: \"615cb2ca-8c1a-4866-a405-2ec892d5f2f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4xcz" Jul 10 01:10:51.738239 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:51.738192 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12176f77-1c04-46fe-a3a0-c0a763bb9b0d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "12176f77-1c04-46fe-a3a0-c0a763bb9b0d" (UID: "12176f77-1c04-46fe-a3a0-c0a763bb9b0d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 01:10:51.739921 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:51.739894 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12176f77-1c04-46fe-a3a0-c0a763bb9b0d-kube-api-access-js9v8" (OuterVolumeSpecName: "kube-api-access-js9v8") pod "12176f77-1c04-46fe-a3a0-c0a763bb9b0d" (UID: "12176f77-1c04-46fe-a3a0-c0a763bb9b0d"). InnerVolumeSpecName "kube-api-access-js9v8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 01:10:51.838862 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:51.838824 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24jvr\" (UniqueName: \"kubernetes.io/projected/615cb2ca-8c1a-4866-a405-2ec892d5f2f9-kube-api-access-24jvr\") pod \"kuadrant-operator-controller-manager-86878c769f-f4xcz\" (UID: \"615cb2ca-8c1a-4866-a405-2ec892d5f2f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4xcz" Jul 10 01:10:51.839010 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:51.838875 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/615cb2ca-8c1a-4866-a405-2ec892d5f2f9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-f4xcz\" (UID: \"615cb2ca-8c1a-4866-a405-2ec892d5f2f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4xcz" Jul 10 01:10:51.839010 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:51.838910 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-js9v8\" (UniqueName: \"kubernetes.io/projected/12176f77-1c04-46fe-a3a0-c0a763bb9b0d-kube-api-access-js9v8\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:10:51.839010 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:51.838920 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12176f77-1c04-46fe-a3a0-c0a763bb9b0d-extensions-socket-volume\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jul 10 01:10:51.839214 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:51.839198 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/615cb2ca-8c1a-4866-a405-2ec892d5f2f9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-f4xcz\" (UID: \"615cb2ca-8c1a-4866-a405-2ec892d5f2f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4xcz" Jul 10 01:10:51.847616 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:51.847590 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24jvr\" (UniqueName: \"kubernetes.io/projected/615cb2ca-8c1a-4866-a405-2ec892d5f2f9-kube-api-access-24jvr\") pod \"kuadrant-operator-controller-manager-86878c769f-f4xcz\" (UID: \"615cb2ca-8c1a-4866-a405-2ec892d5f2f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4xcz" Jul 10 01:10:51.943580 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:51.943475 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4xcz" Jul 10 01:10:52.074268 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:52.074140 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4xcz"] Jul 10 01:10:52.076754 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:10:52.076732 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod615cb2ca_8c1a_4866_a405_2ec892d5f2f9.slice/crio-f42b55407844281c604b74cc2c0341fd241e9c51db78e3c3140401b9e530583a WatchSource:0}: Error finding container f42b55407844281c604b74cc2c0341fd241e9c51db78e3c3140401b9e530583a: Status 404 returned error can't find the container with id f42b55407844281c604b74cc2c0341fd241e9c51db78e3c3140401b9e530583a Jul 10 01:10:52.553116 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:52.553085 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4xcz" event={"ID":"615cb2ca-8c1a-4866-a405-2ec892d5f2f9","Type":"ContainerStarted","Data":"379f250d5d89f8fbb09ab595b281d152d4d8a75aef4ea80e2108c5f920827f95"} Jul 10 01:10:52.553567 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:52.553141 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4xcz" Jul 10 01:10:52.553567 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:52.553164 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4xcz" event={"ID":"615cb2ca-8c1a-4866-a405-2ec892d5f2f9","Type":"ContainerStarted","Data":"f42b55407844281c604b74cc2c0341fd241e9c51db78e3c3140401b9e530583a"} Jul 10 01:10:52.554333 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:52.554315 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdtrr" event={"ID":"12176f77-1c04-46fe-a3a0-c0a763bb9b0d","Type":"ContainerDied","Data":"0a7eeeeb1734dc0a36b7ff35066062d179c23dddeb90d8ec888d1396a832eb50"} Jul 10 01:10:52.554410 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:52.554365 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdtrr" Jul 10 01:10:52.554410 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:52.554378 2554 scope.go:117] "RemoveContainer" containerID="11338934d7c45bd38e1e2cdffb10b5ffd1aa327cec1fdd3f54b2669bdbe43134" Jul 10 01:10:52.583235 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:52.583175 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4xcz" podStartSLOduration=1.583159515 podStartE2EDuration="1.583159515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:10:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:10:52.580087514 +0000 UTC m=+641.171568711" watchObservedRunningTime="2026-07-10 01:10:52.583159515 +0000 UTC m=+641.174640713" Jul 10 01:10:52.596491 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:52.596464 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdtrr"] Jul 10 01:10:52.600359 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:52.600334 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdtrr"] Jul 10 01:10:54.030159 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:10:54.030127 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12176f77-1c04-46fe-a3a0-c0a763bb9b0d" path="/var/lib/kubelet/pods/12176f77-1c04-46fe-a3a0-c0a763bb9b0d/volumes" Jul 10 01:11:03.563082 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:03.563051 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4xcz" Jul 10 01:11:07.730434 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.730395 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf"] Jul 10 01:11:07.734214 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.734190 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:07.737189 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.737152 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-zcqtk\"" Jul 10 01:11:07.746080 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.746049 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf"] Jul 10 01:11:07.877978 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.877944 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a694bfd-c83e-44d8-98e5-741dca0542b6-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cf9lf\" (UID: \"4a694bfd-c83e-44d8-98e5-741dca0542b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:07.878165 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.877990 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a694bfd-c83e-44d8-98e5-741dca0542b6-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-cf9lf\" (UID: \"4a694bfd-c83e-44d8-98e5-741dca0542b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:07.878165 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.878059 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a694bfd-c83e-44d8-98e5-741dca0542b6-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-cf9lf\" (UID: \"4a694bfd-c83e-44d8-98e5-741dca0542b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:07.878165 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.878121 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a694bfd-c83e-44d8-98e5-741dca0542b6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-cf9lf\" (UID: \"4a694bfd-c83e-44d8-98e5-741dca0542b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:07.878165 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.878144 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a694bfd-c83e-44d8-98e5-741dca0542b6-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cf9lf\" (UID: \"4a694bfd-c83e-44d8-98e5-741dca0542b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:07.878356 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.878167 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a694bfd-c83e-44d8-98e5-741dca0542b6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-cf9lf\" (UID: \"4a694bfd-c83e-44d8-98e5-741dca0542b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:07.878356 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.878210 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f5vv\" (UniqueName: \"kubernetes.io/projected/4a694bfd-c83e-44d8-98e5-741dca0542b6-kube-api-access-5f5vv\") pod \"maas-default-gateway-openshift-default-56654dcf7-cf9lf\" (UID: \"4a694bfd-c83e-44d8-98e5-741dca0542b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:07.878356 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.878239 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a694bfd-c83e-44d8-98e5-741dca0542b6-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-cf9lf\" (UID: \"4a694bfd-c83e-44d8-98e5-741dca0542b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:07.878356 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.878295 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a694bfd-c83e-44d8-98e5-741dca0542b6-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-cf9lf\" (UID: \"4a694bfd-c83e-44d8-98e5-741dca0542b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:07.979402 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.979364 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a694bfd-c83e-44d8-98e5-741dca0542b6-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-cf9lf\" (UID: \"4a694bfd-c83e-44d8-98e5-741dca0542b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:07.979604 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.979436 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a694bfd-c83e-44d8-98e5-741dca0542b6-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cf9lf\" (UID: \"4a694bfd-c83e-44d8-98e5-741dca0542b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:07.979604 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.979478 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a694bfd-c83e-44d8-98e5-741dca0542b6-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-cf9lf\" (UID: \"4a694bfd-c83e-44d8-98e5-741dca0542b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:07.979604 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.979511 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a694bfd-c83e-44d8-98e5-741dca0542b6-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-cf9lf\" (UID: \"4a694bfd-c83e-44d8-98e5-741dca0542b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:07.979604 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.979552 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a694bfd-c83e-44d8-98e5-741dca0542b6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-cf9lf\" (UID: \"4a694bfd-c83e-44d8-98e5-741dca0542b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:07.979604 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.979576 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a694bfd-c83e-44d8-98e5-741dca0542b6-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cf9lf\" (UID: \"4a694bfd-c83e-44d8-98e5-741dca0542b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:07.979604 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.979601 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a694bfd-c83e-44d8-98e5-741dca0542b6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-cf9lf\" (UID: \"4a694bfd-c83e-44d8-98e5-741dca0542b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:07.979898 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.979630 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f5vv\" (UniqueName: \"kubernetes.io/projected/4a694bfd-c83e-44d8-98e5-741dca0542b6-kube-api-access-5f5vv\") pod \"maas-default-gateway-openshift-default-56654dcf7-cf9lf\" (UID: \"4a694bfd-c83e-44d8-98e5-741dca0542b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:07.979898 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.979657 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a694bfd-c83e-44d8-98e5-741dca0542b6-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-cf9lf\" (UID: \"4a694bfd-c83e-44d8-98e5-741dca0542b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:07.979898 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.979853 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a694bfd-c83e-44d8-98e5-741dca0542b6-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-cf9lf\" (UID: \"4a694bfd-c83e-44d8-98e5-741dca0542b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:07.980087 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.979895 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a694bfd-c83e-44d8-98e5-741dca0542b6-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cf9lf\" (UID: \"4a694bfd-c83e-44d8-98e5-741dca0542b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:07.980087 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.979929 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a694bfd-c83e-44d8-98e5-741dca0542b6-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cf9lf\" (UID: \"4a694bfd-c83e-44d8-98e5-741dca0542b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:07.980322 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.980296 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a694bfd-c83e-44d8-98e5-741dca0542b6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-cf9lf\" (UID: \"4a694bfd-c83e-44d8-98e5-741dca0542b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:07.980412 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.980342 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a694bfd-c83e-44d8-98e5-741dca0542b6-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-cf9lf\" (UID: \"4a694bfd-c83e-44d8-98e5-741dca0542b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:07.982120 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.982061 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a694bfd-c83e-44d8-98e5-741dca0542b6-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-cf9lf\" (UID: \"4a694bfd-c83e-44d8-98e5-741dca0542b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:07.982204 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.982136 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a694bfd-c83e-44d8-98e5-741dca0542b6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-cf9lf\" (UID: \"4a694bfd-c83e-44d8-98e5-741dca0542b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:07.990095 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.990069 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a694bfd-c83e-44d8-98e5-741dca0542b6-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-cf9lf\" (UID: \"4a694bfd-c83e-44d8-98e5-741dca0542b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:07.990410 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:07.990142 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f5vv\" (UniqueName: \"kubernetes.io/projected/4a694bfd-c83e-44d8-98e5-741dca0542b6-kube-api-access-5f5vv\") pod \"maas-default-gateway-openshift-default-56654dcf7-cf9lf\" (UID: \"4a694bfd-c83e-44d8-98e5-741dca0542b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:08.046086 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:08.046048 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:08.212856 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:08.212823 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf"] Jul 10 01:11:08.215131 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:11:08.215099 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a694bfd_c83e_44d8_98e5_741dca0542b6.slice/crio-52aa2dcff2bdf60d89ea8588c96272ac389386e884183ad5c1b68eb6913ace92 WatchSource:0}: Error finding container 52aa2dcff2bdf60d89ea8588c96272ac389386e884183ad5c1b68eb6913ace92: Status 404 returned error can't find the container with id 52aa2dcff2bdf60d89ea8588c96272ac389386e884183ad5c1b68eb6913ace92 Jul 10 01:11:08.217295 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:08.217262 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 01:11:08.217392 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:08.217349 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 01:11:08.217453 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:08.217394 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 01:11:08.635629 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:08.635545 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" event={"ID":"4a694bfd-c83e-44d8-98e5-741dca0542b6","Type":"ContainerStarted","Data":"c2606e96ad5a879b70366fb7e3e91612b4d54b3a9eb4a10618bf1112daf4fc1b"} Jul 10 01:11:08.635629 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:08.635594 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" event={"ID":"4a694bfd-c83e-44d8-98e5-741dca0542b6","Type":"ContainerStarted","Data":"52aa2dcff2bdf60d89ea8588c96272ac389386e884183ad5c1b68eb6913ace92"} Jul 10 01:11:08.656551 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:08.656508 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" podStartSLOduration=1.656492907 podStartE2EDuration="1.656492907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:11:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:11:08.654742906 +0000 UTC m=+657.246224108" watchObservedRunningTime="2026-07-10 01:11:08.656492907 +0000 UTC m=+657.247974105" Jul 10 01:11:09.047147 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:09.047108 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:09.051771 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:09.051745 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:09.639989 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:09.639959 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:11:09.641140 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:11:09.641120 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:12:49.100356 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:12:49.100318 2554 generic.go:356] "Generic (PLEG): container finished" podID="4a694bfd-c83e-44d8-98e5-741dca0542b6" containerID="c2606e96ad5a879b70366fb7e3e91612b4d54b3a9eb4a10618bf1112daf4fc1b" exitCode=0 Jul 10 01:12:49.100825 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:12:49.100370 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" event={"ID":"4a694bfd-c83e-44d8-98e5-741dca0542b6","Type":"ContainerDied","Data":"c2606e96ad5a879b70366fb7e3e91612b4d54b3a9eb4a10618bf1112daf4fc1b"} Jul 10 01:12:49.100825 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:12:49.100740 2554 scope.go:117] "RemoveContainer" containerID="c2606e96ad5a879b70366fb7e3e91612b4d54b3a9eb4a10618bf1112daf4fc1b" Jul 10 01:12:49.101722 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:12:49.101696 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 01:12:49.101772 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:12:49.101761 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 01:12:49.101823 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:12:49.101811 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 01:12:50.117383 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:12:50.117345 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" event={"ID":"4a694bfd-c83e-44d8-98e5-741dca0542b6","Type":"ContainerStarted","Data":"e7ade7cbb09813e9ed3cf421509fac9a11c426c92beb6d85fd460e769847229c"} Jul 10 01:12:51.047201 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:12:51.047169 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:12:51.048077 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:12:51.048047 2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-cf9lf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 10 01:12:51.048195 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:12:51.048096 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" podUID="4a694bfd-c83e-44d8-98e5-741dca0542b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 10 01:12:52.047039 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:12:52.046997 2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-cf9lf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 10 01:12:52.047453 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:12:52.047057 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" podUID="4a694bfd-c83e-44d8-98e5-741dca0542b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 10 01:12:53.046540 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:12:53.046488 2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-cf9lf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 10 01:12:53.046762 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:12:53.046554 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" podUID="4a694bfd-c83e-44d8-98e5-741dca0542b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 10 01:12:54.051755 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:12:54.051720 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:12:54.052277 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:12:54.052257 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:12:54.053037 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:12:54.053015 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cf9lf" Jul 10 01:13:18.642244 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:18.642196 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d"] Jul 10 01:13:18.653489 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:18.653458 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d" Jul 10 01:13:18.657397 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:18.657359 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d"] Jul 10 01:13:18.657858 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:18.657836 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xrfbf\"" Jul 10 01:13:18.658019 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:18.657904 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 10 01:13:18.658019 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:18.657956 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 10 01:13:18.658178 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:18.658022 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 10 01:13:18.738959 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:18.738927 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65145fe3-c78a-478f-a150-66ad3a1393ea-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7zr2d\" (UID: \"65145fe3-c78a-478f-a150-66ad3a1393ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d" Jul 10 01:13:18.739138 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:18.738972 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65145fe3-c78a-478f-a150-66ad3a1393ea-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7zr2d\" (UID: \"65145fe3-c78a-478f-a150-66ad3a1393ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d" Jul 10 01:13:18.739138 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:18.738996 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65145fe3-c78a-478f-a150-66ad3a1393ea-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7zr2d\" (UID: \"65145fe3-c78a-478f-a150-66ad3a1393ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d" Jul 10 01:13:18.739138 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:18.739091 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65145fe3-c78a-478f-a150-66ad3a1393ea-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7zr2d\" (UID: \"65145fe3-c78a-478f-a150-66ad3a1393ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d" Jul 10 01:13:18.739138 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:18.739118 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t2x2\" (UniqueName: \"kubernetes.io/projected/65145fe3-c78a-478f-a150-66ad3a1393ea-kube-api-access-8t2x2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7zr2d\" (UID: \"65145fe3-c78a-478f-a150-66ad3a1393ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d" Jul 10 01:13:18.739302 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:18.739141 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65145fe3-c78a-478f-a150-66ad3a1393ea-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7zr2d\" (UID: \"65145fe3-c78a-478f-a150-66ad3a1393ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d" Jul 10 01:13:18.840252 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:18.840186 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65145fe3-c78a-478f-a150-66ad3a1393ea-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7zr2d\" (UID: \"65145fe3-c78a-478f-a150-66ad3a1393ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d" Jul 10 01:13:18.840460 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:18.840283 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65145fe3-c78a-478f-a150-66ad3a1393ea-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7zr2d\" (UID: \"65145fe3-c78a-478f-a150-66ad3a1393ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d" Jul 10 01:13:18.840460 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:18.840314 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65145fe3-c78a-478f-a150-66ad3a1393ea-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7zr2d\" (UID: \"65145fe3-c78a-478f-a150-66ad3a1393ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d" Jul 10 01:13:18.840460 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:18.840347 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65145fe3-c78a-478f-a150-66ad3a1393ea-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7zr2d\" (UID: \"65145fe3-c78a-478f-a150-66ad3a1393ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d" Jul 10 01:13:18.840460 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:18.840369 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t2x2\" (UniqueName: \"kubernetes.io/projected/65145fe3-c78a-478f-a150-66ad3a1393ea-kube-api-access-8t2x2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7zr2d\" (UID: \"65145fe3-c78a-478f-a150-66ad3a1393ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d" Jul 10 01:13:18.840887 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:18.840493 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65145fe3-c78a-478f-a150-66ad3a1393ea-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7zr2d\" (UID: \"65145fe3-c78a-478f-a150-66ad3a1393ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d" Jul 10 01:13:18.840887 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:18.840746 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65145fe3-c78a-478f-a150-66ad3a1393ea-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7zr2d\" (UID: \"65145fe3-c78a-478f-a150-66ad3a1393ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d" Jul 10 01:13:18.840887 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:18.840783 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65145fe3-c78a-478f-a150-66ad3a1393ea-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7zr2d\" (UID: \"65145fe3-c78a-478f-a150-66ad3a1393ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d" Jul 10 01:13:18.840887 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:18.840815 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65145fe3-c78a-478f-a150-66ad3a1393ea-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7zr2d\" (UID: \"65145fe3-c78a-478f-a150-66ad3a1393ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d" Jul 10 01:13:18.842567 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:18.842538 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65145fe3-c78a-478f-a150-66ad3a1393ea-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7zr2d\" (UID: \"65145fe3-c78a-478f-a150-66ad3a1393ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d" Jul 10 01:13:18.842817 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:18.842798 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65145fe3-c78a-478f-a150-66ad3a1393ea-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7zr2d\" (UID: \"65145fe3-c78a-478f-a150-66ad3a1393ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d" Jul 10 01:13:18.848053 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:18.848035 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t2x2\" (UniqueName: \"kubernetes.io/projected/65145fe3-c78a-478f-a150-66ad3a1393ea-kube-api-access-8t2x2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7zr2d\" (UID: \"65145fe3-c78a-478f-a150-66ad3a1393ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d" Jul 10 01:13:18.967551 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:18.967512 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d" Jul 10 01:13:19.103769 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:19.103738 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d"] Jul 10 01:13:19.105747 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:13:19.105721 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65145fe3_c78a_478f_a150_66ad3a1393ea.slice/crio-cadddd5085a1ca0c7407a946c8e391c3e9eb8dc19d70436fb8e47382320f6b2c WatchSource:0}: Error finding container cadddd5085a1ca0c7407a946c8e391c3e9eb8dc19d70436fb8e47382320f6b2c: Status 404 returned error can't find the container with id cadddd5085a1ca0c7407a946c8e391c3e9eb8dc19d70436fb8e47382320f6b2c Jul 10 01:13:19.252512 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:19.252411 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d" event={"ID":"65145fe3-c78a-478f-a150-66ad3a1393ea","Type":"ContainerStarted","Data":"cadddd5085a1ca0c7407a946c8e391c3e9eb8dc19d70436fb8e47382320f6b2c"} Jul 10 01:13:20.259856 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:20.259824 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d" event={"ID":"65145fe3-c78a-478f-a150-66ad3a1393ea","Type":"ContainerStarted","Data":"2e3cb1f2671b7035ea3390b9172cde943a961720dd6f8855d28ba7cf716c33c0"} Jul 10 01:13:20.279182 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:20.279136 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d" podStartSLOduration=1.222174081 podStartE2EDuration="2.279118601s" totalImagesPullingTime="1.05694452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:13:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:13:20.278043382 +0000 UTC m=+788.869524581" watchObservedRunningTime="2026-07-10 01:13:20.279118601 +0000 UTC m=+788.870599800" Jul 10 01:13:28.968464 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:28.968422 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d" Jul 10 01:13:28.968848 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:28.968489 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d" Jul 10 01:13:28.980672 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:28.980646 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d" Jul 10 01:13:29.313073 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:29.312996 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7zr2d" Jul 10 01:13:42.340901 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:42.340865 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj"] Jul 10 01:13:42.344159 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:42.344142 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj" Jul 10 01:13:42.346827 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:42.346802 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 10 01:13:42.352808 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:42.352773 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj"] Jul 10 01:13:42.460516 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:42.460483 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dda66dae-d177-4b5f-a427-f8b1aa5a7b91-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qjzbj\" (UID: \"dda66dae-d177-4b5f-a427-f8b1aa5a7b91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj" Jul 10 01:13:42.460669 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:42.460550 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q52w\" (UniqueName: \"kubernetes.io/projected/dda66dae-d177-4b5f-a427-f8b1aa5a7b91-kube-api-access-6q52w\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qjzbj\" (UID: \"dda66dae-d177-4b5f-a427-f8b1aa5a7b91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj" Jul 10 01:13:42.460669 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:42.460583 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dda66dae-d177-4b5f-a427-f8b1aa5a7b91-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qjzbj\" (UID: \"dda66dae-d177-4b5f-a427-f8b1aa5a7b91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj" Jul 10 01:13:42.460669 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:42.460601 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dda66dae-d177-4b5f-a427-f8b1aa5a7b91-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qjzbj\" (UID: \"dda66dae-d177-4b5f-a427-f8b1aa5a7b91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj" Jul 10 01:13:42.460791 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:42.460675 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dda66dae-d177-4b5f-a427-f8b1aa5a7b91-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qjzbj\" (UID: \"dda66dae-d177-4b5f-a427-f8b1aa5a7b91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj" Jul 10 01:13:42.460791 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:42.460714 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dda66dae-d177-4b5f-a427-f8b1aa5a7b91-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qjzbj\" (UID: \"dda66dae-d177-4b5f-a427-f8b1aa5a7b91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj" Jul 10 01:13:42.561296 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:42.561263 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dda66dae-d177-4b5f-a427-f8b1aa5a7b91-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qjzbj\" (UID: \"dda66dae-d177-4b5f-a427-f8b1aa5a7b91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj" Jul 10 01:13:42.561477 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:42.561326 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q52w\" (UniqueName: \"kubernetes.io/projected/dda66dae-d177-4b5f-a427-f8b1aa5a7b91-kube-api-access-6q52w\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qjzbj\" (UID: \"dda66dae-d177-4b5f-a427-f8b1aa5a7b91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj" Jul 10 01:13:42.561477 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:42.561354 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dda66dae-d177-4b5f-a427-f8b1aa5a7b91-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qjzbj\" (UID: \"dda66dae-d177-4b5f-a427-f8b1aa5a7b91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj" Jul 10 01:13:42.561477 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:42.561380 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dda66dae-d177-4b5f-a427-f8b1aa5a7b91-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qjzbj\" (UID: \"dda66dae-d177-4b5f-a427-f8b1aa5a7b91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj" Jul 10 01:13:42.561477 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:42.561430 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dda66dae-d177-4b5f-a427-f8b1aa5a7b91-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qjzbj\" (UID: \"dda66dae-d177-4b5f-a427-f8b1aa5a7b91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj" Jul 10 01:13:42.561477 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:42.561453 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dda66dae-d177-4b5f-a427-f8b1aa5a7b91-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qjzbj\" (UID: \"dda66dae-d177-4b5f-a427-f8b1aa5a7b91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj" Jul 10 01:13:42.561756 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:42.561732 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dda66dae-d177-4b5f-a427-f8b1aa5a7b91-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qjzbj\" (UID: \"dda66dae-d177-4b5f-a427-f8b1aa5a7b91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj" Jul 10 01:13:42.561850 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:42.561827 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dda66dae-d177-4b5f-a427-f8b1aa5a7b91-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qjzbj\" (UID: \"dda66dae-d177-4b5f-a427-f8b1aa5a7b91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj" Jul 10 01:13:42.561892 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:42.561849 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dda66dae-d177-4b5f-a427-f8b1aa5a7b91-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qjzbj\" (UID: \"dda66dae-d177-4b5f-a427-f8b1aa5a7b91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj" Jul 10 01:13:42.563697 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:42.563673 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dda66dae-d177-4b5f-a427-f8b1aa5a7b91-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qjzbj\" (UID: \"dda66dae-d177-4b5f-a427-f8b1aa5a7b91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj" Jul 10 01:13:42.563829 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:42.563812 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dda66dae-d177-4b5f-a427-f8b1aa5a7b91-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qjzbj\" (UID: \"dda66dae-d177-4b5f-a427-f8b1aa5a7b91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj" Jul 10 01:13:42.568811 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:42.568788 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q52w\" (UniqueName: \"kubernetes.io/projected/dda66dae-d177-4b5f-a427-f8b1aa5a7b91-kube-api-access-6q52w\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qjzbj\" (UID: \"dda66dae-d177-4b5f-a427-f8b1aa5a7b91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj" Jul 10 01:13:42.655484 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:42.655386 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj" Jul 10 01:13:42.790725 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:42.790694 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj"] Jul 10 01:13:42.792074 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:13:42.792051 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddda66dae_d177_4b5f_a427_f8b1aa5a7b91.slice/crio-338dabff9caed289794758361c59101acd584e3bd88dab24b0c387d6b26d288f WatchSource:0}: Error finding container 338dabff9caed289794758361c59101acd584e3bd88dab24b0c387d6b26d288f: Status 404 returned error can't find the container with id 338dabff9caed289794758361c59101acd584e3bd88dab24b0c387d6b26d288f Jul 10 01:13:43.369840 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:43.369749 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj" event={"ID":"dda66dae-d177-4b5f-a427-f8b1aa5a7b91","Type":"ContainerStarted","Data":"5ff42efbb145de799773b4780a06877cde9f32ae82735ee7f92ee0d4c4ac0ff9"} Jul 10 01:13:43.369840 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:43.369801 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj" event={"ID":"dda66dae-d177-4b5f-a427-f8b1aa5a7b91","Type":"ContainerStarted","Data":"338dabff9caed289794758361c59101acd584e3bd88dab24b0c387d6b26d288f"} Jul 10 01:13:43.386949 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:43.386892 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj" podStartSLOduration=1.201388439 podStartE2EDuration="1.386875097s" totalImagesPullingTime="185.486658ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:13:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:13:43.385315106 +0000 UTC m=+811.976796308" watchObservedRunningTime="2026-07-10 01:13:43.386875097 +0000 UTC m=+811.978356296" Jul 10 01:13:52.655796 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:52.655762 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj" Jul 10 01:13:52.656347 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:52.655853 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj" Jul 10 01:13:52.668384 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:52.668360 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj" Jul 10 01:13:53.430553 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:13:53.430524 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qjzbj" Jul 10 01:15:12.037463 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:15:12.037375 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsbgv_38689ba6-fbae-4092-b63e-3488ce589912/ovn-acl-logging/0.log" Jul 10 01:15:12.038920 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:15:12.038902 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsbgv_38689ba6-fbae-4092-b63e-3488ce589912/ovn-acl-logging/0.log" Jul 10 01:20:12.065211 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:20:12.065183 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsbgv_38689ba6-fbae-4092-b63e-3488ce589912/ovn-acl-logging/0.log" Jul 10 01:20:12.067633 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:20:12.067614 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsbgv_38689ba6-fbae-4092-b63e-3488ce589912/ovn-acl-logging/0.log" Jul 10 01:25:12.095024 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:25:12.094991 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsbgv_38689ba6-fbae-4092-b63e-3488ce589912/ovn-acl-logging/0.log" Jul 10 01:25:12.098065 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:25:12.098047 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsbgv_38689ba6-fbae-4092-b63e-3488ce589912/ovn-acl-logging/0.log" Jul 10 01:26:58.120664 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:26:58.120631 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-hvmbr_9faf217e-b7d5-417a-9b0c-c07cf4e3b2ce/manager/0.log" Jul 10 01:26:58.660870 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:26:58.660833 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9c74cbdcf-n97p8_0193e26c-a49c-4167-90d6-b98a44ffcf45/manager/0.log" Jul 10 01:26:58.666692 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:26:58.666672 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9c74cbdcf-n97p8_0193e26c-a49c-4167-90d6-b98a44ffcf45/copy-manifests/0.log" Jul 10 01:27:01.146781 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:01.146748 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-r88kj_1f21f226-7331-4f96-a12f-71d01443df63/manager/0.log" Jul 10 01:27:01.551113 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:01.551075 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-f4xcz_615cb2ca-8c1a-4866-a405-2ec892d5f2f9/manager/0.log" Jul 10 01:27:01.824921 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:01.824832 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vzbqh_0aafefa8-4e81-4417-9c1a-7152b9cbf5d9/manager/0.log" Jul 10 01:27:02.228822 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:02.228789 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf42xsg6_376c59ea-dd4d-444c-ac3b-fbe1788bdebd/istio-proxy/0.log" Jul 10 01:27:02.756373 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:02.756346 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cf9lf_4a694bfd-c83e-44d8-98e5-741dca0542b6/istio-proxy/1.log" Jul 10 01:27:03.665365 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:03.665333 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-7zr2d_65145fe3-c78a-478f-a150-66ad3a1393ea/main/0.log" Jul 10 01:27:04.035349 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:04.035322 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-qjzbj_dda66dae-d177-4b5f-a427-f8b1aa5a7b91/main/0.log" Jul 10 01:27:11.600838 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:11.600803 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4d5dw_98691035-8cf9-4daf-b08b-702da9077a5c/global-pull-secret-syncer/0.log" Jul 10 01:27:11.774816 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:11.774786 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pvtp7_76247a4f-c780-4a08-bda6-8e8fc84d6f72/konnectivity-agent/0.log" Jul 10 01:27:11.817610 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:11.817585 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-251.ec2.internal_c24d6c8d9b99ab2f60ec24f7270257cc/haproxy/0.log" Jul 10 01:27:16.884684 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:16.884655 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-r88kj_1f21f226-7331-4f96-a12f-71d01443df63/manager/0.log" Jul 10 01:27:17.031779 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:17.031748 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-f4xcz_615cb2ca-8c1a-4866-a405-2ec892d5f2f9/manager/0.log" Jul 10 01:27:17.104910 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:17.104880 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vzbqh_0aafefa8-4e81-4417-9c1a-7152b9cbf5d9/manager/0.log" Jul 10 01:27:19.114658 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:19.114620 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-4xr95_6d4307e8-f279-4a1b-a2a3-72d28349cceb/cluster-monitoring-operator/0.log" Jul 10 01:27:19.254519 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:19.254489 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-8rvgb_fc106d42-71ca-432d-b6a2-64f37ba4f14c/monitoring-plugin/0.log" Jul 10 01:27:19.290426 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:19.290353 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ttl82_cc600c03-9db7-4ff5-8d20-edd40cea75b6/node-exporter/0.log" Jul 10 01:27:19.313267 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:19.313240 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ttl82_cc600c03-9db7-4ff5-8d20-edd40cea75b6/kube-rbac-proxy/0.log" Jul 10 01:27:19.334444 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:19.334416 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ttl82_cc600c03-9db7-4ff5-8d20-edd40cea75b6/init-textfile/0.log" Jul 10 01:27:19.620522 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:19.620442 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_87dbbaad-687e-468d-b9d0-5026ea79fa05/prometheus/0.log" Jul 10 01:27:19.641015 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:19.640988 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_87dbbaad-687e-468d-b9d0-5026ea79fa05/config-reloader/0.log" Jul 10 01:27:19.662012 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:19.661987 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_87dbbaad-687e-468d-b9d0-5026ea79fa05/thanos-sidecar/0.log" Jul 10 01:27:19.683096 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:19.683066 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_87dbbaad-687e-468d-b9d0-5026ea79fa05/kube-rbac-proxy-web/0.log" Jul 10 01:27:19.703154 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:19.703127 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_87dbbaad-687e-468d-b9d0-5026ea79fa05/kube-rbac-proxy/0.log" Jul 10 01:27:19.724015 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:19.723991 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_87dbbaad-687e-468d-b9d0-5026ea79fa05/kube-rbac-proxy-thanos/0.log" Jul 10 01:27:19.744501 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:19.744476 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_87dbbaad-687e-468d-b9d0-5026ea79fa05/init-config-reloader/0.log" Jul 10 01:27:19.771966 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:19.771939 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-qkjn7_fc07fd1a-981a-4d39-90c1-6b6bc2f02f20/prometheus-operator/0.log" Jul 10 01:27:19.790511 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:19.790483 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-qkjn7_fc07fd1a-981a-4d39-90c1-6b6bc2f02f20/kube-rbac-proxy/0.log" Jul 10 01:27:19.816492 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:19.816464 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-czn6v_c86e5a83-920e-468d-b2c8-ece1d5ee1b20/prometheus-operator-admission-webhook/0.log" Jul 10 01:27:21.173722 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:21.173688 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-kkhf6_ed34c96b-f17b-40b0-88de-639790a23f79/networking-console-plugin/0.log" Jul 10 01:27:22.035458 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:22.035431 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jcgw7/perf-node-gather-daemonset-5h7bs"] Jul 10 01:27:22.038958 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:22.038937 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jcgw7/perf-node-gather-daemonset-5h7bs" Jul 10 01:27:22.041686 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:22.041662 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jcgw7\"/\"openshift-service-ca.crt\"" Jul 10 01:27:22.041821 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:22.041746 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jcgw7\"/\"kube-root-ca.crt\"" Jul 10 01:27:22.042943 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:22.042925 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jcgw7\"/\"default-dockercfg-sk8zq\"" Jul 10 01:27:22.047860 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:22.047838 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jcgw7/perf-node-gather-daemonset-5h7bs"] Jul 10 01:27:22.150361 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:22.150322 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8c7bfbf7-b377-49c7-bac5-970707f43165-proc\") pod \"perf-node-gather-daemonset-5h7bs\" (UID: \"8c7bfbf7-b377-49c7-bac5-970707f43165\") " pod="openshift-must-gather-jcgw7/perf-node-gather-daemonset-5h7bs" Jul 10 01:27:22.150361 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:22.150366 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8c7bfbf7-b377-49c7-bac5-970707f43165-lib-modules\") pod \"perf-node-gather-daemonset-5h7bs\" (UID: \"8c7bfbf7-b377-49c7-bac5-970707f43165\") " pod="openshift-must-gather-jcgw7/perf-node-gather-daemonset-5h7bs" Jul 10 01:27:22.150570 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:22.150463 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c7bfbf7-b377-49c7-bac5-970707f43165-sys\") pod \"perf-node-gather-daemonset-5h7bs\" (UID: \"8c7bfbf7-b377-49c7-bac5-970707f43165\") " pod="openshift-must-gather-jcgw7/perf-node-gather-daemonset-5h7bs" Jul 10 01:27:22.150570 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:22.150497 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ngqb\" (UniqueName: \"kubernetes.io/projected/8c7bfbf7-b377-49c7-bac5-970707f43165-kube-api-access-8ngqb\") pod \"perf-node-gather-daemonset-5h7bs\" (UID: \"8c7bfbf7-b377-49c7-bac5-970707f43165\") " pod="openshift-must-gather-jcgw7/perf-node-gather-daemonset-5h7bs" Jul 10 01:27:22.150670 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:22.150565 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8c7bfbf7-b377-49c7-bac5-970707f43165-podres\") pod \"perf-node-gather-daemonset-5h7bs\" (UID: \"8c7bfbf7-b377-49c7-bac5-970707f43165\") " pod="openshift-must-gather-jcgw7/perf-node-gather-daemonset-5h7bs" Jul 10 01:27:22.251610 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:22.251562 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c7bfbf7-b377-49c7-bac5-970707f43165-sys\") pod \"perf-node-gather-daemonset-5h7bs\" (UID: \"8c7bfbf7-b377-49c7-bac5-970707f43165\") " pod="openshift-must-gather-jcgw7/perf-node-gather-daemonset-5h7bs" Jul 10 01:27:22.251958 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:22.251627 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ngqb\" (UniqueName: \"kubernetes.io/projected/8c7bfbf7-b377-49c7-bac5-970707f43165-kube-api-access-8ngqb\") pod \"perf-node-gather-daemonset-5h7bs\" (UID: \"8c7bfbf7-b377-49c7-bac5-970707f43165\") " pod="openshift-must-gather-jcgw7/perf-node-gather-daemonset-5h7bs" Jul 10 01:27:22.251958 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:22.251681 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c7bfbf7-b377-49c7-bac5-970707f43165-sys\") pod \"perf-node-gather-daemonset-5h7bs\" (UID: \"8c7bfbf7-b377-49c7-bac5-970707f43165\") " pod="openshift-must-gather-jcgw7/perf-node-gather-daemonset-5h7bs" Jul 10 01:27:22.251958 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:22.251697 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8c7bfbf7-b377-49c7-bac5-970707f43165-podres\") pod \"perf-node-gather-daemonset-5h7bs\" (UID: \"8c7bfbf7-b377-49c7-bac5-970707f43165\") " pod="openshift-must-gather-jcgw7/perf-node-gather-daemonset-5h7bs" Jul 10 01:27:22.251958 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:22.251750 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8c7bfbf7-b377-49c7-bac5-970707f43165-proc\") pod \"perf-node-gather-daemonset-5h7bs\" (UID: \"8c7bfbf7-b377-49c7-bac5-970707f43165\") " pod="openshift-must-gather-jcgw7/perf-node-gather-daemonset-5h7bs" Jul 10 01:27:22.251958 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:22.251770 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8c7bfbf7-b377-49c7-bac5-970707f43165-lib-modules\") pod \"perf-node-gather-daemonset-5h7bs\" (UID: \"8c7bfbf7-b377-49c7-bac5-970707f43165\") " pod="openshift-must-gather-jcgw7/perf-node-gather-daemonset-5h7bs" Jul 10 01:27:22.251958 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:22.251822 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8c7bfbf7-b377-49c7-bac5-970707f43165-podres\") pod \"perf-node-gather-daemonset-5h7bs\" (UID: \"8c7bfbf7-b377-49c7-bac5-970707f43165\") " pod="openshift-must-gather-jcgw7/perf-node-gather-daemonset-5h7bs" Jul 10 01:27:22.251958 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:22.251867 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8c7bfbf7-b377-49c7-bac5-970707f43165-proc\") pod \"perf-node-gather-daemonset-5h7bs\" (UID: \"8c7bfbf7-b377-49c7-bac5-970707f43165\") " pod="openshift-must-gather-jcgw7/perf-node-gather-daemonset-5h7bs" Jul 10 01:27:22.251958 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:22.251917 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8c7bfbf7-b377-49c7-bac5-970707f43165-lib-modules\") pod \"perf-node-gather-daemonset-5h7bs\" (UID: \"8c7bfbf7-b377-49c7-bac5-970707f43165\") " pod="openshift-must-gather-jcgw7/perf-node-gather-daemonset-5h7bs" Jul 10 01:27:22.259828 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:22.259801 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ngqb\" (UniqueName: \"kubernetes.io/projected/8c7bfbf7-b377-49c7-bac5-970707f43165-kube-api-access-8ngqb\") pod \"perf-node-gather-daemonset-5h7bs\" (UID: \"8c7bfbf7-b377-49c7-bac5-970707f43165\") " pod="openshift-must-gather-jcgw7/perf-node-gather-daemonset-5h7bs" Jul 10 01:27:22.325415 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:22.325331 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-hccf2_d15d572c-b4d2-482e-8fb9-38977eac71e8/download-server/0.log" Jul 10 01:27:22.348995 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:22.348969 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jcgw7/perf-node-gather-daemonset-5h7bs" Jul 10 01:27:22.491442 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:22.491413 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jcgw7/perf-node-gather-daemonset-5h7bs"] Jul 10 01:27:22.494095 ip-10-0-138-251 kubenswrapper[2554]: W0710 01:27:22.494069 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8c7bfbf7_b377_49c7_bac5_970707f43165.slice/crio-3f7f80678cd42d9f910932b30437a5e236e6cd95ffe18b16f884b7ac26f7a746 WatchSource:0}: Error finding container 3f7f80678cd42d9f910932b30437a5e236e6cd95ffe18b16f884b7ac26f7a746: Status 404 returned error can't find the container with id 3f7f80678cd42d9f910932b30437a5e236e6cd95ffe18b16f884b7ac26f7a746 Jul 10 01:27:22.927023 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:22.926941 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-ldnt9_eff54e11-2617-4e1f-b8e4-32ab3499b5d4/volume-data-source-validator/0.log" Jul 10 01:27:23.331936 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:23.331895 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jcgw7/perf-node-gather-daemonset-5h7bs" event={"ID":"8c7bfbf7-b377-49c7-bac5-970707f43165","Type":"ContainerStarted","Data":"ce5625ea54c43ad469f0b60a77a7be292b29bddc14b772e01b03c2e598042ac6"} Jul 10 01:27:23.332373 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:23.331956 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jcgw7/perf-node-gather-daemonset-5h7bs" event={"ID":"8c7bfbf7-b377-49c7-bac5-970707f43165","Type":"ContainerStarted","Data":"3f7f80678cd42d9f910932b30437a5e236e6cd95ffe18b16f884b7ac26f7a746"} Jul 10 01:27:23.332373 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:23.332098 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jcgw7/perf-node-gather-daemonset-5h7bs" Jul 10 01:27:23.348585 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:23.348534 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jcgw7/perf-node-gather-daemonset-5h7bs" podStartSLOduration=1.348519576 podStartE2EDuration="1.348519576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 01:27:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:27:23.346960558 +0000 UTC m=+1631.938441774" watchObservedRunningTime="2026-07-10 01:27:23.348519576 +0000 UTC m=+1631.940000775" Jul 10 01:27:23.902119 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:23.902090 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b4kzz_666a82b2-f068-427d-8a98-6380178c6be9/dns/0.log" Jul 10 01:27:23.922260 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:23.922206 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b4kzz_666a82b2-f068-427d-8a98-6380178c6be9/kube-rbac-proxy/0.log" Jul 10 01:27:24.082793 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:24.082760 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tc8jw_09043fd5-e2a5-493e-82b8-f0ac9fa1f99b/dns-node-resolver/0.log" Jul 10 01:27:24.642880 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:24.642845 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-thhvj_be8fc9c0-d919-4435-bc77-ddd249ad1a3c/node-ca/0.log" Jul 10 01:27:25.561727 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:25.561699 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf42xsg6_376c59ea-dd4d-444c-ac3b-fbe1788bdebd/istio-proxy/0.log" Jul 10 01:27:25.683133 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:25.683096 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cf9lf_4a694bfd-c83e-44d8-98e5-741dca0542b6/istio-proxy/0.log" Jul 10 01:27:25.699044 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:25.699016 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cf9lf_4a694bfd-c83e-44d8-98e5-741dca0542b6/istio-proxy/1.log" Jul 10 01:27:26.360959 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:26.360933 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7q7jk_77c25259-df3b-478e-ba40-7aa97d674ac3/serve-healthcheck-canary/0.log" Jul 10 01:27:27.257913 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:27.257887 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xt5hg_0562244a-ce25-4bce-974e-c2c868371830/kube-rbac-proxy/0.log" Jul 10 01:27:27.286124 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:27.286093 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xt5hg_0562244a-ce25-4bce-974e-c2c868371830/exporter/0.log" Jul 10 01:27:27.310080 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:27.310056 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xt5hg_0562244a-ce25-4bce-974e-c2c868371830/extractor/0.log" Jul 10 01:27:29.346438 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:29.346411 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jcgw7/perf-node-gather-daemonset-5h7bs" Jul 10 01:27:29.407961 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:29.407928 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-hvmbr_9faf217e-b7d5-417a-9b0c-c07cf4e3b2ce/manager/0.log" Jul 10 01:27:29.536335 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:29.536304 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9c74cbdcf-n97p8_0193e26c-a49c-4167-90d6-b98a44ffcf45/manager/0.log" Jul 10 01:27:29.555696 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:29.555671 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9c74cbdcf-n97p8_0193e26c-a49c-4167-90d6-b98a44ffcf45/copy-manifests/0.log" Jul 10 01:27:30.899617 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:30.899542 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7476f9c699-xz7jl_047f61be-da93-4836-bc15-6541cbe48b4a/manager/0.log" Jul 10 01:27:32.383653 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:32.383567 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf42xsg6_376c59ea-dd4d-444c-ac3b-fbe1788bdebd/istio-proxy/0.log" Jul 10 01:27:32.473526 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:32.473501 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cf9lf_4a694bfd-c83e-44d8-98e5-741dca0542b6/istio-proxy/0.log" Jul 10 01:27:32.493408 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:32.493379 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cf9lf_4a694bfd-c83e-44d8-98e5-741dca0542b6/istio-proxy/1.log" Jul 10 01:27:33.681459 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:33.681427 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf42xsg6_376c59ea-dd4d-444c-ac3b-fbe1788bdebd/istio-proxy/0.log" Jul 10 01:27:33.787552 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:33.787518 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cf9lf_4a694bfd-c83e-44d8-98e5-741dca0542b6/istio-proxy/0.log" Jul 10 01:27:33.802191 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:33.802154 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cf9lf_4a694bfd-c83e-44d8-98e5-741dca0542b6/istio-proxy/1.log" Jul 10 01:27:36.139916 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:36.139885 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-h4fjh_43134e21-e995-46c1-9af7-66d814cf5f8a/migrator/0.log" Jul 10 01:27:36.158929 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:36.158898 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-h4fjh_43134e21-e995-46c1-9af7-66d814cf5f8a/graceful-termination/0.log" Jul 10 01:27:36.517703 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:36.517674 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-6xm9b_92d12b46-a0b8-4a61-a518-9bd36ca219cf/kube-storage-version-migrator-operator/1.log" Jul 10 01:27:36.518477 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:36.518461 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-6xm9b_92d12b46-a0b8-4a61-a518-9bd36ca219cf/kube-storage-version-migrator-operator/0.log" Jul 10 01:27:37.566881 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:37.566853 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-29q6p_17e4d0c0-a003-495f-bca4-4fbfbe95b5fb/kube-multus/0.log" Jul 10 01:27:37.592560 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:37.592529 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5c4qd_975dd67f-4a1f-42b9-88b0-8270b032f818/kube-multus-additional-cni-plugins/0.log" Jul 10 01:27:37.616677 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:37.616645 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5c4qd_975dd67f-4a1f-42b9-88b0-8270b032f818/egress-router-binary-copy/0.log" Jul 10 01:27:37.650732 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:37.650704 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5c4qd_975dd67f-4a1f-42b9-88b0-8270b032f818/cni-plugins/0.log" Jul 10 01:27:37.670923 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:37.670898 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5c4qd_975dd67f-4a1f-42b9-88b0-8270b032f818/bond-cni-plugin/0.log" Jul 10 01:27:37.692661 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:37.692633 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5c4qd_975dd67f-4a1f-42b9-88b0-8270b032f818/routeoverride-cni/0.log" Jul 10 01:27:37.712390 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:37.712362 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5c4qd_975dd67f-4a1f-42b9-88b0-8270b032f818/whereabouts-cni-bincopy/0.log" Jul 10 01:27:37.733953 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:37.733925 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5c4qd_975dd67f-4a1f-42b9-88b0-8270b032f818/whereabouts-cni/0.log" Jul 10 01:27:38.155991 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:38.155960 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qx5ln_e76bc68e-d074-4131-8788-bfb781cc785a/network-metrics-daemon/0.log" Jul 10 01:27:38.173806 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:38.173775 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qx5ln_e76bc68e-d074-4131-8788-bfb781cc785a/kube-rbac-proxy/0.log" Jul 10 01:27:39.361456 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:39.361407 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsbgv_38689ba6-fbae-4092-b63e-3488ce589912/ovn-controller/0.log" Jul 10 01:27:39.380019 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:39.379993 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsbgv_38689ba6-fbae-4092-b63e-3488ce589912/ovn-acl-logging/1.log" Jul 10 01:27:39.380205 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:39.380097 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsbgv_38689ba6-fbae-4092-b63e-3488ce589912/ovn-acl-logging/0.log" Jul 10 01:27:39.401566 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:39.401537 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsbgv_38689ba6-fbae-4092-b63e-3488ce589912/kube-rbac-proxy-node/0.log" Jul 10 01:27:39.420861 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:39.420834 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsbgv_38689ba6-fbae-4092-b63e-3488ce589912/kube-rbac-proxy-ovn-metrics/0.log" Jul 10 01:27:39.437934 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:39.437900 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsbgv_38689ba6-fbae-4092-b63e-3488ce589912/northd/0.log" Jul 10 01:27:39.461730 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:39.461702 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsbgv_38689ba6-fbae-4092-b63e-3488ce589912/nbdb/0.log" Jul 10 01:27:39.482064 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:39.482037 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsbgv_38689ba6-fbae-4092-b63e-3488ce589912/sbdb/0.log" Jul 10 01:27:39.523319 ip-10-0-138-251 kubenswrapper[2554]: I0710 01:27:39.523288 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsbgv_38689ba6-fbae-4092-b63e-3488ce589912/ovnkube-controller/0.log"