Jul 24 14:34:22.330538 ip-10-0-140-149 systemd[1]: Starting Kubernetes Kubelet... Jul 24 14:34:22.763293 ip-10-0-140-149 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 14:34:22.763293 ip-10-0-140-149 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 24 14:34:22.763293 ip-10-0-140-149 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 14:34:22.763293 ip-10-0-140-149 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 24 14:34:22.763293 ip-10-0-140-149 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 14:34:22.764284 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.764179 2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 24 14:34:22.768830 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768810 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 14:34:22.768830 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768827 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 14:34:22.768830 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768832 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 14:34:22.768830 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768837 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 14:34:22.769082 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768841 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 14:34:22.769082 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768846 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 14:34:22.769082 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768850 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 14:34:22.769082 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768855 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 14:34:22.769082 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768859 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 14:34:22.769082 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768862 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 14:34:22.769082 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768866 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 14:34:22.769082 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768870 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 14:34:22.769082 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768873 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 14:34:22.769082 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768877 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 14:34:22.769082 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768882 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 14:34:22.769082 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768886 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 14:34:22.769082 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768891 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 14:34:22.769082 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768894 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 14:34:22.769082 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768898 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 14:34:22.769082 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768902 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 14:34:22.769082 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768906 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 14:34:22.769082 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768910 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 14:34:22.769082 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768914 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 14:34:22.769082 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768918 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 14:34:22.769730 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768922 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 14:34:22.769730 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768926 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 14:34:22.769730 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768930 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 14:34:22.769730 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768934 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 14:34:22.769730 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768938 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 14:34:22.769730 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768943 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 14:34:22.769730 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768947 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 14:34:22.769730 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768951 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 14:34:22.769730 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768955 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 14:34:22.769730 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768959 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 14:34:22.769730 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768963 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 14:34:22.769730 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768967 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 14:34:22.769730 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768972 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 14:34:22.769730 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768976 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 14:34:22.769730 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768981 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 14:34:22.769730 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768985 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 14:34:22.769730 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768990 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 14:34:22.769730 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768995 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 14:34:22.769730 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.768999 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 14:34:22.769730 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769003 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 14:34:22.770260 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769007 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 14:34:22.770260 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769011 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 14:34:22.770260 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769016 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 14:34:22.770260 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769020 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 14:34:22.770260 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769024 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 14:34:22.770260 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769028 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 14:34:22.770260 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769032 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 14:34:22.770260 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769036 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 14:34:22.770260 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769041 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 14:34:22.770260 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769045 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 14:34:22.770260 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769050 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 14:34:22.770260 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769054 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 14:34:22.770260 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769058 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 14:34:22.770260 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769063 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 14:34:22.770260 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769069 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 14:34:22.770260 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769073 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 14:34:22.770260 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769078 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 14:34:22.770260 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769082 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 14:34:22.770260 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769086 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 14:34:22.770260 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769090 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 14:34:22.770802 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769094 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 14:34:22.770802 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769098 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 14:34:22.770802 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769103 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 14:34:22.770802 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769107 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 14:34:22.770802 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769112 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 14:34:22.770802 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769117 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 14:34:22.770802 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769122 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 14:34:22.770802 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769126 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 14:34:22.770802 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769133 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 14:34:22.770802 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769140 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 14:34:22.770802 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769145 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 24 14:34:22.770802 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769150 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 14:34:22.770802 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769155 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 14:34:22.770802 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769159 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 14:34:22.770802 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769163 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 14:34:22.770802 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769167 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 14:34:22.770802 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769172 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 14:34:22.770802 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769177 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 14:34:22.770802 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769181 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 14:34:22.771275 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769185 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 14:34:22.771275 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769192 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 14:34:22.771275 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769197 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 14:34:22.771275 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769203 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 14:34:22.771275 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769209 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 14:34:22.771275 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769267 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 14:34:22.771275 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769276 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 14:34:22.771275 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769283 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 14:34:22.771275 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769288 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 14:34:22.771275 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769293 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 14:34:22.771275 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769298 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 14:34:22.771275 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769303 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 14:34:22.771275 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769307 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 14:34:22.771275 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769312 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 14:34:22.771275 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769317 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 14:34:22.771275 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.769321 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 14:34:22.772359 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772342 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 14:34:22.772359 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772355 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 14:34:22.772359 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772360 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 14:34:22.772359 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772364 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 14:34:22.772595 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772368 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 14:34:22.772595 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772374 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 14:34:22.772595 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772378 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 14:34:22.772595 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772382 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 14:34:22.772595 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772388 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 14:34:22.772595 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772393 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 14:34:22.772595 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772398 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 14:34:22.772595 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772402 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 14:34:22.772595 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772406 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 14:34:22.772595 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772410 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 14:34:22.772595 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772413 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 14:34:22.772595 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772418 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 14:34:22.772595 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772422 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 14:34:22.772595 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772426 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 14:34:22.772595 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772430 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 14:34:22.772595 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772434 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 14:34:22.772595 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772438 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 14:34:22.772595 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772442 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 14:34:22.772595 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772446 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 14:34:22.773394 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772450 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 14:34:22.773394 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772454 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 14:34:22.773394 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772457 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 14:34:22.773394 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772462 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 14:34:22.773394 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772465 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 14:34:22.773394 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772469 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 14:34:22.773394 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772473 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 14:34:22.773394 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772478 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 14:34:22.773394 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772482 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 14:34:22.773394 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772488 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 14:34:22.773394 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772492 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 14:34:22.773394 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772497 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 14:34:22.773394 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772501 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 14:34:22.773394 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772505 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 14:34:22.773394 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772510 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 14:34:22.773394 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772514 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 14:34:22.773394 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772519 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 14:34:22.773394 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772524 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 14:34:22.773394 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772528 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 14:34:22.773394 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772532 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 14:34:22.774217 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772537 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 14:34:22.774217 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772541 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 14:34:22.774217 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772545 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 14:34:22.774217 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772549 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 14:34:22.774217 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772553 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 14:34:22.774217 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772557 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 14:34:22.774217 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772562 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 14:34:22.774217 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772566 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 14:34:22.774217 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772570 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 14:34:22.774217 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772575 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 14:34:22.774217 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772579 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 14:34:22.774217 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772583 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 14:34:22.774217 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772587 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 14:34:22.774217 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772591 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 14:34:22.774217 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772595 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 14:34:22.774217 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772599 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 14:34:22.774217 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772603 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 14:34:22.774217 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772607 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 14:34:22.774217 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772611 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 14:34:22.774217 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772615 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 14:34:22.774899 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772619 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 24 14:34:22.774899 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772623 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 14:34:22.774899 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772627 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 14:34:22.774899 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772631 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 14:34:22.774899 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772636 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 14:34:22.774899 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772640 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 14:34:22.774899 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772645 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 14:34:22.774899 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772649 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 14:34:22.774899 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772653 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 14:34:22.774899 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772659 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 14:34:22.774899 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772665 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 14:34:22.774899 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772670 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 14:34:22.774899 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772674 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 14:34:22.774899 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772679 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 14:34:22.774899 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772683 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 14:34:22.774899 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772688 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 14:34:22.774899 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772692 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 14:34:22.774899 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772696 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 14:34:22.774899 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772700 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 14:34:22.775397 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772704 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 14:34:22.775397 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772711 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 14:34:22.775397 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772717 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 14:34:22.775397 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772723 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 14:34:22.775397 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772727 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 14:34:22.775397 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772731 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 14:34:22.775397 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772735 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 14:34:22.775397 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772739 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 14:34:22.775397 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772743 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 14:34:22.775397 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772748 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 14:34:22.775397 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772752 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 14:34:22.775397 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772756 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 14:34:22.775397 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772760 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 14:34:22.775397 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772764 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 14:34:22.775397 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772769 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 14:34:22.775397 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772773 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 14:34:22.775397 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.772777 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 14:34:22.775397 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774210 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 14:34:22.775397 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774248 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 14:34:22.775861 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774255 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 14:34:22.775861 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774262 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 14:34:22.775861 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774266 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 14:34:22.775861 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774273 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 14:34:22.775861 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774295 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 14:34:22.775861 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774298 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 14:34:22.775861 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774421 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 14:34:22.775861 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774426 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 14:34:22.775861 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774429 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 14:34:22.775861 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774432 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 14:34:22.775861 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774435 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 14:34:22.775861 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774438 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 14:34:22.775861 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774441 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 14:34:22.775861 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774444 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 14:34:22.775861 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774446 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 14:34:22.775861 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774450 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 14:34:22.775861 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774453 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 14:34:22.775861 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774455 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 14:34:22.775861 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774458 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 14:34:22.776426 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774461 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 14:34:22.776426 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774463 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 14:34:22.776426 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774466 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 14:34:22.776426 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774468 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 14:34:22.776426 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774471 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 14:34:22.776426 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774474 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 14:34:22.776426 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774476 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 14:34:22.776426 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774479 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 14:34:22.776426 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774481 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 14:34:22.776426 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774484 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 14:34:22.776426 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774487 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 14:34:22.776426 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774490 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 14:34:22.776426 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774496 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 14:34:22.776426 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774500 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 14:34:22.776426 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774502 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 14:34:22.776426 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774505 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 14:34:22.776426 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774508 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 14:34:22.776426 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774511 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 14:34:22.776426 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774513 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 14:34:22.776426 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774516 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 14:34:22.776918 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774519 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 14:34:22.776918 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774521 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 14:34:22.776918 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774524 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 14:34:22.776918 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774527 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 14:34:22.776918 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774529 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 14:34:22.776918 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774532 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 14:34:22.776918 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774534 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 14:34:22.776918 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774537 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 14:34:22.776918 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774540 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 14:34:22.776918 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774542 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 14:34:22.776918 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774545 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 14:34:22.776918 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774548 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 14:34:22.776918 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774550 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 14:34:22.776918 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774553 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 14:34:22.776918 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774555 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 14:34:22.776918 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774558 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 14:34:22.776918 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774560 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 14:34:22.776918 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774566 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 14:34:22.776918 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774571 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 14:34:22.776918 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774574 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 14:34:22.777477 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774577 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 14:34:22.777477 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774580 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 14:34:22.777477 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774582 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 14:34:22.777477 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774586 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 14:34:22.777477 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774589 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 14:34:22.777477 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774594 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 14:34:22.777477 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774597 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 14:34:22.777477 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774600 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 14:34:22.777477 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774603 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 14:34:22.777477 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774606 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 14:34:22.777477 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774609 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 14:34:22.777477 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774612 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 14:34:22.777477 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774615 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 14:34:22.777477 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774618 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 14:34:22.777477 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774620 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 14:34:22.777477 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774623 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 14:34:22.777477 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774626 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 14:34:22.777477 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774628 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 14:34:22.777477 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774631 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 14:34:22.777936 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774633 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 14:34:22.777936 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774636 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 14:34:22.777936 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774640 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 24 14:34:22.777936 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774643 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 14:34:22.777936 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774646 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 14:34:22.777936 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774648 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 14:34:22.777936 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774651 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 14:34:22.777936 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774654 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 14:34:22.777936 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774656 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 14:34:22.777936 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774659 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 14:34:22.777936 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774662 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 14:34:22.777936 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774665 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 14:34:22.777936 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774667 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 14:34:22.777936 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774670 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 14:34:22.777936 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774673 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 14:34:22.777936 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774675 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 14:34:22.777936 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774678 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 14:34:22.777936 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774680 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 14:34:22.777936 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.774683 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 14:34:22.777936 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774754 2582 flags.go:64] FLAG: --address="0.0.0.0" Jul 24 14:34:22.777936 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774761 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 24 14:34:22.778464 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774768 2582 flags.go:64] FLAG: --anonymous-auth="true" Jul 24 14:34:22.778464 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774772 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 24 14:34:22.778464 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774779 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 24 14:34:22.778464 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774783 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 24 14:34:22.778464 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774787 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 24 14:34:22.778464 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774791 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 24 14:34:22.778464 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774794 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 24 14:34:22.778464 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774798 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 24 14:34:22.778464 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774801 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 24 14:34:22.778464 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774805 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 24 14:34:22.778464 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774824 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 24 14:34:22.778464 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774827 2582 flags.go:64] FLAG: --cgroup-root="" Jul 24 14:34:22.778464 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774831 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 24 14:34:22.778464 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774834 2582 flags.go:64] FLAG: --client-ca-file="" Jul 24 14:34:22.778464 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774837 2582 flags.go:64] FLAG: --cloud-provider="external" Jul 24 14:34:22.778464 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774841 2582 flags.go:64] FLAG: --cluster-dns="[]" Jul 24 14:34:22.778464 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774846 2582 flags.go:64] FLAG: --cluster-domain="" Jul 24 14:34:22.778464 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774849 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 24 14:34:22.778464 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774852 2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 24 14:34:22.778464 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774855 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 24 14:34:22.778464 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774858 2582 flags.go:64] FLAG: --container-log-max-files="5" Jul 24 14:34:22.778464 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774862 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 24 14:34:22.778464 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774865 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 24 14:34:22.779010 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774869 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 24 14:34:22.779010 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774872 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 24 14:34:22.779010 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774875 2582 flags.go:64] FLAG: --contention-profiling="false" Jul 24 14:34:22.779010 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774878 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 24 14:34:22.779010 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774881 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 24 14:34:22.779010 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774884 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 24 14:34:22.779010 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774887 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 24 14:34:22.779010 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774891 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 24 14:34:22.779010 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774894 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 24 14:34:22.779010 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774897 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 24 14:34:22.779010 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774900 2582 flags.go:64] FLAG: --enable-load-reader="false" Jul 24 14:34:22.779010 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774903 2582 flags.go:64] FLAG: --enable-server="true" Jul 24 14:34:22.779010 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774906 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 24 14:34:22.779010 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774911 2582 flags.go:64] FLAG: --event-burst="100" Jul 24 14:34:22.779010 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774914 2582 flags.go:64] FLAG: --event-qps="50" Jul 24 14:34:22.779010 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774917 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 24 14:34:22.779010 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774920 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 24 14:34:22.779010 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774923 2582 flags.go:64] FLAG: --eviction-hard="" Jul 24 14:34:22.779010 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774926 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 24 14:34:22.779010 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774929 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 24 14:34:22.779010 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774932 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 24 14:34:22.779010 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774935 2582 flags.go:64] FLAG: --eviction-soft="" Jul 24 14:34:22.779010 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774938 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 24 14:34:22.779010 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774941 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 24 14:34:22.779010 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774944 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 24 14:34:22.779686 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774948 2582 flags.go:64] FLAG: --experimental-mounter-path="" Jul 24 14:34:22.779686 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774952 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 24 14:34:22.779686 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774955 2582 flags.go:64] FLAG: --fail-swap-on="true" Jul 24 14:34:22.779686 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774958 2582 flags.go:64] FLAG: --feature-gates="" Jul 24 14:34:22.779686 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774962 2582 flags.go:64] FLAG: --file-check-frequency="20s" Jul 24 14:34:22.779686 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774965 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 24 14:34:22.779686 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774968 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 24 14:34:22.779686 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774971 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 24 14:34:22.779686 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774974 2582 flags.go:64] FLAG: --healthz-port="10248" Jul 24 14:34:22.779686 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774977 2582 flags.go:64] FLAG: --help="false" Jul 24 14:34:22.779686 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774980 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-140-149.ec2.internal" Jul 24 14:34:22.779686 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774984 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 24 14:34:22.779686 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774987 2582 flags.go:64] FLAG: --http-check-frequency="20s" Jul 24 14:34:22.779686 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774990 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 24 14:34:22.779686 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774993 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 24 14:34:22.779686 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.774997 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 24 14:34:22.779686 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775000 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 24 14:34:22.779686 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775002 2582 flags.go:64] FLAG: --image-service-endpoint="" Jul 24 14:34:22.779686 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775005 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 24 14:34:22.779686 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775008 2582 flags.go:64] FLAG: --kube-api-burst="100" Jul 24 14:34:22.779686 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775011 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 24 14:34:22.779686 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775014 2582 flags.go:64] FLAG: --kube-api-qps="50" Jul 24 14:34:22.779686 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775017 2582 flags.go:64] FLAG: --kube-reserved="" Jul 24 14:34:22.779686 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775020 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 24 14:34:22.780286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775023 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 24 14:34:22.780286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775026 2582 flags.go:64] FLAG: --kubelet-cgroups="" Jul 24 14:34:22.780286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775029 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 24 14:34:22.780286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775031 2582 flags.go:64] FLAG: --lock-file="" Jul 24 14:34:22.780286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775034 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 24 14:34:22.780286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775037 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 24 14:34:22.780286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775042 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 24 14:34:22.780286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775047 2582 flags.go:64] FLAG: --log-json-split-stream="false" Jul 24 14:34:22.780286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775050 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 24 14:34:22.780286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775054 2582 flags.go:64] FLAG: --log-text-split-stream="false" Jul 24 14:34:22.780286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775057 2582 flags.go:64] FLAG: --logging-format="text" Jul 24 14:34:22.780286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775060 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 24 14:34:22.780286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775063 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 24 14:34:22.780286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775066 2582 flags.go:64] FLAG: --manifest-url="" Jul 24 14:34:22.780286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775069 2582 flags.go:64] FLAG: --manifest-url-header="" Jul 24 14:34:22.780286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775074 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 24 14:34:22.780286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775077 2582 flags.go:64] FLAG: --max-open-files="1000000" Jul 24 14:34:22.780286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775081 2582 flags.go:64] FLAG: --max-pods="110" Jul 24 14:34:22.780286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775084 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 24 14:34:22.780286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775087 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 24 14:34:22.780286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775090 2582 flags.go:64] FLAG: --memory-manager-policy="None" Jul 24 14:34:22.780286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775093 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 24 14:34:22.780286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775096 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 24 14:34:22.780286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775098 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 24 14:34:22.780286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775102 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 24 14:34:22.780935 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775109 2582 flags.go:64] FLAG: --node-status-max-images="50" Jul 24 14:34:22.780935 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775112 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 24 14:34:22.780935 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775115 2582 flags.go:64] FLAG: --oom-score-adj="-999" Jul 24 14:34:22.780935 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775118 2582 flags.go:64] FLAG: --pod-cidr="" Jul 24 14:34:22.780935 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775121 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 24 14:34:22.780935 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775126 2582 flags.go:64] FLAG: --pod-manifest-path="" Jul 24 14:34:22.780935 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775129 2582 flags.go:64] FLAG: --pod-max-pids="-1" Jul 24 14:34:22.780935 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775132 2582 flags.go:64] FLAG: --pods-per-core="0" Jul 24 14:34:22.780935 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775135 2582 flags.go:64] FLAG: --port="10250" Jul 24 14:34:22.780935 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775138 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 24 14:34:22.780935 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775140 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0789284f48302ae3d" Jul 24 14:34:22.780935 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775144 2582 flags.go:64] FLAG: --qos-reserved="" Jul 24 14:34:22.780935 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775146 2582 flags.go:64] FLAG: --read-only-port="10255" Jul 24 14:34:22.780935 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775150 2582 flags.go:64] FLAG: --register-node="true" Jul 24 14:34:22.780935 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775154 2582 flags.go:64] FLAG: --register-with-taints="" Jul 24 14:34:22.780935 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775158 2582 flags.go:64] FLAG: --registry-burst="10" Jul 24 14:34:22.780935 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775161 2582 flags.go:64] FLAG: --registry-qps="5" Jul 24 14:34:22.780935 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775166 2582 flags.go:64] FLAG: --reserved-cpus="" Jul 24 14:34:22.780935 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775169 2582 flags.go:64] FLAG: --reserved-memory="" Jul 24 14:34:22.780935 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775173 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 24 14:34:22.780935 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775176 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 24 14:34:22.780935 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775179 2582 flags.go:64] FLAG: --rotate-certificates="false" Jul 24 14:34:22.780935 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775182 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 24 14:34:22.780935 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775185 2582 flags.go:64] FLAG: --runonce="false" Jul 24 14:34:22.780935 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775188 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 24 14:34:22.781567 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775191 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 24 14:34:22.781567 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775194 2582 flags.go:64] FLAG: --seccomp-default="false" Jul 24 14:34:22.781567 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775197 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 24 14:34:22.781567 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775199 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 24 14:34:22.781567 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775202 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 24 14:34:22.781567 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775205 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 24 14:34:22.781567 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775208 2582 flags.go:64] FLAG: --storage-driver-password="root" Jul 24 14:34:22.781567 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775211 2582 flags.go:64] FLAG: --storage-driver-secure="false" Jul 24 14:34:22.781567 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775214 2582 flags.go:64] FLAG: --storage-driver-table="stats" Jul 24 14:34:22.781567 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775217 2582 flags.go:64] FLAG: --storage-driver-user="root" Jul 24 14:34:22.781567 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775219 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 24 14:34:22.781567 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775222 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 24 14:34:22.781567 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775225 2582 flags.go:64] FLAG: --system-cgroups="" Jul 24 14:34:22.781567 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775228 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 24 14:34:22.781567 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775247 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 24 14:34:22.781567 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775250 2582 flags.go:64] FLAG: --tls-cert-file="" Jul 24 14:34:22.781567 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775252 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 24 14:34:22.781567 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775257 2582 flags.go:64] FLAG: --tls-min-version="" Jul 24 14:34:22.781567 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775260 2582 flags.go:64] FLAG: --tls-private-key-file="" Jul 24 14:34:22.781567 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775263 2582 flags.go:64] FLAG: --topology-manager-policy="none" Jul 24 14:34:22.781567 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775266 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 24 14:34:22.781567 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775270 2582 flags.go:64] FLAG: --topology-manager-scope="container" Jul 24 14:34:22.781567 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775273 2582 flags.go:64] FLAG: --v="2" Jul 24 14:34:22.781567 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775277 2582 flags.go:64] FLAG: --version="false" Jul 24 14:34:22.781567 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775283 2582 flags.go:64] FLAG: --vmodule="" Jul 24 14:34:22.782184 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775287 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 24 14:34:22.782184 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.775291 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 24 14:34:22.782184 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775403 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 14:34:22.782184 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775407 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 14:34:22.782184 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775410 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 14:34:22.782184 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775413 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 14:34:22.782184 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775417 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 14:34:22.782184 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775422 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 14:34:22.782184 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775425 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 14:34:22.782184 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775428 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 14:34:22.782184 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775431 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 14:34:22.782184 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775434 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 14:34:22.782184 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775438 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 14:34:22.782184 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775441 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 14:34:22.782184 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775443 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 14:34:22.782184 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775447 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 14:34:22.782184 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775449 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 14:34:22.782184 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775452 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 14:34:22.782184 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775454 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 14:34:22.782671 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775457 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 14:34:22.782671 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775460 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 14:34:22.782671 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775462 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 14:34:22.782671 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775465 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 14:34:22.782671 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775467 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 14:34:22.782671 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775470 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 14:34:22.782671 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775473 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 14:34:22.782671 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775475 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 14:34:22.782671 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775478 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 14:34:22.782671 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775482 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 14:34:22.782671 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775484 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 14:34:22.782671 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775487 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 14:34:22.782671 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775491 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 14:34:22.782671 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775493 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 14:34:22.782671 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775497 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 14:34:22.782671 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775499 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 14:34:22.782671 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775502 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 14:34:22.782671 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775504 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 14:34:22.782671 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775507 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 14:34:22.782671 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775510 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 14:34:22.783163 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775513 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 14:34:22.783163 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775515 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 14:34:22.783163 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775518 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 14:34:22.783163 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775520 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 14:34:22.783163 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775523 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 14:34:22.783163 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775526 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 14:34:22.783163 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775528 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 14:34:22.783163 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775531 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 14:34:22.783163 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775533 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 14:34:22.783163 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775536 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 14:34:22.783163 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775539 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 14:34:22.783163 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775541 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 14:34:22.783163 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775544 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 14:34:22.783163 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775546 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 14:34:22.783163 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775549 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 14:34:22.783163 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775551 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 14:34:22.783163 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775554 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 14:34:22.783163 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775556 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 14:34:22.783163 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775559 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 14:34:22.783163 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775561 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 14:34:22.783673 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775565 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 14:34:22.783673 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775570 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 14:34:22.783673 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775573 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 14:34:22.783673 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775576 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 14:34:22.783673 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775580 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 14:34:22.783673 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775583 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 14:34:22.783673 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775585 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 14:34:22.783673 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775589 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 14:34:22.783673 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775591 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 14:34:22.783673 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775594 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 14:34:22.783673 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775597 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 14:34:22.783673 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775599 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 14:34:22.783673 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775602 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 14:34:22.783673 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775604 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 14:34:22.783673 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775607 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 14:34:22.783673 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775610 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 14:34:22.783673 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775612 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 14:34:22.783673 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775615 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 14:34:22.783673 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775617 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 14:34:22.784129 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775620 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 14:34:22.784129 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775622 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 14:34:22.784129 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775625 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 14:34:22.784129 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775627 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 14:34:22.784129 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775629 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 14:34:22.784129 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775632 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 14:34:22.784129 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775635 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 14:34:22.784129 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775637 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 24 14:34:22.784129 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775640 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 14:34:22.784129 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775642 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 14:34:22.784129 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775645 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 14:34:22.784129 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775647 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 14:34:22.784129 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775650 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 14:34:22.784129 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775653 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 14:34:22.784129 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775657 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 14:34:22.784129 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775659 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 14:34:22.784129 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775662 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 14:34:22.784129 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775666 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 14:34:22.784129 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775669 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 14:34:22.784610 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775672 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 14:34:22.784610 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775674 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 14:34:22.784610 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775678 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 14:34:22.784610 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.775680 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 14:34:22.784610 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.776638 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 14:34:22.784610 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.783079 2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 24 14:34:22.784610 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.783094 2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 24 14:34:22.784610 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.783113 2582 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 24 14:34:22.784610 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.783120 2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 24 14:34:22.784610 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783170 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 14:34:22.784610 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783175 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 14:34:22.784610 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783178 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 14:34:22.784610 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783181 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 14:34:22.784610 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783184 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 14:34:22.784610 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783187 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 14:34:22.784980 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783190 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 14:34:22.784980 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783193 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 14:34:22.784980 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783196 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 14:34:22.784980 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783198 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 14:34:22.784980 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783201 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 14:34:22.784980 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783204 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 14:34:22.784980 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783207 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 14:34:22.784980 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783209 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 14:34:22.784980 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783212 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 14:34:22.784980 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783214 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 14:34:22.784980 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783217 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 14:34:22.784980 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783220 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 24 14:34:22.784980 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783223 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 14:34:22.784980 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783226 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 14:34:22.784980 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783229 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 14:34:22.784980 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783231 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 14:34:22.784980 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783249 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 14:34:22.784980 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783252 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 14:34:22.784980 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783255 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 14:34:22.784980 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783258 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 14:34:22.785480 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783260 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 14:34:22.785480 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783263 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 14:34:22.785480 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783265 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 14:34:22.785480 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783269 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 14:34:22.785480 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783272 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 14:34:22.785480 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783275 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 14:34:22.785480 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783277 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 14:34:22.785480 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783280 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 14:34:22.785480 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783283 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 14:34:22.785480 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783285 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 14:34:22.785480 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783288 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 14:34:22.785480 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783290 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 14:34:22.785480 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783293 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 14:34:22.785480 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783296 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 14:34:22.785480 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783298 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 14:34:22.785480 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783301 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 14:34:22.785480 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783303 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 14:34:22.785480 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783306 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 14:34:22.785480 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783308 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 14:34:22.785480 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783311 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 14:34:22.785967 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783314 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 14:34:22.785967 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783316 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 14:34:22.785967 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783319 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 14:34:22.785967 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783322 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 14:34:22.785967 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783325 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 14:34:22.785967 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783327 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 14:34:22.785967 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783331 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 14:34:22.785967 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783335 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 14:34:22.785967 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783338 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 14:34:22.785967 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783340 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 14:34:22.785967 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783343 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 14:34:22.785967 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783346 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 14:34:22.785967 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783348 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 14:34:22.785967 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783351 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 14:34:22.785967 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783353 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 14:34:22.785967 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783356 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 14:34:22.785967 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783360 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 14:34:22.785967 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783362 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 14:34:22.785967 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783365 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 14:34:22.786481 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783368 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 14:34:22.786481 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783370 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 14:34:22.786481 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783373 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 14:34:22.786481 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783376 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 14:34:22.786481 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783379 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 14:34:22.786481 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783381 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 14:34:22.786481 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783384 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 14:34:22.786481 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783386 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 14:34:22.786481 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783389 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 14:34:22.786481 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783391 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 14:34:22.786481 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783394 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 14:34:22.786481 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783396 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 14:34:22.786481 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783398 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 14:34:22.786481 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783401 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 14:34:22.786481 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783404 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 14:34:22.786481 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783406 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 14:34:22.786481 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783409 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 14:34:22.786481 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783412 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 14:34:22.786481 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783415 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 14:34:22.786929 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783418 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 14:34:22.786929 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783420 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 14:34:22.786929 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783424 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 14:34:22.786929 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783428 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 14:34:22.786929 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783431 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 14:34:22.786929 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783434 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 14:34:22.786929 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783436 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 14:34:22.786929 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783439 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 14:34:22.786929 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783442 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 14:34:22.786929 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783445 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 14:34:22.786929 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783448 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 14:34:22.786929 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783451 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 14:34:22.786929 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783455 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 14:34:22.786929 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783458 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 14:34:22.786929 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783461 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 14:34:22.787307 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.783466 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 14:34:22.787307 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783573 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 14:34:22.787307 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783578 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 14:34:22.787307 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783581 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 14:34:22.787307 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783585 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 14:34:22.787307 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783589 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 14:34:22.787307 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783591 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 14:34:22.787307 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783594 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 14:34:22.787307 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783597 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 14:34:22.787307 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783600 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 14:34:22.787307 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783603 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 14:34:22.787307 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783606 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 14:34:22.787307 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783608 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 14:34:22.787307 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783611 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 14:34:22.787644 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783614 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 14:34:22.787644 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783617 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 14:34:22.787644 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783621 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 14:34:22.787644 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783624 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 14:34:22.787644 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783627 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 14:34:22.787644 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783630 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 14:34:22.787644 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783633 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 14:34:22.787644 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783636 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 14:34:22.787644 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783638 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 14:34:22.787644 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783641 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 14:34:22.787644 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783644 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 14:34:22.787644 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783647 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 14:34:22.787644 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783649 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 14:34:22.787644 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783653 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 14:34:22.787644 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783656 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 14:34:22.787644 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783659 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 14:34:22.787644 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783662 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 14:34:22.787644 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783665 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 14:34:22.787644 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783668 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 14:34:22.787644 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783670 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 14:34:22.788121 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783673 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 14:34:22.788121 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783675 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 14:34:22.788121 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783678 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 14:34:22.788121 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783681 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 14:34:22.788121 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783683 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 14:34:22.788121 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783686 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 14:34:22.788121 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783688 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 14:34:22.788121 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783691 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 14:34:22.788121 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783693 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 14:34:22.788121 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783696 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 14:34:22.788121 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783698 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 14:34:22.788121 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783701 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 14:34:22.788121 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783704 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 14:34:22.788121 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783707 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 14:34:22.788121 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783710 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 14:34:22.788121 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783712 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 14:34:22.788121 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783715 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 14:34:22.788121 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783718 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 14:34:22.788121 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783722 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 14:34:22.788121 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783724 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 14:34:22.788678 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783727 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 14:34:22.788678 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783730 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 14:34:22.788678 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783732 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 14:34:22.788678 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783735 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 14:34:22.788678 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783738 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 14:34:22.788678 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783741 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 14:34:22.788678 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783743 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 14:34:22.788678 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783746 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 14:34:22.788678 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783749 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 14:34:22.788678 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783751 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 14:34:22.788678 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783754 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 14:34:22.788678 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783756 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 14:34:22.788678 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783758 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 14:34:22.788678 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783761 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 14:34:22.788678 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783763 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 14:34:22.788678 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783766 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 14:34:22.788678 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783768 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 14:34:22.788678 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783771 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 14:34:22.788678 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783773 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 14:34:22.788678 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783776 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 14:34:22.789147 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783779 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 14:34:22.789147 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783781 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 14:34:22.789147 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783783 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 14:34:22.789147 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783786 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 14:34:22.789147 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783788 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 14:34:22.789147 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783791 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 14:34:22.789147 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783793 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 14:34:22.789147 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783796 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 14:34:22.789147 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783798 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 14:34:22.789147 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783801 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 14:34:22.789147 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783803 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 14:34:22.789147 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783806 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 14:34:22.789147 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783808 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 14:34:22.789147 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783811 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 14:34:22.789147 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783813 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 24 14:34:22.789147 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783815 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 14:34:22.789147 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783818 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 14:34:22.789147 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783821 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 14:34:22.789147 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783823 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 14:34:22.789147 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783826 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 14:34:22.789637 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783828 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 14:34:22.789637 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783831 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 14:34:22.789637 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783834 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 14:34:22.789637 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783836 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 14:34:22.789637 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783838 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 14:34:22.789637 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:22.783841 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 14:34:22.789637 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.783846 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 14:34:22.789637 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.783938 2582 server.go:962] "Client rotation is on, will bootstrap in background" Jul 24 14:34:22.789637 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.785904 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 24 14:34:22.789637 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.787314 2582 server.go:1019] "Starting client certificate rotation" Jul 24 14:34:22.789637 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.787409 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 14:34:22.789637 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.787442 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 14:34:22.790723 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.790710 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 14:34:22.792644 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.792630 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 14:34:22.799300 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.799284 2582 log.go:25] "Validated CRI v1 runtime API" Jul 24 14:34:22.801197 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.801184 2582 log.go:25] "Validated CRI v1 image API" Jul 24 14:34:22.802689 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.802675 2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 24 14:34:22.805754 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.805736 2582 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 dc9c847e-722a-4fb2-bc3b-88bea5eeade9:/dev/nvme0n1p4 ddbb9316-80c3-4edc-9ff7-89bb7e54e509:/dev/nvme0n1p3] Jul 24 14:34:22.805811 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.805753 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 24 14:34:22.811185 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.811078 2582 manager.go:216] Machine: {Timestamp:2026-07-24 14:34:22.810614737 +0000 UTC m=+0.349464255 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100240 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fa1ab86ced1d54e4b2bb19292bd66 SystemUUID:ec2fa1ab-86ce-d1d5-4e4b-2bb19292bd66 BootID:74528f62-b816-4907-aa56-421cd0a09586 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:da:ac:3d:95:45 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:da:ac:3d:95:45 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:66:5c:06:b8:c3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 24 14:34:22.811185 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.811176 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 24 14:34:22.811347 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.811257 2582 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 24 14:34:22.814360 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.814336 2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 24 14:34:22.814489 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.814363 2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-149.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 24 14:34:22.815104 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.815094 2582 topology_manager.go:138] "Creating topology manager with none policy" Jul 24 14:34:22.815140 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.815107 2582 container_manager_linux.go:309] "Creating device plugin manager" Jul 24 14:34:22.815140 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.815114 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 14:34:22.815812 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.815799 2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 14:34:22.816671 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.816661 2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 24 14:34:22.818759 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.818747 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 24 14:34:22.818870 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.818861 2582 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 24 14:34:22.818910 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.818889 2582 kubelet.go:486] "Attempting to sync node with API server" Jul 24 14:34:22.818910 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.818899 2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 24 14:34:22.818964 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.818911 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 24 14:34:22.818964 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.818920 2582 kubelet.go:398] "Adding apiserver pod source" Jul 24 14:34:22.818964 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.818928 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 24 14:34:22.819316 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.819301 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 14:34:22.819366 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.819330 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 14:34:22.819470 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.819448 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 14:34:22.821754 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.821733 2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 24 14:34:22.823604 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.823591 2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 24 14:34:22.823664 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.823622 2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 24 14:34:22.825115 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.825104 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 24 14:34:22.825158 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.825121 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 24 14:34:22.825158 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.825127 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 24 14:34:22.825158 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.825132 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 24 14:34:22.825158 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.825140 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 24 14:34:22.825158 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.825145 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 24 14:34:22.825158 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.825155 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 24 14:34:22.825328 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.825165 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 24 14:34:22.825328 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.825174 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 24 14:34:22.825328 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.825179 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 24 14:34:22.825328 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.825188 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 24 14:34:22.825328 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.825194 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 24 14:34:22.825810 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.825799 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 24 14:34:22.825841 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.825811 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 24 14:34:22.828486 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.828469 2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-149.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 24 14:34:22.828486 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:22.828476 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 24 14:34:22.828591 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:22.828484 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-149.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 24 14:34:22.829022 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.828980 2582 server.go:1268] "Started kubelet" Jul 24 14:34:22.829083 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.829042 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 24 14:34:22.829138 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.829087 2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 24 14:34:22.829188 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.829147 2582 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 24 14:34:22.829776 ip-10-0-140-149 systemd[1]: Started Kubernetes Kubelet. Jul 24 14:34:22.831062 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.831047 2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 24 14:34:22.831882 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.831869 2582 server.go:310] "Adding debug handlers to kubelet server" Jul 24 14:34:22.834946 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:22.833921 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-149.ec2.internal.18c5406cad347fa2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-149.ec2.internal,UID:ip-10-0-140-149.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-149.ec2.internal,},FirstTimestamp:2026-07-24 14:34:22.828814242 +0000 UTC m=+0.367663759,LastTimestamp:2026-07-24 14:34:22.828814242 +0000 UTC m=+0.367663759,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-149.ec2.internal,}" Jul 24 14:34:22.835556 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:22.835533 2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 24 14:34:22.837073 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.837049 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 24 14:34:22.837176 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:22.837128 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-149.ec2.internal\" not found" Jul 24 14:34:22.837176 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.837057 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 24 14:34:22.837995 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.837980 2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 24 14:34:22.838095 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.837920 2582 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 24 14:34:22.838150 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.838099 2582 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 24 14:34:22.838279 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.838265 2582 reconstruct.go:97] "Volume reconstruction finished" Jul 24 14:34:22.838279 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.838279 2582 reconciler.go:29] "Reconciler: start to sync state" Jul 24 14:34:22.838987 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.838966 2582 factory.go:55] Registering systemd factory Jul 24 14:34:22.839062 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.838990 2582 factory.go:223] Registration of the systemd container factory successfully Jul 24 14:34:22.839261 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.839228 2582 factory.go:153] Registering CRI-O factory Jul 24 14:34:22.839322 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.839267 2582 factory.go:223] Registration of the crio container factory successfully Jul 24 14:34:22.839322 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.839318 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 24 14:34:22.839424 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.839344 2582 factory.go:103] Registering Raw factory Jul 24 14:34:22.839424 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.839373 2582 manager.go:1196] Started watching for new ooms in manager Jul 24 14:34:22.839799 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.839782 2582 manager.go:349] Starting recovery of all containers Jul 24 14:34:22.840430 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.840409 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dp4gg" Jul 24 14:34:22.850332 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.849947 2582 manager.go:354] Recovery completed Jul 24 14:34:22.850332 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.849951 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dp4gg" Jul 24 14:34:22.851293 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:22.851266 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 24 14:34:22.851396 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:22.851342 2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-149.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 24 14:34:22.854451 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.854437 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 14:34:22.856179 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.856163 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-149.ec2.internal" event="NodeHasSufficientMemory" Jul 24 14:34:22.856229 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.856194 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-149.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 14:34:22.856229 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.856207 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-149.ec2.internal" event="NodeHasSufficientPID" Jul 24 14:34:22.856804 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.856786 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 24 14:34:22.856804 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.856802 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 24 14:34:22.856922 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.856814 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 14:34:22.856922 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.856818 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 24 14:34:22.857555 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.857539 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-149.ec2.internal" event="NodeHasSufficientMemory" Jul 24 14:34:22.857646 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.857571 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-149.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 14:34:22.857646 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.857585 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-149.ec2.internal" event="NodeHasSufficientPID" Jul 24 14:34:22.858378 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.858367 2582 policy_none.go:49] "None policy: Start" Jul 24 14:34:22.858428 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.858381 2582 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 24 14:34:22.858428 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.858392 2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 24 14:34:22.859315 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.859306 2582 policy_none.go:47] "Start" Jul 24 14:34:22.884866 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.884848 2582 manager.go:337] "Starting Device Plugin manager" Jul 24 14:34:22.885008 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:22.884894 2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 24 14:34:22.885008 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.884908 2582 server.go:87] "Starting device plugin registration server" Jul 24 14:34:22.885227 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.885210 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 24 14:34:22.885349 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.885228 2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 24 14:34:22.885581 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.885425 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 24 14:34:22.886033 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.885750 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 24 14:34:22.886033 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.885960 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 24 14:34:22.886033 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:22.885973 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 24 14:34:22.886033 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:22.886029 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-149.ec2.internal\" not found" Jul 24 14:34:22.985478 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.985451 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 14:34:22.986617 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.986599 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-149.ec2.internal" event="NodeHasSufficientMemory" Jul 24 14:34:22.986700 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.986637 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-149.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 14:34:22.986700 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.986652 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-149.ec2.internal" event="NodeHasSufficientPID" Jul 24 14:34:22.986700 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.986688 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-149.ec2.internal" Jul 24 14:34:22.996818 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:22.996789 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-149.ec2.internal" Jul 24 14:34:22.996818 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:22.996823 2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-149.ec2.internal\": node \"ip-10-0-140-149.ec2.internal\" not found" Jul 24 14:34:23.012683 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:23.012658 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-149.ec2.internal\" not found" Jul 24 14:34:23.030332 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.030227 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 24 14:34:23.031389 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.031374 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 24 14:34:23.031452 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.031416 2582 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 24 14:34:23.031452 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.031440 2582 kubelet.go:2448] "Starting kubelet main sync loop" Jul 24 14:34:23.031545 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:23.031472 2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 24 14:34:23.033647 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.033628 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 14:34:23.112874 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:23.112833 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-149.ec2.internal\" not found" Jul 24 14:34:23.131989 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.131965 2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-149.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-149.ec2.internal"] Jul 24 14:34:23.132054 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.132047 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 14:34:23.133128 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.133112 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-149.ec2.internal" event="NodeHasSufficientMemory" Jul 24 14:34:23.133224 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.133145 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-149.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 14:34:23.133224 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.133159 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-149.ec2.internal" event="NodeHasSufficientPID" Jul 24 14:34:23.134437 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.134424 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 14:34:23.134541 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.134528 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-149.ec2.internal" Jul 24 14:34:23.134583 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.134557 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 14:34:23.135178 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.135161 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-149.ec2.internal" event="NodeHasSufficientMemory" Jul 24 14:34:23.135286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.135186 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-149.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 14:34:23.135286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.135196 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-149.ec2.internal" event="NodeHasSufficientPID" Jul 24 14:34:23.135286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.135202 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-149.ec2.internal" event="NodeHasSufficientMemory" Jul 24 14:34:23.135286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.135224 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-149.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 14:34:23.135286 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.135258 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-149.ec2.internal" event="NodeHasSufficientPID" Jul 24 14:34:23.136511 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.136495 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-149.ec2.internal" Jul 24 14:34:23.136561 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.136522 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 14:34:23.137128 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.137114 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-149.ec2.internal" event="NodeHasSufficientMemory" Jul 24 14:34:23.137189 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.137137 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-149.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 14:34:23.137189 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.137146 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-149.ec2.internal" event="NodeHasSufficientPID" Jul 24 14:34:23.140792 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.140606 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69a77d7e8c6fe38a2fc31e156f740d64-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-149.ec2.internal\" (UID: \"69a77d7e8c6fe38a2fc31e156f740d64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-149.ec2.internal" Jul 24 14:34:23.140859 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.140814 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/50e1130ea2c6a2d58cc431a3aa9c96ce-config\") pod \"kube-apiserver-proxy-ip-10-0-140-149.ec2.internal\" (UID: \"50e1130ea2c6a2d58cc431a3aa9c96ce\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-149.ec2.internal" Jul 24 14:34:23.140859 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.140843 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/69a77d7e8c6fe38a2fc31e156f740d64-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-149.ec2.internal\" (UID: \"69a77d7e8c6fe38a2fc31e156f740d64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-149.ec2.internal" Jul 24 14:34:23.153739 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:23.153718 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-149.ec2.internal\" not found" node="ip-10-0-140-149.ec2.internal" Jul 24 14:34:23.157625 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:23.157610 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-149.ec2.internal\" not found" node="ip-10-0-140-149.ec2.internal" Jul 24 14:34:23.213089 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:23.213068 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-149.ec2.internal\" not found" Jul 24 14:34:23.241719 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.241698 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/50e1130ea2c6a2d58cc431a3aa9c96ce-config\") pod \"kube-apiserver-proxy-ip-10-0-140-149.ec2.internal\" (UID: \"50e1130ea2c6a2d58cc431a3aa9c96ce\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-149.ec2.internal" Jul 24 14:34:23.241800 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.241723 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/69a77d7e8c6fe38a2fc31e156f740d64-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-149.ec2.internal\" (UID: \"69a77d7e8c6fe38a2fc31e156f740d64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-149.ec2.internal" Jul 24 14:34:23.241800 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.241740 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69a77d7e8c6fe38a2fc31e156f740d64-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-149.ec2.internal\" (UID: \"69a77d7e8c6fe38a2fc31e156f740d64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-149.ec2.internal" Jul 24 14:34:23.241800 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.241769 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69a77d7e8c6fe38a2fc31e156f740d64-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-149.ec2.internal\" (UID: \"69a77d7e8c6fe38a2fc31e156f740d64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-149.ec2.internal" Jul 24 14:34:23.241800 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.241783 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/50e1130ea2c6a2d58cc431a3aa9c96ce-config\") pod \"kube-apiserver-proxy-ip-10-0-140-149.ec2.internal\" (UID: \"50e1130ea2c6a2d58cc431a3aa9c96ce\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-149.ec2.internal" Jul 24 14:34:23.241931 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.241797 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/69a77d7e8c6fe38a2fc31e156f740d64-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-149.ec2.internal\" (UID: \"69a77d7e8c6fe38a2fc31e156f740d64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-149.ec2.internal" Jul 24 14:34:23.314027 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:23.313952 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-149.ec2.internal\" not found" Jul 24 14:34:23.414464 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:23.414428 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-149.ec2.internal\" not found" Jul 24 14:34:23.456902 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.456881 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-149.ec2.internal" Jul 24 14:34:23.461701 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.461670 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-149.ec2.internal" Jul 24 14:34:23.514796 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:23.514766 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-149.ec2.internal\" not found" Jul 24 14:34:23.615336 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:23.615269 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-149.ec2.internal\" not found" Jul 24 14:34:23.666061 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.666041 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 14:34:23.716229 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:23.716201 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-149.ec2.internal\" not found" Jul 24 14:34:23.786677 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.786651 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 24 14:34:23.787084 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.786787 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 14:34:23.787084 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.786823 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 14:34:23.816893 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:23.816867 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-149.ec2.internal\" not found" Jul 24 14:34:23.854480 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.854442 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 14:29:22 +0000 UTC" deadline="2028-03-25 13:57:12.571857625 +0000 UTC" Jul 24 14:34:23.854480 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:23.854475 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14639h22m48.717386466s" Jul 24 14:34:23.917111 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:23.917045 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-149.ec2.internal\" not found" Jul 24 14:34:24.000773 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.000746 2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 14:34:24.038016 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.037995 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-149.ec2.internal" Jul 24 14:34:24.048508 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.048489 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 14:34:24.050429 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.050414 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-149.ec2.internal" Jul 24 14:34:24.058311 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.058294 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 14:34:24.083096 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:24.083062 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69a77d7e8c6fe38a2fc31e156f740d64.slice/crio-cc9213c976259b0c9df71e4998b67c12099ee5312b62fcc902ffb9d6a0f9abb8 WatchSource:0}: Error finding container cc9213c976259b0c9df71e4998b67c12099ee5312b62fcc902ffb9d6a0f9abb8: Status 404 returned error can't find the container with id cc9213c976259b0c9df71e4998b67c12099ee5312b62fcc902ffb9d6a0f9abb8 Jul 24 14:34:24.083562 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:24.083541 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50e1130ea2c6a2d58cc431a3aa9c96ce.slice/crio-c3af0d1312ff747ac306f3331db2c02b5fad1f83a3617855891e0be7dafa2ec4 WatchSource:0}: Error finding container c3af0d1312ff747ac306f3331db2c02b5fad1f83a3617855891e0be7dafa2ec4: Status 404 returned error can't find the container with id c3af0d1312ff747ac306f3331db2c02b5fad1f83a3617855891e0be7dafa2ec4 Jul 24 14:34:24.087354 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.087341 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 14:34:24.198195 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.198117 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 14:34:24.820199 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.820160 2582 apiserver.go:52] "Watching apiserver" Jul 24 14:34:24.829469 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.829441 2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 24 14:34:24.830026 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.830003 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-tcdq5","kube-system/konnectivity-agent-zw72w","kube-system/kube-apiserver-proxy-ip-10-0-140-149.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns","openshift-cluster-node-tuning-operator/tuned-lk6j4","openshift-dns/node-resolver-tknp6","openshift-image-registry/node-ca-t646b","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-149.ec2.internal","openshift-multus/multus-2l8k6","openshift-multus/multus-additional-cni-plugins-7t7kr","openshift-multus/network-metrics-daemon-4krzg","openshift-network-diagnostics/network-check-target-lbbkb","openshift-network-operator/iptables-alerter-cd5xg","openshift-ovn-kubernetes/ovnkube-node-xltl7"] Jul 24 14:34:24.832778 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.832754 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:34:24.832881 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:24.832848 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbbkb" podUID="338cf0d2-54e7-43c9-9aa1-f1e1bf494397" Jul 24 14:34:24.834893 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.834854 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cd5xg" Jul 24 14:34:24.837224 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.837187 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 24 14:34:24.837646 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.837478 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 24 14:34:24.837646 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.837571 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6h779\"" Jul 24 14:34:24.837830 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.837691 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 24 14:34:24.837830 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.837716 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 24 14:34:24.838610 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.838588 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t646b" Jul 24 14:34:24.840446 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.840425 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 24 14:34:24.840921 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.840898 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6hlzv\"" Jul 24 14:34:24.841144 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.841129 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns" Jul 24 14:34:24.841428 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.841408 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 24 14:34:24.843118 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.843076 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:24.843693 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.843672 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 24 14:34:24.844176 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.844119 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 24 14:34:24.844532 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.844515 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 24 14:34:24.844625 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.844564 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zhgg5\"" Jul 24 14:34:24.845030 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.845007 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 24 14:34:24.845958 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.845940 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tknp6" Jul 24 14:34:24.848346 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.848321 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:24.848442 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:24.848402 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcdq5" podUID="e8948e1d-72b0-43bd-972d-5767963f2837" Jul 24 14:34:24.850478 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.850458 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2l8k6" Jul 24 14:34:24.850610 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.850591 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-t7zn6\"" Jul 24 14:34:24.850884 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.850866 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 24 14:34:24.850997 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.850976 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5e3482a6-bb70-4341-8efc-b5a022fecccc-iptables-alerter-script\") pod \"iptables-alerter-cd5xg\" (UID: \"5e3482a6-bb70-4341-8efc-b5a022fecccc\") " pod="openshift-network-operator/iptables-alerter-cd5xg" Jul 24 14:34:24.851059 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.851014 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/394bc207-77e9-446d-9dd6-b52551f532af-device-dir\") pod \"aws-ebs-csi-driver-node-pbgns\" (UID: \"394bc207-77e9-446d-9dd6-b52551f532af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns" Jul 24 14:34:24.851107 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.851065 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e3482a6-bb70-4341-8efc-b5a022fecccc-host-slash\") pod \"iptables-alerter-cd5xg\" (UID: \"5e3482a6-bb70-4341-8efc-b5a022fecccc\") " pod="openshift-network-operator/iptables-alerter-cd5xg" Jul 24 14:34:24.851107 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.851090 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d44sg\" (UniqueName: \"kubernetes.io/projected/5e3482a6-bb70-4341-8efc-b5a022fecccc-kube-api-access-d44sg\") pod \"iptables-alerter-cd5xg\" (UID: \"5e3482a6-bb70-4341-8efc-b5a022fecccc\") " pod="openshift-network-operator/iptables-alerter-cd5xg" Jul 24 14:34:24.851202 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.851117 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f51ed1d0-a38c-44c3-83c0-865ce0465977-serviceca\") pod \"node-ca-t646b\" (UID: \"f51ed1d0-a38c-44c3-83c0-865ce0465977\") " pod="openshift-image-registry/node-ca-t646b" Jul 24 14:34:24.851202 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.851141 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv6hp\" (UniqueName: \"kubernetes.io/projected/f51ed1d0-a38c-44c3-83c0-865ce0465977-kube-api-access-pv6hp\") pod \"node-ca-t646b\" (UID: \"f51ed1d0-a38c-44c3-83c0-865ce0465977\") " pod="openshift-image-registry/node-ca-t646b" Jul 24 14:34:24.851202 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.851164 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f51ed1d0-a38c-44c3-83c0-865ce0465977-host\") pod \"node-ca-t646b\" (UID: \"f51ed1d0-a38c-44c3-83c0-865ce0465977\") " pod="openshift-image-registry/node-ca-t646b" Jul 24 14:34:24.851424 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.851399 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 24 14:34:24.851493 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.851472 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 24 14:34:24.851615 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.851561 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/394bc207-77e9-446d-9dd6-b52551f532af-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pbgns\" (UID: \"394bc207-77e9-446d-9dd6-b52551f532af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns" Jul 24 14:34:24.851687 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.851637 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/394bc207-77e9-446d-9dd6-b52551f532af-socket-dir\") pod \"aws-ebs-csi-driver-node-pbgns\" (UID: \"394bc207-77e9-446d-9dd6-b52551f532af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns" Jul 24 14:34:24.851687 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.851667 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/394bc207-77e9-446d-9dd6-b52551f532af-etc-selinux\") pod \"aws-ebs-csi-driver-node-pbgns\" (UID: \"394bc207-77e9-446d-9dd6-b52551f532af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns" Jul 24 14:34:24.851804 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.851701 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-r4r4m\"" Jul 24 14:34:24.851804 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.851703 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/394bc207-77e9-446d-9dd6-b52551f532af-sys-fs\") pod \"aws-ebs-csi-driver-node-pbgns\" (UID: \"394bc207-77e9-446d-9dd6-b52551f532af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns" Jul 24 14:34:24.851804 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.851749 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjnrn\" (UniqueName: \"kubernetes.io/projected/394bc207-77e9-446d-9dd6-b52551f532af-kube-api-access-pjnrn\") pod \"aws-ebs-csi-driver-node-pbgns\" (UID: \"394bc207-77e9-446d-9dd6-b52551f532af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns" Jul 24 14:34:24.851804 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.851781 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25cbv\" (UniqueName: \"kubernetes.io/projected/338cf0d2-54e7-43c9-9aa1-f1e1bf494397-kube-api-access-25cbv\") pod \"network-check-target-lbbkb\" (UID: \"338cf0d2-54e7-43c9-9aa1-f1e1bf494397\") " pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:34:24.852008 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.851805 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/394bc207-77e9-446d-9dd6-b52551f532af-registration-dir\") pod \"aws-ebs-csi-driver-node-pbgns\" (UID: \"394bc207-77e9-446d-9dd6-b52551f532af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns" Jul 24 14:34:24.852008 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.851807 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 24 14:34:24.852818 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.852795 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7t7kr" Jul 24 14:34:24.854400 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.854379 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 24 14:34:24.854528 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.854414 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 24 14:34:24.854833 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.854816 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-n9cjb\"" Jul 24 14:34:24.855082 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.855067 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 24 14:34:24.855247 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.855217 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 24 14:34:24.855654 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.855271 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:24.855654 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:24.855479 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4krzg" podUID="e4f832fe-7318-4ab6-814f-565dee143906" Jul 24 14:34:24.855916 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.855896 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-czmlz\"" Jul 24 14:34:24.856839 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.856814 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 14:34:24.857105 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.857086 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 24 14:34:24.857218 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.857178 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 24 14:34:24.857925 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.857906 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zw72w" Jul 24 14:34:24.860278 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.860181 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:24.860379 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.860340 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 24 14:34:24.860568 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.860533 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-js87p\"" Jul 24 14:34:24.861037 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.860836 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 24 14:34:24.864176 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.864049 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 24 14:34:24.864176 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.864084 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 24 14:34:24.864885 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.864860 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 24 14:34:24.865006 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.864928 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 24 14:34:24.865172 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.865154 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 24 14:34:24.865276 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.865163 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fr55d\"" Jul 24 14:34:24.865276 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.865210 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 24 14:34:24.877704 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.877681 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-t2q5d" Jul 24 14:34:24.886153 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.886134 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-t2q5d" Jul 24 14:34:24.938823 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.938796 2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 24 14:34:24.952656 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952177 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/394bc207-77e9-446d-9dd6-b52551f532af-registration-dir\") pod \"aws-ebs-csi-driver-node-pbgns\" (UID: \"394bc207-77e9-446d-9dd6-b52551f532af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns" Jul 24 14:34:24.952656 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952221 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b887ed95-26ee-4d64-a947-95c991a50bf7-system-cni-dir\") pod \"multus-additional-cni-plugins-7t7kr\" (UID: \"b887ed95-26ee-4d64-a947-95c991a50bf7\") " pod="openshift-multus/multus-additional-cni-plugins-7t7kr" Jul 24 14:34:24.952656 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952290 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-etc-systemd\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:24.952656 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952316 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/394bc207-77e9-446d-9dd6-b52551f532af-device-dir\") pod \"aws-ebs-csi-driver-node-pbgns\" (UID: \"394bc207-77e9-446d-9dd6-b52551f532af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns" Jul 24 14:34:24.952656 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952342 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-cnibin\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:24.952656 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952366 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bt28\" (UniqueName: \"kubernetes.io/projected/b887ed95-26ee-4d64-a947-95c991a50bf7-kube-api-access-2bt28\") pod \"multus-additional-cni-plugins-7t7kr\" (UID: \"b887ed95-26ee-4d64-a947-95c991a50bf7\") " pod="openshift-multus/multus-additional-cni-plugins-7t7kr" Jul 24 14:34:24.952656 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952390 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c682b4d8-97db-4538-931d-93b229e4f2b9-konnectivity-ca\") pod \"konnectivity-agent-zw72w\" (UID: \"c682b4d8-97db-4538-931d-93b229e4f2b9\") " pod="kube-system/konnectivity-agent-zw72w" Jul 24 14:34:24.952656 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952413 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-run-openvswitch\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:24.952656 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952423 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/394bc207-77e9-446d-9dd6-b52551f532af-registration-dir\") pod \"aws-ebs-csi-driver-node-pbgns\" (UID: \"394bc207-77e9-446d-9dd6-b52551f532af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns" Jul 24 14:34:24.952656 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952439 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-log-socket\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:24.952656 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952481 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-ovnkube-config\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:24.952656 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952510 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bhhx\" (UniqueName: \"kubernetes.io/projected/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-kube-api-access-2bhhx\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:24.952656 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952519 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/394bc207-77e9-446d-9dd6-b52551f532af-device-dir\") pod \"aws-ebs-csi-driver-node-pbgns\" (UID: \"394bc207-77e9-446d-9dd6-b52551f532af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns" Jul 24 14:34:24.952656 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952547 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv6hp\" (UniqueName: \"kubernetes.io/projected/f51ed1d0-a38c-44c3-83c0-865ce0465977-kube-api-access-pv6hp\") pod \"node-ca-t646b\" (UID: \"f51ed1d0-a38c-44c3-83c0-865ce0465977\") " pod="openshift-image-registry/node-ca-t646b" Jul 24 14:34:24.952656 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952575 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e8948e1d-72b0-43bd-972d-5767963f2837-kubelet-config\") pod \"global-pull-secret-syncer-tcdq5\" (UID: \"e8948e1d-72b0-43bd-972d-5767963f2837\") " pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:24.952656 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952599 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e8948e1d-72b0-43bd-972d-5767963f2837-dbus\") pod \"global-pull-secret-syncer-tcdq5\" (UID: \"e8948e1d-72b0-43bd-972d-5767963f2837\") " pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:24.953606 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952621 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-system-cni-dir\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:24.953606 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952645 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b887ed95-26ee-4d64-a947-95c991a50bf7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7t7kr\" (UID: \"b887ed95-26ee-4d64-a947-95c991a50bf7\") " pod="openshift-multus/multus-additional-cni-plugins-7t7kr" Jul 24 14:34:24.953606 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952672 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-var-lib-kubelet\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:24.953606 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952694 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-host\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:24.953606 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952716 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-run-systemd\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:24.953606 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952738 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b887ed95-26ee-4d64-a947-95c991a50bf7-cni-binary-copy\") pod \"multus-additional-cni-plugins-7t7kr\" (UID: \"b887ed95-26ee-4d64-a947-95c991a50bf7\") " pod="openshift-multus/multus-additional-cni-plugins-7t7kr" Jul 24 14:34:24.953606 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952759 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-sys\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:24.953606 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952779 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-etc-kubernetes\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:24.953606 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952807 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/394bc207-77e9-446d-9dd6-b52551f532af-socket-dir\") pod \"aws-ebs-csi-driver-node-pbgns\" (UID: \"394bc207-77e9-446d-9dd6-b52551f532af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns" Jul 24 14:34:24.953606 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952835 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/60edbb3f-acb2-4532-af66-76e819c36977-etc-tuned\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:24.953606 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952861 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fplng\" (UniqueName: \"kubernetes.io/projected/e4f832fe-7318-4ab6-814f-565dee143906-kube-api-access-fplng\") pod \"network-metrics-daemon-4krzg\" (UID: \"e4f832fe-7318-4ab6-814f-565dee143906\") " pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:24.953606 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952886 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-systemd-units\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:24.953606 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952911 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-host-run-ovn-kubernetes\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:24.953606 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952937 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25cbv\" (UniqueName: \"kubernetes.io/projected/338cf0d2-54e7-43c9-9aa1-f1e1bf494397-kube-api-access-25cbv\") pod \"network-check-target-lbbkb\" (UID: \"338cf0d2-54e7-43c9-9aa1-f1e1bf494397\") " pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:34:24.953606 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952962 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x944l\" (UniqueName: \"kubernetes.io/projected/c3f9f86d-744c-430f-8188-f23974690f5c-kube-api-access-x944l\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:24.953606 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.952990 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b887ed95-26ee-4d64-a947-95c991a50bf7-os-release\") pod \"multus-additional-cni-plugins-7t7kr\" (UID: \"b887ed95-26ee-4d64-a947-95c991a50bf7\") " pod="openshift-multus/multus-additional-cni-plugins-7t7kr" Jul 24 14:34:24.954506 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953011 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-etc-sysctl-conf\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:24.954506 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953033 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-lib-modules\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:24.954506 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953034 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/394bc207-77e9-446d-9dd6-b52551f532af-socket-dir\") pod \"aws-ebs-csi-driver-node-pbgns\" (UID: \"394bc207-77e9-446d-9dd6-b52551f532af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns" Jul 24 14:34:24.954506 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953054 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4f832fe-7318-4ab6-814f-565dee143906-metrics-certs\") pod \"network-metrics-daemon-4krzg\" (UID: \"e4f832fe-7318-4ab6-814f-565dee143906\") " pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:24.954506 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953077 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-etc-openvswitch\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:24.954506 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953103 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-ovnkube-script-lib\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:24.954506 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953127 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-host-var-lib-cni-multus\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:24.954506 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953178 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-etc-sysctl-d\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:24.954506 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953194 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl6qj\" (UniqueName: \"kubernetes.io/projected/60edbb3f-acb2-4532-af66-76e819c36977-kube-api-access-hl6qj\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:24.954506 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953209 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-env-overrides\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:24.954506 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953223 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-os-release\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:24.954506 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953253 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3f9f86d-744c-430f-8188-f23974690f5c-cni-binary-copy\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:24.954506 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953274 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d44sg\" (UniqueName: \"kubernetes.io/projected/5e3482a6-bb70-4341-8efc-b5a022fecccc-kube-api-access-d44sg\") pod \"iptables-alerter-cd5xg\" (UID: \"5e3482a6-bb70-4341-8efc-b5a022fecccc\") " pod="openshift-network-operator/iptables-alerter-cd5xg" Jul 24 14:34:24.954506 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953290 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f51ed1d0-a38c-44c3-83c0-865ce0465977-serviceca\") pod \"node-ca-t646b\" (UID: \"f51ed1d0-a38c-44c3-83c0-865ce0465977\") " pod="openshift-image-registry/node-ca-t646b" Jul 24 14:34:24.954506 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953305 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-host-var-lib-cni-bin\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:24.954506 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953326 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-host-slash\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:24.954506 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953349 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/394bc207-77e9-446d-9dd6-b52551f532af-sys-fs\") pod \"aws-ebs-csi-driver-node-pbgns\" (UID: \"394bc207-77e9-446d-9dd6-b52551f532af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns" Jul 24 14:34:24.955430 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953469 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjnrn\" (UniqueName: \"kubernetes.io/projected/394bc207-77e9-446d-9dd6-b52551f532af-kube-api-access-pjnrn\") pod \"aws-ebs-csi-driver-node-pbgns\" (UID: \"394bc207-77e9-446d-9dd6-b52551f532af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns" Jul 24 14:34:24.955430 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953510 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-etc-sysconfig\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:24.955430 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953535 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c682b4d8-97db-4538-931d-93b229e4f2b9-agent-certs\") pod \"konnectivity-agent-zw72w\" (UID: \"c682b4d8-97db-4538-931d-93b229e4f2b9\") " pod="kube-system/konnectivity-agent-zw72w" Jul 24 14:34:24.955430 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953476 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/394bc207-77e9-446d-9dd6-b52551f532af-sys-fs\") pod \"aws-ebs-csi-driver-node-pbgns\" (UID: \"394bc207-77e9-446d-9dd6-b52551f532af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns" Jul 24 14:34:24.955430 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953595 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-host-cni-bin\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:24.955430 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953619 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-host-cni-netd\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:24.955430 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953663 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-multus-socket-dir-parent\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:24.955430 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953700 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-etc-kubernetes\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:24.955430 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953733 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n7qh\" (UniqueName: \"kubernetes.io/projected/480812e2-0ab3-4c07-b971-d222f629b250-kube-api-access-4n7qh\") pod \"node-resolver-tknp6\" (UID: \"480812e2-0ab3-4c07-b971-d222f629b250\") " pod="openshift-dns/node-resolver-tknp6" Jul 24 14:34:24.955430 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953760 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-multus-cni-dir\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:24.955430 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953785 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-host-run-multus-certs\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:24.955430 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953809 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8948e1d-72b0-43bd-972d-5767963f2837-original-pull-secret\") pod \"global-pull-secret-syncer-tcdq5\" (UID: \"e8948e1d-72b0-43bd-972d-5767963f2837\") " pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:24.955430 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953843 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-host-var-lib-kubelet\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:24.955430 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953860 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f51ed1d0-a38c-44c3-83c0-865ce0465977-serviceca\") pod \"node-ca-t646b\" (UID: \"f51ed1d0-a38c-44c3-83c0-865ce0465977\") " pod="openshift-image-registry/node-ca-t646b" Jul 24 14:34:24.955430 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953881 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-host-kubelet\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:24.955430 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953902 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-etc-modprobe-d\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:24.955430 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.953971 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-run\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:24.956289 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.954002 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f51ed1d0-a38c-44c3-83c0-865ce0465977-host\") pod \"node-ca-t646b\" (UID: \"f51ed1d0-a38c-44c3-83c0-865ce0465977\") " pod="openshift-image-registry/node-ca-t646b" Jul 24 14:34:24.956289 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.954034 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f51ed1d0-a38c-44c3-83c0-865ce0465977-host\") pod \"node-ca-t646b\" (UID: \"f51ed1d0-a38c-44c3-83c0-865ce0465977\") " pod="openshift-image-registry/node-ca-t646b" Jul 24 14:34:24.956289 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.954049 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/394bc207-77e9-446d-9dd6-b52551f532af-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pbgns\" (UID: \"394bc207-77e9-446d-9dd6-b52551f532af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns" Jul 24 14:34:24.956289 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.954081 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/394bc207-77e9-446d-9dd6-b52551f532af-etc-selinux\") pod \"aws-ebs-csi-driver-node-pbgns\" (UID: \"394bc207-77e9-446d-9dd6-b52551f532af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns" Jul 24 14:34:24.956289 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.954107 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/480812e2-0ab3-4c07-b971-d222f629b250-hosts-file\") pod \"node-resolver-tknp6\" (UID: \"480812e2-0ab3-4c07-b971-d222f629b250\") " pod="openshift-dns/node-resolver-tknp6" Jul 24 14:34:24.956289 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.954132 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-hostroot\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:24.956289 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.954154 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-multus-conf-dir\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:24.956289 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.954157 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/394bc207-77e9-446d-9dd6-b52551f532af-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pbgns\" (UID: \"394bc207-77e9-446d-9dd6-b52551f532af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns" Jul 24 14:34:24.956289 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.954179 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-host-run-k8s-cni-cncf-io\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:24.956289 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.954206 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b887ed95-26ee-4d64-a947-95c991a50bf7-cnibin\") pod \"multus-additional-cni-plugins-7t7kr\" (UID: \"b887ed95-26ee-4d64-a947-95c991a50bf7\") " pod="openshift-multus/multus-additional-cni-plugins-7t7kr" Jul 24 14:34:24.956289 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.954227 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c3f9f86d-744c-430f-8188-f23974690f5c-multus-daemon-config\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:24.956289 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.954266 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-node-log\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:24.956289 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.954289 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-ovn-node-metrics-cert\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:24.956289 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.954316 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5e3482a6-bb70-4341-8efc-b5a022fecccc-iptables-alerter-script\") pod \"iptables-alerter-cd5xg\" (UID: \"5e3482a6-bb70-4341-8efc-b5a022fecccc\") " pod="openshift-network-operator/iptables-alerter-cd5xg" Jul 24 14:34:24.956289 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.954332 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/394bc207-77e9-446d-9dd6-b52551f532af-etc-selinux\") pod \"aws-ebs-csi-driver-node-pbgns\" (UID: \"394bc207-77e9-446d-9dd6-b52551f532af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns" Jul 24 14:34:24.956289 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.954340 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/480812e2-0ab3-4c07-b971-d222f629b250-tmp-dir\") pod \"node-resolver-tknp6\" (UID: \"480812e2-0ab3-4c07-b971-d222f629b250\") " pod="openshift-dns/node-resolver-tknp6" Jul 24 14:34:24.956289 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.954364 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-var-lib-openvswitch\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:24.957142 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.954387 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e3482a6-bb70-4341-8efc-b5a022fecccc-host-slash\") pod \"iptables-alerter-cd5xg\" (UID: \"5e3482a6-bb70-4341-8efc-b5a022fecccc\") " pod="openshift-network-operator/iptables-alerter-cd5xg" Jul 24 14:34:24.957142 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.954410 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-host-run-netns\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:24.957142 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.954432 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60edbb3f-acb2-4532-af66-76e819c36977-tmp\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:24.957142 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.954455 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-host-run-netns\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:24.957142 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.954478 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-run-ovn\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:24.957142 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.954504 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b887ed95-26ee-4d64-a947-95c991a50bf7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7t7kr\" (UID: \"b887ed95-26ee-4d64-a947-95c991a50bf7\") " pod="openshift-multus/multus-additional-cni-plugins-7t7kr" Jul 24 14:34:24.957142 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.954504 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e3482a6-bb70-4341-8efc-b5a022fecccc-host-slash\") pod \"iptables-alerter-cd5xg\" (UID: \"5e3482a6-bb70-4341-8efc-b5a022fecccc\") " pod="openshift-network-operator/iptables-alerter-cd5xg" Jul 24 14:34:24.957142 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.954529 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b887ed95-26ee-4d64-a947-95c991a50bf7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7t7kr\" (UID: \"b887ed95-26ee-4d64-a947-95c991a50bf7\") " pod="openshift-multus/multus-additional-cni-plugins-7t7kr" Jul 24 14:34:24.957142 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.954582 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:24.957142 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.954968 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5e3482a6-bb70-4341-8efc-b5a022fecccc-iptables-alerter-script\") pod \"iptables-alerter-cd5xg\" (UID: \"5e3482a6-bb70-4341-8efc-b5a022fecccc\") " pod="openshift-network-operator/iptables-alerter-cd5xg" Jul 24 14:34:24.964966 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:24.964941 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 14:34:24.964966 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:24.964966 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 14:34:24.965160 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:24.964975 2582 projected.go:196] Error preparing data for projected volume kube-api-access-25cbv for pod openshift-network-diagnostics/network-check-target-lbbkb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:24.965160 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:24.965044 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/338cf0d2-54e7-43c9-9aa1-f1e1bf494397-kube-api-access-25cbv podName:338cf0d2-54e7-43c9-9aa1-f1e1bf494397 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:25.465023444 +0000 UTC m=+3.003872952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-25cbv" (UniqueName: "kubernetes.io/projected/338cf0d2-54e7-43c9-9aa1-f1e1bf494397-kube-api-access-25cbv") pod "network-check-target-lbbkb" (UID: "338cf0d2-54e7-43c9-9aa1-f1e1bf494397") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:24.965403 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.965380 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 24 14:34:24.969571 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.969536 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d44sg\" (UniqueName: \"kubernetes.io/projected/5e3482a6-bb70-4341-8efc-b5a022fecccc-kube-api-access-d44sg\") pod \"iptables-alerter-cd5xg\" (UID: \"5e3482a6-bb70-4341-8efc-b5a022fecccc\") " pod="openshift-network-operator/iptables-alerter-cd5xg" Jul 24 14:34:24.969701 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.969536 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv6hp\" (UniqueName: \"kubernetes.io/projected/f51ed1d0-a38c-44c3-83c0-865ce0465977-kube-api-access-pv6hp\") pod \"node-ca-t646b\" (UID: \"f51ed1d0-a38c-44c3-83c0-865ce0465977\") " pod="openshift-image-registry/node-ca-t646b" Jul 24 14:34:24.969701 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.969541 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjnrn\" (UniqueName: \"kubernetes.io/projected/394bc207-77e9-446d-9dd6-b52551f532af-kube-api-access-pjnrn\") pod \"aws-ebs-csi-driver-node-pbgns\" (UID: \"394bc207-77e9-446d-9dd6-b52551f532af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns" Jul 24 14:34:24.996606 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:24.996580 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 14:34:25.035891 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.035842 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-149.ec2.internal" event={"ID":"50e1130ea2c6a2d58cc431a3aa9c96ce","Type":"ContainerStarted","Data":"c3af0d1312ff747ac306f3331db2c02b5fad1f83a3617855891e0be7dafa2ec4"} Jul 24 14:34:25.036933 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.036905 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-149.ec2.internal" event={"ID":"69a77d7e8c6fe38a2fc31e156f740d64","Type":"ContainerStarted","Data":"cc9213c976259b0c9df71e4998b67c12099ee5312b62fcc902ffb9d6a0f9abb8"} Jul 24 14:34:25.054813 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.054782 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-host-run-netns\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.054925 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.054814 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60edbb3f-acb2-4532-af66-76e819c36977-tmp\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.054925 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.054857 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-host-run-netns\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.054925 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.054879 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-run-ovn\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.054925 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.054897 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b887ed95-26ee-4d64-a947-95c991a50bf7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7t7kr\" (UID: \"b887ed95-26ee-4d64-a947-95c991a50bf7\") " pod="openshift-multus/multus-additional-cni-plugins-7t7kr" Jul 24 14:34:25.054925 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.054910 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-host-run-netns\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.055186 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.054919 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b887ed95-26ee-4d64-a947-95c991a50bf7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7t7kr\" (UID: \"b887ed95-26ee-4d64-a947-95c991a50bf7\") " pod="openshift-multus/multus-additional-cni-plugins-7t7kr" Jul 24 14:34:25.055186 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.054976 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-run-ovn\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.055186 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.054975 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.055186 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055006 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.055186 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055003 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-host-run-netns\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.055186 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055024 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b887ed95-26ee-4d64-a947-95c991a50bf7-system-cni-dir\") pod \"multus-additional-cni-plugins-7t7kr\" (UID: \"b887ed95-26ee-4d64-a947-95c991a50bf7\") " pod="openshift-multus/multus-additional-cni-plugins-7t7kr" Jul 24 14:34:25.055186 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055057 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b887ed95-26ee-4d64-a947-95c991a50bf7-system-cni-dir\") pod \"multus-additional-cni-plugins-7t7kr\" (UID: \"b887ed95-26ee-4d64-a947-95c991a50bf7\") " pod="openshift-multus/multus-additional-cni-plugins-7t7kr" Jul 24 14:34:25.055186 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055060 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-etc-systemd\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.055186 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055087 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-cnibin\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.055186 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055111 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bt28\" (UniqueName: \"kubernetes.io/projected/b887ed95-26ee-4d64-a947-95c991a50bf7-kube-api-access-2bt28\") pod \"multus-additional-cni-plugins-7t7kr\" (UID: \"b887ed95-26ee-4d64-a947-95c991a50bf7\") " pod="openshift-multus/multus-additional-cni-plugins-7t7kr" Jul 24 14:34:25.055186 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055132 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b887ed95-26ee-4d64-a947-95c991a50bf7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7t7kr\" (UID: \"b887ed95-26ee-4d64-a947-95c991a50bf7\") " pod="openshift-multus/multus-additional-cni-plugins-7t7kr" Jul 24 14:34:25.055186 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055142 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-etc-systemd\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.055186 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055135 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c682b4d8-97db-4538-931d-93b229e4f2b9-konnectivity-ca\") pod \"konnectivity-agent-zw72w\" (UID: \"c682b4d8-97db-4538-931d-93b229e4f2b9\") " pod="kube-system/konnectivity-agent-zw72w" Jul 24 14:34:25.055186 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055159 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-cnibin\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.055186 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055190 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-run-openvswitch\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.055948 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055231 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-log-socket\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.055948 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055275 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-run-openvswitch\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.055948 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055268 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-ovnkube-config\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.055948 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055315 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bhhx\" (UniqueName: \"kubernetes.io/projected/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-kube-api-access-2bhhx\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.055948 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055351 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e8948e1d-72b0-43bd-972d-5767963f2837-kubelet-config\") pod \"global-pull-secret-syncer-tcdq5\" (UID: \"e8948e1d-72b0-43bd-972d-5767963f2837\") " pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:25.055948 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055373 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e8948e1d-72b0-43bd-972d-5767963f2837-dbus\") pod \"global-pull-secret-syncer-tcdq5\" (UID: \"e8948e1d-72b0-43bd-972d-5767963f2837\") " pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:25.055948 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055397 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-system-cni-dir\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.055948 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055419 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b887ed95-26ee-4d64-a947-95c991a50bf7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7t7kr\" (UID: \"b887ed95-26ee-4d64-a947-95c991a50bf7\") " pod="openshift-multus/multus-additional-cni-plugins-7t7kr" Jul 24 14:34:25.055948 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055422 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e8948e1d-72b0-43bd-972d-5767963f2837-kubelet-config\") pod \"global-pull-secret-syncer-tcdq5\" (UID: \"e8948e1d-72b0-43bd-972d-5767963f2837\") " pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:25.055948 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055314 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-log-socket\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.055948 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055493 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-system-cni-dir\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.055948 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055535 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b887ed95-26ee-4d64-a947-95c991a50bf7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7t7kr\" (UID: \"b887ed95-26ee-4d64-a947-95c991a50bf7\") " pod="openshift-multus/multus-additional-cni-plugins-7t7kr" Jul 24 14:34:25.055948 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055442 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-var-lib-kubelet\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.055948 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055546 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-var-lib-kubelet\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.055948 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055574 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-host\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.055948 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055595 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-run-systemd\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.055948 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055611 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b887ed95-26ee-4d64-a947-95c991a50bf7-cni-binary-copy\") pod \"multus-additional-cni-plugins-7t7kr\" (UID: \"b887ed95-26ee-4d64-a947-95c991a50bf7\") " pod="openshift-multus/multus-additional-cni-plugins-7t7kr" Jul 24 14:34:25.056788 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055643 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e8948e1d-72b0-43bd-972d-5767963f2837-dbus\") pod \"global-pull-secret-syncer-tcdq5\" (UID: \"e8948e1d-72b0-43bd-972d-5767963f2837\") " pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:25.056788 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055631 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-sys\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.056788 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055665 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c682b4d8-97db-4538-931d-93b229e4f2b9-konnectivity-ca\") pod \"konnectivity-agent-zw72w\" (UID: \"c682b4d8-97db-4538-931d-93b229e4f2b9\") " pod="kube-system/konnectivity-agent-zw72w" Jul 24 14:34:25.056788 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055679 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-run-systemd\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.056788 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055678 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-etc-kubernetes\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.056788 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055723 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-host\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.056788 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055731 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-etc-kubernetes\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.056788 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055761 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/60edbb3f-acb2-4532-af66-76e819c36977-etc-tuned\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.056788 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055769 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-sys\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.056788 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055805 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fplng\" (UniqueName: \"kubernetes.io/projected/e4f832fe-7318-4ab6-814f-565dee143906-kube-api-access-fplng\") pod \"network-metrics-daemon-4krzg\" (UID: \"e4f832fe-7318-4ab6-814f-565dee143906\") " pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:25.056788 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055871 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-ovnkube-config\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.056788 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055922 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-systemd-units\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.056788 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055950 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-host-run-ovn-kubernetes\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.056788 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.055988 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-host-run-ovn-kubernetes\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.056788 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056038 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-systemd-units\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.056788 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056045 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x944l\" (UniqueName: \"kubernetes.io/projected/c3f9f86d-744c-430f-8188-f23974690f5c-kube-api-access-x944l\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.056788 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056069 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b887ed95-26ee-4d64-a947-95c991a50bf7-cni-binary-copy\") pod \"multus-additional-cni-plugins-7t7kr\" (UID: \"b887ed95-26ee-4d64-a947-95c991a50bf7\") " pod="openshift-multus/multus-additional-cni-plugins-7t7kr" Jul 24 14:34:25.056788 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056175 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b887ed95-26ee-4d64-a947-95c991a50bf7-os-release\") pod \"multus-additional-cni-plugins-7t7kr\" (UID: \"b887ed95-26ee-4d64-a947-95c991a50bf7\") " pod="openshift-multus/multus-additional-cni-plugins-7t7kr" Jul 24 14:34:25.057550 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056222 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-etc-sysctl-conf\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.057550 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056267 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-lib-modules\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.057550 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056285 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b887ed95-26ee-4d64-a947-95c991a50bf7-os-release\") pod \"multus-additional-cni-plugins-7t7kr\" (UID: \"b887ed95-26ee-4d64-a947-95c991a50bf7\") " pod="openshift-multus/multus-additional-cni-plugins-7t7kr" Jul 24 14:34:25.057550 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056294 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4f832fe-7318-4ab6-814f-565dee143906-metrics-certs\") pod \"network-metrics-daemon-4krzg\" (UID: \"e4f832fe-7318-4ab6-814f-565dee143906\") " pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:25.057550 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056321 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-etc-openvswitch\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.057550 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056345 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-ovnkube-script-lib\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.057550 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056367 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-etc-sysctl-conf\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.057550 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056368 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-host-var-lib-cni-multus\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.057550 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056405 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-etc-sysctl-d\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.057550 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056416 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-host-var-lib-cni-multus\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.057550 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056430 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-lib-modules\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.057550 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056433 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl6qj\" (UniqueName: \"kubernetes.io/projected/60edbb3f-acb2-4532-af66-76e819c36977-kube-api-access-hl6qj\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.057550 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056470 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-etc-openvswitch\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.057550 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056468 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-env-overrides\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.057550 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056507 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-os-release\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.057550 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056530 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3f9f86d-744c-430f-8188-f23974690f5c-cni-binary-copy\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.057550 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056558 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-host-var-lib-cni-bin\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.057550 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056581 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-host-slash\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.058316 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056607 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-etc-sysconfig\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.058316 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056630 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c682b4d8-97db-4538-931d-93b229e4f2b9-agent-certs\") pod \"konnectivity-agent-zw72w\" (UID: \"c682b4d8-97db-4538-931d-93b229e4f2b9\") " pod="kube-system/konnectivity-agent-zw72w" Jul 24 14:34:25.058316 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056652 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-host-cni-bin\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.058316 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056674 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-host-cni-netd\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.058316 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056683 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b887ed95-26ee-4d64-a947-95c991a50bf7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7t7kr\" (UID: \"b887ed95-26ee-4d64-a947-95c991a50bf7\") " pod="openshift-multus/multus-additional-cni-plugins-7t7kr" Jul 24 14:34:25.058316 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056696 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-multus-socket-dir-parent\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.058316 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056712 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-etc-sysctl-d\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.058316 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056720 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-etc-kubernetes\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.058316 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056745 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n7qh\" (UniqueName: \"kubernetes.io/projected/480812e2-0ab3-4c07-b971-d222f629b250-kube-api-access-4n7qh\") pod \"node-resolver-tknp6\" (UID: \"480812e2-0ab3-4c07-b971-d222f629b250\") " pod="openshift-dns/node-resolver-tknp6" Jul 24 14:34:25.058316 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056765 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-etc-sysconfig\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.058316 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056768 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-multus-cni-dir\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.058316 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056801 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-host-run-multus-certs\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.058316 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056820 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-multus-cni-dir\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.058316 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056829 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8948e1d-72b0-43bd-972d-5767963f2837-original-pull-secret\") pod \"global-pull-secret-syncer-tcdq5\" (UID: \"e8948e1d-72b0-43bd-972d-5767963f2837\") " pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:25.058316 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056852 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-host-var-lib-kubelet\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.058316 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056856 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-host-cni-netd\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.058316 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056867 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-host-kubelet\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.058936 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056883 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-etc-modprobe-d\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.058936 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056905 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-run\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.058936 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056922 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-multus-socket-dir-parent\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.058936 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056931 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/480812e2-0ab3-4c07-b971-d222f629b250-hosts-file\") pod \"node-resolver-tknp6\" (UID: \"480812e2-0ab3-4c07-b971-d222f629b250\") " pod="openshift-dns/node-resolver-tknp6" Jul 24 14:34:25.058936 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056963 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-ovnkube-script-lib\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.058936 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056965 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-etc-kubernetes\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.058936 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056997 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-host-slash\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.058936 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.056951 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-hostroot\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.058936 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.057033 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-multus-conf-dir\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.058936 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.057034 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-host-var-lib-kubelet\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.058936 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.057040 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-env-overrides\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.058936 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.057060 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-host-run-k8s-cni-cncf-io\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.058936 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.057085 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b887ed95-26ee-4d64-a947-95c991a50bf7-cnibin\") pod \"multus-additional-cni-plugins-7t7kr\" (UID: \"b887ed95-26ee-4d64-a947-95c991a50bf7\") " pod="openshift-multus/multus-additional-cni-plugins-7t7kr" Jul 24 14:34:25.058936 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.057089 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-host-var-lib-cni-bin\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.058936 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.057109 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c3f9f86d-744c-430f-8188-f23974690f5c-multus-daemon-config\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.058936 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:25.057121 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:25.058936 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.057137 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-etc-modprobe-d\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.058936 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.057146 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-os-release\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.059618 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:25.057182 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4f832fe-7318-4ab6-814f-565dee143906-metrics-certs podName:e4f832fe-7318-4ab6-814f-565dee143906 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:25.557164975 +0000 UTC m=+3.096014497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4f832fe-7318-4ab6-814f-565dee143906-metrics-certs") pod "network-metrics-daemon-4krzg" (UID: "e4f832fe-7318-4ab6-814f-565dee143906") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:25.059618 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.057184 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-host-cni-bin\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.059618 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.057181 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-host-run-multus-certs\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.059618 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.057216 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-multus-conf-dir\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.059618 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:25.057231 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:25.059618 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:25.057281 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8948e1d-72b0-43bd-972d-5767963f2837-original-pull-secret podName:e8948e1d-72b0-43bd-972d-5767963f2837 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:25.557270125 +0000 UTC m=+3.096119640 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8948e1d-72b0-43bd-972d-5767963f2837-original-pull-secret") pod "global-pull-secret-syncer-tcdq5" (UID: "e8948e1d-72b0-43bd-972d-5767963f2837") : object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:25.059618 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.057305 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-host-run-k8s-cni-cncf-io\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.059618 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.057316 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b887ed95-26ee-4d64-a947-95c991a50bf7-cnibin\") pod \"multus-additional-cni-plugins-7t7kr\" (UID: \"b887ed95-26ee-4d64-a947-95c991a50bf7\") " pod="openshift-multus/multus-additional-cni-plugins-7t7kr" Jul 24 14:34:25.059618 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.057329 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c3f9f86d-744c-430f-8188-f23974690f5c-hostroot\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.059618 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.057358 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-host-kubelet\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.059618 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.057402 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/60edbb3f-acb2-4532-af66-76e819c36977-run\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.059618 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.057448 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/480812e2-0ab3-4c07-b971-d222f629b250-hosts-file\") pod \"node-resolver-tknp6\" (UID: \"480812e2-0ab3-4c07-b971-d222f629b250\") " pod="openshift-dns/node-resolver-tknp6" Jul 24 14:34:25.059618 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.057554 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-node-log\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.059618 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.057718 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3f9f86d-744c-430f-8188-f23974690f5c-cni-binary-copy\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.059618 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.057840 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c3f9f86d-744c-430f-8188-f23974690f5c-multus-daemon-config\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.059618 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.059253 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c682b4d8-97db-4538-931d-93b229e4f2b9-agent-certs\") pod \"konnectivity-agent-zw72w\" (UID: \"c682b4d8-97db-4538-931d-93b229e4f2b9\") " pod="kube-system/konnectivity-agent-zw72w" Jul 24 14:34:25.059618 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.057135 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-node-log\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.060292 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.059338 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-ovn-node-metrics-cert\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.060292 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.059368 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/480812e2-0ab3-4c07-b971-d222f629b250-tmp-dir\") pod \"node-resolver-tknp6\" (UID: \"480812e2-0ab3-4c07-b971-d222f629b250\") " pod="openshift-dns/node-resolver-tknp6" Jul 24 14:34:25.060292 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.059392 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-var-lib-openvswitch\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.060292 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.059460 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-var-lib-openvswitch\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.060292 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.059666 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/480812e2-0ab3-4c07-b971-d222f629b250-tmp-dir\") pod \"node-resolver-tknp6\" (UID: \"480812e2-0ab3-4c07-b971-d222f629b250\") " pod="openshift-dns/node-resolver-tknp6" Jul 24 14:34:25.061450 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.061428 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-ovn-node-metrics-cert\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.064700 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.064675 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bhhx\" (UniqueName: \"kubernetes.io/projected/3fbb8dbf-514a-4c13-98f0-4ee9534c77bf-kube-api-access-2bhhx\") pod \"ovnkube-node-xltl7\" (UID: \"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.065208 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.065162 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fplng\" (UniqueName: \"kubernetes.io/projected/e4f832fe-7318-4ab6-814f-565dee143906-kube-api-access-fplng\") pod \"network-metrics-daemon-4krzg\" (UID: \"e4f832fe-7318-4ab6-814f-565dee143906\") " pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:25.065208 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.065174 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bt28\" (UniqueName: \"kubernetes.io/projected/b887ed95-26ee-4d64-a947-95c991a50bf7-kube-api-access-2bt28\") pod \"multus-additional-cni-plugins-7t7kr\" (UID: \"b887ed95-26ee-4d64-a947-95c991a50bf7\") " pod="openshift-multus/multus-additional-cni-plugins-7t7kr" Jul 24 14:34:25.065366 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.065317 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x944l\" (UniqueName: \"kubernetes.io/projected/c3f9f86d-744c-430f-8188-f23974690f5c-kube-api-access-x944l\") pod \"multus-2l8k6\" (UID: \"c3f9f86d-744c-430f-8188-f23974690f5c\") " pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.065662 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.065639 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60edbb3f-acb2-4532-af66-76e819c36977-tmp\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.065793 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.065769 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/60edbb3f-acb2-4532-af66-76e819c36977-etc-tuned\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.066561 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.066539 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n7qh\" (UniqueName: \"kubernetes.io/projected/480812e2-0ab3-4c07-b971-d222f629b250-kube-api-access-4n7qh\") pod \"node-resolver-tknp6\" (UID: \"480812e2-0ab3-4c07-b971-d222f629b250\") " pod="openshift-dns/node-resolver-tknp6" Jul 24 14:34:25.067707 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.067690 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl6qj\" (UniqueName: \"kubernetes.io/projected/60edbb3f-acb2-4532-af66-76e819c36977-kube-api-access-hl6qj\") pod \"tuned-lk6j4\" (UID: \"60edbb3f-acb2-4532-af66-76e819c36977\") " pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.152669 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.152581 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cd5xg" Jul 24 14:34:25.159874 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.159846 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t646b" Jul 24 14:34:25.168499 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.168480 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns" Jul 24 14:34:25.175247 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.175213 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" Jul 24 14:34:25.183874 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.183857 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tknp6" Jul 24 14:34:25.190427 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.190401 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2l8k6" Jul 24 14:34:25.197021 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.197005 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7t7kr" Jul 24 14:34:25.205704 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.205686 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zw72w" Jul 24 14:34:25.211411 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.211374 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:25.563611 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.563525 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25cbv\" (UniqueName: \"kubernetes.io/projected/338cf0d2-54e7-43c9-9aa1-f1e1bf494397-kube-api-access-25cbv\") pod \"network-check-target-lbbkb\" (UID: \"338cf0d2-54e7-43c9-9aa1-f1e1bf494397\") " pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:34:25.563611 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.563572 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4f832fe-7318-4ab6-814f-565dee143906-metrics-certs\") pod \"network-metrics-daemon-4krzg\" (UID: \"e4f832fe-7318-4ab6-814f-565dee143906\") " pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:25.563829 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.563614 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8948e1d-72b0-43bd-972d-5767963f2837-original-pull-secret\") pod \"global-pull-secret-syncer-tcdq5\" (UID: \"e8948e1d-72b0-43bd-972d-5767963f2837\") " pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:25.563829 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:25.563701 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 14:34:25.563829 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:25.563725 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 14:34:25.563829 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:25.563727 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:25.563829 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:25.563737 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:25.563829 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:25.563739 2582 projected.go:196] Error preparing data for projected volume kube-api-access-25cbv for pod openshift-network-diagnostics/network-check-target-lbbkb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:25.563829 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:25.563783 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4f832fe-7318-4ab6-814f-565dee143906-metrics-certs podName:e4f832fe-7318-4ab6-814f-565dee143906 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:26.563767203 +0000 UTC m=+4.102616711 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4f832fe-7318-4ab6-814f-565dee143906-metrics-certs") pod "network-metrics-daemon-4krzg" (UID: "e4f832fe-7318-4ab6-814f-565dee143906") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:25.563829 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:25.563800 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8948e1d-72b0-43bd-972d-5767963f2837-original-pull-secret podName:e8948e1d-72b0-43bd-972d-5767963f2837 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:26.563792844 +0000 UTC m=+4.102642352 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8948e1d-72b0-43bd-972d-5767963f2837-original-pull-secret") pod "global-pull-secret-syncer-tcdq5" (UID: "e8948e1d-72b0-43bd-972d-5767963f2837") : object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:25.563829 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:25.563817 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/338cf0d2-54e7-43c9-9aa1-f1e1bf494397-kube-api-access-25cbv podName:338cf0d2-54e7-43c9-9aa1-f1e1bf494397 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:26.563808551 +0000 UTC m=+4.102658058 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-25cbv" (UniqueName: "kubernetes.io/projected/338cf0d2-54e7-43c9-9aa1-f1e1bf494397-kube-api-access-25cbv") pod "network-check-target-lbbkb" (UID: "338cf0d2-54e7-43c9-9aa1-f1e1bf494397") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:25.889114 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.889005 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 14:29:24 +0000 UTC" deadline="2028-02-15 16:19:46.038055041 +0000 UTC" Jul 24 14:34:25.889114 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:25.889065 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13705h45m20.148994356s" Jul 24 14:34:25.942505 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:25.942467 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod394bc207_77e9_446d_9dd6_b52551f532af.slice/crio-2a3ff8492be5e04c0fefe5340d8b599388f0d404153ad3ac79b88d3a4a51c8c9 WatchSource:0}: Error finding container 2a3ff8492be5e04c0fefe5340d8b599388f0d404153ad3ac79b88d3a4a51c8c9: Status 404 returned error can't find the container with id 2a3ff8492be5e04c0fefe5340d8b599388f0d404153ad3ac79b88d3a4a51c8c9 Jul 24 14:34:25.946408 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:25.946322 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3f9f86d_744c_430f_8188_f23974690f5c.slice/crio-f83255a01efd8359736b5225e701f557a276c111338c44a9453f4fa3dfee68f0 WatchSource:0}: Error finding container f83255a01efd8359736b5225e701f557a276c111338c44a9453f4fa3dfee68f0: Status 404 returned error can't find the container with id f83255a01efd8359736b5225e701f557a276c111338c44a9453f4fa3dfee68f0 Jul 24 14:34:25.948792 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:25.948764 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60edbb3f_acb2_4532_af66_76e819c36977.slice/crio-76272c93f934b8f31865bc84defc11cbd60d32ed3d2aacb15f043db9bc7ca73f WatchSource:0}: Error finding container 76272c93f934b8f31865bc84defc11cbd60d32ed3d2aacb15f043db9bc7ca73f: Status 404 returned error can't find the container with id 76272c93f934b8f31865bc84defc11cbd60d32ed3d2aacb15f043db9bc7ca73f Jul 24 14:34:25.949589 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:25.949568 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf51ed1d0_a38c_44c3_83c0_865ce0465977.slice/crio-318ec0e5484a9b3fc72bec3868c64e13f651d5a2e84ed9423bcb8bd024c19ca4 WatchSource:0}: Error finding container 318ec0e5484a9b3fc72bec3868c64e13f651d5a2e84ed9423bcb8bd024c19ca4: Status 404 returned error can't find the container with id 318ec0e5484a9b3fc72bec3868c64e13f651d5a2e84ed9423bcb8bd024c19ca4 Jul 24 14:34:25.950917 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:25.950894 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc682b4d8_97db_4538_931d_93b229e4f2b9.slice/crio-e8c710411262e41f14cb9df421a1b76ecfec46af22dd54721c3a827bc8f51c19 WatchSource:0}: Error finding container e8c710411262e41f14cb9df421a1b76ecfec46af22dd54721c3a827bc8f51c19: Status 404 returned error can't find the container with id e8c710411262e41f14cb9df421a1b76ecfec46af22dd54721c3a827bc8f51c19 Jul 24 14:34:25.951782 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:25.951765 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e3482a6_bb70_4341_8efc_b5a022fecccc.slice/crio-76851c24eca584d5c8d740ac362701460c7f6e489c63ae87b96250b6727972d6 WatchSource:0}: Error finding container 76851c24eca584d5c8d740ac362701460c7f6e489c63ae87b96250b6727972d6: Status 404 returned error can't find the container with id 76851c24eca584d5c8d740ac362701460c7f6e489c63ae87b96250b6727972d6 Jul 24 14:34:25.952526 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:25.952504 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod480812e2_0ab3_4c07_b971_d222f629b250.slice/crio-426f6a2a4b3184a3fe362878e2797d2d2ace85385b707bfb3c48525738805c8b WatchSource:0}: Error finding container 426f6a2a4b3184a3fe362878e2797d2d2ace85385b707bfb3c48525738805c8b: Status 404 returned error can't find the container with id 426f6a2a4b3184a3fe362878e2797d2d2ace85385b707bfb3c48525738805c8b Jul 24 14:34:25.953770 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:25.953750 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fbb8dbf_514a_4c13_98f0_4ee9534c77bf.slice/crio-9dd2f0dbd135cb574b3cfa85346199723559b5b5b70366100599a1f549a17317 WatchSource:0}: Error finding container 9dd2f0dbd135cb574b3cfa85346199723559b5b5b70366100599a1f549a17317: Status 404 returned error can't find the container with id 9dd2f0dbd135cb574b3cfa85346199723559b5b5b70366100599a1f549a17317 Jul 24 14:34:26.032293 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:26.032268 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:34:26.032410 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:26.032386 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbbkb" podUID="338cf0d2-54e7-43c9-9aa1-f1e1bf494397" Jul 24 14:34:26.039306 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:26.039278 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7t7kr" event={"ID":"b887ed95-26ee-4d64-a947-95c991a50bf7","Type":"ContainerStarted","Data":"421dee37a58eb9c984195939a48080744454f6ec69754d0b13832eec0cd79e65"} Jul 24 14:34:26.040596 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:26.040563 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" event={"ID":"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf","Type":"ContainerStarted","Data":"9dd2f0dbd135cb574b3cfa85346199723559b5b5b70366100599a1f549a17317"} Jul 24 14:34:26.041687 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:26.041666 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tknp6" event={"ID":"480812e2-0ab3-4c07-b971-d222f629b250","Type":"ContainerStarted","Data":"426f6a2a4b3184a3fe362878e2797d2d2ace85385b707bfb3c48525738805c8b"} Jul 24 14:34:26.042891 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:26.042863 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cd5xg" event={"ID":"5e3482a6-bb70-4341-8efc-b5a022fecccc","Type":"ContainerStarted","Data":"76851c24eca584d5c8d740ac362701460c7f6e489c63ae87b96250b6727972d6"} Jul 24 14:34:26.043987 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:26.043967 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zw72w" event={"ID":"c682b4d8-97db-4538-931d-93b229e4f2b9","Type":"ContainerStarted","Data":"e8c710411262e41f14cb9df421a1b76ecfec46af22dd54721c3a827bc8f51c19"} Jul 24 14:34:26.046866 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:26.046822 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2l8k6" event={"ID":"c3f9f86d-744c-430f-8188-f23974690f5c","Type":"ContainerStarted","Data":"f83255a01efd8359736b5225e701f557a276c111338c44a9453f4fa3dfee68f0"} Jul 24 14:34:26.048588 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:26.048560 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t646b" event={"ID":"f51ed1d0-a38c-44c3-83c0-865ce0465977","Type":"ContainerStarted","Data":"318ec0e5484a9b3fc72bec3868c64e13f651d5a2e84ed9423bcb8bd024c19ca4"} Jul 24 14:34:26.049923 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:26.049900 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" event={"ID":"60edbb3f-acb2-4532-af66-76e819c36977","Type":"ContainerStarted","Data":"76272c93f934b8f31865bc84defc11cbd60d32ed3d2aacb15f043db9bc7ca73f"} Jul 24 14:34:26.051146 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:26.051122 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns" event={"ID":"394bc207-77e9-446d-9dd6-b52551f532af","Type":"ContainerStarted","Data":"2a3ff8492be5e04c0fefe5340d8b599388f0d404153ad3ac79b88d3a4a51c8c9"} Jul 24 14:34:26.132684 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:26.132644 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 14:34:26.571077 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:26.570780 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25cbv\" (UniqueName: \"kubernetes.io/projected/338cf0d2-54e7-43c9-9aa1-f1e1bf494397-kube-api-access-25cbv\") pod \"network-check-target-lbbkb\" (UID: \"338cf0d2-54e7-43c9-9aa1-f1e1bf494397\") " pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:34:26.571077 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:26.571041 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4f832fe-7318-4ab6-814f-565dee143906-metrics-certs\") pod \"network-metrics-daemon-4krzg\" (UID: \"e4f832fe-7318-4ab6-814f-565dee143906\") " pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:26.571317 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:26.571088 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8948e1d-72b0-43bd-972d-5767963f2837-original-pull-secret\") pod \"global-pull-secret-syncer-tcdq5\" (UID: \"e8948e1d-72b0-43bd-972d-5767963f2837\") " pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:26.571317 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:26.571225 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:26.571317 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:26.571302 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8948e1d-72b0-43bd-972d-5767963f2837-original-pull-secret podName:e8948e1d-72b0-43bd-972d-5767963f2837 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:28.571282065 +0000 UTC m=+6.110131585 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8948e1d-72b0-43bd-972d-5767963f2837-original-pull-secret") pod "global-pull-secret-syncer-tcdq5" (UID: "e8948e1d-72b0-43bd-972d-5767963f2837") : object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:26.571758 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:26.571672 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 14:34:26.571758 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:26.571692 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 14:34:26.571758 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:26.571705 2582 projected.go:196] Error preparing data for projected volume kube-api-access-25cbv for pod openshift-network-diagnostics/network-check-target-lbbkb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:26.571758 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:26.571746 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/338cf0d2-54e7-43c9-9aa1-f1e1bf494397-kube-api-access-25cbv podName:338cf0d2-54e7-43c9-9aa1-f1e1bf494397 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:28.571733325 +0000 UTC m=+6.110582831 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-25cbv" (UniqueName: "kubernetes.io/projected/338cf0d2-54e7-43c9-9aa1-f1e1bf494397-kube-api-access-25cbv") pod "network-check-target-lbbkb" (UID: "338cf0d2-54e7-43c9-9aa1-f1e1bf494397") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:26.571977 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:26.571805 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:26.571977 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:26.571833 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4f832fe-7318-4ab6-814f-565dee143906-metrics-certs podName:e4f832fe-7318-4ab6-814f-565dee143906 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:28.571823333 +0000 UTC m=+6.110672842 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4f832fe-7318-4ab6-814f-565dee143906-metrics-certs") pod "network-metrics-daemon-4krzg" (UID: "e4f832fe-7318-4ab6-814f-565dee143906") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:26.889941 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:26.889853 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 14:29:24 +0000 UTC" deadline="2028-04-29 09:07:20.751073062 +0000 UTC" Jul 24 14:34:26.889941 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:26.889890 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15474h32m53.861188212s" Jul 24 14:34:27.034923 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:27.034887 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:27.035089 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:27.035016 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcdq5" podUID="e8948e1d-72b0-43bd-972d-5767963f2837" Jul 24 14:34:27.035489 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:27.035460 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:27.035607 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:27.035573 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4krzg" podUID="e4f832fe-7318-4ab6-814f-565dee143906" Jul 24 14:34:27.075392 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:27.074385 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-149.ec2.internal" event={"ID":"50e1130ea2c6a2d58cc431a3aa9c96ce","Type":"ContainerStarted","Data":"1a1be556ba6d7ddc4e02c5ae6a18a4a515e473cf9c7365717a15503806072265"} Jul 24 14:34:27.093219 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:27.093161 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-149.ec2.internal" podStartSLOduration=3.093143682 podStartE2EDuration="3.093143682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:34:27.092514869 +0000 UTC m=+4.631364395" watchObservedRunningTime="2026-07-24 14:34:27.093143682 +0000 UTC m=+4.631993204" Jul 24 14:34:27.113502 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:27.112725 2582 generic.go:356] "Generic (PLEG): container finished" podID="69a77d7e8c6fe38a2fc31e156f740d64" containerID="d368c6cf46673e15ff576a156ac745abb0f03541deb957d0c0004401b93fe781" exitCode=0 Jul 24 14:34:27.113502 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:27.112777 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-149.ec2.internal" event={"ID":"69a77d7e8c6fe38a2fc31e156f740d64","Type":"ContainerDied","Data":"d368c6cf46673e15ff576a156ac745abb0f03541deb957d0c0004401b93fe781"} Jul 24 14:34:28.032348 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:28.032313 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:34:28.032813 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:28.032443 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbbkb" podUID="338cf0d2-54e7-43c9-9aa1-f1e1bf494397" Jul 24 14:34:28.134783 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:28.134399 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-149.ec2.internal" event={"ID":"69a77d7e8c6fe38a2fc31e156f740d64","Type":"ContainerStarted","Data":"f52eaae1660feb641bd710c82566f877cb001e2819d02c8e5e2c22c8676f2ff3"} Jul 24 14:34:28.590406 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:28.589530 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25cbv\" (UniqueName: \"kubernetes.io/projected/338cf0d2-54e7-43c9-9aa1-f1e1bf494397-kube-api-access-25cbv\") pod \"network-check-target-lbbkb\" (UID: \"338cf0d2-54e7-43c9-9aa1-f1e1bf494397\") " pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:34:28.590406 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:28.589577 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4f832fe-7318-4ab6-814f-565dee143906-metrics-certs\") pod \"network-metrics-daemon-4krzg\" (UID: \"e4f832fe-7318-4ab6-814f-565dee143906\") " pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:28.590406 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:28.589619 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8948e1d-72b0-43bd-972d-5767963f2837-original-pull-secret\") pod \"global-pull-secret-syncer-tcdq5\" (UID: \"e8948e1d-72b0-43bd-972d-5767963f2837\") " pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:28.590406 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:28.589749 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:28.590406 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:28.589804 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8948e1d-72b0-43bd-972d-5767963f2837-original-pull-secret podName:e8948e1d-72b0-43bd-972d-5767963f2837 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:32.589786403 +0000 UTC m=+10.128635912 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8948e1d-72b0-43bd-972d-5767963f2837-original-pull-secret") pod "global-pull-secret-syncer-tcdq5" (UID: "e8948e1d-72b0-43bd-972d-5767963f2837") : object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:28.590406 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:28.590181 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 14:34:28.590406 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:28.590199 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 14:34:28.590406 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:28.590211 2582 projected.go:196] Error preparing data for projected volume kube-api-access-25cbv for pod openshift-network-diagnostics/network-check-target-lbbkb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:28.590406 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:28.590270 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/338cf0d2-54e7-43c9-9aa1-f1e1bf494397-kube-api-access-25cbv podName:338cf0d2-54e7-43c9-9aa1-f1e1bf494397 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:32.590256169 +0000 UTC m=+10.129105675 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-25cbv" (UniqueName: "kubernetes.io/projected/338cf0d2-54e7-43c9-9aa1-f1e1bf494397-kube-api-access-25cbv") pod "network-check-target-lbbkb" (UID: "338cf0d2-54e7-43c9-9aa1-f1e1bf494397") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:28.590406 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:28.590332 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:28.590406 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:28.590367 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4f832fe-7318-4ab6-814f-565dee143906-metrics-certs podName:e4f832fe-7318-4ab6-814f-565dee143906 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:32.590354877 +0000 UTC m=+10.129204385 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4f832fe-7318-4ab6-814f-565dee143906-metrics-certs") pod "network-metrics-daemon-4krzg" (UID: "e4f832fe-7318-4ab6-814f-565dee143906") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:29.035107 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:29.035032 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:29.035568 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:29.035160 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcdq5" podUID="e8948e1d-72b0-43bd-972d-5767963f2837" Jul 24 14:34:29.035694 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:29.035665 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:29.035813 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:29.035790 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4krzg" podUID="e4f832fe-7318-4ab6-814f-565dee143906" Jul 24 14:34:30.032559 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:30.032526 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:34:30.032735 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:30.032664 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbbkb" podUID="338cf0d2-54e7-43c9-9aa1-f1e1bf494397" Jul 24 14:34:31.032303 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:31.032270 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:31.032741 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:31.032412 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4krzg" podUID="e4f832fe-7318-4ab6-814f-565dee143906" Jul 24 14:34:31.032741 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:31.032559 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:31.032741 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:31.032678 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcdq5" podUID="e8948e1d-72b0-43bd-972d-5767963f2837" Jul 24 14:34:32.032580 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:32.032086 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:34:32.032580 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:32.032225 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbbkb" podUID="338cf0d2-54e7-43c9-9aa1-f1e1bf494397" Jul 24 14:34:32.626248 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:32.626192 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8948e1d-72b0-43bd-972d-5767963f2837-original-pull-secret\") pod \"global-pull-secret-syncer-tcdq5\" (UID: \"e8948e1d-72b0-43bd-972d-5767963f2837\") " pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:32.626431 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:32.626284 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25cbv\" (UniqueName: \"kubernetes.io/projected/338cf0d2-54e7-43c9-9aa1-f1e1bf494397-kube-api-access-25cbv\") pod \"network-check-target-lbbkb\" (UID: \"338cf0d2-54e7-43c9-9aa1-f1e1bf494397\") " pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:34:32.626431 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:32.626318 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4f832fe-7318-4ab6-814f-565dee143906-metrics-certs\") pod \"network-metrics-daemon-4krzg\" (UID: \"e4f832fe-7318-4ab6-814f-565dee143906\") " pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:32.626557 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:32.626432 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:32.626557 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:32.626436 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:32.626557 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:32.626450 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 14:34:32.626557 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:32.626467 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 14:34:32.626557 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:32.626479 2582 projected.go:196] Error preparing data for projected volume kube-api-access-25cbv for pod openshift-network-diagnostics/network-check-target-lbbkb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:32.626557 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:32.626497 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4f832fe-7318-4ab6-814f-565dee143906-metrics-certs podName:e4f832fe-7318-4ab6-814f-565dee143906 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:40.626479735 +0000 UTC m=+18.165329248 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4f832fe-7318-4ab6-814f-565dee143906-metrics-certs") pod "network-metrics-daemon-4krzg" (UID: "e4f832fe-7318-4ab6-814f-565dee143906") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:32.626557 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:32.626514 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/338cf0d2-54e7-43c9-9aa1-f1e1bf494397-kube-api-access-25cbv podName:338cf0d2-54e7-43c9-9aa1-f1e1bf494397 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:40.626503151 +0000 UTC m=+18.165352656 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-25cbv" (UniqueName: "kubernetes.io/projected/338cf0d2-54e7-43c9-9aa1-f1e1bf494397-kube-api-access-25cbv") pod "network-check-target-lbbkb" (UID: "338cf0d2-54e7-43c9-9aa1-f1e1bf494397") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:32.626557 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:32.626532 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8948e1d-72b0-43bd-972d-5767963f2837-original-pull-secret podName:e8948e1d-72b0-43bd-972d-5767963f2837 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:40.626523846 +0000 UTC m=+18.165373365 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8948e1d-72b0-43bd-972d-5767963f2837-original-pull-secret") pod "global-pull-secret-syncer-tcdq5" (UID: "e8948e1d-72b0-43bd-972d-5767963f2837") : object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:33.033382 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:33.032818 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:33.033382 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:33.032930 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcdq5" podUID="e8948e1d-72b0-43bd-972d-5767963f2837" Jul 24 14:34:33.034120 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:33.033938 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:33.034120 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:33.034083 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4krzg" podUID="e4f832fe-7318-4ab6-814f-565dee143906" Jul 24 14:34:34.031909 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:34.031866 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:34:34.032053 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:34.032003 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbbkb" podUID="338cf0d2-54e7-43c9-9aa1-f1e1bf494397" Jul 24 14:34:35.032165 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:35.032131 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:35.032611 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:35.032274 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcdq5" podUID="e8948e1d-72b0-43bd-972d-5767963f2837" Jul 24 14:34:35.032702 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:35.032643 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:35.032768 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:35.032745 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4krzg" podUID="e4f832fe-7318-4ab6-814f-565dee143906" Jul 24 14:34:36.032428 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:36.032398 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:34:36.032871 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:36.032515 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbbkb" podUID="338cf0d2-54e7-43c9-9aa1-f1e1bf494397" Jul 24 14:34:37.032475 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:37.032437 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:37.032475 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:37.032472 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:37.032939 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:37.032581 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4krzg" podUID="e4f832fe-7318-4ab6-814f-565dee143906" Jul 24 14:34:37.032939 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:37.032691 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcdq5" podUID="e8948e1d-72b0-43bd-972d-5767963f2837" Jul 24 14:34:38.032464 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:38.032426 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:34:38.032659 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:38.032544 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbbkb" podUID="338cf0d2-54e7-43c9-9aa1-f1e1bf494397" Jul 24 14:34:39.032282 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:39.032229 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:39.032282 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:39.032282 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:39.032515 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:39.032375 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcdq5" podUID="e8948e1d-72b0-43bd-972d-5767963f2837" Jul 24 14:34:39.032605 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:39.032505 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4krzg" podUID="e4f832fe-7318-4ab6-814f-565dee143906" Jul 24 14:34:40.031863 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:40.031825 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:34:40.032356 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:40.031931 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbbkb" podUID="338cf0d2-54e7-43c9-9aa1-f1e1bf494397" Jul 24 14:34:40.688951 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:40.688899 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25cbv\" (UniqueName: \"kubernetes.io/projected/338cf0d2-54e7-43c9-9aa1-f1e1bf494397-kube-api-access-25cbv\") pod \"network-check-target-lbbkb\" (UID: \"338cf0d2-54e7-43c9-9aa1-f1e1bf494397\") " pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:34:40.689130 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:40.688962 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4f832fe-7318-4ab6-814f-565dee143906-metrics-certs\") pod \"network-metrics-daemon-4krzg\" (UID: \"e4f832fe-7318-4ab6-814f-565dee143906\") " pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:40.689130 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:40.688998 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8948e1d-72b0-43bd-972d-5767963f2837-original-pull-secret\") pod \"global-pull-secret-syncer-tcdq5\" (UID: \"e8948e1d-72b0-43bd-972d-5767963f2837\") " pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:40.689130 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:40.689092 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 14:34:40.689130 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:40.689113 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:40.689130 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:40.689120 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 14:34:40.689387 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:40.689138 2582 projected.go:196] Error preparing data for projected volume kube-api-access-25cbv for pod openshift-network-diagnostics/network-check-target-lbbkb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:40.689387 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:40.689113 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:40.689387 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:40.689175 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4f832fe-7318-4ab6-814f-565dee143906-metrics-certs podName:e4f832fe-7318-4ab6-814f-565dee143906 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:56.689161793 +0000 UTC m=+34.228011298 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4f832fe-7318-4ab6-814f-565dee143906-metrics-certs") pod "network-metrics-daemon-4krzg" (UID: "e4f832fe-7318-4ab6-814f-565dee143906") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:40.689387 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:40.689225 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/338cf0d2-54e7-43c9-9aa1-f1e1bf494397-kube-api-access-25cbv podName:338cf0d2-54e7-43c9-9aa1-f1e1bf494397 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:56.68920717 +0000 UTC m=+34.228056677 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-25cbv" (UniqueName: "kubernetes.io/projected/338cf0d2-54e7-43c9-9aa1-f1e1bf494397-kube-api-access-25cbv") pod "network-check-target-lbbkb" (UID: "338cf0d2-54e7-43c9-9aa1-f1e1bf494397") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:40.689387 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:40.689264 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8948e1d-72b0-43bd-972d-5767963f2837-original-pull-secret podName:e8948e1d-72b0-43bd-972d-5767963f2837 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:56.689252259 +0000 UTC m=+34.228101766 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8948e1d-72b0-43bd-972d-5767963f2837-original-pull-secret") pod "global-pull-secret-syncer-tcdq5" (UID: "e8948e1d-72b0-43bd-972d-5767963f2837") : object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:41.032555 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:41.032521 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:41.032555 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:41.032540 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:41.033143 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:41.032652 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcdq5" podUID="e8948e1d-72b0-43bd-972d-5767963f2837" Jul 24 14:34:41.033143 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:41.032762 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4krzg" podUID="e4f832fe-7318-4ab6-814f-565dee143906" Jul 24 14:34:42.031886 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:42.031851 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:34:42.032038 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:42.031975 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbbkb" podUID="338cf0d2-54e7-43c9-9aa1-f1e1bf494397" Jul 24 14:34:43.032646 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:43.032610 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:43.033038 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:43.032727 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4krzg" podUID="e4f832fe-7318-4ab6-814f-565dee143906" Jul 24 14:34:43.033038 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:43.032762 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:43.033038 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:43.032831 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcdq5" podUID="e8948e1d-72b0-43bd-972d-5767963f2837" Jul 24 14:34:44.032679 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:44.032642 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:34:44.033063 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:44.032760 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbbkb" podUID="338cf0d2-54e7-43c9-9aa1-f1e1bf494397" Jul 24 14:34:45.032514 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:45.032324 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:45.032704 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:45.032393 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:45.032704 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:45.032595 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcdq5" podUID="e8948e1d-72b0-43bd-972d-5767963f2837" Jul 24 14:34:45.032704 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:45.032669 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4krzg" podUID="e4f832fe-7318-4ab6-814f-565dee143906" Jul 24 14:34:45.169400 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:45.169311 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t646b" event={"ID":"f51ed1d0-a38c-44c3-83c0-865ce0465977","Type":"ContainerStarted","Data":"7b7325ff3c50646069a0279f6f81ac2d7e59e6c9d8ba8438d1e2db1dc227bad1"} Jul 24 14:34:45.170955 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:45.170924 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" event={"ID":"60edbb3f-acb2-4532-af66-76e819c36977","Type":"ContainerStarted","Data":"e28a0c1a3129b1681e73e7bef8bbf1803e80305d838feffa5fd78d95c3f5d9d3"} Jul 24 14:34:45.174965 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:45.174938 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns" event={"ID":"394bc207-77e9-446d-9dd6-b52551f532af","Type":"ContainerStarted","Data":"9b6bcfb098122f3fdd712e2313a1977d57f0d80d7834fea4c91eb545d21d2a81"} Jul 24 14:34:45.176780 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:45.176755 2582 generic.go:356] "Generic (PLEG): container finished" podID="b887ed95-26ee-4d64-a947-95c991a50bf7" containerID="aecd3376d0d44aee5480b941f546f455999bf40a3034d0d2ffb42d4ad1941ed3" exitCode=0 Jul 24 14:34:45.176894 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:45.176835 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7t7kr" event={"ID":"b887ed95-26ee-4d64-a947-95c991a50bf7","Type":"ContainerDied","Data":"aecd3376d0d44aee5480b941f546f455999bf40a3034d0d2ffb42d4ad1941ed3"} Jul 24 14:34:45.180369 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:45.180344 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" event={"ID":"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf","Type":"ContainerStarted","Data":"78d6c452d5d1fd52fc2834b07c4114650ef1119bab30da3a0cb94541ab72561a"} Jul 24 14:34:45.180462 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:45.180419 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" event={"ID":"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf","Type":"ContainerStarted","Data":"3ed1b0c7b8c104822e17af44b3d427a2dd0165e14d98aee19941cc05895b903f"} Jul 24 14:34:45.180555 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:45.180524 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" event={"ID":"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf","Type":"ContainerStarted","Data":"1341fc8aa90c3b039e760001243da97b0ddba695a2aa886dd106a44d213760df"} Jul 24 14:34:45.180608 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:45.180588 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" event={"ID":"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf","Type":"ContainerStarted","Data":"01c7fc963b4e61ae98e1ab82ab32f4bfa456eb70a1db523a8048a1e7054b8cbe"} Jul 24 14:34:45.180663 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:45.180639 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" event={"ID":"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf","Type":"ContainerStarted","Data":"a5c9766e1c1a94726d84df3ae1f8a920e6747b0991d3027b25c0abadedcf15ef"} Jul 24 14:34:45.180728 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:45.180698 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" event={"ID":"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf","Type":"ContainerStarted","Data":"1c397f6c42fec221305bb8e9eee48b29c9613e24ab50e08aea8772b5ac680a87"} Jul 24 14:34:45.181992 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:45.181969 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tknp6" event={"ID":"480812e2-0ab3-4c07-b971-d222f629b250","Type":"ContainerStarted","Data":"54605844f72e716809909c2cec76ef7a673f76865f599900ed5be48c34b0e0f9"} Jul 24 14:34:45.183592 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:45.183573 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zw72w" event={"ID":"c682b4d8-97db-4538-931d-93b229e4f2b9","Type":"ContainerStarted","Data":"998b5d0f9c4632c48afc7fc9fc470205dbd601007367b5bd51d8e50cd5d260dc"} Jul 24 14:34:45.185054 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:45.185029 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2l8k6" event={"ID":"c3f9f86d-744c-430f-8188-f23974690f5c","Type":"ContainerStarted","Data":"3ea34bd444d858d6ccc2d29978d3a11b43a3926f1ba496a8e11d7947642eabbd"} Jul 24 14:34:45.187279 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:45.187229 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-t646b" podStartSLOduration=3.933967478 podStartE2EDuration="22.187218903s" totalImagesPullingTime="18.253251425s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:34:45.186999916 +0000 UTC m=+22.725849447" watchObservedRunningTime="2026-07-24 14:34:45.187218903 +0000 UTC m=+22.726068430" Jul 24 14:34:45.187392 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:45.187316 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-149.ec2.internal" podStartSLOduration=21.187308888 podStartE2EDuration="21.187308888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:34:28.155474896 +0000 UTC m=+5.694324425" watchObservedRunningTime="2026-07-24 14:34:45.187308888 +0000 UTC m=+22.726158416" Jul 24 14:34:45.208078 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:45.208032 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tknp6" podStartSLOduration=3.954977671 podStartE2EDuration="22.208016651s" totalImagesPullingTime="18.25303898s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:34:45.207947508 +0000 UTC m=+22.746797036" watchObservedRunningTime="2026-07-24 14:34:45.208016651 +0000 UTC m=+22.746866178" Jul 24 14:34:45.227111 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:45.227067 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2l8k6" podStartSLOduration=3.884741435 podStartE2EDuration="22.227052492s" totalImagesPullingTime="18.342311057s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:34:45.226718187 +0000 UTC m=+22.765567714" watchObservedRunningTime="2026-07-24 14:34:45.227052492 +0000 UTC m=+22.765902020" Jul 24 14:34:45.263017 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:45.262971 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zw72w" podStartSLOduration=11.606279637 podStartE2EDuration="22.262955387s" totalImagesPullingTime="10.65667575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:34:45.262644662 +0000 UTC m=+22.801494189" watchObservedRunningTime="2026-07-24 14:34:45.262955387 +0000 UTC m=+22.801804915" Jul 24 14:34:45.279618 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:45.279568 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lk6j4" podStartSLOduration=3.978675277 podStartE2EDuration="22.279555117s" totalImagesPullingTime="18.30087984s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:34:45.279536085 +0000 UTC m=+22.818385611" watchObservedRunningTime="2026-07-24 14:34:45.279555117 +0000 UTC m=+22.818404644" Jul 24 14:34:45.686000 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:45.685949 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 24 14:34:45.898623 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:45.898441 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T14:34:45.685983794Z","UUID":"d31b2e36-e6d4-4835-8ae6-908b83ccba90","Handler":null,"Name":"","Endpoint":""} Jul 24 14:34:45.900008 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:45.899989 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 24 14:34:45.900137 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:45.900027 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 24 14:34:46.032277 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:46.032227 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:34:46.032457 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:46.032369 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbbkb" podUID="338cf0d2-54e7-43c9-9aa1-f1e1bf494397" Jul 24 14:34:46.189635 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:46.189552 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns" event={"ID":"394bc207-77e9-446d-9dd6-b52551f532af","Type":"ContainerStarted","Data":"0cde4b16d453e113aa17e24f1dd7a76f2401c6dd8dfdd3a5120d1397bfbebbb9"} Jul 24 14:34:46.191505 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:46.191475 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cd5xg" event={"ID":"5e3482a6-bb70-4341-8efc-b5a022fecccc","Type":"ContainerStarted","Data":"9b92ef0e25ffafd0a1f89cf730d97acf5b071358966878c884191abbc0c6d3ed"} Jul 24 14:34:47.032121 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:47.032093 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:47.032264 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:47.032093 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:47.032403 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:47.032253 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4krzg" podUID="e4f832fe-7318-4ab6-814f-565dee143906" Jul 24 14:34:47.032403 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:47.032347 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcdq5" podUID="e8948e1d-72b0-43bd-972d-5767963f2837" Jul 24 14:34:47.196637 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:47.196556 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns" event={"ID":"394bc207-77e9-446d-9dd6-b52551f532af","Type":"ContainerStarted","Data":"be834d6554299a71ba430bbf62b19fe6dca19dac4b89135f43850d876690d508"} Jul 24 14:34:47.200293 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:47.200265 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" event={"ID":"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf","Type":"ContainerStarted","Data":"3694f546ca3af340207032dafe9a6e006ac0547efd0998ebb644fcb571d64401"} Jul 24 14:34:47.215792 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:47.215740 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cd5xg" podStartSLOduration=6.937688761 podStartE2EDuration="25.215718735s" totalImagesPullingTime="18.278029974s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:34:46.207663976 +0000 UTC m=+23.746513503" watchObservedRunningTime="2026-07-24 14:34:47.215718735 +0000 UTC m=+24.754568263" Jul 24 14:34:47.216165 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:47.216132 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbgns" podStartSLOduration=3.798539608 podStartE2EDuration="24.216124208s" totalImagesPullingTime="20.4175846s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:34:47.21547107 +0000 UTC m=+24.754320597" watchObservedRunningTime="2026-07-24 14:34:47.216124208 +0000 UTC m=+24.754973736" Jul 24 14:34:48.031776 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:48.031740 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:34:48.031947 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:48.031866 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbbkb" podUID="338cf0d2-54e7-43c9-9aa1-f1e1bf494397" Jul 24 14:34:48.819400 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:48.819364 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zw72w" Jul 24 14:34:48.820057 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:48.820033 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zw72w" Jul 24 14:34:49.034715 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:49.034688 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:49.034900 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:49.034822 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4krzg" podUID="e4f832fe-7318-4ab6-814f-565dee143906" Jul 24 14:34:49.034900 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:49.034868 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:49.035016 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:49.034960 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcdq5" podUID="e8948e1d-72b0-43bd-972d-5767963f2837" Jul 24 14:34:49.204964 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:49.204938 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zw72w" Jul 24 14:34:49.205509 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:49.205490 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zw72w" Jul 24 14:34:50.031995 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:50.031961 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:34:50.032724 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:50.032066 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbbkb" podUID="338cf0d2-54e7-43c9-9aa1-f1e1bf494397" Jul 24 14:34:50.208870 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:50.208836 2582 generic.go:356] "Generic (PLEG): container finished" podID="b887ed95-26ee-4d64-a947-95c991a50bf7" containerID="f79df97c3c26fff86159709b9cbcca4079753bad0f3f8438551432250ccefe28" exitCode=0 Jul 24 14:34:50.209056 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:50.208893 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7t7kr" event={"ID":"b887ed95-26ee-4d64-a947-95c991a50bf7","Type":"ContainerDied","Data":"f79df97c3c26fff86159709b9cbcca4079753bad0f3f8438551432250ccefe28"} Jul 24 14:34:50.212704 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:50.212684 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" event={"ID":"3fbb8dbf-514a-4c13-98f0-4ee9534c77bf","Type":"ContainerStarted","Data":"7c7c3e451a76d2e19d33cdfec3faeea8edc58f6ede7a3a42f7f63a2827ff1c6a"} Jul 24 14:34:50.212926 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:50.212908 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:50.213026 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:50.213011 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:50.213094 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:50.213077 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:50.228215 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:50.228193 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:50.228686 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:50.228671 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:34:50.268131 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:50.268083 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" podStartSLOduration=8.946459234 podStartE2EDuration="27.268070171s" totalImagesPullingTime="18.321610937s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:34:50.267796204 +0000 UTC m=+27.806645742" watchObservedRunningTime="2026-07-24 14:34:50.268070171 +0000 UTC m=+27.806919729" Jul 24 14:34:51.031756 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:51.031723 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:51.032026 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:51.031875 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4krzg" podUID="e4f832fe-7318-4ab6-814f-565dee143906" Jul 24 14:34:51.032026 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:51.031723 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:51.032498 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:51.032029 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcdq5" podUID="e8948e1d-72b0-43bd-972d-5767963f2837" Jul 24 14:34:51.294657 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:51.294630 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tcdq5"] Jul 24 14:34:51.294815 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:51.294726 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:51.294880 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:51.294822 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcdq5" podUID="e8948e1d-72b0-43bd-972d-5767963f2837" Jul 24 14:34:51.297594 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:51.297555 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lbbkb"] Jul 24 14:34:51.297735 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:51.297685 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:34:51.297811 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:51.297789 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbbkb" podUID="338cf0d2-54e7-43c9-9aa1-f1e1bf494397" Jul 24 14:34:51.298421 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:51.298397 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4krzg"] Jul 24 14:34:51.298532 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:51.298481 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:51.298599 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:51.298577 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4krzg" podUID="e4f832fe-7318-4ab6-814f-565dee143906" Jul 24 14:34:52.219367 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:52.219332 2582 generic.go:356] "Generic (PLEG): container finished" podID="b887ed95-26ee-4d64-a947-95c991a50bf7" containerID="cbd97d2647854470f0bc3df89ead616554ffc99f67d2a0d07817c7f4f19d59a2" exitCode=0 Jul 24 14:34:52.219857 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:52.219407 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7t7kr" event={"ID":"b887ed95-26ee-4d64-a947-95c991a50bf7","Type":"ContainerDied","Data":"cbd97d2647854470f0bc3df89ead616554ffc99f67d2a0d07817c7f4f19d59a2"} Jul 24 14:34:53.034981 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:53.034946 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:34:53.035163 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:53.035036 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:53.035163 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:53.035038 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbbkb" podUID="338cf0d2-54e7-43c9-9aa1-f1e1bf494397" Jul 24 14:34:53.035163 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:53.035069 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:53.035338 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:53.035162 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4krzg" podUID="e4f832fe-7318-4ab6-814f-565dee143906" Jul 24 14:34:53.035338 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:53.035265 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcdq5" podUID="e8948e1d-72b0-43bd-972d-5767963f2837" Jul 24 14:34:54.226395 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:54.226202 2582 generic.go:356] "Generic (PLEG): container finished" podID="b887ed95-26ee-4d64-a947-95c991a50bf7" containerID="b08385321e9fb19a91041d875931f6f0bbf5e90d749abaef5b057e0aef563d47" exitCode=0 Jul 24 14:34:54.226798 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:54.226281 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7t7kr" event={"ID":"b887ed95-26ee-4d64-a947-95c991a50bf7","Type":"ContainerDied","Data":"b08385321e9fb19a91041d875931f6f0bbf5e90d749abaef5b057e0aef563d47"} Jul 24 14:34:55.031753 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:55.031723 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:34:55.031937 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:55.031723 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:55.031937 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:55.031845 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbbkb" podUID="338cf0d2-54e7-43c9-9aa1-f1e1bf494397" Jul 24 14:34:55.031937 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:55.031723 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:55.031937 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:55.031926 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcdq5" podUID="e8948e1d-72b0-43bd-972d-5767963f2837" Jul 24 14:34:55.032553 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:55.032396 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4krzg" podUID="e4f832fe-7318-4ab6-814f-565dee143906" Jul 24 14:34:56.705197 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:56.705156 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8948e1d-72b0-43bd-972d-5767963f2837-original-pull-secret\") pod \"global-pull-secret-syncer-tcdq5\" (UID: \"e8948e1d-72b0-43bd-972d-5767963f2837\") " pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:56.705693 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:56.705222 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25cbv\" (UniqueName: \"kubernetes.io/projected/338cf0d2-54e7-43c9-9aa1-f1e1bf494397-kube-api-access-25cbv\") pod \"network-check-target-lbbkb\" (UID: \"338cf0d2-54e7-43c9-9aa1-f1e1bf494397\") " pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:34:56.705693 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:56.705262 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4f832fe-7318-4ab6-814f-565dee143906-metrics-certs\") pod \"network-metrics-daemon-4krzg\" (UID: \"e4f832fe-7318-4ab6-814f-565dee143906\") " pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:56.705693 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:56.705320 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:56.705693 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:56.705334 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 14:34:56.705693 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:56.705357 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 14:34:56.705693 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:56.705367 2582 projected.go:196] Error preparing data for projected volume kube-api-access-25cbv for pod openshift-network-diagnostics/network-check-target-lbbkb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:56.705693 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:56.705371 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:56.705693 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:56.705382 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8948e1d-72b0-43bd-972d-5767963f2837-original-pull-secret podName:e8948e1d-72b0-43bd-972d-5767963f2837 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:28.705367761 +0000 UTC m=+66.244217269 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8948e1d-72b0-43bd-972d-5767963f2837-original-pull-secret") pod "global-pull-secret-syncer-tcdq5" (UID: "e8948e1d-72b0-43bd-972d-5767963f2837") : object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:56.705693 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:56.705406 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/338cf0d2-54e7-43c9-9aa1-f1e1bf494397-kube-api-access-25cbv podName:338cf0d2-54e7-43c9-9aa1-f1e1bf494397 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:28.705393939 +0000 UTC m=+66.244243444 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-25cbv" (UniqueName: "kubernetes.io/projected/338cf0d2-54e7-43c9-9aa1-f1e1bf494397-kube-api-access-25cbv") pod "network-check-target-lbbkb" (UID: "338cf0d2-54e7-43c9-9aa1-f1e1bf494397") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:56.705693 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:56.705420 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4f832fe-7318-4ab6-814f-565dee143906-metrics-certs podName:e4f832fe-7318-4ab6-814f-565dee143906 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:28.705413435 +0000 UTC m=+66.244262939 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4f832fe-7318-4ab6-814f-565dee143906-metrics-certs") pod "network-metrics-daemon-4krzg" (UID: "e4f832fe-7318-4ab6-814f-565dee143906") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:57.032361 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.031902 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:57.032361 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.031904 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:57.032361 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:57.032033 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcdq5" podUID="e8948e1d-72b0-43bd-972d-5767963f2837" Jul 24 14:34:57.032361 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.032047 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:34:57.032361 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:57.032137 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4krzg" podUID="e4f832fe-7318-4ab6-814f-565dee143906" Jul 24 14:34:57.032361 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:57.032219 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbbkb" podUID="338cf0d2-54e7-43c9-9aa1-f1e1bf494397" Jul 24 14:34:57.266758 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.266731 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-149.ec2.internal" event="NodeReady" Jul 24 14:34:57.266940 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.266869 2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 24 14:34:57.307396 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.307326 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-g7zlw"] Jul 24 14:34:57.309839 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.309824 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g7zlw" Jul 24 14:34:57.310159 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.310137 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j5g25"] Jul 24 14:34:57.312156 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.311888 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j5g25" Jul 24 14:34:57.312156 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.312011 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-26zbb\"" Jul 24 14:34:57.312156 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.312113 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 24 14:34:57.312579 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.312537 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 24 14:34:57.315414 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.315381 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 24 14:34:57.315529 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.315414 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n9c9d\"" Jul 24 14:34:57.315529 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.315475 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 24 14:34:57.315811 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.315793 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 24 14:34:57.324992 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.324964 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j5g25"] Jul 24 14:34:57.328691 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.328664 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g7zlw"] Jul 24 14:34:57.410756 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.410721 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf6r2\" (UniqueName: \"kubernetes.io/projected/affd1875-04ba-449a-bd65-df82fc62df91-kube-api-access-qf6r2\") pod \"ingress-canary-j5g25\" (UID: \"affd1875-04ba-449a-bd65-df82fc62df91\") " pod="openshift-ingress-canary/ingress-canary-j5g25" Jul 24 14:34:57.410934 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.410775 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwzc7\" (UniqueName: \"kubernetes.io/projected/836ce326-bf5d-4c96-9a71-da5ab147043f-kube-api-access-qwzc7\") pod \"dns-default-g7zlw\" (UID: \"836ce326-bf5d-4c96-9a71-da5ab147043f\") " pod="openshift-dns/dns-default-g7zlw" Jul 24 14:34:57.410934 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.410855 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/836ce326-bf5d-4c96-9a71-da5ab147043f-metrics-tls\") pod \"dns-default-g7zlw\" (UID: \"836ce326-bf5d-4c96-9a71-da5ab147043f\") " pod="openshift-dns/dns-default-g7zlw" Jul 24 14:34:57.410934 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.410877 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/affd1875-04ba-449a-bd65-df82fc62df91-cert\") pod \"ingress-canary-j5g25\" (UID: \"affd1875-04ba-449a-bd65-df82fc62df91\") " pod="openshift-ingress-canary/ingress-canary-j5g25" Jul 24 14:34:57.410934 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.410896 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/836ce326-bf5d-4c96-9a71-da5ab147043f-tmp-dir\") pod \"dns-default-g7zlw\" (UID: \"836ce326-bf5d-4c96-9a71-da5ab147043f\") " pod="openshift-dns/dns-default-g7zlw" Jul 24 14:34:57.411155 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.410972 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/836ce326-bf5d-4c96-9a71-da5ab147043f-config-volume\") pod \"dns-default-g7zlw\" (UID: \"836ce326-bf5d-4c96-9a71-da5ab147043f\") " pod="openshift-dns/dns-default-g7zlw" Jul 24 14:34:57.512099 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.512063 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwzc7\" (UniqueName: \"kubernetes.io/projected/836ce326-bf5d-4c96-9a71-da5ab147043f-kube-api-access-qwzc7\") pod \"dns-default-g7zlw\" (UID: \"836ce326-bf5d-4c96-9a71-da5ab147043f\") " pod="openshift-dns/dns-default-g7zlw" Jul 24 14:34:57.512295 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.512135 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/836ce326-bf5d-4c96-9a71-da5ab147043f-metrics-tls\") pod \"dns-default-g7zlw\" (UID: \"836ce326-bf5d-4c96-9a71-da5ab147043f\") " pod="openshift-dns/dns-default-g7zlw" Jul 24 14:34:57.512295 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.512156 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/affd1875-04ba-449a-bd65-df82fc62df91-cert\") pod \"ingress-canary-j5g25\" (UID: \"affd1875-04ba-449a-bd65-df82fc62df91\") " pod="openshift-ingress-canary/ingress-canary-j5g25" Jul 24 14:34:57.512295 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.512183 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/836ce326-bf5d-4c96-9a71-da5ab147043f-tmp-dir\") pod \"dns-default-g7zlw\" (UID: \"836ce326-bf5d-4c96-9a71-da5ab147043f\") " pod="openshift-dns/dns-default-g7zlw" Jul 24 14:34:57.512295 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.512208 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/836ce326-bf5d-4c96-9a71-da5ab147043f-config-volume\") pod \"dns-default-g7zlw\" (UID: \"836ce326-bf5d-4c96-9a71-da5ab147043f\") " pod="openshift-dns/dns-default-g7zlw" Jul 24 14:34:57.512295 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.512290 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf6r2\" (UniqueName: \"kubernetes.io/projected/affd1875-04ba-449a-bd65-df82fc62df91-kube-api-access-qf6r2\") pod \"ingress-canary-j5g25\" (UID: \"affd1875-04ba-449a-bd65-df82fc62df91\") " pod="openshift-ingress-canary/ingress-canary-j5g25" Jul 24 14:34:57.512538 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:57.512524 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:34:57.512591 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:57.512586 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/836ce326-bf5d-4c96-9a71-da5ab147043f-metrics-tls podName:836ce326-bf5d-4c96-9a71-da5ab147043f nodeName:}" failed. No retries permitted until 2026-07-24 14:34:58.012567072 +0000 UTC m=+35.551416589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/836ce326-bf5d-4c96-9a71-da5ab147043f-metrics-tls") pod "dns-default-g7zlw" (UID: "836ce326-bf5d-4c96-9a71-da5ab147043f") : secret "dns-default-metrics-tls" not found Jul 24 14:34:57.512888 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.512856 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/836ce326-bf5d-4c96-9a71-da5ab147043f-tmp-dir\") pod \"dns-default-g7zlw\" (UID: \"836ce326-bf5d-4c96-9a71-da5ab147043f\") " pod="openshift-dns/dns-default-g7zlw" Jul 24 14:34:57.513422 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.513404 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/836ce326-bf5d-4c96-9a71-da5ab147043f-config-volume\") pod \"dns-default-g7zlw\" (UID: \"836ce326-bf5d-4c96-9a71-da5ab147043f\") " pod="openshift-dns/dns-default-g7zlw" Jul 24 14:34:57.518105 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.518082 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/affd1875-04ba-449a-bd65-df82fc62df91-cert\") pod \"ingress-canary-j5g25\" (UID: \"affd1875-04ba-449a-bd65-df82fc62df91\") " pod="openshift-ingress-canary/ingress-canary-j5g25" Jul 24 14:34:57.523221 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.523194 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwzc7\" (UniqueName: \"kubernetes.io/projected/836ce326-bf5d-4c96-9a71-da5ab147043f-kube-api-access-qwzc7\") pod \"dns-default-g7zlw\" (UID: \"836ce326-bf5d-4c96-9a71-da5ab147043f\") " pod="openshift-dns/dns-default-g7zlw" Jul 24 14:34:57.523469 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.523444 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf6r2\" (UniqueName: \"kubernetes.io/projected/affd1875-04ba-449a-bd65-df82fc62df91-kube-api-access-qf6r2\") pod \"ingress-canary-j5g25\" (UID: \"affd1875-04ba-449a-bd65-df82fc62df91\") " pod="openshift-ingress-canary/ingress-canary-j5g25" Jul 24 14:34:57.628625 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:57.628541 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j5g25" Jul 24 14:34:58.016774 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:58.016739 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/836ce326-bf5d-4c96-9a71-da5ab147043f-metrics-tls\") pod \"dns-default-g7zlw\" (UID: \"836ce326-bf5d-4c96-9a71-da5ab147043f\") " pod="openshift-dns/dns-default-g7zlw" Jul 24 14:34:58.017492 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:58.016868 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:34:58.017492 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:58.016922 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/836ce326-bf5d-4c96-9a71-da5ab147043f-metrics-tls podName:836ce326-bf5d-4c96-9a71-da5ab147043f nodeName:}" failed. No retries permitted until 2026-07-24 14:34:59.016908796 +0000 UTC m=+36.555758302 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/836ce326-bf5d-4c96-9a71-da5ab147043f-metrics-tls") pod "dns-default-g7zlw" (UID: "836ce326-bf5d-4c96-9a71-da5ab147043f") : secret "dns-default-metrics-tls" not found Jul 24 14:34:58.315910 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:58.315882 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j5g25"] Jul 24 14:34:58.319715 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:34:58.319694 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaffd1875_04ba_449a_bd65_df82fc62df91.slice/crio-cd5754c372cbf923d41d346d3b0e55b7a43d39ddb70e473410e17f2516980c7a WatchSource:0}: Error finding container cd5754c372cbf923d41d346d3b0e55b7a43d39ddb70e473410e17f2516980c7a: Status 404 returned error can't find the container with id cd5754c372cbf923d41d346d3b0e55b7a43d39ddb70e473410e17f2516980c7a Jul 24 14:34:59.024269 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:59.024212 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/836ce326-bf5d-4c96-9a71-da5ab147043f-metrics-tls\") pod \"dns-default-g7zlw\" (UID: \"836ce326-bf5d-4c96-9a71-da5ab147043f\") " pod="openshift-dns/dns-default-g7zlw" Jul 24 14:34:59.024776 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:59.024391 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:34:59.024776 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:34:59.024467 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/836ce326-bf5d-4c96-9a71-da5ab147043f-metrics-tls podName:836ce326-bf5d-4c96-9a71-da5ab147043f nodeName:}" failed. No retries permitted until 2026-07-24 14:35:01.02444666 +0000 UTC m=+38.563296189 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/836ce326-bf5d-4c96-9a71-da5ab147043f-metrics-tls") pod "dns-default-g7zlw" (UID: "836ce326-bf5d-4c96-9a71-da5ab147043f") : secret "dns-default-metrics-tls" not found Jul 24 14:34:59.031829 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:59.031802 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:34:59.031963 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:59.031813 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:34:59.031963 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:59.031954 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:34:59.034190 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:59.034134 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 14:34:59.034822 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:59.034800 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2pw7m\"" Jul 24 14:34:59.034822 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:59.034814 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 14:34:59.034969 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:59.034958 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 14:34:59.035032 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:59.035009 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 14:34:59.035254 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:59.035224 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d7cdd\"" Jul 24 14:34:59.239012 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:59.238973 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j5g25" event={"ID":"affd1875-04ba-449a-bd65-df82fc62df91","Type":"ContainerStarted","Data":"cd5754c372cbf923d41d346d3b0e55b7a43d39ddb70e473410e17f2516980c7a"} Jul 24 14:34:59.241992 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:59.241957 2582 generic.go:356] "Generic (PLEG): container finished" podID="b887ed95-26ee-4d64-a947-95c991a50bf7" containerID="be43aac27a0fdb5b51cdc08aed0521774807243d52aac27b5627999289d95cde" exitCode=0 Jul 24 14:34:59.242121 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:34:59.242007 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7t7kr" event={"ID":"b887ed95-26ee-4d64-a947-95c991a50bf7","Type":"ContainerDied","Data":"be43aac27a0fdb5b51cdc08aed0521774807243d52aac27b5627999289d95cde"} Jul 24 14:35:00.248883 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:00.248847 2582 generic.go:356] "Generic (PLEG): container finished" podID="b887ed95-26ee-4d64-a947-95c991a50bf7" containerID="9e01e4c1a9eeb525fecabb0e0ee18b74db136d431b0770f3b7dd3fce8b4b2475" exitCode=0 Jul 24 14:35:00.249324 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:00.248900 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7t7kr" event={"ID":"b887ed95-26ee-4d64-a947-95c991a50bf7","Type":"ContainerDied","Data":"9e01e4c1a9eeb525fecabb0e0ee18b74db136d431b0770f3b7dd3fce8b4b2475"} Jul 24 14:35:01.039783 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:01.039614 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/836ce326-bf5d-4c96-9a71-da5ab147043f-metrics-tls\") pod \"dns-default-g7zlw\" (UID: \"836ce326-bf5d-4c96-9a71-da5ab147043f\") " pod="openshift-dns/dns-default-g7zlw" Jul 24 14:35:01.039933 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:01.039757 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:35:01.039933 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:01.039843 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/836ce326-bf5d-4c96-9a71-da5ab147043f-metrics-tls podName:836ce326-bf5d-4c96-9a71-da5ab147043f nodeName:}" failed. No retries permitted until 2026-07-24 14:35:05.039827864 +0000 UTC m=+42.578677369 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/836ce326-bf5d-4c96-9a71-da5ab147043f-metrics-tls") pod "dns-default-g7zlw" (UID: "836ce326-bf5d-4c96-9a71-da5ab147043f") : secret "dns-default-metrics-tls" not found Jul 24 14:35:01.254382 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:01.254343 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7t7kr" event={"ID":"b887ed95-26ee-4d64-a947-95c991a50bf7","Type":"ContainerStarted","Data":"ba7e0d5ca56e7bbc2ef6d007ece62002ba294c5327c691584343bc74d37e57af"} Jul 24 14:35:01.255705 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:01.255682 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j5g25" event={"ID":"affd1875-04ba-449a-bd65-df82fc62df91","Type":"ContainerStarted","Data":"8e6c9d7d754e27adcc72ff754b9e0bf36b5d14601a8b29a5a0c7c75649f4eb3b"} Jul 24 14:35:01.277996 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:01.277950 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7t7kr" podStartSLOduration=9.990073763 podStartE2EDuration="38.27793565s" totalImagesPullingTime="28.287861887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:01.276590274 +0000 UTC m=+38.815439798" watchObservedRunningTime="2026-07-24 14:35:01.27793565 +0000 UTC m=+38.816785177" Jul 24 14:35:01.293704 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:01.293659 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j5g25" podStartSLOduration=2.145991633 podStartE2EDuration="4.29364536s" totalImagesPullingTime="2.147653727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:01.292961895 +0000 UTC m=+38.831811424" watchObservedRunningTime="2026-07-24 14:35:01.29364536 +0000 UTC m=+38.832494886" Jul 24 14:35:05.068883 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:05.068840 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/836ce326-bf5d-4c96-9a71-da5ab147043f-metrics-tls\") pod \"dns-default-g7zlw\" (UID: \"836ce326-bf5d-4c96-9a71-da5ab147043f\") " pod="openshift-dns/dns-default-g7zlw" Jul 24 14:35:05.069318 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:05.068996 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:35:05.069318 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:05.069058 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/836ce326-bf5d-4c96-9a71-da5ab147043f-metrics-tls podName:836ce326-bf5d-4c96-9a71-da5ab147043f nodeName:}" failed. No retries permitted until 2026-07-24 14:35:13.0690419 +0000 UTC m=+50.607891405 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/836ce326-bf5d-4c96-9a71-da5ab147043f-metrics-tls") pod "dns-default-g7zlw" (UID: "836ce326-bf5d-4c96-9a71-da5ab147043f") : secret "dns-default-metrics-tls" not found Jul 24 14:35:13.121332 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:13.121293 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/836ce326-bf5d-4c96-9a71-da5ab147043f-metrics-tls\") pod \"dns-default-g7zlw\" (UID: \"836ce326-bf5d-4c96-9a71-da5ab147043f\") " pod="openshift-dns/dns-default-g7zlw" Jul 24 14:35:13.121916 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:13.121448 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:35:13.121916 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:13.121528 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/836ce326-bf5d-4c96-9a71-da5ab147043f-metrics-tls podName:836ce326-bf5d-4c96-9a71-da5ab147043f nodeName:}" failed. No retries permitted until 2026-07-24 14:35:29.121508688 +0000 UTC m=+66.660358212 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/836ce326-bf5d-4c96-9a71-da5ab147043f-metrics-tls") pod "dns-default-g7zlw" (UID: "836ce326-bf5d-4c96-9a71-da5ab147043f") : secret "dns-default-metrics-tls" not found Jul 24 14:35:22.230251 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:22.230205 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xltl7" Jul 24 14:35:28.722440 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:28.722401 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25cbv\" (UniqueName: \"kubernetes.io/projected/338cf0d2-54e7-43c9-9aa1-f1e1bf494397-kube-api-access-25cbv\") pod \"network-check-target-lbbkb\" (UID: \"338cf0d2-54e7-43c9-9aa1-f1e1bf494397\") " pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:35:28.722440 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:28.722448 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4f832fe-7318-4ab6-814f-565dee143906-metrics-certs\") pod \"network-metrics-daemon-4krzg\" (UID: \"e4f832fe-7318-4ab6-814f-565dee143906\") " pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:35:28.722986 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:28.722486 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8948e1d-72b0-43bd-972d-5767963f2837-original-pull-secret\") pod \"global-pull-secret-syncer-tcdq5\" (UID: \"e8948e1d-72b0-43bd-972d-5767963f2837\") " pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:35:28.725087 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:28.725067 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 14:35:28.725141 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:28.725091 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 14:35:28.725141 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:28.725106 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 14:35:28.732915 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:28.732898 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 24 14:35:28.732970 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:28.732960 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4f832fe-7318-4ab6-814f-565dee143906-metrics-certs podName:e4f832fe-7318-4ab6-814f-565dee143906 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:32.732945228 +0000 UTC m=+130.271794737 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4f832fe-7318-4ab6-814f-565dee143906-metrics-certs") pod "network-metrics-daemon-4krzg" (UID: "e4f832fe-7318-4ab6-814f-565dee143906") : secret "metrics-daemon-secret" not found Jul 24 14:35:28.734579 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:28.734563 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 14:35:28.736657 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:28.736641 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8948e1d-72b0-43bd-972d-5767963f2837-original-pull-secret\") pod \"global-pull-secret-syncer-tcdq5\" (UID: \"e8948e1d-72b0-43bd-972d-5767963f2837\") " pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:35:28.745546 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:28.745525 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25cbv\" (UniqueName: \"kubernetes.io/projected/338cf0d2-54e7-43c9-9aa1-f1e1bf494397-kube-api-access-25cbv\") pod \"network-check-target-lbbkb\" (UID: \"338cf0d2-54e7-43c9-9aa1-f1e1bf494397\") " pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:35:28.757430 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:28.757411 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcdq5" Jul 24 14:35:28.876319 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:28.876289 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tcdq5"] Jul 24 14:35:28.879913 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:35:28.879884 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8948e1d_72b0_43bd_972d_5767963f2837.slice/crio-4e39fcf56a7e2d4543ac3fdfd5f82f75b915c1336a6df8297aab494dcd24ad57 WatchSource:0}: Error finding container 4e39fcf56a7e2d4543ac3fdfd5f82f75b915c1336a6df8297aab494dcd24ad57: Status 404 returned error can't find the container with id 4e39fcf56a7e2d4543ac3fdfd5f82f75b915c1336a6df8297aab494dcd24ad57 Jul 24 14:35:29.046552 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:29.046479 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2pw7m\"" Jul 24 14:35:29.054665 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:29.054648 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:35:29.129361 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:29.128741 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/836ce326-bf5d-4c96-9a71-da5ab147043f-metrics-tls\") pod \"dns-default-g7zlw\" (UID: \"836ce326-bf5d-4c96-9a71-da5ab147043f\") " pod="openshift-dns/dns-default-g7zlw" Jul 24 14:35:29.129361 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:29.128913 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:35:29.129361 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:29.128977 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/836ce326-bf5d-4c96-9a71-da5ab147043f-metrics-tls podName:836ce326-bf5d-4c96-9a71-da5ab147043f nodeName:}" failed. No retries permitted until 2026-07-24 14:36:01.128957145 +0000 UTC m=+98.667806665 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/836ce326-bf5d-4c96-9a71-da5ab147043f-metrics-tls") pod "dns-default-g7zlw" (UID: "836ce326-bf5d-4c96-9a71-da5ab147043f") : secret "dns-default-metrics-tls" not found Jul 24 14:35:29.187669 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:29.187626 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lbbkb"] Jul 24 14:35:29.191098 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:35:29.191068 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod338cf0d2_54e7_43c9_9aa1_f1e1bf494397.slice/crio-6850e63868f8c79cdafa33b767084d88175a52b3334a2338a5e1215b8b942dcb WatchSource:0}: Error finding container 6850e63868f8c79cdafa33b767084d88175a52b3334a2338a5e1215b8b942dcb: Status 404 returned error can't find the container with id 6850e63868f8c79cdafa33b767084d88175a52b3334a2338a5e1215b8b942dcb Jul 24 14:35:29.320935 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:29.320853 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lbbkb" event={"ID":"338cf0d2-54e7-43c9-9aa1-f1e1bf494397","Type":"ContainerStarted","Data":"6850e63868f8c79cdafa33b767084d88175a52b3334a2338a5e1215b8b942dcb"} Jul 24 14:35:29.321860 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:29.321836 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tcdq5" event={"ID":"e8948e1d-72b0-43bd-972d-5767963f2837","Type":"ContainerStarted","Data":"4e39fcf56a7e2d4543ac3fdfd5f82f75b915c1336a6df8297aab494dcd24ad57"} Jul 24 14:35:34.334900 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:34.334858 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tcdq5" event={"ID":"e8948e1d-72b0-43bd-972d-5767963f2837","Type":"ContainerStarted","Data":"1479befc9712da1c5a0e9258692458c3bac34550aa5facefa516fb2bbbdae28a"} Jul 24 14:35:34.336330 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:34.336306 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lbbkb" event={"ID":"338cf0d2-54e7-43c9-9aa1-f1e1bf494397","Type":"ContainerStarted","Data":"91f64db0ad21b8da713dcf7775ad2e5dddd597f283e8927f40d96a8362b92fac"} Jul 24 14:35:34.336442 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:34.336426 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:35:34.354573 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:34.354513 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tcdq5" podStartSLOduration=66.727477458 podStartE2EDuration="1m11.354498676s" totalImagesPullingTime="4.627021218s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:34.354119648 +0000 UTC m=+71.892969176" watchObservedRunningTime="2026-07-24 14:35:34.354498676 +0000 UTC m=+71.893348204" Jul 24 14:35:43.013676 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.013616 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lbbkb" podStartSLOduration=76.701463748 podStartE2EDuration="1m21.013595686s" totalImagesPullingTime="4.312131938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:34:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:34.37473118 +0000 UTC m=+71.913580708" watchObservedRunningTime="2026-07-24 14:35:43.013595686 +0000 UTC m=+80.552445215" Jul 24 14:35:43.014102 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.013935 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-425z6"] Jul 24 14:35:43.015680 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.015665 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-425z6" Jul 24 14:35:43.018146 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.018120 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 24 14:35:43.018282 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.018181 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-cs9hz\"" Jul 24 14:35:43.018735 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.018718 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 24 14:35:43.018836 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.018749 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 24 14:35:43.018836 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.018802 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 24 14:35:43.026612 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.026590 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 24 14:35:43.027152 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.027132 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-425z6"] Jul 24 14:35:43.125308 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.125274 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a0909119-831a-46d5-9ac9-36b277728f89-serving-cert\") pod \"insights-operator-5885fdb759-425z6\" (UID: \"a0909119-831a-46d5-9ac9-36b277728f89\") " pod="openshift-insights/insights-operator-5885fdb759-425z6" Jul 24 14:35:43.125470 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.125325 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a0909119-831a-46d5-9ac9-36b277728f89-snapshots\") pod \"insights-operator-5885fdb759-425z6\" (UID: \"a0909119-831a-46d5-9ac9-36b277728f89\") " pod="openshift-insights/insights-operator-5885fdb759-425z6" Jul 24 14:35:43.125470 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.125405 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0909119-831a-46d5-9ac9-36b277728f89-tmp\") pod \"insights-operator-5885fdb759-425z6\" (UID: \"a0909119-831a-46d5-9ac9-36b277728f89\") " pod="openshift-insights/insights-operator-5885fdb759-425z6" Jul 24 14:35:43.125470 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.125435 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0909119-831a-46d5-9ac9-36b277728f89-service-ca-bundle\") pod \"insights-operator-5885fdb759-425z6\" (UID: \"a0909119-831a-46d5-9ac9-36b277728f89\") " pod="openshift-insights/insights-operator-5885fdb759-425z6" Jul 24 14:35:43.125470 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.125458 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0909119-831a-46d5-9ac9-36b277728f89-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-425z6\" (UID: \"a0909119-831a-46d5-9ac9-36b277728f89\") " pod="openshift-insights/insights-operator-5885fdb759-425z6" Jul 24 14:35:43.125599 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.125477 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq86l\" (UniqueName: \"kubernetes.io/projected/a0909119-831a-46d5-9ac9-36b277728f89-kube-api-access-kq86l\") pod \"insights-operator-5885fdb759-425z6\" (UID: \"a0909119-831a-46d5-9ac9-36b277728f89\") " pod="openshift-insights/insights-operator-5885fdb759-425z6" Jul 24 14:35:43.226385 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.226357 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0909119-831a-46d5-9ac9-36b277728f89-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-425z6\" (UID: \"a0909119-831a-46d5-9ac9-36b277728f89\") " pod="openshift-insights/insights-operator-5885fdb759-425z6" Jul 24 14:35:43.226468 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.226395 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq86l\" (UniqueName: \"kubernetes.io/projected/a0909119-831a-46d5-9ac9-36b277728f89-kube-api-access-kq86l\") pod \"insights-operator-5885fdb759-425z6\" (UID: \"a0909119-831a-46d5-9ac9-36b277728f89\") " pod="openshift-insights/insights-operator-5885fdb759-425z6" Jul 24 14:35:43.226468 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.226412 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a0909119-831a-46d5-9ac9-36b277728f89-serving-cert\") pod \"insights-operator-5885fdb759-425z6\" (UID: \"a0909119-831a-46d5-9ac9-36b277728f89\") " pod="openshift-insights/insights-operator-5885fdb759-425z6" Jul 24 14:35:43.226468 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.226445 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a0909119-831a-46d5-9ac9-36b277728f89-snapshots\") pod \"insights-operator-5885fdb759-425z6\" (UID: \"a0909119-831a-46d5-9ac9-36b277728f89\") " pod="openshift-insights/insights-operator-5885fdb759-425z6" Jul 24 14:35:43.226610 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.226483 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0909119-831a-46d5-9ac9-36b277728f89-tmp\") pod \"insights-operator-5885fdb759-425z6\" (UID: \"a0909119-831a-46d5-9ac9-36b277728f89\") " pod="openshift-insights/insights-operator-5885fdb759-425z6" Jul 24 14:35:43.226610 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.226499 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0909119-831a-46d5-9ac9-36b277728f89-service-ca-bundle\") pod \"insights-operator-5885fdb759-425z6\" (UID: \"a0909119-831a-46d5-9ac9-36b277728f89\") " pod="openshift-insights/insights-operator-5885fdb759-425z6" Jul 24 14:35:43.227107 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.227081 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0909119-831a-46d5-9ac9-36b277728f89-service-ca-bundle\") pod \"insights-operator-5885fdb759-425z6\" (UID: \"a0909119-831a-46d5-9ac9-36b277728f89\") " pod="openshift-insights/insights-operator-5885fdb759-425z6" Jul 24 14:35:43.227205 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.227180 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0909119-831a-46d5-9ac9-36b277728f89-tmp\") pod \"insights-operator-5885fdb759-425z6\" (UID: \"a0909119-831a-46d5-9ac9-36b277728f89\") " pod="openshift-insights/insights-operator-5885fdb759-425z6" Jul 24 14:35:43.227278 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.227230 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a0909119-831a-46d5-9ac9-36b277728f89-snapshots\") pod \"insights-operator-5885fdb759-425z6\" (UID: \"a0909119-831a-46d5-9ac9-36b277728f89\") " pod="openshift-insights/insights-operator-5885fdb759-425z6" Jul 24 14:35:43.227338 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.227328 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0909119-831a-46d5-9ac9-36b277728f89-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-425z6\" (UID: \"a0909119-831a-46d5-9ac9-36b277728f89\") " pod="openshift-insights/insights-operator-5885fdb759-425z6" Jul 24 14:35:43.228846 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.228826 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a0909119-831a-46d5-9ac9-36b277728f89-serving-cert\") pod \"insights-operator-5885fdb759-425z6\" (UID: \"a0909119-831a-46d5-9ac9-36b277728f89\") " pod="openshift-insights/insights-operator-5885fdb759-425z6" Jul 24 14:35:43.234513 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.234494 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq86l\" (UniqueName: \"kubernetes.io/projected/a0909119-831a-46d5-9ac9-36b277728f89-kube-api-access-kq86l\") pod \"insights-operator-5885fdb759-425z6\" (UID: \"a0909119-831a-46d5-9ac9-36b277728f89\") " pod="openshift-insights/insights-operator-5885fdb759-425z6" Jul 24 14:35:43.325400 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.325320 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-425z6" Jul 24 14:35:43.442556 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:43.442526 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-425z6"] Jul 24 14:35:43.445689 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:35:43.445656 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0909119_831a_46d5_9ac9_36b277728f89.slice/crio-e1cfa8516ee5f8755163dc59e6a411a25c0982488f91c6c507feb57d44b911c9 WatchSource:0}: Error finding container e1cfa8516ee5f8755163dc59e6a411a25c0982488f91c6c507feb57d44b911c9: Status 404 returned error can't find the container with id e1cfa8516ee5f8755163dc59e6a411a25c0982488f91c6c507feb57d44b911c9 Jul 24 14:35:44.362811 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:44.362769 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-425z6" event={"ID":"a0909119-831a-46d5-9ac9-36b277728f89","Type":"ContainerStarted","Data":"e1cfa8516ee5f8755163dc59e6a411a25c0982488f91c6c507feb57d44b911c9"} Jul 24 14:35:45.367198 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:45.367159 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-425z6" event={"ID":"a0909119-831a-46d5-9ac9-36b277728f89","Type":"ContainerStarted","Data":"98a46111b40cbed040f65034c4710d7421e1c3aa46bea32c4eb3c19844ffc931"} Jul 24 14:35:45.390380 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:45.390335 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-425z6" podStartSLOduration=1.5920309110000002 podStartE2EDuration="3.39032101s" totalImagesPullingTime="1.798290099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:35:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:45.390073017 +0000 UTC m=+82.928922544" watchObservedRunningTime="2026-07-24 14:35:45.39032101 +0000 UTC m=+82.929170562" Jul 24 14:35:46.092554 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:46.092521 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ljkrw"] Jul 24 14:35:46.094709 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:46.094689 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ljkrw" Jul 24 14:35:46.096667 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:46.096641 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-tls\" is forbidden: User \"system:node:ip-10-0-140-149.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-140-149.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" Jul 24 14:35:46.096758 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:46.096643 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-sa-dockercfg-slrpn\" is forbidden: User \"system:node:ip-10-0-140-149.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-140-149.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-slrpn\"" type="*v1.Secret" Jul 24 14:35:46.096898 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:46.096875 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-140-149.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-140-149.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" Jul 24 14:35:46.146904 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:46.146872 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ljkrw\" (UID: \"84400f39-82b9-4c0a-9755-2ce1e6baa0f3\") " pod="openshift-insights/insights-runtime-extractor-ljkrw" Jul 24 14:35:46.146904 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:46.146905 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-data-volume\") pod \"insights-runtime-extractor-ljkrw\" (UID: \"84400f39-82b9-4c0a-9755-2ce1e6baa0f3\") " pod="openshift-insights/insights-runtime-extractor-ljkrw" Jul 24 14:35:46.147099 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:46.146921 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ljkrw\" (UID: \"84400f39-82b9-4c0a-9755-2ce1e6baa0f3\") " pod="openshift-insights/insights-runtime-extractor-ljkrw" Jul 24 14:35:46.147099 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:46.146936 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl2bs\" (UniqueName: \"kubernetes.io/projected/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-kube-api-access-jl2bs\") pod \"insights-runtime-extractor-ljkrw\" (UID: \"84400f39-82b9-4c0a-9755-2ce1e6baa0f3\") " pod="openshift-insights/insights-runtime-extractor-ljkrw" Jul 24 14:35:46.147099 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:46.147050 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-crio-socket\") pod \"insights-runtime-extractor-ljkrw\" (UID: \"84400f39-82b9-4c0a-9755-2ce1e6baa0f3\") " pod="openshift-insights/insights-runtime-extractor-ljkrw" Jul 24 14:35:46.161699 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:46.161664 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ljkrw"] Jul 24 14:35:46.248217 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:46.248188 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ljkrw\" (UID: \"84400f39-82b9-4c0a-9755-2ce1e6baa0f3\") " pod="openshift-insights/insights-runtime-extractor-ljkrw" Jul 24 14:35:46.248217 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:46.248221 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-data-volume\") pod \"insights-runtime-extractor-ljkrw\" (UID: \"84400f39-82b9-4c0a-9755-2ce1e6baa0f3\") " pod="openshift-insights/insights-runtime-extractor-ljkrw" Jul 24 14:35:46.248419 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:46.248254 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ljkrw\" (UID: \"84400f39-82b9-4c0a-9755-2ce1e6baa0f3\") " pod="openshift-insights/insights-runtime-extractor-ljkrw" Jul 24 14:35:46.248419 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:46.248271 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl2bs\" (UniqueName: \"kubernetes.io/projected/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-kube-api-access-jl2bs\") pod \"insights-runtime-extractor-ljkrw\" (UID: \"84400f39-82b9-4c0a-9755-2ce1e6baa0f3\") " pod="openshift-insights/insights-runtime-extractor-ljkrw" Jul 24 14:35:46.248419 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:46.248305 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-crio-socket\") pod \"insights-runtime-extractor-ljkrw\" (UID: \"84400f39-82b9-4c0a-9755-2ce1e6baa0f3\") " pod="openshift-insights/insights-runtime-extractor-ljkrw" Jul 24 14:35:46.248419 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:46.248402 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-crio-socket\") pod \"insights-runtime-extractor-ljkrw\" (UID: \"84400f39-82b9-4c0a-9755-2ce1e6baa0f3\") " pod="openshift-insights/insights-runtime-extractor-ljkrw" Jul 24 14:35:46.248671 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:46.248652 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-data-volume\") pod \"insights-runtime-extractor-ljkrw\" (UID: \"84400f39-82b9-4c0a-9755-2ce1e6baa0f3\") " pod="openshift-insights/insights-runtime-extractor-ljkrw" Jul 24 14:35:46.263352 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:46.263324 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl2bs\" (UniqueName: \"kubernetes.io/projected/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-kube-api-access-jl2bs\") pod \"insights-runtime-extractor-ljkrw\" (UID: \"84400f39-82b9-4c0a-9755-2ce1e6baa0f3\") " pod="openshift-insights/insights-runtime-extractor-ljkrw" Jul 24 14:35:47.073609 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:47.073575 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 24 14:35:47.078722 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:47.078700 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 14:35:47.078832 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:47.078779 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-insights-runtime-extractor-tls podName:84400f39-82b9-4c0a-9755-2ce1e6baa0f3 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:47.578762366 +0000 UTC m=+85.117611874 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ljkrw" (UID: "84400f39-82b9-4c0a-9755-2ce1e6baa0f3") : secret "insights-runtime-extractor-tls" not found Jul 24 14:35:47.248771 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:47.248727 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: failed to sync configmap cache: timed out waiting for the condition Jul 24 14:35:47.248941 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:47.248825 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-kube-rbac-proxy-cm podName:84400f39-82b9-4c0a-9755-2ce1e6baa0f3 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:47.748805723 +0000 UTC m=+85.287655228 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ljkrw" (UID: "84400f39-82b9-4c0a-9755-2ce1e6baa0f3") : failed to sync configmap cache: timed out waiting for the condition Jul 24 14:35:47.359450 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:47.359361 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-slrpn\"" Jul 24 14:35:47.532135 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:47.532106 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 24 14:35:47.657231 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:47.657134 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ljkrw\" (UID: \"84400f39-82b9-4c0a-9755-2ce1e6baa0f3\") " pod="openshift-insights/insights-runtime-extractor-ljkrw" Jul 24 14:35:47.657393 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:47.657274 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 14:35:47.657393 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:47.657332 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-insights-runtime-extractor-tls podName:84400f39-82b9-4c0a-9755-2ce1e6baa0f3 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:48.657314959 +0000 UTC m=+86.196164463 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ljkrw" (UID: "84400f39-82b9-4c0a-9755-2ce1e6baa0f3") : secret "insights-runtime-extractor-tls" not found Jul 24 14:35:47.758009 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:47.757960 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ljkrw\" (UID: \"84400f39-82b9-4c0a-9755-2ce1e6baa0f3\") " pod="openshift-insights/insights-runtime-extractor-ljkrw" Jul 24 14:35:47.758185 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:47.758081 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 14:35:47.758185 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:47.758154 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-kube-rbac-proxy-cm podName:84400f39-82b9-4c0a-9755-2ce1e6baa0f3 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:48.758135448 +0000 UTC m=+86.296984953 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ljkrw" (UID: "84400f39-82b9-4c0a-9755-2ce1e6baa0f3") : configmap "kube-rbac-proxy" not found Jul 24 14:35:48.296591 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:48.296559 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tknp6_480812e2-0ab3-4c07-b971-d222f629b250/dns-node-resolver/0.log" Jul 24 14:35:48.663666 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:48.663585 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ljkrw\" (UID: \"84400f39-82b9-4c0a-9755-2ce1e6baa0f3\") " pod="openshift-insights/insights-runtime-extractor-ljkrw" Jul 24 14:35:48.663831 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:48.663681 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 14:35:48.663831 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:48.663742 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-insights-runtime-extractor-tls podName:84400f39-82b9-4c0a-9755-2ce1e6baa0f3 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:50.663728002 +0000 UTC m=+88.202577507 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ljkrw" (UID: "84400f39-82b9-4c0a-9755-2ce1e6baa0f3") : secret "insights-runtime-extractor-tls" not found Jul 24 14:35:48.764754 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:48.764714 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ljkrw\" (UID: \"84400f39-82b9-4c0a-9755-2ce1e6baa0f3\") " pod="openshift-insights/insights-runtime-extractor-ljkrw" Jul 24 14:35:48.764930 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:48.764798 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 14:35:48.764930 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:48.764850 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-kube-rbac-proxy-cm podName:84400f39-82b9-4c0a-9755-2ce1e6baa0f3 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:50.764837007 +0000 UTC m=+88.303686512 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ljkrw" (UID: "84400f39-82b9-4c0a-9755-2ce1e6baa0f3") : configmap "kube-rbac-proxy" not found Jul 24 14:35:49.097215 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:49.097185 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t646b_f51ed1d0-a38c-44c3-83c0-865ce0465977/node-ca/0.log" Jul 24 14:35:49.696696 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:49.696667 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j5g25_affd1875-04ba-449a-bd65-df82fc62df91/serve-healthcheck-canary/0.log" Jul 24 14:35:50.680600 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:50.680565 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ljkrw\" (UID: \"84400f39-82b9-4c0a-9755-2ce1e6baa0f3\") " pod="openshift-insights/insights-runtime-extractor-ljkrw" Jul 24 14:35:50.680772 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:50.680716 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 14:35:50.680816 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:50.680785 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-insights-runtime-extractor-tls podName:84400f39-82b9-4c0a-9755-2ce1e6baa0f3 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:54.680769265 +0000 UTC m=+92.219618773 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ljkrw" (UID: "84400f39-82b9-4c0a-9755-2ce1e6baa0f3") : secret "insights-runtime-extractor-tls" not found Jul 24 14:35:50.781637 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:50.781593 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ljkrw\" (UID: \"84400f39-82b9-4c0a-9755-2ce1e6baa0f3\") " pod="openshift-insights/insights-runtime-extractor-ljkrw" Jul 24 14:35:50.781993 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:50.781719 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 14:35:50.781993 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:50.781782 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-kube-rbac-proxy-cm podName:84400f39-82b9-4c0a-9755-2ce1e6baa0f3 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:54.781767394 +0000 UTC m=+92.320616899 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ljkrw" (UID: "84400f39-82b9-4c0a-9755-2ce1e6baa0f3") : configmap "kube-rbac-proxy" not found Jul 24 14:35:52.856415 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.856380 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gnfwq"] Jul 24 14:35:52.858605 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.858590 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gnfwq" Jul 24 14:35:52.860780 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.860755 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-h4kz9\"" Jul 24 14:35:52.861143 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.861125 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 24 14:35:52.861427 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.861401 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 24 14:35:52.867492 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.867469 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w"] Jul 24 14:35:52.869179 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.869162 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w" Jul 24 14:35:52.880654 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.880632 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 24 14:35:52.880750 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.880635 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 24 14:35:52.881744 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.881726 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 24 14:35:52.882582 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.882561 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gnfwq"] Jul 24 14:35:52.882843 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.882828 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 24 14:35:52.884660 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.884643 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-wvwxb\"" Jul 24 14:35:52.897467 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.897440 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2mjc\" (UniqueName: \"kubernetes.io/projected/9312eedd-5786-4fba-8ac5-0ca3311853c3-kube-api-access-p2mjc\") pod \"volume-data-source-validator-549c6d54cf-gnfwq\" (UID: \"9312eedd-5786-4fba-8ac5-0ca3311853c3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gnfwq" Jul 24 14:35:52.919878 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.919853 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w"] Jul 24 14:35:52.981031 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.981003 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nvcvq"] Jul 24 14:35:52.982882 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.982866 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nvcvq" Jul 24 14:35:52.985154 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.985136 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hdcd4\"" Jul 24 14:35:52.985533 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.985516 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 24 14:35:52.985638 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.985624 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 24 14:35:52.985829 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.985813 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 24 14:35:52.989409 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.989383 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-bx87n"] Jul 24 14:35:52.991264 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.991248 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" Jul 24 14:35:52.995015 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.994994 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 24 14:35:52.995108 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.994996 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 24 14:35:52.995924 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.995905 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 24 14:35:52.996058 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.996036 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-2828g\"" Jul 24 14:35:52.998296 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.997294 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 24 14:35:53.001698 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.998891 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tbvs\" (UniqueName: \"kubernetes.io/projected/972377ec-7ec3-492e-83e7-3a65e365274c-kube-api-access-2tbvs\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w\" (UID: \"972377ec-7ec3-492e-83e7-3a65e365274c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w" Jul 24 14:35:53.001698 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.999061 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/972377ec-7ec3-492e-83e7-3a65e365274c-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w\" (UID: \"972377ec-7ec3-492e-83e7-3a65e365274c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w" Jul 24 14:35:53.001698 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.999314 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2mjc\" (UniqueName: \"kubernetes.io/projected/9312eedd-5786-4fba-8ac5-0ca3311853c3-kube-api-access-p2mjc\") pod \"volume-data-source-validator-549c6d54cf-gnfwq\" (UID: \"9312eedd-5786-4fba-8ac5-0ca3311853c3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gnfwq" Jul 24 14:35:53.001698 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:52.999356 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/972377ec-7ec3-492e-83e7-3a65e365274c-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w\" (UID: \"972377ec-7ec3-492e-83e7-3a65e365274c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w" Jul 24 14:35:53.001698 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.000460 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nvcvq"] Jul 24 14:35:53.004597 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.004573 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-bx87n"] Jul 24 14:35:53.005459 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.005440 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 24 14:35:53.015433 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.015414 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2mjc\" (UniqueName: \"kubernetes.io/projected/9312eedd-5786-4fba-8ac5-0ca3311853c3-kube-api-access-p2mjc\") pod \"volume-data-source-validator-549c6d54cf-gnfwq\" (UID: \"9312eedd-5786-4fba-8ac5-0ca3311853c3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gnfwq" Jul 24 14:35:53.100422 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.100386 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/972377ec-7ec3-492e-83e7-3a65e365274c-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w\" (UID: \"972377ec-7ec3-492e-83e7-3a65e365274c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w" Jul 24 14:35:53.100422 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.100426 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl5ct\" (UniqueName: \"kubernetes.io/projected/29194dab-422f-4d5b-b931-2233fa973344-kube-api-access-vl5ct\") pod \"cluster-samples-operator-6748489656-nvcvq\" (UID: \"29194dab-422f-4d5b-b931-2233fa973344\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nvcvq" Jul 24 14:35:53.100647 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.100446 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d54a10a-875a-45fd-8c7a-100dd1a7d3ca-serving-cert\") pod \"console-operator-584dcb6b54-bx87n\" (UID: \"0d54a10a-875a-45fd-8c7a-100dd1a7d3ca\") " pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" Jul 24 14:35:53.100647 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.100483 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d54a10a-875a-45fd-8c7a-100dd1a7d3ca-trusted-ca\") pod \"console-operator-584dcb6b54-bx87n\" (UID: \"0d54a10a-875a-45fd-8c7a-100dd1a7d3ca\") " pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" Jul 24 14:35:53.100647 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.100540 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rwnd\" (UniqueName: \"kubernetes.io/projected/0d54a10a-875a-45fd-8c7a-100dd1a7d3ca-kube-api-access-6rwnd\") pod \"console-operator-584dcb6b54-bx87n\" (UID: \"0d54a10a-875a-45fd-8c7a-100dd1a7d3ca\") " pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" Jul 24 14:35:53.100647 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.100604 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tbvs\" (UniqueName: \"kubernetes.io/projected/972377ec-7ec3-492e-83e7-3a65e365274c-kube-api-access-2tbvs\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w\" (UID: \"972377ec-7ec3-492e-83e7-3a65e365274c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w" Jul 24 14:35:53.100647 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.100624 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d54a10a-875a-45fd-8c7a-100dd1a7d3ca-config\") pod \"console-operator-584dcb6b54-bx87n\" (UID: \"0d54a10a-875a-45fd-8c7a-100dd1a7d3ca\") " pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" Jul 24 14:35:53.100866 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.100651 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/29194dab-422f-4d5b-b931-2233fa973344-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-nvcvq\" (UID: \"29194dab-422f-4d5b-b931-2233fa973344\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nvcvq" Jul 24 14:35:53.100866 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.100698 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/972377ec-7ec3-492e-83e7-3a65e365274c-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w\" (UID: \"972377ec-7ec3-492e-83e7-3a65e365274c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w" Jul 24 14:35:53.101026 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.101002 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/972377ec-7ec3-492e-83e7-3a65e365274c-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w\" (UID: \"972377ec-7ec3-492e-83e7-3a65e365274c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w" Jul 24 14:35:53.102773 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.102746 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/972377ec-7ec3-492e-83e7-3a65e365274c-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w\" (UID: \"972377ec-7ec3-492e-83e7-3a65e365274c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w" Jul 24 14:35:53.108413 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.108364 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tbvs\" (UniqueName: \"kubernetes.io/projected/972377ec-7ec3-492e-83e7-3a65e365274c-kube-api-access-2tbvs\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w\" (UID: \"972377ec-7ec3-492e-83e7-3a65e365274c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w" Jul 24 14:35:53.168493 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.168450 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gnfwq" Jul 24 14:35:53.176756 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.176734 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w" Jul 24 14:35:53.201977 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.201941 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl5ct\" (UniqueName: \"kubernetes.io/projected/29194dab-422f-4d5b-b931-2233fa973344-kube-api-access-vl5ct\") pod \"cluster-samples-operator-6748489656-nvcvq\" (UID: \"29194dab-422f-4d5b-b931-2233fa973344\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nvcvq" Jul 24 14:35:53.201977 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.201978 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d54a10a-875a-45fd-8c7a-100dd1a7d3ca-serving-cert\") pod \"console-operator-584dcb6b54-bx87n\" (UID: \"0d54a10a-875a-45fd-8c7a-100dd1a7d3ca\") " pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" Jul 24 14:35:53.202210 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.202021 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d54a10a-875a-45fd-8c7a-100dd1a7d3ca-trusted-ca\") pod \"console-operator-584dcb6b54-bx87n\" (UID: \"0d54a10a-875a-45fd-8c7a-100dd1a7d3ca\") " pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" Jul 24 14:35:53.202210 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.202051 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rwnd\" (UniqueName: \"kubernetes.io/projected/0d54a10a-875a-45fd-8c7a-100dd1a7d3ca-kube-api-access-6rwnd\") pod \"console-operator-584dcb6b54-bx87n\" (UID: \"0d54a10a-875a-45fd-8c7a-100dd1a7d3ca\") " pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" Jul 24 14:35:53.202210 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.202201 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d54a10a-875a-45fd-8c7a-100dd1a7d3ca-config\") pod \"console-operator-584dcb6b54-bx87n\" (UID: \"0d54a10a-875a-45fd-8c7a-100dd1a7d3ca\") " pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" Jul 24 14:35:53.202387 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.202271 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/29194dab-422f-4d5b-b931-2233fa973344-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-nvcvq\" (UID: \"29194dab-422f-4d5b-b931-2233fa973344\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nvcvq" Jul 24 14:35:53.202444 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:53.202413 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 14:35:53.202523 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:53.202508 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29194dab-422f-4d5b-b931-2233fa973344-samples-operator-tls podName:29194dab-422f-4d5b-b931-2233fa973344 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:53.702468405 +0000 UTC m=+91.241317910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/29194dab-422f-4d5b-b931-2233fa973344-samples-operator-tls") pod "cluster-samples-operator-6748489656-nvcvq" (UID: "29194dab-422f-4d5b-b931-2233fa973344") : secret "samples-operator-tls" not found Jul 24 14:35:53.202949 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.202929 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d54a10a-875a-45fd-8c7a-100dd1a7d3ca-config\") pod \"console-operator-584dcb6b54-bx87n\" (UID: \"0d54a10a-875a-45fd-8c7a-100dd1a7d3ca\") " pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" Jul 24 14:35:53.203297 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.203273 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d54a10a-875a-45fd-8c7a-100dd1a7d3ca-trusted-ca\") pod \"console-operator-584dcb6b54-bx87n\" (UID: \"0d54a10a-875a-45fd-8c7a-100dd1a7d3ca\") " pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" Jul 24 14:35:53.204519 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.204467 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d54a10a-875a-45fd-8c7a-100dd1a7d3ca-serving-cert\") pod \"console-operator-584dcb6b54-bx87n\" (UID: \"0d54a10a-875a-45fd-8c7a-100dd1a7d3ca\") " pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" Jul 24 14:35:53.213953 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.213922 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rwnd\" (UniqueName: \"kubernetes.io/projected/0d54a10a-875a-45fd-8c7a-100dd1a7d3ca-kube-api-access-6rwnd\") pod \"console-operator-584dcb6b54-bx87n\" (UID: \"0d54a10a-875a-45fd-8c7a-100dd1a7d3ca\") " pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" Jul 24 14:35:53.215367 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.214759 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl5ct\" (UniqueName: \"kubernetes.io/projected/29194dab-422f-4d5b-b931-2233fa973344-kube-api-access-vl5ct\") pod \"cluster-samples-operator-6748489656-nvcvq\" (UID: \"29194dab-422f-4d5b-b931-2233fa973344\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nvcvq" Jul 24 14:35:53.297753 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.297709 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gnfwq"] Jul 24 14:35:53.301172 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:35:53.301146 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9312eedd_5786_4fba_8ac5_0ca3311853c3.slice/crio-d72559620912ab89f73653ffe1436f5199d5112f40f5670f9048fd1097a8cb61 WatchSource:0}: Error finding container d72559620912ab89f73653ffe1436f5199d5112f40f5670f9048fd1097a8cb61: Status 404 returned error can't find the container with id d72559620912ab89f73653ffe1436f5199d5112f40f5670f9048fd1097a8cb61 Jul 24 14:35:53.302372 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.302351 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" Jul 24 14:35:53.317981 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.317958 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w"] Jul 24 14:35:53.320627 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:35:53.320604 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod972377ec_7ec3_492e_83e7_3a65e365274c.slice/crio-938ab82c93382633107d14877211ef89b42c7e57f505826186e6bb92a74ce494 WatchSource:0}: Error finding container 938ab82c93382633107d14877211ef89b42c7e57f505826186e6bb92a74ce494: Status 404 returned error can't find the container with id 938ab82c93382633107d14877211ef89b42c7e57f505826186e6bb92a74ce494 Jul 24 14:35:53.387386 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.387351 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gnfwq" event={"ID":"9312eedd-5786-4fba-8ac5-0ca3311853c3","Type":"ContainerStarted","Data":"d72559620912ab89f73653ffe1436f5199d5112f40f5670f9048fd1097a8cb61"} Jul 24 14:35:53.388607 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.388581 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w" event={"ID":"972377ec-7ec3-492e-83e7-3a65e365274c","Type":"ContainerStarted","Data":"938ab82c93382633107d14877211ef89b42c7e57f505826186e6bb92a74ce494"} Jul 24 14:35:53.431796 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.431768 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-bx87n"] Jul 24 14:35:53.435045 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:35:53.435021 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d54a10a_875a_45fd_8c7a_100dd1a7d3ca.slice/crio-f9c51481f05b9ec400a04023acd52a1fb9d272d21eeb14b220c6b88fec4d790f WatchSource:0}: Error finding container f9c51481f05b9ec400a04023acd52a1fb9d272d21eeb14b220c6b88fec4d790f: Status 404 returned error can't find the container with id f9c51481f05b9ec400a04023acd52a1fb9d272d21eeb14b220c6b88fec4d790f Jul 24 14:35:53.706317 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:53.706202 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/29194dab-422f-4d5b-b931-2233fa973344-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-nvcvq\" (UID: \"29194dab-422f-4d5b-b931-2233fa973344\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nvcvq" Jul 24 14:35:53.706484 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:53.706356 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 14:35:53.706484 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:53.706425 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29194dab-422f-4d5b-b931-2233fa973344-samples-operator-tls podName:29194dab-422f-4d5b-b931-2233fa973344 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:54.706406569 +0000 UTC m=+92.245256074 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/29194dab-422f-4d5b-b931-2233fa973344-samples-operator-tls") pod "cluster-samples-operator-6748489656-nvcvq" (UID: "29194dab-422f-4d5b-b931-2233fa973344") : secret "samples-operator-tls" not found Jul 24 14:35:54.393732 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:54.393699 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" event={"ID":"0d54a10a-875a-45fd-8c7a-100dd1a7d3ca","Type":"ContainerStarted","Data":"f9c51481f05b9ec400a04023acd52a1fb9d272d21eeb14b220c6b88fec4d790f"} Jul 24 14:35:54.715836 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:54.715795 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ljkrw\" (UID: \"84400f39-82b9-4c0a-9755-2ce1e6baa0f3\") " pod="openshift-insights/insights-runtime-extractor-ljkrw" Jul 24 14:35:54.716112 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:54.715911 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/29194dab-422f-4d5b-b931-2233fa973344-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-nvcvq\" (UID: \"29194dab-422f-4d5b-b931-2233fa973344\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nvcvq" Jul 24 14:35:54.716112 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:54.715955 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 14:35:54.716112 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:54.716031 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-insights-runtime-extractor-tls podName:84400f39-82b9-4c0a-9755-2ce1e6baa0f3 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:02.716008121 +0000 UTC m=+100.254857648 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ljkrw" (UID: "84400f39-82b9-4c0a-9755-2ce1e6baa0f3") : secret "insights-runtime-extractor-tls" not found Jul 24 14:35:54.716112 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:54.716075 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 14:35:54.716457 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:54.716125 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29194dab-422f-4d5b-b931-2233fa973344-samples-operator-tls podName:29194dab-422f-4d5b-b931-2233fa973344 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:56.716109374 +0000 UTC m=+94.254958881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/29194dab-422f-4d5b-b931-2233fa973344-samples-operator-tls") pod "cluster-samples-operator-6748489656-nvcvq" (UID: "29194dab-422f-4d5b-b931-2233fa973344") : secret "samples-operator-tls" not found Jul 24 14:35:54.817326 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:54.817289 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ljkrw\" (UID: \"84400f39-82b9-4c0a-9755-2ce1e6baa0f3\") " pod="openshift-insights/insights-runtime-extractor-ljkrw" Jul 24 14:35:54.817549 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:54.817415 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 14:35:54.817549 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:54.817493 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-kube-rbac-proxy-cm podName:84400f39-82b9-4c0a-9755-2ce1e6baa0f3 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:02.817472862 +0000 UTC m=+100.356322370 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ljkrw" (UID: "84400f39-82b9-4c0a-9755-2ce1e6baa0f3") : configmap "kube-rbac-proxy" not found Jul 24 14:35:55.398409 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:55.398365 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gnfwq" event={"ID":"9312eedd-5786-4fba-8ac5-0ca3311853c3","Type":"ContainerStarted","Data":"e05b1ed9eea59c236f0215b4cb13d2e3dfc0312de515bbbde62927a19cfc78fc"} Jul 24 14:35:55.419697 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:55.419646 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gnfwq" podStartSLOduration=2.201622218 podStartE2EDuration="3.419630973s" totalImagesPullingTime="1.218008755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:35:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:55.419204742 +0000 UTC m=+92.958054274" watchObservedRunningTime="2026-07-24 14:35:55.419630973 +0000 UTC m=+92.958480501" Jul 24 14:35:56.403288 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:56.403251 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w" event={"ID":"972377ec-7ec3-492e-83e7-3a65e365274c","Type":"ContainerStarted","Data":"c4cf58acb8e9bf500e98a3b240ac72ed684e66215ebd0a61e8b12236841b79db"} Jul 24 14:35:56.404806 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:56.404787 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bx87n_0d54a10a-875a-45fd-8c7a-100dd1a7d3ca/console-operator/0.log" Jul 24 14:35:56.404904 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:56.404823 2582 generic.go:356] "Generic (PLEG): container finished" podID="0d54a10a-875a-45fd-8c7a-100dd1a7d3ca" containerID="e9c6fbdd02c2d38d245764c2f76e5d70df1aeb995bcb5f77f5843419da1be327" exitCode=255 Jul 24 14:35:56.404904 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:56.404893 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" event={"ID":"0d54a10a-875a-45fd-8c7a-100dd1a7d3ca","Type":"ContainerDied","Data":"e9c6fbdd02c2d38d245764c2f76e5d70df1aeb995bcb5f77f5843419da1be327"} Jul 24 14:35:56.405121 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:56.405105 2582 scope.go:117] "RemoveContainer" containerID="e9c6fbdd02c2d38d245764c2f76e5d70df1aeb995bcb5f77f5843419da1be327" Jul 24 14:35:56.420511 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:56.420466 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w" podStartSLOduration=1.9893700490000001 podStartE2EDuration="4.420447599s" totalImagesPullingTime="2.43107755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:35:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:56.419343341 +0000 UTC m=+93.958192869" watchObservedRunningTime="2026-07-24 14:35:56.420447599 +0000 UTC m=+93.959297127" Jul 24 14:35:56.736016 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:56.735980 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/29194dab-422f-4d5b-b931-2233fa973344-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-nvcvq\" (UID: \"29194dab-422f-4d5b-b931-2233fa973344\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nvcvq" Jul 24 14:35:56.736195 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:56.736095 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 14:35:56.736195 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:56.736147 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29194dab-422f-4d5b-b931-2233fa973344-samples-operator-tls podName:29194dab-422f-4d5b-b931-2233fa973344 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:00.736134538 +0000 UTC m=+98.274984043 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/29194dab-422f-4d5b-b931-2233fa973344-samples-operator-tls") pod "cluster-samples-operator-6748489656-nvcvq" (UID: "29194dab-422f-4d5b-b931-2233fa973344") : secret "samples-operator-tls" not found Jul 24 14:35:57.410082 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:57.410055 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bx87n_0d54a10a-875a-45fd-8c7a-100dd1a7d3ca/console-operator/1.log" Jul 24 14:35:57.410519 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:57.410403 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bx87n_0d54a10a-875a-45fd-8c7a-100dd1a7d3ca/console-operator/0.log" Jul 24 14:35:57.410519 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:57.410437 2582 generic.go:356] "Generic (PLEG): container finished" podID="0d54a10a-875a-45fd-8c7a-100dd1a7d3ca" containerID="289dc03b64d10de9ad4c0765d832f3d3f7afe1c116f1315df21467b3c6a1e50c" exitCode=255 Jul 24 14:35:57.410519 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:57.410470 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" event={"ID":"0d54a10a-875a-45fd-8c7a-100dd1a7d3ca","Type":"ContainerDied","Data":"289dc03b64d10de9ad4c0765d832f3d3f7afe1c116f1315df21467b3c6a1e50c"} Jul 24 14:35:57.410626 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:57.410527 2582 scope.go:117] "RemoveContainer" containerID="e9c6fbdd02c2d38d245764c2f76e5d70df1aeb995bcb5f77f5843419da1be327" Jul 24 14:35:57.410855 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:57.410832 2582 scope.go:117] "RemoveContainer" containerID="289dc03b64d10de9ad4c0765d832f3d3f7afe1c116f1315df21467b3c6a1e50c" Jul 24 14:35:57.410981 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:57.410967 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-bx87n_openshift-console-operator(0d54a10a-875a-45fd-8c7a-100dd1a7d3ca)\"" pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" podUID="0d54a10a-875a-45fd-8c7a-100dd1a7d3ca" Jul 24 14:35:58.415030 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:58.415001 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bx87n_0d54a10a-875a-45fd-8c7a-100dd1a7d3ca/console-operator/1.log" Jul 24 14:35:58.415413 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:35:58.415316 2582 scope.go:117] "RemoveContainer" containerID="289dc03b64d10de9ad4c0765d832f3d3f7afe1c116f1315df21467b3c6a1e50c" Jul 24 14:35:58.415471 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:35:58.415453 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-bx87n_openshift-console-operator(0d54a10a-875a-45fd-8c7a-100dd1a7d3ca)\"" pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" podUID="0d54a10a-875a-45fd-8c7a-100dd1a7d3ca" Jul 24 14:36:00.771173 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:00.771120 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/29194dab-422f-4d5b-b931-2233fa973344-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-nvcvq\" (UID: \"29194dab-422f-4d5b-b931-2233fa973344\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nvcvq" Jul 24 14:36:00.771614 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:36:00.771335 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 14:36:00.771614 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:36:00.771398 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29194dab-422f-4d5b-b931-2233fa973344-samples-operator-tls podName:29194dab-422f-4d5b-b931-2233fa973344 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:08.7713804 +0000 UTC m=+106.310229909 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/29194dab-422f-4d5b-b931-2233fa973344-samples-operator-tls") pod "cluster-samples-operator-6748489656-nvcvq" (UID: "29194dab-422f-4d5b-b931-2233fa973344") : secret "samples-operator-tls" not found Jul 24 14:36:01.175486 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:01.175391 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/836ce326-bf5d-4c96-9a71-da5ab147043f-metrics-tls\") pod \"dns-default-g7zlw\" (UID: \"836ce326-bf5d-4c96-9a71-da5ab147043f\") " pod="openshift-dns/dns-default-g7zlw" Jul 24 14:36:01.175635 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:36:01.175508 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:36:01.175635 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:36:01.175558 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/836ce326-bf5d-4c96-9a71-da5ab147043f-metrics-tls podName:836ce326-bf5d-4c96-9a71-da5ab147043f nodeName:}" failed. No retries permitted until 2026-07-24 14:37:05.175545232 +0000 UTC m=+162.714394738 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/836ce326-bf5d-4c96-9a71-da5ab147043f-metrics-tls") pod "dns-default-g7zlw" (UID: "836ce326-bf5d-4c96-9a71-da5ab147043f") : secret "dns-default-metrics-tls" not found Jul 24 14:36:02.008772 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:02.008739 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9rmd"] Jul 24 14:36:02.011365 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:02.011348 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9rmd" Jul 24 14:36:02.013756 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:02.013728 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 24 14:36:02.013858 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:02.013793 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 24 14:36:02.013858 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:02.013803 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 24 14:36:02.013858 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:02.013815 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 24 14:36:02.014463 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:02.014446 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-phvm2\"" Jul 24 14:36:02.026488 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:02.026465 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9rmd"] Jul 24 14:36:02.081577 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:02.081542 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e938d4d-fbf3-484a-a4a1-5aebb70b79c4-serving-cert\") pod \"service-ca-operator-5d6c75f84f-k9rmd\" (UID: \"6e938d4d-fbf3-484a-a4a1-5aebb70b79c4\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9rmd" Jul 24 14:36:02.081711 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:02.081583 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e938d4d-fbf3-484a-a4a1-5aebb70b79c4-config\") pod \"service-ca-operator-5d6c75f84f-k9rmd\" (UID: \"6e938d4d-fbf3-484a-a4a1-5aebb70b79c4\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9rmd" Jul 24 14:36:02.081711 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:02.081668 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwmtf\" (UniqueName: \"kubernetes.io/projected/6e938d4d-fbf3-484a-a4a1-5aebb70b79c4-kube-api-access-mwmtf\") pod \"service-ca-operator-5d6c75f84f-k9rmd\" (UID: \"6e938d4d-fbf3-484a-a4a1-5aebb70b79c4\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9rmd" Jul 24 14:36:02.182618 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:02.182581 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwmtf\" (UniqueName: \"kubernetes.io/projected/6e938d4d-fbf3-484a-a4a1-5aebb70b79c4-kube-api-access-mwmtf\") pod \"service-ca-operator-5d6c75f84f-k9rmd\" (UID: \"6e938d4d-fbf3-484a-a4a1-5aebb70b79c4\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9rmd" Jul 24 14:36:02.182784 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:02.182670 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e938d4d-fbf3-484a-a4a1-5aebb70b79c4-serving-cert\") pod \"service-ca-operator-5d6c75f84f-k9rmd\" (UID: \"6e938d4d-fbf3-484a-a4a1-5aebb70b79c4\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9rmd" Jul 24 14:36:02.182784 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:02.182694 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e938d4d-fbf3-484a-a4a1-5aebb70b79c4-config\") pod \"service-ca-operator-5d6c75f84f-k9rmd\" (UID: \"6e938d4d-fbf3-484a-a4a1-5aebb70b79c4\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9rmd" Jul 24 14:36:02.183231 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:02.183212 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e938d4d-fbf3-484a-a4a1-5aebb70b79c4-config\") pod \"service-ca-operator-5d6c75f84f-k9rmd\" (UID: \"6e938d4d-fbf3-484a-a4a1-5aebb70b79c4\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9rmd" Jul 24 14:36:02.184917 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:02.184896 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e938d4d-fbf3-484a-a4a1-5aebb70b79c4-serving-cert\") pod \"service-ca-operator-5d6c75f84f-k9rmd\" (UID: \"6e938d4d-fbf3-484a-a4a1-5aebb70b79c4\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9rmd" Jul 24 14:36:02.191468 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:02.191449 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwmtf\" (UniqueName: \"kubernetes.io/projected/6e938d4d-fbf3-484a-a4a1-5aebb70b79c4-kube-api-access-mwmtf\") pod \"service-ca-operator-5d6c75f84f-k9rmd\" (UID: \"6e938d4d-fbf3-484a-a4a1-5aebb70b79c4\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9rmd" Jul 24 14:36:02.320034 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:02.319936 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9rmd" Jul 24 14:36:02.447901 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:02.447867 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9rmd"] Jul 24 14:36:02.451802 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:36:02.451775 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e938d4d_fbf3_484a_a4a1_5aebb70b79c4.slice/crio-338fabb2cb5831a6d34e6f1abc9ea1264f8bb771105bcda49192767b1dfa33f4 WatchSource:0}: Error finding container 338fabb2cb5831a6d34e6f1abc9ea1264f8bb771105bcda49192767b1dfa33f4: Status 404 returned error can't find the container with id 338fabb2cb5831a6d34e6f1abc9ea1264f8bb771105bcda49192767b1dfa33f4 Jul 24 14:36:02.788564 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:02.788524 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ljkrw\" (UID: \"84400f39-82b9-4c0a-9755-2ce1e6baa0f3\") " pod="openshift-insights/insights-runtime-extractor-ljkrw" Jul 24 14:36:02.788779 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:36:02.788691 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 14:36:02.788779 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:36:02.788769 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-insights-runtime-extractor-tls podName:84400f39-82b9-4c0a-9755-2ce1e6baa0f3 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:18.788747335 +0000 UTC m=+116.327596844 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ljkrw" (UID: "84400f39-82b9-4c0a-9755-2ce1e6baa0f3") : secret "insights-runtime-extractor-tls" not found Jul 24 14:36:02.889931 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:02.889886 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ljkrw\" (UID: \"84400f39-82b9-4c0a-9755-2ce1e6baa0f3\") " pod="openshift-insights/insights-runtime-extractor-ljkrw" Jul 24 14:36:02.890471 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:02.890448 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ljkrw\" (UID: \"84400f39-82b9-4c0a-9755-2ce1e6baa0f3\") " pod="openshift-insights/insights-runtime-extractor-ljkrw" Jul 24 14:36:03.302618 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:03.302578 2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" Jul 24 14:36:03.303040 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:03.302649 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" Jul 24 14:36:03.303105 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:03.303038 2582 scope.go:117] "RemoveContainer" containerID="289dc03b64d10de9ad4c0765d832f3d3f7afe1c116f1315df21467b3c6a1e50c" Jul 24 14:36:03.303214 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:36:03.303189 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-bx87n_openshift-console-operator(0d54a10a-875a-45fd-8c7a-100dd1a7d3ca)\"" pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" podUID="0d54a10a-875a-45fd-8c7a-100dd1a7d3ca" Jul 24 14:36:03.431926 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:03.431891 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9rmd" event={"ID":"6e938d4d-fbf3-484a-a4a1-5aebb70b79c4","Type":"ContainerStarted","Data":"338fabb2cb5831a6d34e6f1abc9ea1264f8bb771105bcda49192767b1dfa33f4"} Jul 24 14:36:05.342081 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:05.342051 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lbbkb" Jul 24 14:36:05.438695 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:05.438662 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9rmd" event={"ID":"6e938d4d-fbf3-484a-a4a1-5aebb70b79c4","Type":"ContainerStarted","Data":"c0846227672ef97845c97af0fd154b410d2ed17f3a855396ea36ddcf825d3780"} Jul 24 14:36:05.454777 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:05.454721 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9rmd" podStartSLOduration=2.144271266 podStartE2EDuration="4.454703842s" totalImagesPullingTime="2.310432576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:05.454413107 +0000 UTC m=+102.993262640" watchObservedRunningTime="2026-07-24 14:36:05.454703842 +0000 UTC m=+102.993553369" Jul 24 14:36:08.836778 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:08.836735 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/29194dab-422f-4d5b-b931-2233fa973344-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-nvcvq\" (UID: \"29194dab-422f-4d5b-b931-2233fa973344\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nvcvq" Jul 24 14:36:08.837307 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:36:08.836858 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 14:36:08.837307 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:36:08.836916 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29194dab-422f-4d5b-b931-2233fa973344-samples-operator-tls podName:29194dab-422f-4d5b-b931-2233fa973344 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:24.836899671 +0000 UTC m=+122.375749177 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/29194dab-422f-4d5b-b931-2233fa973344-samples-operator-tls") pod "cluster-samples-operator-6748489656-nvcvq" (UID: "29194dab-422f-4d5b-b931-2233fa973344") : secret "samples-operator-tls" not found Jul 24 14:36:09.284048 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:09.284012 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-n24dt"] Jul 24 14:36:09.286161 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:09.286145 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-n24dt" Jul 24 14:36:09.288289 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:09.288264 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 24 14:36:09.288289 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:09.288278 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 24 14:36:09.288498 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:09.288304 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 24 14:36:09.288914 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:09.288896 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-999gm\"" Jul 24 14:36:09.289026 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:09.288947 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 24 14:36:09.294481 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:09.294456 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-n24dt"] Jul 24 14:36:09.441195 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:09.441164 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/33543b2b-a122-4ca0-a016-130c98684a6e-signing-cabundle\") pod \"service-ca-658d7b7c78-n24dt\" (UID: \"33543b2b-a122-4ca0-a016-130c98684a6e\") " pod="openshift-service-ca/service-ca-658d7b7c78-n24dt" Jul 24 14:36:09.441376 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:09.441231 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gck2h\" (UniqueName: \"kubernetes.io/projected/33543b2b-a122-4ca0-a016-130c98684a6e-kube-api-access-gck2h\") pod \"service-ca-658d7b7c78-n24dt\" (UID: \"33543b2b-a122-4ca0-a016-130c98684a6e\") " pod="openshift-service-ca/service-ca-658d7b7c78-n24dt" Jul 24 14:36:09.441376 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:09.441318 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/33543b2b-a122-4ca0-a016-130c98684a6e-signing-key\") pod \"service-ca-658d7b7c78-n24dt\" (UID: \"33543b2b-a122-4ca0-a016-130c98684a6e\") " pod="openshift-service-ca/service-ca-658d7b7c78-n24dt" Jul 24 14:36:09.542741 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:09.542658 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gck2h\" (UniqueName: \"kubernetes.io/projected/33543b2b-a122-4ca0-a016-130c98684a6e-kube-api-access-gck2h\") pod \"service-ca-658d7b7c78-n24dt\" (UID: \"33543b2b-a122-4ca0-a016-130c98684a6e\") " pod="openshift-service-ca/service-ca-658d7b7c78-n24dt" Jul 24 14:36:09.542741 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:09.542737 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/33543b2b-a122-4ca0-a016-130c98684a6e-signing-key\") pod \"service-ca-658d7b7c78-n24dt\" (UID: \"33543b2b-a122-4ca0-a016-130c98684a6e\") " pod="openshift-service-ca/service-ca-658d7b7c78-n24dt" Jul 24 14:36:09.542935 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:09.542766 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/33543b2b-a122-4ca0-a016-130c98684a6e-signing-cabundle\") pod \"service-ca-658d7b7c78-n24dt\" (UID: \"33543b2b-a122-4ca0-a016-130c98684a6e\") " pod="openshift-service-ca/service-ca-658d7b7c78-n24dt" Jul 24 14:36:09.543485 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:09.543464 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/33543b2b-a122-4ca0-a016-130c98684a6e-signing-cabundle\") pod \"service-ca-658d7b7c78-n24dt\" (UID: \"33543b2b-a122-4ca0-a016-130c98684a6e\") " pod="openshift-service-ca/service-ca-658d7b7c78-n24dt" Jul 24 14:36:09.545112 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:09.545095 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/33543b2b-a122-4ca0-a016-130c98684a6e-signing-key\") pod \"service-ca-658d7b7c78-n24dt\" (UID: \"33543b2b-a122-4ca0-a016-130c98684a6e\") " pod="openshift-service-ca/service-ca-658d7b7c78-n24dt" Jul 24 14:36:09.551801 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:09.551775 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gck2h\" (UniqueName: \"kubernetes.io/projected/33543b2b-a122-4ca0-a016-130c98684a6e-kube-api-access-gck2h\") pod \"service-ca-658d7b7c78-n24dt\" (UID: \"33543b2b-a122-4ca0-a016-130c98684a6e\") " pod="openshift-service-ca/service-ca-658d7b7c78-n24dt" Jul 24 14:36:09.595437 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:09.595407 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-n24dt" Jul 24 14:36:09.720518 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:09.720495 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-n24dt"] Jul 24 14:36:09.722746 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:36:09.722719 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33543b2b_a122_4ca0_a016_130c98684a6e.slice/crio-b59cf451fb33aba2b56a878c40b6e6fcb1bed259be491bfd452b14facbd79122 WatchSource:0}: Error finding container b59cf451fb33aba2b56a878c40b6e6fcb1bed259be491bfd452b14facbd79122: Status 404 returned error can't find the container with id b59cf451fb33aba2b56a878c40b6e6fcb1bed259be491bfd452b14facbd79122 Jul 24 14:36:10.454889 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:10.454857 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-n24dt" event={"ID":"33543b2b-a122-4ca0-a016-130c98684a6e","Type":"ContainerStarted","Data":"1cfaec1fac22921d0b617a2d3b596997ee503acd34a32bb252d061708781115c"} Jul 24 14:36:10.455267 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:10.454905 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-n24dt" event={"ID":"33543b2b-a122-4ca0-a016-130c98684a6e","Type":"ContainerStarted","Data":"b59cf451fb33aba2b56a878c40b6e6fcb1bed259be491bfd452b14facbd79122"} Jul 24 14:36:10.479884 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:10.479840 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-n24dt" podStartSLOduration=1.479825941 podStartE2EDuration="1.479825941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:10.479680397 +0000 UTC m=+108.018529924" watchObservedRunningTime="2026-07-24 14:36:10.479825941 +0000 UTC m=+108.018675468" Jul 24 14:36:18.032750 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:18.032713 2582 scope.go:117] "RemoveContainer" containerID="289dc03b64d10de9ad4c0765d832f3d3f7afe1c116f1315df21467b3c6a1e50c" Jul 24 14:36:18.480878 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:18.480852 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bx87n_0d54a10a-875a-45fd-8c7a-100dd1a7d3ca/console-operator/2.log" Jul 24 14:36:18.481301 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:18.481285 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bx87n_0d54a10a-875a-45fd-8c7a-100dd1a7d3ca/console-operator/1.log" Jul 24 14:36:18.481381 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:18.481319 2582 generic.go:356] "Generic (PLEG): container finished" podID="0d54a10a-875a-45fd-8c7a-100dd1a7d3ca" containerID="83694685fbd92b4f982e63c7e4ea8e5ec6cdea51a5039f9ca77d74dfa5758fed" exitCode=255 Jul 24 14:36:18.481418 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:18.481391 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" event={"ID":"0d54a10a-875a-45fd-8c7a-100dd1a7d3ca","Type":"ContainerDied","Data":"83694685fbd92b4f982e63c7e4ea8e5ec6cdea51a5039f9ca77d74dfa5758fed"} Jul 24 14:36:18.481478 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:18.481466 2582 scope.go:117] "RemoveContainer" containerID="289dc03b64d10de9ad4c0765d832f3d3f7afe1c116f1315df21467b3c6a1e50c" Jul 24 14:36:18.481808 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:18.481779 2582 scope.go:117] "RemoveContainer" containerID="83694685fbd92b4f982e63c7e4ea8e5ec6cdea51a5039f9ca77d74dfa5758fed" Jul 24 14:36:18.481987 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:36:18.481966 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-bx87n_openshift-console-operator(0d54a10a-875a-45fd-8c7a-100dd1a7d3ca)\"" pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" podUID="0d54a10a-875a-45fd-8c7a-100dd1a7d3ca" Jul 24 14:36:18.815996 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:18.815900 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ljkrw\" (UID: \"84400f39-82b9-4c0a-9755-2ce1e6baa0f3\") " pod="openshift-insights/insights-runtime-extractor-ljkrw" Jul 24 14:36:18.818222 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:18.818202 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84400f39-82b9-4c0a-9755-2ce1e6baa0f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ljkrw\" (UID: \"84400f39-82b9-4c0a-9755-2ce1e6baa0f3\") " pod="openshift-insights/insights-runtime-extractor-ljkrw" Jul 24 14:36:19.104506 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:19.104426 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ljkrw" Jul 24 14:36:19.232988 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:19.232957 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ljkrw"] Jul 24 14:36:19.235880 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:36:19.235851 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84400f39_82b9_4c0a_9755_2ce1e6baa0f3.slice/crio-cfbba81f5b7a1660b7b6e4f386f6415393e2a0aef24a4f97db93d2fbf704c611 WatchSource:0}: Error finding container cfbba81f5b7a1660b7b6e4f386f6415393e2a0aef24a4f97db93d2fbf704c611: Status 404 returned error can't find the container with id cfbba81f5b7a1660b7b6e4f386f6415393e2a0aef24a4f97db93d2fbf704c611 Jul 24 14:36:19.485452 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:19.485425 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bx87n_0d54a10a-875a-45fd-8c7a-100dd1a7d3ca/console-operator/2.log" Jul 24 14:36:19.486572 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:19.486543 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ljkrw" event={"ID":"84400f39-82b9-4c0a-9755-2ce1e6baa0f3","Type":"ContainerStarted","Data":"cfbba81f5b7a1660b7b6e4f386f6415393e2a0aef24a4f97db93d2fbf704c611"} Jul 24 14:36:23.303268 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:23.303211 2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" Jul 24 14:36:23.303648 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:23.303305 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" Jul 24 14:36:23.303717 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:23.303707 2582 scope.go:117] "RemoveContainer" containerID="83694685fbd92b4f982e63c7e4ea8e5ec6cdea51a5039f9ca77d74dfa5758fed" Jul 24 14:36:23.303938 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:36:23.303911 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-bx87n_openshift-console-operator(0d54a10a-875a-45fd-8c7a-100dd1a7d3ca)\"" pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" podUID="0d54a10a-875a-45fd-8c7a-100dd1a7d3ca" Jul 24 14:36:24.506745 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:24.506712 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ljkrw" event={"ID":"84400f39-82b9-4c0a-9755-2ce1e6baa0f3","Type":"ContainerStarted","Data":"013210ceb8651ccaeb48cf1c11a87549b08dad78a9243d12989a5c264ac71113"} Jul 24 14:36:24.866174 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:24.866089 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/29194dab-422f-4d5b-b931-2233fa973344-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-nvcvq\" (UID: \"29194dab-422f-4d5b-b931-2233fa973344\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nvcvq" Jul 24 14:36:24.869066 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:24.869034 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/29194dab-422f-4d5b-b931-2233fa973344-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-nvcvq\" (UID: \"29194dab-422f-4d5b-b931-2233fa973344\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nvcvq" Jul 24 14:36:25.094416 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:25.094383 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hdcd4\"" Jul 24 14:36:25.102397 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:25.102362 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nvcvq" Jul 24 14:36:25.261467 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:25.261436 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nvcvq"] Jul 24 14:36:25.511337 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:25.511301 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nvcvq" event={"ID":"29194dab-422f-4d5b-b931-2233fa973344","Type":"ContainerStarted","Data":"5ed2bdc887184111406902ae1baaad7a4f28e78d500edf9c155a33671e0cd453"} Jul 24 14:36:28.524575 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:28.524537 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ljkrw" event={"ID":"84400f39-82b9-4c0a-9755-2ce1e6baa0f3","Type":"ContainerStarted","Data":"57fcc7b2095e3dbd5e2ad29b030e1bc323cdf17426c4d97737784e73973750cb"} Jul 24 14:36:28.526222 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:28.526196 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nvcvq" event={"ID":"29194dab-422f-4d5b-b931-2233fa973344","Type":"ContainerStarted","Data":"edb26cb8b34e8ef2287be840dd12b6579795d1d8cf8191734d10e99cdca75c80"} Jul 24 14:36:28.526359 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:28.526254 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nvcvq" event={"ID":"29194dab-422f-4d5b-b931-2233fa973344","Type":"ContainerStarted","Data":"27e0358d934cbfb714fc0234aab78ef953cf9f82959319cd304bc0389cdb4c4d"} Jul 24 14:36:28.542138 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:28.542087 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nvcvq" podStartSLOduration=33.738818406 podStartE2EDuration="36.542074051s" totalImagesPullingTime="2.803255645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:35:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:28.541222647 +0000 UTC m=+126.080072176" watchObservedRunningTime="2026-07-24 14:36:28.542074051 +0000 UTC m=+126.080923578" Jul 24 14:36:31.869275 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:31.869227 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-56bd87cfd7-rd46n"] Jul 24 14:36:31.872218 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:31.872201 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" Jul 24 14:36:31.875539 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:31.875517 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pzwk4\"" Jul 24 14:36:31.875685 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:31.875598 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 24 14:36:31.875753 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:31.875731 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 24 14:36:31.883471 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:31.883451 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 24 14:36:31.895504 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:31.895481 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 24 14:36:31.906230 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:31.906201 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56bd87cfd7-rd46n"] Jul 24 14:36:31.925542 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:31.925515 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/abe922f7-8920-4a70-ba97-20b51af434e4-ca-trust-extracted\") pod \"image-registry-56bd87cfd7-rd46n\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" Jul 24 14:36:31.925666 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:31.925547 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/abe922f7-8920-4a70-ba97-20b51af434e4-trusted-ca\") pod \"image-registry-56bd87cfd7-rd46n\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" Jul 24 14:36:31.925666 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:31.925571 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/abe922f7-8920-4a70-ba97-20b51af434e4-registry-certificates\") pod \"image-registry-56bd87cfd7-rd46n\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" Jul 24 14:36:31.925666 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:31.925600 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/abe922f7-8920-4a70-ba97-20b51af434e4-installation-pull-secrets\") pod \"image-registry-56bd87cfd7-rd46n\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" Jul 24 14:36:31.925830 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:31.925659 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/abe922f7-8920-4a70-ba97-20b51af434e4-image-registry-private-configuration\") pod \"image-registry-56bd87cfd7-rd46n\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" Jul 24 14:36:31.925830 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:31.925763 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abe922f7-8920-4a70-ba97-20b51af434e4-registry-tls\") pod \"image-registry-56bd87cfd7-rd46n\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" Jul 24 14:36:31.925830 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:31.925813 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptcm2\" (UniqueName: \"kubernetes.io/projected/abe922f7-8920-4a70-ba97-20b51af434e4-kube-api-access-ptcm2\") pod \"image-registry-56bd87cfd7-rd46n\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" Jul 24 14:36:31.925956 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:31.925846 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/abe922f7-8920-4a70-ba97-20b51af434e4-bound-sa-token\") pod \"image-registry-56bd87cfd7-rd46n\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" Jul 24 14:36:31.965781 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:31.965754 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56bd87cfd7-rd46n"] Jul 24 14:36:31.965975 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:36:31.965955 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-ptcm2 registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" podUID="abe922f7-8920-4a70-ba97-20b51af434e4" Jul 24 14:36:32.026934 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.026845 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/abe922f7-8920-4a70-ba97-20b51af434e4-ca-trust-extracted\") pod \"image-registry-56bd87cfd7-rd46n\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" Jul 24 14:36:32.026934 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.026889 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/abe922f7-8920-4a70-ba97-20b51af434e4-trusted-ca\") pod \"image-registry-56bd87cfd7-rd46n\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" Jul 24 14:36:32.026934 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.026917 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/abe922f7-8920-4a70-ba97-20b51af434e4-registry-certificates\") pod \"image-registry-56bd87cfd7-rd46n\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" Jul 24 14:36:32.027190 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.027102 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/abe922f7-8920-4a70-ba97-20b51af434e4-installation-pull-secrets\") pod \"image-registry-56bd87cfd7-rd46n\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" Jul 24 14:36:32.027190 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.027150 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/abe922f7-8920-4a70-ba97-20b51af434e4-image-registry-private-configuration\") pod \"image-registry-56bd87cfd7-rd46n\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" Jul 24 14:36:32.027339 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.027197 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abe922f7-8920-4a70-ba97-20b51af434e4-registry-tls\") pod \"image-registry-56bd87cfd7-rd46n\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" Jul 24 14:36:32.027339 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.027232 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/abe922f7-8920-4a70-ba97-20b51af434e4-ca-trust-extracted\") pod \"image-registry-56bd87cfd7-rd46n\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" Jul 24 14:36:32.027339 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.027265 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptcm2\" (UniqueName: \"kubernetes.io/projected/abe922f7-8920-4a70-ba97-20b51af434e4-kube-api-access-ptcm2\") pod \"image-registry-56bd87cfd7-rd46n\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" Jul 24 14:36:32.027339 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.027317 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/abe922f7-8920-4a70-ba97-20b51af434e4-bound-sa-token\") pod \"image-registry-56bd87cfd7-rd46n\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" Jul 24 14:36:32.027802 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.027780 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/abe922f7-8920-4a70-ba97-20b51af434e4-registry-certificates\") pod \"image-registry-56bd87cfd7-rd46n\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" Jul 24 14:36:32.028098 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.028076 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/abe922f7-8920-4a70-ba97-20b51af434e4-trusted-ca\") pod \"image-registry-56bd87cfd7-rd46n\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" Jul 24 14:36:32.029557 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.029539 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/abe922f7-8920-4a70-ba97-20b51af434e4-installation-pull-secrets\") pod \"image-registry-56bd87cfd7-rd46n\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" Jul 24 14:36:32.029729 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.029712 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abe922f7-8920-4a70-ba97-20b51af434e4-registry-tls\") pod \"image-registry-56bd87cfd7-rd46n\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" Jul 24 14:36:32.029729 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.029719 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/abe922f7-8920-4a70-ba97-20b51af434e4-image-registry-private-configuration\") pod \"image-registry-56bd87cfd7-rd46n\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" Jul 24 14:36:32.050701 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.050668 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/abe922f7-8920-4a70-ba97-20b51af434e4-bound-sa-token\") pod \"image-registry-56bd87cfd7-rd46n\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" Jul 24 14:36:32.052159 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.052130 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptcm2\" (UniqueName: \"kubernetes.io/projected/abe922f7-8920-4a70-ba97-20b51af434e4-kube-api-access-ptcm2\") pod \"image-registry-56bd87cfd7-rd46n\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" Jul 24 14:36:32.541489 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.541458 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" Jul 24 14:36:32.541688 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.541456 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ljkrw" event={"ID":"84400f39-82b9-4c0a-9755-2ce1e6baa0f3","Type":"ContainerStarted","Data":"53a36bfda03d7f70fdacb1b37b4f9ff5ef33bc91f2b671180297cd6aa305288a"} Jul 24 14:36:32.549013 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.548991 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" Jul 24 14:36:32.633100 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.633071 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/abe922f7-8920-4a70-ba97-20b51af434e4-trusted-ca\") pod \"abe922f7-8920-4a70-ba97-20b51af434e4\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " Jul 24 14:36:32.633423 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.633137 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/abe922f7-8920-4a70-ba97-20b51af434e4-image-registry-private-configuration\") pod \"abe922f7-8920-4a70-ba97-20b51af434e4\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " Jul 24 14:36:32.633423 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.633165 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptcm2\" (UniqueName: \"kubernetes.io/projected/abe922f7-8920-4a70-ba97-20b51af434e4-kube-api-access-ptcm2\") pod \"abe922f7-8920-4a70-ba97-20b51af434e4\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " Jul 24 14:36:32.633423 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.633206 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/abe922f7-8920-4a70-ba97-20b51af434e4-ca-trust-extracted\") pod \"abe922f7-8920-4a70-ba97-20b51af434e4\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " Jul 24 14:36:32.633423 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.633231 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/abe922f7-8920-4a70-ba97-20b51af434e4-registry-certificates\") pod \"abe922f7-8920-4a70-ba97-20b51af434e4\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " Jul 24 14:36:32.633423 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.633319 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/abe922f7-8920-4a70-ba97-20b51af434e4-installation-pull-secrets\") pod \"abe922f7-8920-4a70-ba97-20b51af434e4\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " Jul 24 14:36:32.633423 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.633376 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/abe922f7-8920-4a70-ba97-20b51af434e4-bound-sa-token\") pod \"abe922f7-8920-4a70-ba97-20b51af434e4\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " Jul 24 14:36:32.633423 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.633414 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abe922f7-8920-4a70-ba97-20b51af434e4-registry-tls\") pod \"abe922f7-8920-4a70-ba97-20b51af434e4\" (UID: \"abe922f7-8920-4a70-ba97-20b51af434e4\") " Jul 24 14:36:32.633788 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.633573 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abe922f7-8920-4a70-ba97-20b51af434e4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "abe922f7-8920-4a70-ba97-20b51af434e4" (UID: "abe922f7-8920-4a70-ba97-20b51af434e4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:36:32.633788 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.633625 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abe922f7-8920-4a70-ba97-20b51af434e4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "abe922f7-8920-4a70-ba97-20b51af434e4" (UID: "abe922f7-8920-4a70-ba97-20b51af434e4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:36:32.633788 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.633653 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abe922f7-8920-4a70-ba97-20b51af434e4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "abe922f7-8920-4a70-ba97-20b51af434e4" (UID: "abe922f7-8920-4a70-ba97-20b51af434e4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:36:32.633788 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.633746 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/abe922f7-8920-4a70-ba97-20b51af434e4-trusted-ca\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:36:32.633788 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.633764 2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/abe922f7-8920-4a70-ba97-20b51af434e4-ca-trust-extracted\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:36:32.633788 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.633777 2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/abe922f7-8920-4a70-ba97-20b51af434e4-registry-certificates\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:36:32.635843 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.635754 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abe922f7-8920-4a70-ba97-20b51af434e4-kube-api-access-ptcm2" (OuterVolumeSpecName: "kube-api-access-ptcm2") pod "abe922f7-8920-4a70-ba97-20b51af434e4" (UID: "abe922f7-8920-4a70-ba97-20b51af434e4"). InnerVolumeSpecName "kube-api-access-ptcm2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:36:32.635988 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.635968 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abe922f7-8920-4a70-ba97-20b51af434e4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "abe922f7-8920-4a70-ba97-20b51af434e4" (UID: "abe922f7-8920-4a70-ba97-20b51af434e4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:36:32.636159 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.636138 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abe922f7-8920-4a70-ba97-20b51af434e4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "abe922f7-8920-4a70-ba97-20b51af434e4" (UID: "abe922f7-8920-4a70-ba97-20b51af434e4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:36:32.636230 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.636212 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abe922f7-8920-4a70-ba97-20b51af434e4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "abe922f7-8920-4a70-ba97-20b51af434e4" (UID: "abe922f7-8920-4a70-ba97-20b51af434e4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:36:32.636315 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.636256 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abe922f7-8920-4a70-ba97-20b51af434e4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "abe922f7-8920-4a70-ba97-20b51af434e4" (UID: "abe922f7-8920-4a70-ba97-20b51af434e4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:36:32.636527 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.636489 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ljkrw" podStartSLOduration=34.260954749 podStartE2EDuration="46.636475327s" totalImagesPullingTime="12.375520578s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:35:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:32.635949856 +0000 UTC m=+130.174799404" watchObservedRunningTime="2026-07-24 14:36:32.636475327 +0000 UTC m=+130.175324853" Jul 24 14:36:32.734519 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.734485 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4f832fe-7318-4ab6-814f-565dee143906-metrics-certs\") pod \"network-metrics-daemon-4krzg\" (UID: \"e4f832fe-7318-4ab6-814f-565dee143906\") " pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:36:32.734706 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.734584 2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/abe922f7-8920-4a70-ba97-20b51af434e4-image-registry-private-configuration\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:36:32.734706 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.734599 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptcm2\" (UniqueName: \"kubernetes.io/projected/abe922f7-8920-4a70-ba97-20b51af434e4-kube-api-access-ptcm2\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:36:32.734706 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.734612 2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/abe922f7-8920-4a70-ba97-20b51af434e4-installation-pull-secrets\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:36:32.734706 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.734624 2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/abe922f7-8920-4a70-ba97-20b51af434e4-bound-sa-token\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:36:32.734706 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.734636 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abe922f7-8920-4a70-ba97-20b51af434e4-registry-tls\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:36:32.736643 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.736621 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4f832fe-7318-4ab6-814f-565dee143906-metrics-certs\") pod \"network-metrics-daemon-4krzg\" (UID: \"e4f832fe-7318-4ab6-814f-565dee143906\") " pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:36:32.953731 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.953645 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d7cdd\"" Jul 24 14:36:32.962481 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:32.962460 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4krzg" Jul 24 14:36:33.119601 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:33.119572 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4krzg"] Jul 24 14:36:33.122616 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:36:33.122587 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4f832fe_7318_4ab6_814f_565dee143906.slice/crio-54023c44b41bdd31a264530e8f9556fde311ffb1d590eabe7266d5ee7f3daa6b WatchSource:0}: Error finding container 54023c44b41bdd31a264530e8f9556fde311ffb1d590eabe7266d5ee7f3daa6b: Status 404 returned error can't find the container with id 54023c44b41bdd31a264530e8f9556fde311ffb1d590eabe7266d5ee7f3daa6b Jul 24 14:36:33.546171 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:33.546135 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4krzg" event={"ID":"e4f832fe-7318-4ab6-814f-565dee143906","Type":"ContainerStarted","Data":"54023c44b41bdd31a264530e8f9556fde311ffb1d590eabe7266d5ee7f3daa6b"} Jul 24 14:36:33.546374 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:33.546159 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56bd87cfd7-rd46n" Jul 24 14:36:33.623616 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:33.623579 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56bd87cfd7-rd46n"] Jul 24 14:36:33.631412 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:33.631384 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-56bd87cfd7-rd46n"] Jul 24 14:36:34.550833 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:34.550800 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4krzg" event={"ID":"e4f832fe-7318-4ab6-814f-565dee143906","Type":"ContainerStarted","Data":"92c1ec0d29127516804b227e9ff1a5e63d74f7130027287bc51a343c8f1d88c9"} Jul 24 14:36:34.551324 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:34.550853 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4krzg" event={"ID":"e4f832fe-7318-4ab6-814f-565dee143906","Type":"ContainerStarted","Data":"eb5645473c6f689d866066532cf8d449a3faad2ad18014532d442e90e715cd4f"} Jul 24 14:36:35.036206 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:35.036168 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abe922f7-8920-4a70-ba97-20b51af434e4" path="/var/lib/kubelet/pods/abe922f7-8920-4a70-ba97-20b51af434e4/volumes" Jul 24 14:36:36.032885 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:36.032859 2582 scope.go:117] "RemoveContainer" containerID="83694685fbd92b4f982e63c7e4ea8e5ec6cdea51a5039f9ca77d74dfa5758fed" Jul 24 14:36:36.033306 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:36:36.033007 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-bx87n_openshift-console-operator(0d54a10a-875a-45fd-8c7a-100dd1a7d3ca)\"" pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" podUID="0d54a10a-875a-45fd-8c7a-100dd1a7d3ca" Jul 24 14:36:49.512556 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:49.512501 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4krzg" podStartSLOduration=145.662884185 podStartE2EDuration="2m26.512484492s" totalImagesPullingTime="849.600307ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:34.569097046 +0000 UTC m=+132.107946575" watchObservedRunningTime="2026-07-24 14:36:49.512484492 +0000 UTC m=+147.051333997" Jul 24 14:36:49.513318 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:49.513297 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pcqg7"] Jul 24 14:36:49.516373 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:49.516354 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pcqg7" Jul 24 14:36:49.519027 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:49.519006 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 24 14:36:49.519256 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:49.519228 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6drhw\"" Jul 24 14:36:49.526521 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:49.526495 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pcqg7"] Jul 24 14:36:49.551371 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:49.551339 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1420cbda-3fe4-4f8d-b8bc-ec7f44d8c15b-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-pcqg7\" (UID: \"1420cbda-3fe4-4f8d-b8bc-ec7f44d8c15b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pcqg7" Jul 24 14:36:49.652470 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:49.652437 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1420cbda-3fe4-4f8d-b8bc-ec7f44d8c15b-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-pcqg7\" (UID: \"1420cbda-3fe4-4f8d-b8bc-ec7f44d8c15b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pcqg7" Jul 24 14:36:49.652650 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:36:49.652626 2582 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 24 14:36:49.652724 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:36:49.652713 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1420cbda-3fe4-4f8d-b8bc-ec7f44d8c15b-tls-certificates podName:1420cbda-3fe4-4f8d-b8bc-ec7f44d8c15b nodeName:}" failed. No retries permitted until 2026-07-24 14:36:50.152689325 +0000 UTC m=+147.691538835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/1420cbda-3fe4-4f8d-b8bc-ec7f44d8c15b-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-pcqg7" (UID: "1420cbda-3fe4-4f8d-b8bc-ec7f44d8c15b") : secret "prometheus-operator-admission-webhook-tls" not found Jul 24 14:36:50.155844 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:50.155802 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1420cbda-3fe4-4f8d-b8bc-ec7f44d8c15b-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-pcqg7\" (UID: \"1420cbda-3fe4-4f8d-b8bc-ec7f44d8c15b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pcqg7" Jul 24 14:36:50.158191 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:50.158165 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1420cbda-3fe4-4f8d-b8bc-ec7f44d8c15b-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-pcqg7\" (UID: \"1420cbda-3fe4-4f8d-b8bc-ec7f44d8c15b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pcqg7" Jul 24 14:36:50.425059 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:50.424976 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pcqg7" Jul 24 14:36:50.553288 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:50.553259 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pcqg7"] Jul 24 14:36:50.556425 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:36:50.556397 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1420cbda_3fe4_4f8d_b8bc_ec7f44d8c15b.slice/crio-a7940ff0d1c14a169e031c862c6b8a81c94065e421a9937f06284c9c979f2cbe WatchSource:0}: Error finding container a7940ff0d1c14a169e031c862c6b8a81c94065e421a9937f06284c9c979f2cbe: Status 404 returned error can't find the container with id a7940ff0d1c14a169e031c862c6b8a81c94065e421a9937f06284c9c979f2cbe Jul 24 14:36:50.598548 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:50.598518 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pcqg7" event={"ID":"1420cbda-3fe4-4f8d-b8bc-ec7f44d8c15b","Type":"ContainerStarted","Data":"a7940ff0d1c14a169e031c862c6b8a81c94065e421a9937f06284c9c979f2cbe"} Jul 24 14:36:51.032809 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:51.032782 2582 scope.go:117] "RemoveContainer" containerID="83694685fbd92b4f982e63c7e4ea8e5ec6cdea51a5039f9ca77d74dfa5758fed" Jul 24 14:36:51.603835 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:51.603805 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bx87n_0d54a10a-875a-45fd-8c7a-100dd1a7d3ca/console-operator/2.log" Jul 24 14:36:51.604305 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:51.603886 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" event={"ID":"0d54a10a-875a-45fd-8c7a-100dd1a7d3ca","Type":"ContainerStarted","Data":"d512be70300926d2a0938c757acd6d6fcac476d07d33f319ed9557df560808f7"} Jul 24 14:36:51.604305 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:51.604159 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" Jul 24 14:36:51.630379 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:51.630074 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" podStartSLOduration=57.312423084 podStartE2EDuration="59.630053846s" totalImagesPullingTime="2.317630762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:35:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:51.628990205 +0000 UTC m=+149.167839747" watchObservedRunningTime="2026-07-24 14:36:51.630053846 +0000 UTC m=+149.168903374" Jul 24 14:36:51.869175 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:51.869094 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-bx87n" Jul 24 14:36:52.082914 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:52.082878 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-2p8mm"] Jul 24 14:36:52.085998 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:52.085975 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-2p8mm" Jul 24 14:36:52.088002 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:52.087976 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 24 14:36:52.088586 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:52.088569 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 24 14:36:52.088694 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:52.088576 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-9zbcx\"" Jul 24 14:36:52.100932 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:52.100909 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-2p8mm"] Jul 24 14:36:52.173027 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:52.172944 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5rwg\" (UniqueName: \"kubernetes.io/projected/232c5bdd-4b0e-4448-ad5a-edff8c40a933-kube-api-access-k5rwg\") pod \"downloads-7c97dc4555-2p8mm\" (UID: \"232c5bdd-4b0e-4448-ad5a-edff8c40a933\") " pod="openshift-console/downloads-7c97dc4555-2p8mm" Jul 24 14:36:52.273938 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:52.273908 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5rwg\" (UniqueName: \"kubernetes.io/projected/232c5bdd-4b0e-4448-ad5a-edff8c40a933-kube-api-access-k5rwg\") pod \"downloads-7c97dc4555-2p8mm\" (UID: \"232c5bdd-4b0e-4448-ad5a-edff8c40a933\") " pod="openshift-console/downloads-7c97dc4555-2p8mm" Jul 24 14:36:52.288611 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:52.288583 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5rwg\" (UniqueName: \"kubernetes.io/projected/232c5bdd-4b0e-4448-ad5a-edff8c40a933-kube-api-access-k5rwg\") pod \"downloads-7c97dc4555-2p8mm\" (UID: \"232c5bdd-4b0e-4448-ad5a-edff8c40a933\") " pod="openshift-console/downloads-7c97dc4555-2p8mm" Jul 24 14:36:52.395255 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:52.395205 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-2p8mm" Jul 24 14:36:52.524456 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:52.524424 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-2p8mm"] Jul 24 14:36:52.527644 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:36:52.527602 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod232c5bdd_4b0e_4448_ad5a_edff8c40a933.slice/crio-ae6e23688a0b22776c12f5dc3bd4418df843ce8a1445efc9362113e5acab2a45 WatchSource:0}: Error finding container ae6e23688a0b22776c12f5dc3bd4418df843ce8a1445efc9362113e5acab2a45: Status 404 returned error can't find the container with id ae6e23688a0b22776c12f5dc3bd4418df843ce8a1445efc9362113e5acab2a45 Jul 24 14:36:52.609997 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:52.609957 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pcqg7" event={"ID":"1420cbda-3fe4-4f8d-b8bc-ec7f44d8c15b","Type":"ContainerStarted","Data":"6371d3994eda70efe6d05bcfa49174fe3cc63bda4ce391de158f399ffe252fe0"} Jul 24 14:36:52.610465 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:52.610128 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pcqg7" Jul 24 14:36:52.611201 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:52.611176 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-2p8mm" event={"ID":"232c5bdd-4b0e-4448-ad5a-edff8c40a933","Type":"ContainerStarted","Data":"ae6e23688a0b22776c12f5dc3bd4418df843ce8a1445efc9362113e5acab2a45"} Jul 24 14:36:52.614815 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:52.614797 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pcqg7" Jul 24 14:36:52.629276 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:52.629222 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pcqg7" podStartSLOduration=2.569034735 podStartE2EDuration="3.629209509s" totalImagesPullingTime="1.060174774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:52.627103385 +0000 UTC m=+150.165952922" watchObservedRunningTime="2026-07-24 14:36:52.629209509 +0000 UTC m=+150.168059036" Jul 24 14:36:53.594827 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:53.594786 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-w4vzk"] Jul 24 14:36:53.598022 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:53.597997 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-w4vzk" Jul 24 14:36:53.600961 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:53.600934 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 24 14:36:53.601875 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:53.601799 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 24 14:36:53.601875 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:53.601868 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 24 14:36:53.602075 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:53.601881 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vccn9\"" Jul 24 14:36:53.602075 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:53.602052 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 24 14:36:53.602208 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:53.602189 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 24 14:36:53.614250 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:53.614220 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-w4vzk"] Jul 24 14:36:53.686991 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:53.686636 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be8c8f2c-3baf-48ad-8932-cf3eb9fa3719-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-w4vzk\" (UID: \"be8c8f2c-3baf-48ad-8932-cf3eb9fa3719\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-w4vzk" Jul 24 14:36:53.686991 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:53.686703 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/be8c8f2c-3baf-48ad-8932-cf3eb9fa3719-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-w4vzk\" (UID: \"be8c8f2c-3baf-48ad-8932-cf3eb9fa3719\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-w4vzk" Jul 24 14:36:53.686991 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:53.686800 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be8c8f2c-3baf-48ad-8932-cf3eb9fa3719-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-w4vzk\" (UID: \"be8c8f2c-3baf-48ad-8932-cf3eb9fa3719\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-w4vzk" Jul 24 14:36:53.686991 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:53.686853 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxdq8\" (UniqueName: \"kubernetes.io/projected/be8c8f2c-3baf-48ad-8932-cf3eb9fa3719-kube-api-access-mxdq8\") pod \"prometheus-operator-84d69f794d-w4vzk\" (UID: \"be8c8f2c-3baf-48ad-8932-cf3eb9fa3719\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-w4vzk" Jul 24 14:36:53.787824 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:53.787765 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be8c8f2c-3baf-48ad-8932-cf3eb9fa3719-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-w4vzk\" (UID: \"be8c8f2c-3baf-48ad-8932-cf3eb9fa3719\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-w4vzk" Jul 24 14:36:53.787824 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:53.787824 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/be8c8f2c-3baf-48ad-8932-cf3eb9fa3719-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-w4vzk\" (UID: \"be8c8f2c-3baf-48ad-8932-cf3eb9fa3719\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-w4vzk" Jul 24 14:36:53.788059 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:53.787867 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be8c8f2c-3baf-48ad-8932-cf3eb9fa3719-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-w4vzk\" (UID: \"be8c8f2c-3baf-48ad-8932-cf3eb9fa3719\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-w4vzk" Jul 24 14:36:53.788059 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:53.787894 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxdq8\" (UniqueName: \"kubernetes.io/projected/be8c8f2c-3baf-48ad-8932-cf3eb9fa3719-kube-api-access-mxdq8\") pod \"prometheus-operator-84d69f794d-w4vzk\" (UID: \"be8c8f2c-3baf-48ad-8932-cf3eb9fa3719\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-w4vzk" Jul 24 14:36:53.788798 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:53.788769 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be8c8f2c-3baf-48ad-8932-cf3eb9fa3719-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-w4vzk\" (UID: \"be8c8f2c-3baf-48ad-8932-cf3eb9fa3719\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-w4vzk" Jul 24 14:36:53.790803 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:53.790741 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/be8c8f2c-3baf-48ad-8932-cf3eb9fa3719-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-w4vzk\" (UID: \"be8c8f2c-3baf-48ad-8932-cf3eb9fa3719\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-w4vzk" Jul 24 14:36:53.790803 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:53.790768 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be8c8f2c-3baf-48ad-8932-cf3eb9fa3719-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-w4vzk\" (UID: \"be8c8f2c-3baf-48ad-8932-cf3eb9fa3719\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-w4vzk" Jul 24 14:36:53.797048 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:53.797021 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxdq8\" (UniqueName: \"kubernetes.io/projected/be8c8f2c-3baf-48ad-8932-cf3eb9fa3719-kube-api-access-mxdq8\") pod \"prometheus-operator-84d69f794d-w4vzk\" (UID: \"be8c8f2c-3baf-48ad-8932-cf3eb9fa3719\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-w4vzk" Jul 24 14:36:53.910421 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:53.910333 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-w4vzk" Jul 24 14:36:54.059388 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:54.059346 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-w4vzk"] Jul 24 14:36:54.061941 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:36:54.061904 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe8c8f2c_3baf_48ad_8932_cf3eb9fa3719.slice/crio-7e8634779d79373f6406504774bc78def5b617a4d71ca53f74aaa7c7ec0294d9 WatchSource:0}: Error finding container 7e8634779d79373f6406504774bc78def5b617a4d71ca53f74aaa7c7ec0294d9: Status 404 returned error can't find the container with id 7e8634779d79373f6406504774bc78def5b617a4d71ca53f74aaa7c7ec0294d9 Jul 24 14:36:54.622806 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:54.622729 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-w4vzk" event={"ID":"be8c8f2c-3baf-48ad-8932-cf3eb9fa3719","Type":"ContainerStarted","Data":"7e8634779d79373f6406504774bc78def5b617a4d71ca53f74aaa7c7ec0294d9"} Jul 24 14:36:55.629353 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:55.629265 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-w4vzk" event={"ID":"be8c8f2c-3baf-48ad-8932-cf3eb9fa3719","Type":"ContainerStarted","Data":"8231cc6539389984ac31e9c3ce0d4f2e92420493771e5d9374f52a352bc78144"} Jul 24 14:36:55.629353 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:55.629327 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-w4vzk" event={"ID":"be8c8f2c-3baf-48ad-8932-cf3eb9fa3719","Type":"ContainerStarted","Data":"13898b45b8b5af29027e8a730e660a32e04ac08d8b3606db0d649dea24a057bc"} Jul 24 14:36:55.664009 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:55.663944 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-w4vzk" podStartSLOduration=1.390251498 podStartE2EDuration="2.66392095s" totalImagesPullingTime="1.273669452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:55.661679631 +0000 UTC m=+153.200529177" watchObservedRunningTime="2026-07-24 14:36:55.66392095 +0000 UTC m=+153.202770482" Jul 24 14:36:58.197217 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.197130 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-gmgh4"] Jul 24 14:36:58.363254 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.362935 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-gmgh4"] Jul 24 14:36:58.363254 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.363077 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gmgh4" Jul 24 14:36:58.363254 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.363082 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dlfsf"] Jul 24 14:36:58.366702 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.366299 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-rbwkv\"" Jul 24 14:36:58.366702 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.366645 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 24 14:36:58.366896 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.366869 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 24 14:36:58.376681 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.376598 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.380873 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.380732 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 24 14:36:58.381426 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.381174 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2fgzq\"" Jul 24 14:36:58.381426 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.381227 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 24 14:36:58.381426 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.381174 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 24 14:36:58.430804 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.430750 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-gmgh4\" (UID: \"f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gmgh4" Jul 24 14:36:58.430804 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.430800 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-gmgh4\" (UID: \"f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gmgh4" Jul 24 14:36:58.431102 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.430840 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr7jc\" (UniqueName: \"kubernetes.io/projected/f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad-kube-api-access-kr7jc\") pod \"openshift-state-metrics-b8f49f5c6-gmgh4\" (UID: \"f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gmgh4" Jul 24 14:36:58.431102 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.430870 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-gmgh4\" (UID: \"f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gmgh4" Jul 24 14:36:58.532099 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.532063 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f17bc84b-00dc-4451-9ae9-5c56d2f87db7-node-exporter-textfile\") pod \"node-exporter-dlfsf\" (UID: \"f17bc84b-00dc-4451-9ae9-5c56d2f87db7\") " pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.532329 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.532112 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sh8f\" (UniqueName: \"kubernetes.io/projected/f17bc84b-00dc-4451-9ae9-5c56d2f87db7-kube-api-access-8sh8f\") pod \"node-exporter-dlfsf\" (UID: \"f17bc84b-00dc-4451-9ae9-5c56d2f87db7\") " pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.532329 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.532155 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-gmgh4\" (UID: \"f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gmgh4" Jul 24 14:36:58.532329 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.532186 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-gmgh4\" (UID: \"f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gmgh4" Jul 24 14:36:58.532329 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.532216 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f17bc84b-00dc-4451-9ae9-5c56d2f87db7-metrics-client-ca\") pod \"node-exporter-dlfsf\" (UID: \"f17bc84b-00dc-4451-9ae9-5c56d2f87db7\") " pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.532329 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.532267 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f17bc84b-00dc-4451-9ae9-5c56d2f87db7-sys\") pod \"node-exporter-dlfsf\" (UID: \"f17bc84b-00dc-4451-9ae9-5c56d2f87db7\") " pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.532329 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.532296 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f17bc84b-00dc-4451-9ae9-5c56d2f87db7-node-exporter-accelerators-collector-config\") pod \"node-exporter-dlfsf\" (UID: \"f17bc84b-00dc-4451-9ae9-5c56d2f87db7\") " pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.532674 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:36:58.532354 2582 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 24 14:36:58.532674 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:36:58.532430 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad-openshift-state-metrics-tls podName:f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad nodeName:}" failed. No retries permitted until 2026-07-24 14:36:59.032406105 +0000 UTC m=+156.571255616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-gmgh4" (UID: "f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad") : secret "openshift-state-metrics-tls" not found Jul 24 14:36:58.532674 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.532357 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr7jc\" (UniqueName: \"kubernetes.io/projected/f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad-kube-api-access-kr7jc\") pod \"openshift-state-metrics-b8f49f5c6-gmgh4\" (UID: \"f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gmgh4" Jul 24 14:36:58.532674 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.532586 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f17bc84b-00dc-4451-9ae9-5c56d2f87db7-root\") pod \"node-exporter-dlfsf\" (UID: \"f17bc84b-00dc-4451-9ae9-5c56d2f87db7\") " pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.532674 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.532615 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f17bc84b-00dc-4451-9ae9-5c56d2f87db7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dlfsf\" (UID: \"f17bc84b-00dc-4451-9ae9-5c56d2f87db7\") " pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.532674 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.532652 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-gmgh4\" (UID: \"f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gmgh4" Jul 24 14:36:58.532950 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.532707 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f17bc84b-00dc-4451-9ae9-5c56d2f87db7-node-exporter-tls\") pod \"node-exporter-dlfsf\" (UID: \"f17bc84b-00dc-4451-9ae9-5c56d2f87db7\") " pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.532950 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.532760 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f17bc84b-00dc-4451-9ae9-5c56d2f87db7-node-exporter-wtmp\") pod \"node-exporter-dlfsf\" (UID: \"f17bc84b-00dc-4451-9ae9-5c56d2f87db7\") " pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.533069 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.533049 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-gmgh4\" (UID: \"f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gmgh4" Jul 24 14:36:58.535471 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.535443 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-gmgh4\" (UID: \"f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gmgh4" Jul 24 14:36:58.544754 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.544732 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr7jc\" (UniqueName: \"kubernetes.io/projected/f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad-kube-api-access-kr7jc\") pod \"openshift-state-metrics-b8f49f5c6-gmgh4\" (UID: \"f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gmgh4" Jul 24 14:36:58.633849 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.633659 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f17bc84b-00dc-4451-9ae9-5c56d2f87db7-root\") pod \"node-exporter-dlfsf\" (UID: \"f17bc84b-00dc-4451-9ae9-5c56d2f87db7\") " pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.633849 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.633704 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f17bc84b-00dc-4451-9ae9-5c56d2f87db7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dlfsf\" (UID: \"f17bc84b-00dc-4451-9ae9-5c56d2f87db7\") " pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.633849 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.633739 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f17bc84b-00dc-4451-9ae9-5c56d2f87db7-node-exporter-tls\") pod \"node-exporter-dlfsf\" (UID: \"f17bc84b-00dc-4451-9ae9-5c56d2f87db7\") " pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.633849 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.633782 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f17bc84b-00dc-4451-9ae9-5c56d2f87db7-root\") pod \"node-exporter-dlfsf\" (UID: \"f17bc84b-00dc-4451-9ae9-5c56d2f87db7\") " pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.634181 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.633946 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f17bc84b-00dc-4451-9ae9-5c56d2f87db7-node-exporter-wtmp\") pod \"node-exporter-dlfsf\" (UID: \"f17bc84b-00dc-4451-9ae9-5c56d2f87db7\") " pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.634181 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.634002 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f17bc84b-00dc-4451-9ae9-5c56d2f87db7-node-exporter-textfile\") pod \"node-exporter-dlfsf\" (UID: \"f17bc84b-00dc-4451-9ae9-5c56d2f87db7\") " pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.634181 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.634033 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sh8f\" (UniqueName: \"kubernetes.io/projected/f17bc84b-00dc-4451-9ae9-5c56d2f87db7-kube-api-access-8sh8f\") pod \"node-exporter-dlfsf\" (UID: \"f17bc84b-00dc-4451-9ae9-5c56d2f87db7\") " pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.634181 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.634090 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f17bc84b-00dc-4451-9ae9-5c56d2f87db7-metrics-client-ca\") pod \"node-exporter-dlfsf\" (UID: \"f17bc84b-00dc-4451-9ae9-5c56d2f87db7\") " pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.634181 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.634098 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f17bc84b-00dc-4451-9ae9-5c56d2f87db7-node-exporter-wtmp\") pod \"node-exporter-dlfsf\" (UID: \"f17bc84b-00dc-4451-9ae9-5c56d2f87db7\") " pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.634181 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.634114 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f17bc84b-00dc-4451-9ae9-5c56d2f87db7-sys\") pod \"node-exporter-dlfsf\" (UID: \"f17bc84b-00dc-4451-9ae9-5c56d2f87db7\") " pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.634181 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.634147 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f17bc84b-00dc-4451-9ae9-5c56d2f87db7-node-exporter-accelerators-collector-config\") pod \"node-exporter-dlfsf\" (UID: \"f17bc84b-00dc-4451-9ae9-5c56d2f87db7\") " pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.634593 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.634202 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f17bc84b-00dc-4451-9ae9-5c56d2f87db7-sys\") pod \"node-exporter-dlfsf\" (UID: \"f17bc84b-00dc-4451-9ae9-5c56d2f87db7\") " pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.634593 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.634439 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f17bc84b-00dc-4451-9ae9-5c56d2f87db7-node-exporter-textfile\") pod \"node-exporter-dlfsf\" (UID: \"f17bc84b-00dc-4451-9ae9-5c56d2f87db7\") " pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.634796 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.634768 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f17bc84b-00dc-4451-9ae9-5c56d2f87db7-metrics-client-ca\") pod \"node-exporter-dlfsf\" (UID: \"f17bc84b-00dc-4451-9ae9-5c56d2f87db7\") " pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.634867 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.634837 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f17bc84b-00dc-4451-9ae9-5c56d2f87db7-node-exporter-accelerators-collector-config\") pod \"node-exporter-dlfsf\" (UID: \"f17bc84b-00dc-4451-9ae9-5c56d2f87db7\") " pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.636839 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.636796 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f17bc84b-00dc-4451-9ae9-5c56d2f87db7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dlfsf\" (UID: \"f17bc84b-00dc-4451-9ae9-5c56d2f87db7\") " pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.637097 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.637076 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f17bc84b-00dc-4451-9ae9-5c56d2f87db7-node-exporter-tls\") pod \"node-exporter-dlfsf\" (UID: \"f17bc84b-00dc-4451-9ae9-5c56d2f87db7\") " pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.643006 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.642963 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sh8f\" (UniqueName: \"kubernetes.io/projected/f17bc84b-00dc-4451-9ae9-5c56d2f87db7-kube-api-access-8sh8f\") pod \"node-exporter-dlfsf\" (UID: \"f17bc84b-00dc-4451-9ae9-5c56d2f87db7\") " pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.689180 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:58.689136 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dlfsf" Jul 24 14:36:58.728733 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:36:58.728694 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf17bc84b_00dc_4451_9ae9_5c56d2f87db7.slice/crio-daa99582dd2087a73987b98669e625e3be67aaefd4c7ce9da32022e7caf2d244 WatchSource:0}: Error finding container daa99582dd2087a73987b98669e625e3be67aaefd4c7ce9da32022e7caf2d244: Status 404 returned error can't find the container with id daa99582dd2087a73987b98669e625e3be67aaefd4c7ce9da32022e7caf2d244 Jul 24 14:36:59.038226 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.038164 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-gmgh4\" (UID: \"f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gmgh4" Jul 24 14:36:59.038416 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:36:59.038326 2582 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 24 14:36:59.038416 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:36:59.038391 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad-openshift-state-metrics-tls podName:f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad nodeName:}" failed. No retries permitted until 2026-07-24 14:37:00.038371962 +0000 UTC m=+157.577221474 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-gmgh4" (UID: "f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad") : secret "openshift-state-metrics-tls" not found Jul 24 14:36:59.357066 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.356712 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 14:36:59.375262 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.375162 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.376874 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.376627 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 14:36:59.379151 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.378480 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 24 14:36:59.379151 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.378533 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 24 14:36:59.379151 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.378634 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 24 14:36:59.379151 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.378755 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-62gv8\"" Jul 24 14:36:59.379151 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.378935 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 24 14:36:59.379151 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.378977 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 24 14:36:59.379151 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.379032 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 24 14:36:59.379151 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.379079 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 24 14:36:59.379151 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.378985 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 24 14:36:59.379719 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.379351 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 24 14:36:59.443577 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.443539 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.443767 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.443599 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6c84ba80-7902-4eef-bdc4-40e28d00c048-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.443767 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.443638 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6c84ba80-7902-4eef-bdc4-40e28d00c048-config-out\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.443767 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.443670 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6c84ba80-7902-4eef-bdc4-40e28d00c048-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.443767 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.443743 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c84ba80-7902-4eef-bdc4-40e28d00c048-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.443767 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.443758 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-web-config\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.444067 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.443853 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-config-volume\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.444067 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.443898 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.444067 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.443924 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5xcp\" (UniqueName: \"kubernetes.io/projected/6c84ba80-7902-4eef-bdc4-40e28d00c048-kube-api-access-v5xcp\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.444067 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.443980 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.444067 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.444024 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c84ba80-7902-4eef-bdc4-40e28d00c048-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.444339 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.444094 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.444339 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.444129 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.545204 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.545168 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-config-volume\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.545391 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.545213 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.545391 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.545267 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5xcp\" (UniqueName: \"kubernetes.io/projected/6c84ba80-7902-4eef-bdc4-40e28d00c048-kube-api-access-v5xcp\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.545391 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.545321 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.545391 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.545345 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c84ba80-7902-4eef-bdc4-40e28d00c048-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.545391 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.545372 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.545693 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.545396 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.545693 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.545428 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.545693 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.545551 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6c84ba80-7902-4eef-bdc4-40e28d00c048-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.545693 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.545580 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6c84ba80-7902-4eef-bdc4-40e28d00c048-config-out\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.545693 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.545604 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6c84ba80-7902-4eef-bdc4-40e28d00c048-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.545693 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.545668 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c84ba80-7902-4eef-bdc4-40e28d00c048-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.545693 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.545692 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-web-config\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.547691 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.547392 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c84ba80-7902-4eef-bdc4-40e28d00c048-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.547691 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.547642 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6c84ba80-7902-4eef-bdc4-40e28d00c048-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.548971 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.548943 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c84ba80-7902-4eef-bdc4-40e28d00c048-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.550166 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.549817 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.550166 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.549990 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-web-config\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.550166 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.550107 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6c84ba80-7902-4eef-bdc4-40e28d00c048-config-out\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.550166 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.550112 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-config-volume\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.550490 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.550468 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6c84ba80-7902-4eef-bdc4-40e28d00c048-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.550892 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.550488 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.551293 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.551271 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.552959 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.552936 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.553368 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.553346 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.555529 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.555489 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5xcp\" (UniqueName: \"kubernetes.io/projected/6c84ba80-7902-4eef-bdc4-40e28d00c048-kube-api-access-v5xcp\") pod \"alertmanager-main-0\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.648595 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.648503 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dlfsf" event={"ID":"f17bc84b-00dc-4451-9ae9-5c56d2f87db7","Type":"ContainerStarted","Data":"daa99582dd2087a73987b98669e625e3be67aaefd4c7ce9da32022e7caf2d244"} Jul 24 14:36:59.689935 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.689900 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:36:59.892415 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:36:59.892248 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 14:37:00.004343 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:37:00.004296 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c84ba80_7902_4eef_bdc4_40e28d00c048.slice/crio-a1dc75acd6b3c5b0848524a2bad06716873d28b8f83e84db759fa89d34cb6fa6 WatchSource:0}: Error finding container a1dc75acd6b3c5b0848524a2bad06716873d28b8f83e84db759fa89d34cb6fa6: Status 404 returned error can't find the container with id a1dc75acd6b3c5b0848524a2bad06716873d28b8f83e84db759fa89d34cb6fa6 Jul 24 14:37:00.051775 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:00.051686 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-gmgh4\" (UID: \"f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gmgh4" Jul 24 14:37:00.054410 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:00.054383 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-gmgh4\" (UID: \"f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gmgh4" Jul 24 14:37:00.176608 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:00.176577 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gmgh4" Jul 24 14:37:00.322387 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:37:00.322349 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-g7zlw" podUID="836ce326-bf5d-4c96-9a71-da5ab147043f" Jul 24 14:37:00.343630 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:00.343594 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-gmgh4"] Jul 24 14:37:00.348434 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:37:00.348401 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8aa3fd0_aeb6_488d_b5aa_4adbdc2203ad.slice/crio-bad33b546e7bb487ee3d29755a990cc7f2e0697721f4f557f9dc8bf8934d3ab8 WatchSource:0}: Error finding container bad33b546e7bb487ee3d29755a990cc7f2e0697721f4f557f9dc8bf8934d3ab8: Status 404 returned error can't find the container with id bad33b546e7bb487ee3d29755a990cc7f2e0697721f4f557f9dc8bf8934d3ab8 Jul 24 14:37:00.655587 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:00.655440 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gmgh4" event={"ID":"f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad","Type":"ContainerStarted","Data":"6a804fc578c8734da5dd5ed3d4759d0879c271782097ad918dcac8695aafd703"} Jul 24 14:37:00.655587 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:00.655513 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gmgh4" event={"ID":"f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad","Type":"ContainerStarted","Data":"9d0bc1c7eaded31f59d46fc0fdb42cf5f0dd319a2b0ff760409af6aed7df1a4c"} Jul 24 14:37:00.655587 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:00.655545 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gmgh4" event={"ID":"f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad","Type":"ContainerStarted","Data":"bad33b546e7bb487ee3d29755a990cc7f2e0697721f4f557f9dc8bf8934d3ab8"} Jul 24 14:37:00.659867 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:00.659136 2582 generic.go:356] "Generic (PLEG): container finished" podID="f17bc84b-00dc-4451-9ae9-5c56d2f87db7" containerID="fce33e0b53f38b94bcbce83f566f021fff8909d058a7a45787d8440b79b52dc1" exitCode=0 Jul 24 14:37:00.659867 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:00.659274 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dlfsf" event={"ID":"f17bc84b-00dc-4451-9ae9-5c56d2f87db7","Type":"ContainerDied","Data":"fce33e0b53f38b94bcbce83f566f021fff8909d058a7a45787d8440b79b52dc1"} Jul 24 14:37:00.661683 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:00.661298 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g7zlw" Jul 24 14:37:00.661683 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:00.661596 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c84ba80-7902-4eef-bdc4-40e28d00c048","Type":"ContainerStarted","Data":"a1dc75acd6b3c5b0848524a2bad06716873d28b8f83e84db759fa89d34cb6fa6"} Jul 24 14:37:01.671466 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:01.671428 2582 generic.go:356] "Generic (PLEG): container finished" podID="972377ec-7ec3-492e-83e7-3a65e365274c" containerID="c4cf58acb8e9bf500e98a3b240ac72ed684e66215ebd0a61e8b12236841b79db" exitCode=0 Jul 24 14:37:01.672040 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:01.671537 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w" event={"ID":"972377ec-7ec3-492e-83e7-3a65e365274c","Type":"ContainerDied","Data":"c4cf58acb8e9bf500e98a3b240ac72ed684e66215ebd0a61e8b12236841b79db"} Jul 24 14:37:01.672040 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:01.671872 2582 scope.go:117] "RemoveContainer" containerID="c4cf58acb8e9bf500e98a3b240ac72ed684e66215ebd0a61e8b12236841b79db" Jul 24 14:37:01.674802 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:01.674752 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dlfsf" event={"ID":"f17bc84b-00dc-4451-9ae9-5c56d2f87db7","Type":"ContainerStarted","Data":"e20eb2a21e773facd76c7932be18aaacb2c01447f7b46973668be7d08ee361f9"} Jul 24 14:37:01.674920 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:01.674838 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dlfsf" event={"ID":"f17bc84b-00dc-4451-9ae9-5c56d2f87db7","Type":"ContainerStarted","Data":"101fec254fd572236ef555ae740879f2a4348e64f79ada7fa6fb2425604e91e6"} Jul 24 14:37:01.676537 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:01.676513 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c84ba80-7902-4eef-bdc4-40e28d00c048","Type":"ContainerStarted","Data":"e6bda02ba007c683d12c32a0d7b7653d10482149b3d1425de15c28da5f049a33"} Jul 24 14:37:01.755828 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:01.755690 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dlfsf" podStartSLOduration=2.350155878 podStartE2EDuration="3.755665893s" totalImagesPullingTime="1.296343435s" totalInitContainerRuntime="109.16658ms" isStatefulPod=true podCreationTimestamp="2026-07-24 14:36:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:01.755629718 +0000 UTC m=+159.294479269" watchObservedRunningTime="2026-07-24 14:37:01.755665893 +0000 UTC m=+159.294515422" Jul 24 14:37:02.682554 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.682470 2582 generic.go:356] "Generic (PLEG): container finished" podID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerID="e6bda02ba007c683d12c32a0d7b7653d10482149b3d1425de15c28da5f049a33" exitCode=0 Jul 24 14:37:02.683014 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.682548 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c84ba80-7902-4eef-bdc4-40e28d00c048","Type":"ContainerDied","Data":"e6bda02ba007c683d12c32a0d7b7653d10482149b3d1425de15c28da5f049a33"} Jul 24 14:37:02.685107 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.685076 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gmgh4" event={"ID":"f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad","Type":"ContainerStarted","Data":"e9244978545ff1149dcbe7a46d078bf74d1b3c70c3e7b5709aed780f32d9b447"} Jul 24 14:37:02.687534 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.687508 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w" event={"ID":"972377ec-7ec3-492e-83e7-3a65e365274c","Type":"ContainerStarted","Data":"5a9cc5d0058b6b9bab779653bf5f2a69d9f9a08fc48fe01377664baef5ae6528"} Jul 24 14:37:02.718757 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.718717 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-85b888bf9d-qpmjq"] Jul 24 14:37:02.740141 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.740113 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-85b888bf9d-qpmjq"] Jul 24 14:37:02.740340 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.740215 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" Jul 24 14:37:02.747862 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.747711 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 24 14:37:02.747862 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.747852 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-755wz\"" Jul 24 14:37:02.748085 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.748017 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7cmr2mbb56d9k\"" Jul 24 14:37:02.750593 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.748167 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 24 14:37:02.750593 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.748735 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 24 14:37:02.751672 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.751476 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 24 14:37:02.766332 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.766270 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gmgh4" podStartSLOduration=2.948283167 podStartE2EDuration="4.766231965s" totalImagesPullingTime="1.817948798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:02.765507402 +0000 UTC m=+160.304356930" watchObservedRunningTime="2026-07-24 14:37:02.766231965 +0000 UTC m=+160.305081491" Jul 24 14:37:02.828810 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.828775 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-648b9d75c-llc9f"] Jul 24 14:37:02.842031 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.841999 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648b9d75c-llc9f" Jul 24 14:37:02.845141 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.845113 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 24 14:37:02.845523 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.845481 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 24 14:37:02.846378 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.845730 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 24 14:37:02.846378 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.846000 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hzw4q\"" Jul 24 14:37:02.846378 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.846221 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 24 14:37:02.847205 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.847184 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 24 14:37:02.847701 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.847278 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-648b9d75c-llc9f"] Jul 24 14:37:02.883348 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.882962 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b148f0b1-a634-4d15-8d1b-ec368de4c202-metrics-server-audit-profiles\") pod \"metrics-server-85b888bf9d-qpmjq\" (UID: \"b148f0b1-a634-4d15-8d1b-ec368de4c202\") " pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" Jul 24 14:37:02.883348 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.883027 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b148f0b1-a634-4d15-8d1b-ec368de4c202-secret-metrics-server-client-certs\") pod \"metrics-server-85b888bf9d-qpmjq\" (UID: \"b148f0b1-a634-4d15-8d1b-ec368de4c202\") " pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" Jul 24 14:37:02.883348 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.883055 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b148f0b1-a634-4d15-8d1b-ec368de4c202-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85b888bf9d-qpmjq\" (UID: \"b148f0b1-a634-4d15-8d1b-ec368de4c202\") " pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" Jul 24 14:37:02.883348 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.883095 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b148f0b1-a634-4d15-8d1b-ec368de4c202-audit-log\") pod \"metrics-server-85b888bf9d-qpmjq\" (UID: \"b148f0b1-a634-4d15-8d1b-ec368de4c202\") " pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" Jul 24 14:37:02.883348 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.883141 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b148f0b1-a634-4d15-8d1b-ec368de4c202-client-ca-bundle\") pod \"metrics-server-85b888bf9d-qpmjq\" (UID: \"b148f0b1-a634-4d15-8d1b-ec368de4c202\") " pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" Jul 24 14:37:02.883348 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.883172 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm5np\" (UniqueName: \"kubernetes.io/projected/b148f0b1-a634-4d15-8d1b-ec368de4c202-kube-api-access-rm5np\") pod \"metrics-server-85b888bf9d-qpmjq\" (UID: \"b148f0b1-a634-4d15-8d1b-ec368de4c202\") " pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" Jul 24 14:37:02.883348 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.883218 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b148f0b1-a634-4d15-8d1b-ec368de4c202-secret-metrics-server-tls\") pod \"metrics-server-85b888bf9d-qpmjq\" (UID: \"b148f0b1-a634-4d15-8d1b-ec368de4c202\") " pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" Jul 24 14:37:02.984461 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.984422 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b148f0b1-a634-4d15-8d1b-ec368de4c202-audit-log\") pod \"metrics-server-85b888bf9d-qpmjq\" (UID: \"b148f0b1-a634-4d15-8d1b-ec368de4c202\") " pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" Jul 24 14:37:02.984775 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.984486 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8dd31e89-ba49-40e0-8975-cf179b6e7e39-oauth-serving-cert\") pod \"console-648b9d75c-llc9f\" (UID: \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\") " pod="openshift-console/console-648b9d75c-llc9f" Jul 24 14:37:02.984775 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.984517 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llcw8\" (UniqueName: \"kubernetes.io/projected/8dd31e89-ba49-40e0-8975-cf179b6e7e39-kube-api-access-llcw8\") pod \"console-648b9d75c-llc9f\" (UID: \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\") " pod="openshift-console/console-648b9d75c-llc9f" Jul 24 14:37:02.984775 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.984553 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b148f0b1-a634-4d15-8d1b-ec368de4c202-client-ca-bundle\") pod \"metrics-server-85b888bf9d-qpmjq\" (UID: \"b148f0b1-a634-4d15-8d1b-ec368de4c202\") " pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" Jul 24 14:37:02.984775 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.984580 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8dd31e89-ba49-40e0-8975-cf179b6e7e39-service-ca\") pod \"console-648b9d75c-llc9f\" (UID: \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\") " pod="openshift-console/console-648b9d75c-llc9f" Jul 24 14:37:02.984775 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.984609 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm5np\" (UniqueName: \"kubernetes.io/projected/b148f0b1-a634-4d15-8d1b-ec368de4c202-kube-api-access-rm5np\") pod \"metrics-server-85b888bf9d-qpmjq\" (UID: \"b148f0b1-a634-4d15-8d1b-ec368de4c202\") " pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" Jul 24 14:37:02.984775 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.984662 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b148f0b1-a634-4d15-8d1b-ec368de4c202-secret-metrics-server-tls\") pod \"metrics-server-85b888bf9d-qpmjq\" (UID: \"b148f0b1-a634-4d15-8d1b-ec368de4c202\") " pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" Jul 24 14:37:02.984775 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.984686 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8dd31e89-ba49-40e0-8975-cf179b6e7e39-console-oauth-config\") pod \"console-648b9d75c-llc9f\" (UID: \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\") " pod="openshift-console/console-648b9d75c-llc9f" Jul 24 14:37:02.984775 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.984740 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b148f0b1-a634-4d15-8d1b-ec368de4c202-metrics-server-audit-profiles\") pod \"metrics-server-85b888bf9d-qpmjq\" (UID: \"b148f0b1-a634-4d15-8d1b-ec368de4c202\") " pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" Jul 24 14:37:02.985177 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.984799 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b148f0b1-a634-4d15-8d1b-ec368de4c202-secret-metrics-server-client-certs\") pod \"metrics-server-85b888bf9d-qpmjq\" (UID: \"b148f0b1-a634-4d15-8d1b-ec368de4c202\") " pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" Jul 24 14:37:02.985177 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.984831 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b148f0b1-a634-4d15-8d1b-ec368de4c202-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85b888bf9d-qpmjq\" (UID: \"b148f0b1-a634-4d15-8d1b-ec368de4c202\") " pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" Jul 24 14:37:02.985177 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.984857 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8dd31e89-ba49-40e0-8975-cf179b6e7e39-console-serving-cert\") pod \"console-648b9d75c-llc9f\" (UID: \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\") " pod="openshift-console/console-648b9d75c-llc9f" Jul 24 14:37:02.985177 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.984874 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b148f0b1-a634-4d15-8d1b-ec368de4c202-audit-log\") pod \"metrics-server-85b888bf9d-qpmjq\" (UID: \"b148f0b1-a634-4d15-8d1b-ec368de4c202\") " pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" Jul 24 14:37:02.985177 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.984996 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8dd31e89-ba49-40e0-8975-cf179b6e7e39-console-config\") pod \"console-648b9d75c-llc9f\" (UID: \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\") " pod="openshift-console/console-648b9d75c-llc9f" Jul 24 14:37:02.985607 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.985575 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b148f0b1-a634-4d15-8d1b-ec368de4c202-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85b888bf9d-qpmjq\" (UID: \"b148f0b1-a634-4d15-8d1b-ec368de4c202\") " pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" Jul 24 14:37:02.986294 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.986226 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b148f0b1-a634-4d15-8d1b-ec368de4c202-metrics-server-audit-profiles\") pod \"metrics-server-85b888bf9d-qpmjq\" (UID: \"b148f0b1-a634-4d15-8d1b-ec368de4c202\") " pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" Jul 24 14:37:02.987928 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.987901 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b148f0b1-a634-4d15-8d1b-ec368de4c202-secret-metrics-server-client-certs\") pod \"metrics-server-85b888bf9d-qpmjq\" (UID: \"b148f0b1-a634-4d15-8d1b-ec368de4c202\") " pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" Jul 24 14:37:02.988297 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.988274 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b148f0b1-a634-4d15-8d1b-ec368de4c202-secret-metrics-server-tls\") pod \"metrics-server-85b888bf9d-qpmjq\" (UID: \"b148f0b1-a634-4d15-8d1b-ec368de4c202\") " pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" Jul 24 14:37:02.988515 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.988474 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b148f0b1-a634-4d15-8d1b-ec368de4c202-client-ca-bundle\") pod \"metrics-server-85b888bf9d-qpmjq\" (UID: \"b148f0b1-a634-4d15-8d1b-ec368de4c202\") " pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" Jul 24 14:37:02.997501 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:02.997475 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm5np\" (UniqueName: \"kubernetes.io/projected/b148f0b1-a634-4d15-8d1b-ec368de4c202-kube-api-access-rm5np\") pod \"metrics-server-85b888bf9d-qpmjq\" (UID: \"b148f0b1-a634-4d15-8d1b-ec368de4c202\") " pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" Jul 24 14:37:03.054144 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:03.054087 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" Jul 24 14:37:03.085470 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:03.085434 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8dd31e89-ba49-40e0-8975-cf179b6e7e39-oauth-serving-cert\") pod \"console-648b9d75c-llc9f\" (UID: \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\") " pod="openshift-console/console-648b9d75c-llc9f" Jul 24 14:37:03.085470 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:03.085472 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llcw8\" (UniqueName: \"kubernetes.io/projected/8dd31e89-ba49-40e0-8975-cf179b6e7e39-kube-api-access-llcw8\") pod \"console-648b9d75c-llc9f\" (UID: \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\") " pod="openshift-console/console-648b9d75c-llc9f" Jul 24 14:37:03.085703 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:03.085508 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8dd31e89-ba49-40e0-8975-cf179b6e7e39-service-ca\") pod \"console-648b9d75c-llc9f\" (UID: \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\") " pod="openshift-console/console-648b9d75c-llc9f" Jul 24 14:37:03.085703 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:03.085557 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8dd31e89-ba49-40e0-8975-cf179b6e7e39-console-oauth-config\") pod \"console-648b9d75c-llc9f\" (UID: \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\") " pod="openshift-console/console-648b9d75c-llc9f" Jul 24 14:37:03.085703 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:03.085637 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8dd31e89-ba49-40e0-8975-cf179b6e7e39-console-serving-cert\") pod \"console-648b9d75c-llc9f\" (UID: \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\") " pod="openshift-console/console-648b9d75c-llc9f" Jul 24 14:37:03.085882 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:03.085808 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8dd31e89-ba49-40e0-8975-cf179b6e7e39-console-config\") pod \"console-648b9d75c-llc9f\" (UID: \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\") " pod="openshift-console/console-648b9d75c-llc9f" Jul 24 14:37:03.086360 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:03.086293 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8dd31e89-ba49-40e0-8975-cf179b6e7e39-oauth-serving-cert\") pod \"console-648b9d75c-llc9f\" (UID: \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\") " pod="openshift-console/console-648b9d75c-llc9f" Jul 24 14:37:03.086478 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:03.086411 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8dd31e89-ba49-40e0-8975-cf179b6e7e39-service-ca\") pod \"console-648b9d75c-llc9f\" (UID: \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\") " pod="openshift-console/console-648b9d75c-llc9f" Jul 24 14:37:03.086554 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:03.086513 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8dd31e89-ba49-40e0-8975-cf179b6e7e39-console-config\") pod \"console-648b9d75c-llc9f\" (UID: \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\") " pod="openshift-console/console-648b9d75c-llc9f" Jul 24 14:37:03.088483 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:03.088458 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8dd31e89-ba49-40e0-8975-cf179b6e7e39-console-oauth-config\") pod \"console-648b9d75c-llc9f\" (UID: \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\") " pod="openshift-console/console-648b9d75c-llc9f" Jul 24 14:37:03.088585 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:03.088466 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8dd31e89-ba49-40e0-8975-cf179b6e7e39-console-serving-cert\") pod \"console-648b9d75c-llc9f\" (UID: \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\") " pod="openshift-console/console-648b9d75c-llc9f" Jul 24 14:37:03.098032 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:03.098006 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llcw8\" (UniqueName: \"kubernetes.io/projected/8dd31e89-ba49-40e0-8975-cf179b6e7e39-kube-api-access-llcw8\") pod \"console-648b9d75c-llc9f\" (UID: \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\") " pod="openshift-console/console-648b9d75c-llc9f" Jul 24 14:37:03.156679 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:03.156636 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648b9d75c-llc9f" Jul 24 14:37:04.365736 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.365678 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 14:37:04.369648 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.369623 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.372011 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.371982 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 24 14:37:04.372145 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.372089 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 24 14:37:04.372145 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.372106 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 24 14:37:04.372415 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.372395 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 24 14:37:04.372490 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.372413 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 24 14:37:04.372490 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.372425 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 24 14:37:04.372490 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.372413 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 24 14:37:04.372885 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.372865 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 24 14:37:04.372957 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.372908 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 24 14:37:04.373013 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.372961 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 24 14:37:04.373013 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.372866 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 24 14:37:04.373101 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.373008 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dr77t\"" Jul 24 14:37:04.373101 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.373094 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 24 14:37:04.373372 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.372865 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-aousril6trlr2\"" Jul 24 14:37:04.373372 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.373311 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 24 14:37:04.376859 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.376838 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 24 14:37:04.387566 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.387491 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 14:37:04.500526 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.500480 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.500526 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.500529 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.500847 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.500554 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.500847 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.500634 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2df90998-597e-4a98-8ddc-234cad929223-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.500847 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.500675 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrqk2\" (UniqueName: \"kubernetes.io/projected/2df90998-597e-4a98-8ddc-234cad929223-kube-api-access-qrqk2\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.500847 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.500707 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.500847 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.500770 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.500847 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.500807 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.500847 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.500831 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.501187 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.500855 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.501187 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.500894 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-config\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.501187 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.500922 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.501187 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.500951 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.501187 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.501046 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.501187 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.501080 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-web-config\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.501187 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.501117 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.501187 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.501178 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2df90998-597e-4a98-8ddc-234cad929223-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.501537 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.501214 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2df90998-597e-4a98-8ddc-234cad929223-config-out\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.501537 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.501270 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.501537 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.501307 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.602408 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.602358 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.602595 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.602421 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2df90998-597e-4a98-8ddc-234cad929223-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.602595 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.602452 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2df90998-597e-4a98-8ddc-234cad929223-config-out\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.602595 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.602481 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.602595 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.602514 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.602595 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.602567 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.602595 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.602593 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.602916 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.602637 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.602916 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.602664 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2df90998-597e-4a98-8ddc-234cad929223-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.602916 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.602695 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrqk2\" (UniqueName: \"kubernetes.io/projected/2df90998-597e-4a98-8ddc-234cad929223-kube-api-access-qrqk2\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.602916 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.602720 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.602916 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.602777 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.602916 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.602805 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.602916 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.602828 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.602916 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.602852 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.602916 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.602898 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-config\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.605046 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.602925 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.605046 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.602954 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.605046 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.603002 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.605046 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.603025 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-web-config\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.605046 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.603144 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2df90998-597e-4a98-8ddc-234cad929223-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.605046 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.604612 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.609647 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.606608 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.609647 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.607176 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.609647 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.607518 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2df90998-597e-4a98-8ddc-234cad929223-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.609647 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.607999 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.609647 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.608680 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.609647 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.608721 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.609647 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.609066 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.609647 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.609093 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-web-config\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.609647 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.609506 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.609647 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.609566 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.610201 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.609703 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.610201 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.609779 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-config\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.610563 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.610519 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2df90998-597e-4a98-8ddc-234cad929223-config-out\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.611459 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.611432 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.612302 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.612280 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.612638 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.612617 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.613222 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.613183 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.622105 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.622031 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrqk2\" (UniqueName: \"kubernetes.io/projected/2df90998-597e-4a98-8ddc-234cad929223-kube-api-access-qrqk2\") pod \"prometheus-k8s-0\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:04.685418 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:04.685363 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:05.208038 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:05.208001 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/836ce326-bf5d-4c96-9a71-da5ab147043f-metrics-tls\") pod \"dns-default-g7zlw\" (UID: \"836ce326-bf5d-4c96-9a71-da5ab147043f\") " pod="openshift-dns/dns-default-g7zlw" Jul 24 14:37:05.210645 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:05.210613 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/836ce326-bf5d-4c96-9a71-da5ab147043f-metrics-tls\") pod \"dns-default-g7zlw\" (UID: \"836ce326-bf5d-4c96-9a71-da5ab147043f\") " pod="openshift-dns/dns-default-g7zlw" Jul 24 14:37:05.464940 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:05.464874 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-26zbb\"" Jul 24 14:37:05.472837 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:05.472810 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g7zlw" Jul 24 14:37:09.650249 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:09.650197 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-648b9d75c-llc9f"] Jul 24 14:37:10.047024 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:10.046846 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g7zlw"] Jul 24 14:37:10.059110 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:37:10.059072 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod836ce326_bf5d_4c96_9a71_da5ab147043f.slice/crio-321cde1555f5804fab326d35ceb9e63ebea0264773eb2eee6fe4c8844b8928e2 WatchSource:0}: Error finding container 321cde1555f5804fab326d35ceb9e63ebea0264773eb2eee6fe4c8844b8928e2: Status 404 returned error can't find the container with id 321cde1555f5804fab326d35ceb9e63ebea0264773eb2eee6fe4c8844b8928e2 Jul 24 14:37:10.302938 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:10.302898 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-648b9d75c-llc9f"] Jul 24 14:37:10.306851 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:10.306750 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-85b888bf9d-qpmjq"] Jul 24 14:37:10.326949 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:10.326776 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 14:37:10.327079 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:37:10.327049 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2df90998_597e_4a98_8ddc_234cad929223.slice/crio-9d1bdfe208e14dd759b3e06aec32ecbdeb567ca6ca5a8d7d3965f791e02de28b WatchSource:0}: Error finding container 9d1bdfe208e14dd759b3e06aec32ecbdeb567ca6ca5a8d7d3965f791e02de28b: Status 404 returned error can't find the container with id 9d1bdfe208e14dd759b3e06aec32ecbdeb567ca6ca5a8d7d3965f791e02de28b Jul 24 14:37:10.729821 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:10.729780 2582 generic.go:356] "Generic (PLEG): container finished" podID="2df90998-597e-4a98-8ddc-234cad929223" containerID="f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf" exitCode=0 Jul 24 14:37:10.730319 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:10.729884 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2df90998-597e-4a98-8ddc-234cad929223","Type":"ContainerDied","Data":"f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf"} Jul 24 14:37:10.730319 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:10.729960 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2df90998-597e-4a98-8ddc-234cad929223","Type":"ContainerStarted","Data":"9d1bdfe208e14dd759b3e06aec32ecbdeb567ca6ca5a8d7d3965f791e02de28b"} Jul 24 14:37:10.732781 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:10.732706 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648b9d75c-llc9f" event={"ID":"8dd31e89-ba49-40e0-8975-cf179b6e7e39","Type":"ContainerStarted","Data":"d9baa1c47d7e0f290f58cc85e0b6107249ccf030b50d4d0d5f43f10731553d65"} Jul 24 14:37:10.734488 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:10.734407 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" event={"ID":"b148f0b1-a634-4d15-8d1b-ec368de4c202","Type":"ContainerStarted","Data":"f80e3a3212c11c0e443825085b2981c8ee923bd98b4b9e38ff2a2a78d1681c61"} Jul 24 14:37:10.737293 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:10.736195 2582 generic.go:356] "Generic (PLEG): container finished" podID="a0909119-831a-46d5-9ac9-36b277728f89" containerID="98a46111b40cbed040f65034c4710d7421e1c3aa46bea32c4eb3c19844ffc931" exitCode=0 Jul 24 14:37:10.737293 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:10.736319 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-425z6" event={"ID":"a0909119-831a-46d5-9ac9-36b277728f89","Type":"ContainerDied","Data":"98a46111b40cbed040f65034c4710d7421e1c3aa46bea32c4eb3c19844ffc931"} Jul 24 14:37:10.737293 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:10.736706 2582 scope.go:117] "RemoveContainer" containerID="98a46111b40cbed040f65034c4710d7421e1c3aa46bea32c4eb3c19844ffc931" Jul 24 14:37:10.739368 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:10.739268 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g7zlw" event={"ID":"836ce326-bf5d-4c96-9a71-da5ab147043f","Type":"ContainerStarted","Data":"321cde1555f5804fab326d35ceb9e63ebea0264773eb2eee6fe4c8844b8928e2"} Jul 24 14:37:10.743441 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:10.741948 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-2p8mm" event={"ID":"232c5bdd-4b0e-4448-ad5a-edff8c40a933","Type":"ContainerStarted","Data":"a046d82c4448ec335e3de30aa696eaa083ac194d666cfc72b0bb688933b84ffb"} Jul 24 14:37:10.743441 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:10.743383 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-2p8mm" Jul 24 14:37:10.760932 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:10.760868 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-2p8mm" Jul 24 14:37:10.837715 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:10.837654 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-2p8mm" podStartSLOduration=1.381951639 podStartE2EDuration="18.837630039s" totalImagesPullingTime="17.4556784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:10.813528224 +0000 UTC m=+168.352377762" watchObservedRunningTime="2026-07-24 14:37:10.837630039 +0000 UTC m=+168.376479568" Jul 24 14:37:11.754401 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:11.752930 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-425z6" event={"ID":"a0909119-831a-46d5-9ac9-36b277728f89","Type":"ContainerStarted","Data":"8c84149d79ed1f9ec4e5b5db3a9853e1e7da24c44ddd1fd91feb0e49807080e9"} Jul 24 14:37:11.759915 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:11.759835 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c84ba80-7902-4eef-bdc4-40e28d00c048","Type":"ContainerStarted","Data":"33e41f30c88e5a894c79f9af36ddac9b9f50b35c10f3f757975f2ab46c0feb90"} Jul 24 14:37:11.759915 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:11.759906 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c84ba80-7902-4eef-bdc4-40e28d00c048","Type":"ContainerStarted","Data":"0f23389551b52c29f139664fe860d70e8fba49cb547be5b9082c84efed225a6e"} Jul 24 14:37:11.760123 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:11.759949 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c84ba80-7902-4eef-bdc4-40e28d00c048","Type":"ContainerStarted","Data":"4699e7d454756b70e206a19f17b03621a6a1dcaef2c9d963344ffe0c72d573c1"} Jul 24 14:37:11.760123 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:11.759991 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c84ba80-7902-4eef-bdc4-40e28d00c048","Type":"ContainerStarted","Data":"59d5e38ae106678c5e349877c520d52ea9f7990a4b235a90dc82a77f6bf9cd6b"} Jul 24 14:37:17.805257 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:17.805203 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c84ba80-7902-4eef-bdc4-40e28d00c048","Type":"ContainerStarted","Data":"fb79a59da50c6e8ad770163e673bcac56b9bce2e8bb125aa075001909bd6d22b"} Jul 24 14:37:17.807859 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:17.807775 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g7zlw" event={"ID":"836ce326-bf5d-4c96-9a71-da5ab147043f","Type":"ContainerStarted","Data":"f4fa73eaab0f8dafbfea98c66d2e74706a02f6cb938112eb5a0be9e761bfe364"} Jul 24 14:37:17.810306 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:17.809973 2582 generic.go:356] "Generic (PLEG): container finished" podID="6e938d4d-fbf3-484a-a4a1-5aebb70b79c4" containerID="c0846227672ef97845c97af0fd154b410d2ed17f3a855396ea36ddcf825d3780" exitCode=0 Jul 24 14:37:17.810306 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:17.810007 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9rmd" event={"ID":"6e938d4d-fbf3-484a-a4a1-5aebb70b79c4","Type":"ContainerDied","Data":"c0846227672ef97845c97af0fd154b410d2ed17f3a855396ea36ddcf825d3780"} Jul 24 14:37:17.810461 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:17.810424 2582 scope.go:117] "RemoveContainer" containerID="c0846227672ef97845c97af0fd154b410d2ed17f3a855396ea36ddcf825d3780" Jul 24 14:37:17.813060 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:17.812982 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2df90998-597e-4a98-8ddc-234cad929223","Type":"ContainerStarted","Data":"1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403"} Jul 24 14:37:17.815951 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:17.815201 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648b9d75c-llc9f" event={"ID":"8dd31e89-ba49-40e0-8975-cf179b6e7e39","Type":"ContainerStarted","Data":"d517e81c5fe3f78940da1d20b77ef8e600e0ce3c34d7796155b12b39f5b9e5ea"} Jul 24 14:37:17.818761 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:17.818627 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" event={"ID":"b148f0b1-a634-4d15-8d1b-ec368de4c202","Type":"ContainerStarted","Data":"ce0a48ea4da04a53da51ad0b85c62d4fd608e39f895ab0cf4c2eba7af76f9ee0"} Jul 24 14:37:17.908801 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:17.906797 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" podStartSLOduration=8.844561489 podStartE2EDuration="15.906533077s" totalImagesPullingTime="7.061971588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:37:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:17.878491358 +0000 UTC m=+175.417340886" watchObservedRunningTime="2026-07-24 14:37:17.906533077 +0000 UTC m=+175.445382628" Jul 24 14:37:18.826575 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:18.826546 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g7zlw" event={"ID":"836ce326-bf5d-4c96-9a71-da5ab147043f","Type":"ContainerStarted","Data":"ae5dd61e260d82f044988ba74adc46a04def33d26b40dd4bbe71ff31f07ac785"} Jul 24 14:37:18.827028 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:18.826657 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-g7zlw" Jul 24 14:37:18.828733 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:18.828704 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9rmd" event={"ID":"6e938d4d-fbf3-484a-a4a1-5aebb70b79c4","Type":"ContainerStarted","Data":"042c9f2597c485c713f7d0134b3b0056052e42f52b02674292525dbefbbaba5f"} Jul 24 14:37:18.831213 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:18.831186 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2df90998-597e-4a98-8ddc-234cad929223","Type":"ContainerStarted","Data":"e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c"} Jul 24 14:37:18.856645 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:18.856602 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-g7zlw" podStartSLOduration=134.544502385 podStartE2EDuration="2m21.856584585s" totalImagesPullingTime="7.3120822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:18.855404746 +0000 UTC m=+176.394254274" watchObservedRunningTime="2026-07-24 14:37:18.856584585 +0000 UTC m=+176.395434125" Jul 24 14:37:18.857106 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:18.857073 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-648b9d75c-llc9f" podStartSLOduration=9.727995062 podStartE2EDuration="16.8570617s" totalImagesPullingTime="7.129066638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:37:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:17.909009896 +0000 UTC m=+175.447859404" watchObservedRunningTime="2026-07-24 14:37:18.8570617 +0000 UTC m=+176.395911229" Jul 24 14:37:19.839730 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:19.839689 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c84ba80-7902-4eef-bdc4-40e28d00c048","Type":"ContainerStarted","Data":"d36d9fc2d0cede6bd1c02676cdff2e59e42ddf9991017e77866dbeca55ce4133"} Jul 24 14:37:19.876808 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:19.876736 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=9.589083599 podStartE2EDuration="20.87671874s" totalImagesPullingTime="11.258859743s" totalInitContainerRuntime="28.775398ms" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:19.876268624 +0000 UTC m=+177.415118174" watchObservedRunningTime="2026-07-24 14:37:19.87671874 +0000 UTC m=+177.415568266" Jul 24 14:37:20.847819 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:20.847734 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2df90998-597e-4a98-8ddc-234cad929223","Type":"ContainerStarted","Data":"6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc"} Jul 24 14:37:20.848164 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:20.847819 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2df90998-597e-4a98-8ddc-234cad929223","Type":"ContainerStarted","Data":"b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2"} Jul 24 14:37:20.848164 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:20.847864 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2df90998-597e-4a98-8ddc-234cad929223","Type":"ContainerStarted","Data":"fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620"} Jul 24 14:37:20.848164 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:20.847911 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2df90998-597e-4a98-8ddc-234cad929223","Type":"ContainerStarted","Data":"f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38"} Jul 24 14:37:20.884886 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:20.884827 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=7.662347186 podStartE2EDuration="16.884811675s" totalImagesPullingTime="9.195353892s" totalInitContainerRuntime="27.110597ms" isStatefulPod=false podCreationTimestamp="2026-07-24 14:37:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:20.882715577 +0000 UTC m=+178.421565107" watchObservedRunningTime="2026-07-24 14:37:20.884811675 +0000 UTC m=+178.423661201" Jul 24 14:37:23.054296 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:23.054264 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" Jul 24 14:37:23.054692 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:23.054467 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" Jul 24 14:37:23.157197 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:23.157161 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-648b9d75c-llc9f" Jul 24 14:37:24.686352 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:24.686314 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:37:28.842225 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:28.842195 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-g7zlw" Jul 24 14:37:42.847743 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:42.847549 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-648b9d75c-llc9f" podUID="8dd31e89-ba49-40e0-8975-cf179b6e7e39" containerName="console" containerID="cri-o://d517e81c5fe3f78940da1d20b77ef8e600e0ce3c34d7796155b12b39f5b9e5ea" gracePeriod=15 Jul 24 14:37:43.060874 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.060846 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" Jul 24 14:37:43.064819 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.064795 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-85b888bf9d-qpmjq" Jul 24 14:37:43.118865 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.118807 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648b9d75c-llc9f" Jul 24 14:37:43.180644 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.180615 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llcw8\" (UniqueName: \"kubernetes.io/projected/8dd31e89-ba49-40e0-8975-cf179b6e7e39-kube-api-access-llcw8\") pod \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\" (UID: \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\") " Jul 24 14:37:43.180644 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.180648 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8dd31e89-ba49-40e0-8975-cf179b6e7e39-console-serving-cert\") pod \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\" (UID: \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\") " Jul 24 14:37:43.180880 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.180691 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8dd31e89-ba49-40e0-8975-cf179b6e7e39-service-ca\") pod \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\" (UID: \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\") " Jul 24 14:37:43.180880 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.180716 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8dd31e89-ba49-40e0-8975-cf179b6e7e39-oauth-serving-cert\") pod \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\" (UID: \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\") " Jul 24 14:37:43.180880 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.180824 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8dd31e89-ba49-40e0-8975-cf179b6e7e39-console-oauth-config\") pod \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\" (UID: \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\") " Jul 24 14:37:43.181033 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.180909 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8dd31e89-ba49-40e0-8975-cf179b6e7e39-console-config\") pod \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\" (UID: \"8dd31e89-ba49-40e0-8975-cf179b6e7e39\") " Jul 24 14:37:43.181152 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.181113 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dd31e89-ba49-40e0-8975-cf179b6e7e39-service-ca" (OuterVolumeSpecName: "service-ca") pod "8dd31e89-ba49-40e0-8975-cf179b6e7e39" (UID: "8dd31e89-ba49-40e0-8975-cf179b6e7e39"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:37:43.181257 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.181182 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dd31e89-ba49-40e0-8975-cf179b6e7e39-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8dd31e89-ba49-40e0-8975-cf179b6e7e39" (UID: "8dd31e89-ba49-40e0-8975-cf179b6e7e39"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:37:43.181323 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.181265 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8dd31e89-ba49-40e0-8975-cf179b6e7e39-service-ca\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:37:43.181323 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.181289 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dd31e89-ba49-40e0-8975-cf179b6e7e39-console-config" (OuterVolumeSpecName: "console-config") pod "8dd31e89-ba49-40e0-8975-cf179b6e7e39" (UID: "8dd31e89-ba49-40e0-8975-cf179b6e7e39"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:37:43.182978 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.182953 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dd31e89-ba49-40e0-8975-cf179b6e7e39-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8dd31e89-ba49-40e0-8975-cf179b6e7e39" (UID: "8dd31e89-ba49-40e0-8975-cf179b6e7e39"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:37:43.182978 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.182961 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dd31e89-ba49-40e0-8975-cf179b6e7e39-kube-api-access-llcw8" (OuterVolumeSpecName: "kube-api-access-llcw8") pod "8dd31e89-ba49-40e0-8975-cf179b6e7e39" (UID: "8dd31e89-ba49-40e0-8975-cf179b6e7e39"). InnerVolumeSpecName "kube-api-access-llcw8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:37:43.183126 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.183024 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dd31e89-ba49-40e0-8975-cf179b6e7e39-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8dd31e89-ba49-40e0-8975-cf179b6e7e39" (UID: "8dd31e89-ba49-40e0-8975-cf179b6e7e39"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:37:43.286448 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.282467 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8dd31e89-ba49-40e0-8975-cf179b6e7e39-oauth-serving-cert\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:37:43.286448 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.282503 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8dd31e89-ba49-40e0-8975-cf179b6e7e39-console-oauth-config\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:37:43.286448 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.282519 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8dd31e89-ba49-40e0-8975-cf179b6e7e39-console-config\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:37:43.286448 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.282535 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llcw8\" (UniqueName: \"kubernetes.io/projected/8dd31e89-ba49-40e0-8975-cf179b6e7e39-kube-api-access-llcw8\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:37:43.286448 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.282554 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8dd31e89-ba49-40e0-8975-cf179b6e7e39-console-serving-cert\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:37:43.946812 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.946773 2582 generic.go:356] "Generic (PLEG): container finished" podID="8dd31e89-ba49-40e0-8975-cf179b6e7e39" containerID="d517e81c5fe3f78940da1d20b77ef8e600e0ce3c34d7796155b12b39f5b9e5ea" exitCode=0 Jul 24 14:37:43.947320 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.946846 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648b9d75c-llc9f" Jul 24 14:37:43.947320 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.946853 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648b9d75c-llc9f" event={"ID":"8dd31e89-ba49-40e0-8975-cf179b6e7e39","Type":"ContainerDied","Data":"d517e81c5fe3f78940da1d20b77ef8e600e0ce3c34d7796155b12b39f5b9e5ea"} Jul 24 14:37:43.947320 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.946951 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648b9d75c-llc9f" event={"ID":"8dd31e89-ba49-40e0-8975-cf179b6e7e39","Type":"ContainerDied","Data":"d9baa1c47d7e0f290f58cc85e0b6107249ccf030b50d4d0d5f43f10731553d65"} Jul 24 14:37:43.947320 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.946985 2582 scope.go:117] "RemoveContainer" containerID="d517e81c5fe3f78940da1d20b77ef8e600e0ce3c34d7796155b12b39f5b9e5ea" Jul 24 14:37:43.956591 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.956331 2582 scope.go:117] "RemoveContainer" containerID="d517e81c5fe3f78940da1d20b77ef8e600e0ce3c34d7796155b12b39f5b9e5ea" Jul 24 14:37:43.956827 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:37:43.956736 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d517e81c5fe3f78940da1d20b77ef8e600e0ce3c34d7796155b12b39f5b9e5ea\": container with ID starting with d517e81c5fe3f78940da1d20b77ef8e600e0ce3c34d7796155b12b39f5b9e5ea not found: ID does not exist" containerID="d517e81c5fe3f78940da1d20b77ef8e600e0ce3c34d7796155b12b39f5b9e5ea" Jul 24 14:37:43.956827 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.956774 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d517e81c5fe3f78940da1d20b77ef8e600e0ce3c34d7796155b12b39f5b9e5ea"} err="failed to get container status \"d517e81c5fe3f78940da1d20b77ef8e600e0ce3c34d7796155b12b39f5b9e5ea\": rpc error: code = NotFound desc = could not find container \"d517e81c5fe3f78940da1d20b77ef8e600e0ce3c34d7796155b12b39f5b9e5ea\": container with ID starting with d517e81c5fe3f78940da1d20b77ef8e600e0ce3c34d7796155b12b39f5b9e5ea not found: ID does not exist" Jul 24 14:37:43.971041 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.971010 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-648b9d75c-llc9f"] Jul 24 14:37:43.975587 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:43.975562 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-648b9d75c-llc9f"] Jul 24 14:37:45.036803 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:37:45.036760 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8dd31e89-ba49-40e0-8975-cf179b6e7e39" path="/var/lib/kubelet/pods/8dd31e89-ba49-40e0-8975-cf179b6e7e39/volumes" Jul 24 14:38:04.685931 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:04.685888 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:04.706697 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:04.706663 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:05.047293 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:05.047265 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:18.584207 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:18.584170 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 14:38:18.584741 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:18.584472 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerName="alertmanager" containerID="cri-o://59d5e38ae106678c5e349877c520d52ea9f7990a4b235a90dc82a77f6bf9cd6b" gracePeriod=120 Jul 24 14:38:18.584741 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:18.584536 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerName="kube-rbac-proxy-metric" containerID="cri-o://fb79a59da50c6e8ad770163e673bcac56b9bce2e8bb125aa075001909bd6d22b" gracePeriod=120 Jul 24 14:38:18.584741 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:18.584569 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerName="kube-rbac-proxy-web" containerID="cri-o://0f23389551b52c29f139664fe860d70e8fba49cb547be5b9082c84efed225a6e" gracePeriod=120 Jul 24 14:38:18.584741 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:18.584603 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerName="config-reloader" containerID="cri-o://4699e7d454756b70e206a19f17b03621a6a1dcaef2c9d963344ffe0c72d573c1" gracePeriod=120 Jul 24 14:38:18.584741 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:18.584639 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerName="prom-label-proxy" containerID="cri-o://d36d9fc2d0cede6bd1c02676cdff2e59e42ddf9991017e77866dbeca55ce4133" gracePeriod=120 Jul 24 14:38:18.584741 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:18.584634 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerName="kube-rbac-proxy" containerID="cri-o://33e41f30c88e5a894c79f9af36ddac9b9f50b35c10f3f757975f2ab46c0feb90" gracePeriod=120 Jul 24 14:38:19.091584 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.091545 2582 generic.go:356] "Generic (PLEG): container finished" podID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerID="d36d9fc2d0cede6bd1c02676cdff2e59e42ddf9991017e77866dbeca55ce4133" exitCode=0 Jul 24 14:38:19.091584 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.091572 2582 generic.go:356] "Generic (PLEG): container finished" podID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerID="fb79a59da50c6e8ad770163e673bcac56b9bce2e8bb125aa075001909bd6d22b" exitCode=0 Jul 24 14:38:19.091584 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.091581 2582 generic.go:356] "Generic (PLEG): container finished" podID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerID="33e41f30c88e5a894c79f9af36ddac9b9f50b35c10f3f757975f2ab46c0feb90" exitCode=0 Jul 24 14:38:19.091584 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.091589 2582 generic.go:356] "Generic (PLEG): container finished" podID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerID="4699e7d454756b70e206a19f17b03621a6a1dcaef2c9d963344ffe0c72d573c1" exitCode=0 Jul 24 14:38:19.091944 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.091598 2582 generic.go:356] "Generic (PLEG): container finished" podID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerID="59d5e38ae106678c5e349877c520d52ea9f7990a4b235a90dc82a77f6bf9cd6b" exitCode=0 Jul 24 14:38:19.091944 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.091614 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c84ba80-7902-4eef-bdc4-40e28d00c048","Type":"ContainerDied","Data":"d36d9fc2d0cede6bd1c02676cdff2e59e42ddf9991017e77866dbeca55ce4133"} Jul 24 14:38:19.091944 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.091684 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c84ba80-7902-4eef-bdc4-40e28d00c048","Type":"ContainerDied","Data":"fb79a59da50c6e8ad770163e673bcac56b9bce2e8bb125aa075001909bd6d22b"} Jul 24 14:38:19.091944 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.091712 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c84ba80-7902-4eef-bdc4-40e28d00c048","Type":"ContainerDied","Data":"33e41f30c88e5a894c79f9af36ddac9b9f50b35c10f3f757975f2ab46c0feb90"} Jul 24 14:38:19.091944 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.091737 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c84ba80-7902-4eef-bdc4-40e28d00c048","Type":"ContainerDied","Data":"4699e7d454756b70e206a19f17b03621a6a1dcaef2c9d963344ffe0c72d573c1"} Jul 24 14:38:19.091944 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.091761 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c84ba80-7902-4eef-bdc4-40e28d00c048","Type":"ContainerDied","Data":"59d5e38ae106678c5e349877c520d52ea9f7990a4b235a90dc82a77f6bf9cd6b"} Jul 24 14:38:19.831344 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.831316 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:19.921165 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.921083 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6c84ba80-7902-4eef-bdc4-40e28d00c048-config-out\") pod \"6c84ba80-7902-4eef-bdc4-40e28d00c048\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " Jul 24 14:38:19.921165 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.921121 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6c84ba80-7902-4eef-bdc4-40e28d00c048-tls-assets\") pod \"6c84ba80-7902-4eef-bdc4-40e28d00c048\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " Jul 24 14:38:19.921165 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.921163 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-secret-alertmanager-kube-rbac-proxy-metric\") pod \"6c84ba80-7902-4eef-bdc4-40e28d00c048\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " Jul 24 14:38:19.921446 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.921192 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6c84ba80-7902-4eef-bdc4-40e28d00c048-alertmanager-main-db\") pod \"6c84ba80-7902-4eef-bdc4-40e28d00c048\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " Jul 24 14:38:19.921446 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.921217 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-cluster-tls-config\") pod \"6c84ba80-7902-4eef-bdc4-40e28d00c048\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " Jul 24 14:38:19.921446 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.921403 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c84ba80-7902-4eef-bdc4-40e28d00c048-alertmanager-trusted-ca-bundle\") pod \"6c84ba80-7902-4eef-bdc4-40e28d00c048\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " Jul 24 14:38:19.921600 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.921454 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-secret-alertmanager-kube-rbac-proxy\") pod \"6c84ba80-7902-4eef-bdc4-40e28d00c048\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " Jul 24 14:38:19.921600 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.921483 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-secret-alertmanager-kube-rbac-proxy-web\") pod \"6c84ba80-7902-4eef-bdc4-40e28d00c048\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " Jul 24 14:38:19.921600 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.921528 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-config-volume\") pod \"6c84ba80-7902-4eef-bdc4-40e28d00c048\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " Jul 24 14:38:19.921600 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.921553 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5xcp\" (UniqueName: \"kubernetes.io/projected/6c84ba80-7902-4eef-bdc4-40e28d00c048-kube-api-access-v5xcp\") pod \"6c84ba80-7902-4eef-bdc4-40e28d00c048\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " Jul 24 14:38:19.921600 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.921557 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c84ba80-7902-4eef-bdc4-40e28d00c048-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "6c84ba80-7902-4eef-bdc4-40e28d00c048" (UID: "6c84ba80-7902-4eef-bdc4-40e28d00c048"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:38:19.921600 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.921592 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c84ba80-7902-4eef-bdc4-40e28d00c048-metrics-client-ca\") pod \"6c84ba80-7902-4eef-bdc4-40e28d00c048\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " Jul 24 14:38:19.921906 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.921623 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-secret-alertmanager-main-tls\") pod \"6c84ba80-7902-4eef-bdc4-40e28d00c048\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " Jul 24 14:38:19.921906 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.921732 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-web-config\") pod \"6c84ba80-7902-4eef-bdc4-40e28d00c048\" (UID: \"6c84ba80-7902-4eef-bdc4-40e28d00c048\") " Jul 24 14:38:19.922014 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.921998 2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6c84ba80-7902-4eef-bdc4-40e28d00c048-alertmanager-main-db\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:19.922070 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.922035 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c84ba80-7902-4eef-bdc4-40e28d00c048-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "6c84ba80-7902-4eef-bdc4-40e28d00c048" (UID: "6c84ba80-7902-4eef-bdc4-40e28d00c048"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:38:19.923720 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.923650 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c84ba80-7902-4eef-bdc4-40e28d00c048-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "6c84ba80-7902-4eef-bdc4-40e28d00c048" (UID: "6c84ba80-7902-4eef-bdc4-40e28d00c048"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:38:19.923899 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.923869 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c84ba80-7902-4eef-bdc4-40e28d00c048-config-out" (OuterVolumeSpecName: "config-out") pod "6c84ba80-7902-4eef-bdc4-40e28d00c048" (UID: "6c84ba80-7902-4eef-bdc4-40e28d00c048"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:38:19.923987 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.923950 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "6c84ba80-7902-4eef-bdc4-40e28d00c048" (UID: "6c84ba80-7902-4eef-bdc4-40e28d00c048"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:38:19.924595 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.924557 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c84ba80-7902-4eef-bdc4-40e28d00c048-kube-api-access-v5xcp" (OuterVolumeSpecName: "kube-api-access-v5xcp") pod "6c84ba80-7902-4eef-bdc4-40e28d00c048" (UID: "6c84ba80-7902-4eef-bdc4-40e28d00c048"). InnerVolumeSpecName "kube-api-access-v5xcp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:38:19.924767 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.924730 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c84ba80-7902-4eef-bdc4-40e28d00c048-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6c84ba80-7902-4eef-bdc4-40e28d00c048" (UID: "6c84ba80-7902-4eef-bdc4-40e28d00c048"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:38:19.924920 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.924890 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "6c84ba80-7902-4eef-bdc4-40e28d00c048" (UID: "6c84ba80-7902-4eef-bdc4-40e28d00c048"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:38:19.925514 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.925470 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "6c84ba80-7902-4eef-bdc4-40e28d00c048" (UID: "6c84ba80-7902-4eef-bdc4-40e28d00c048"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:38:19.925813 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.925794 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-config-volume" (OuterVolumeSpecName: "config-volume") pod "6c84ba80-7902-4eef-bdc4-40e28d00c048" (UID: "6c84ba80-7902-4eef-bdc4-40e28d00c048"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:38:19.926096 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.926074 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "6c84ba80-7902-4eef-bdc4-40e28d00c048" (UID: "6c84ba80-7902-4eef-bdc4-40e28d00c048"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:38:19.929355 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.929333 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "6c84ba80-7902-4eef-bdc4-40e28d00c048" (UID: "6c84ba80-7902-4eef-bdc4-40e28d00c048"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:38:19.935106 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:19.935084 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-web-config" (OuterVolumeSpecName: "web-config") pod "6c84ba80-7902-4eef-bdc4-40e28d00c048" (UID: "6c84ba80-7902-4eef-bdc4-40e28d00c048"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:38:20.022721 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.022672 2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c84ba80-7902-4eef-bdc4-40e28d00c048-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:20.022721 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.022716 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:20.022721 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.022730 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:20.022968 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.022743 2582 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-config-volume\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:20.022968 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.022756 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5xcp\" (UniqueName: \"kubernetes.io/projected/6c84ba80-7902-4eef-bdc4-40e28d00c048-kube-api-access-v5xcp\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:20.022968 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.022770 2582 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c84ba80-7902-4eef-bdc4-40e28d00c048-metrics-client-ca\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:20.022968 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.022780 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-secret-alertmanager-main-tls\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:20.022968 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.022791 2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-web-config\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:20.022968 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.022804 2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6c84ba80-7902-4eef-bdc4-40e28d00c048-config-out\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:20.022968 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.022815 2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6c84ba80-7902-4eef-bdc4-40e28d00c048-tls-assets\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:20.022968 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.022826 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:20.022968 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.022837 2582 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6c84ba80-7902-4eef-bdc4-40e28d00c048-cluster-tls-config\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:20.099679 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.099643 2582 generic.go:356] "Generic (PLEG): container finished" podID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerID="0f23389551b52c29f139664fe860d70e8fba49cb547be5b9082c84efed225a6e" exitCode=0 Jul 24 14:38:20.099834 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.099720 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c84ba80-7902-4eef-bdc4-40e28d00c048","Type":"ContainerDied","Data":"0f23389551b52c29f139664fe860d70e8fba49cb547be5b9082c84efed225a6e"} Jul 24 14:38:20.099834 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.099784 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c84ba80-7902-4eef-bdc4-40e28d00c048","Type":"ContainerDied","Data":"a1dc75acd6b3c5b0848524a2bad06716873d28b8f83e84db759fa89d34cb6fa6"} Jul 24 14:38:20.099834 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.099729 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.100020 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.099817 2582 scope.go:117] "RemoveContainer" containerID="d36d9fc2d0cede6bd1c02676cdff2e59e42ddf9991017e77866dbeca55ce4133" Jul 24 14:38:20.107950 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.107846 2582 scope.go:117] "RemoveContainer" containerID="fb79a59da50c6e8ad770163e673bcac56b9bce2e8bb125aa075001909bd6d22b" Jul 24 14:38:20.115313 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.115292 2582 scope.go:117] "RemoveContainer" containerID="33e41f30c88e5a894c79f9af36ddac9b9f50b35c10f3f757975f2ab46c0feb90" Jul 24 14:38:20.122082 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.122067 2582 scope.go:117] "RemoveContainer" containerID="0f23389551b52c29f139664fe860d70e8fba49cb547be5b9082c84efed225a6e" Jul 24 14:38:20.126566 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.126544 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 14:38:20.130393 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.130371 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 14:38:20.130990 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.130977 2582 scope.go:117] "RemoveContainer" containerID="4699e7d454756b70e206a19f17b03621a6a1dcaef2c9d963344ffe0c72d573c1" Jul 24 14:38:20.138000 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.137982 2582 scope.go:117] "RemoveContainer" containerID="59d5e38ae106678c5e349877c520d52ea9f7990a4b235a90dc82a77f6bf9cd6b" Jul 24 14:38:20.145041 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.145017 2582 scope.go:117] "RemoveContainer" containerID="e6bda02ba007c683d12c32a0d7b7653d10482149b3d1425de15c28da5f049a33" Jul 24 14:38:20.152425 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.152403 2582 scope.go:117] "RemoveContainer" containerID="d36d9fc2d0cede6bd1c02676cdff2e59e42ddf9991017e77866dbeca55ce4133" Jul 24 14:38:20.152684 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:38:20.152665 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d36d9fc2d0cede6bd1c02676cdff2e59e42ddf9991017e77866dbeca55ce4133\": container with ID starting with d36d9fc2d0cede6bd1c02676cdff2e59e42ddf9991017e77866dbeca55ce4133 not found: ID does not exist" containerID="d36d9fc2d0cede6bd1c02676cdff2e59e42ddf9991017e77866dbeca55ce4133" Jul 24 14:38:20.152739 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.152694 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d36d9fc2d0cede6bd1c02676cdff2e59e42ddf9991017e77866dbeca55ce4133"} err="failed to get container status \"d36d9fc2d0cede6bd1c02676cdff2e59e42ddf9991017e77866dbeca55ce4133\": rpc error: code = NotFound desc = could not find container \"d36d9fc2d0cede6bd1c02676cdff2e59e42ddf9991017e77866dbeca55ce4133\": container with ID starting with d36d9fc2d0cede6bd1c02676cdff2e59e42ddf9991017e77866dbeca55ce4133 not found: ID does not exist" Jul 24 14:38:20.152739 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.152713 2582 scope.go:117] "RemoveContainer" containerID="fb79a59da50c6e8ad770163e673bcac56b9bce2e8bb125aa075001909bd6d22b" Jul 24 14:38:20.152959 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:38:20.152943 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb79a59da50c6e8ad770163e673bcac56b9bce2e8bb125aa075001909bd6d22b\": container with ID starting with fb79a59da50c6e8ad770163e673bcac56b9bce2e8bb125aa075001909bd6d22b not found: ID does not exist" containerID="fb79a59da50c6e8ad770163e673bcac56b9bce2e8bb125aa075001909bd6d22b" Jul 24 14:38:20.153012 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.152969 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb79a59da50c6e8ad770163e673bcac56b9bce2e8bb125aa075001909bd6d22b"} err="failed to get container status \"fb79a59da50c6e8ad770163e673bcac56b9bce2e8bb125aa075001909bd6d22b\": rpc error: code = NotFound desc = could not find container \"fb79a59da50c6e8ad770163e673bcac56b9bce2e8bb125aa075001909bd6d22b\": container with ID starting with fb79a59da50c6e8ad770163e673bcac56b9bce2e8bb125aa075001909bd6d22b not found: ID does not exist" Jul 24 14:38:20.153012 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.152984 2582 scope.go:117] "RemoveContainer" containerID="33e41f30c88e5a894c79f9af36ddac9b9f50b35c10f3f757975f2ab46c0feb90" Jul 24 14:38:20.153192 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:38:20.153176 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33e41f30c88e5a894c79f9af36ddac9b9f50b35c10f3f757975f2ab46c0feb90\": container with ID starting with 33e41f30c88e5a894c79f9af36ddac9b9f50b35c10f3f757975f2ab46c0feb90 not found: ID does not exist" containerID="33e41f30c88e5a894c79f9af36ddac9b9f50b35c10f3f757975f2ab46c0feb90" Jul 24 14:38:20.153246 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.153196 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33e41f30c88e5a894c79f9af36ddac9b9f50b35c10f3f757975f2ab46c0feb90"} err="failed to get container status \"33e41f30c88e5a894c79f9af36ddac9b9f50b35c10f3f757975f2ab46c0feb90\": rpc error: code = NotFound desc = could not find container \"33e41f30c88e5a894c79f9af36ddac9b9f50b35c10f3f757975f2ab46c0feb90\": container with ID starting with 33e41f30c88e5a894c79f9af36ddac9b9f50b35c10f3f757975f2ab46c0feb90 not found: ID does not exist" Jul 24 14:38:20.153246 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.153213 2582 scope.go:117] "RemoveContainer" containerID="0f23389551b52c29f139664fe860d70e8fba49cb547be5b9082c84efed225a6e" Jul 24 14:38:20.153420 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:38:20.153400 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f23389551b52c29f139664fe860d70e8fba49cb547be5b9082c84efed225a6e\": container with ID starting with 0f23389551b52c29f139664fe860d70e8fba49cb547be5b9082c84efed225a6e not found: ID does not exist" containerID="0f23389551b52c29f139664fe860d70e8fba49cb547be5b9082c84efed225a6e" Jul 24 14:38:20.153470 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.153424 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f23389551b52c29f139664fe860d70e8fba49cb547be5b9082c84efed225a6e"} err="failed to get container status \"0f23389551b52c29f139664fe860d70e8fba49cb547be5b9082c84efed225a6e\": rpc error: code = NotFound desc = could not find container \"0f23389551b52c29f139664fe860d70e8fba49cb547be5b9082c84efed225a6e\": container with ID starting with 0f23389551b52c29f139664fe860d70e8fba49cb547be5b9082c84efed225a6e not found: ID does not exist" Jul 24 14:38:20.153470 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.153436 2582 scope.go:117] "RemoveContainer" containerID="4699e7d454756b70e206a19f17b03621a6a1dcaef2c9d963344ffe0c72d573c1" Jul 24 14:38:20.153621 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:38:20.153603 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4699e7d454756b70e206a19f17b03621a6a1dcaef2c9d963344ffe0c72d573c1\": container with ID starting with 4699e7d454756b70e206a19f17b03621a6a1dcaef2c9d963344ffe0c72d573c1 not found: ID does not exist" containerID="4699e7d454756b70e206a19f17b03621a6a1dcaef2c9d963344ffe0c72d573c1" Jul 24 14:38:20.153707 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.153621 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4699e7d454756b70e206a19f17b03621a6a1dcaef2c9d963344ffe0c72d573c1"} err="failed to get container status \"4699e7d454756b70e206a19f17b03621a6a1dcaef2c9d963344ffe0c72d573c1\": rpc error: code = NotFound desc = could not find container \"4699e7d454756b70e206a19f17b03621a6a1dcaef2c9d963344ffe0c72d573c1\": container with ID starting with 4699e7d454756b70e206a19f17b03621a6a1dcaef2c9d963344ffe0c72d573c1 not found: ID does not exist" Jul 24 14:38:20.153707 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.153633 2582 scope.go:117] "RemoveContainer" containerID="59d5e38ae106678c5e349877c520d52ea9f7990a4b235a90dc82a77f6bf9cd6b" Jul 24 14:38:20.153841 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:38:20.153825 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59d5e38ae106678c5e349877c520d52ea9f7990a4b235a90dc82a77f6bf9cd6b\": container with ID starting with 59d5e38ae106678c5e349877c520d52ea9f7990a4b235a90dc82a77f6bf9cd6b not found: ID does not exist" containerID="59d5e38ae106678c5e349877c520d52ea9f7990a4b235a90dc82a77f6bf9cd6b" Jul 24 14:38:20.153879 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.153845 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59d5e38ae106678c5e349877c520d52ea9f7990a4b235a90dc82a77f6bf9cd6b"} err="failed to get container status \"59d5e38ae106678c5e349877c520d52ea9f7990a4b235a90dc82a77f6bf9cd6b\": rpc error: code = NotFound desc = could not find container \"59d5e38ae106678c5e349877c520d52ea9f7990a4b235a90dc82a77f6bf9cd6b\": container with ID starting with 59d5e38ae106678c5e349877c520d52ea9f7990a4b235a90dc82a77f6bf9cd6b not found: ID does not exist" Jul 24 14:38:20.153879 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.153859 2582 scope.go:117] "RemoveContainer" containerID="e6bda02ba007c683d12c32a0d7b7653d10482149b3d1425de15c28da5f049a33" Jul 24 14:38:20.154089 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:38:20.154070 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6bda02ba007c683d12c32a0d7b7653d10482149b3d1425de15c28da5f049a33\": container with ID starting with e6bda02ba007c683d12c32a0d7b7653d10482149b3d1425de15c28da5f049a33 not found: ID does not exist" containerID="e6bda02ba007c683d12c32a0d7b7653d10482149b3d1425de15c28da5f049a33" Jul 24 14:38:20.154136 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.154094 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6bda02ba007c683d12c32a0d7b7653d10482149b3d1425de15c28da5f049a33"} err="failed to get container status \"e6bda02ba007c683d12c32a0d7b7653d10482149b3d1425de15c28da5f049a33\": rpc error: code = NotFound desc = could not find container \"e6bda02ba007c683d12c32a0d7b7653d10482149b3d1425de15c28da5f049a33\": container with ID starting with e6bda02ba007c683d12c32a0d7b7653d10482149b3d1425de15c28da5f049a33 not found: ID does not exist" Jul 24 14:38:20.159987 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.159966 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 14:38:20.160288 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.160274 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerName="config-reloader" Jul 24 14:38:20.160288 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.160289 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerName="config-reloader" Jul 24 14:38:20.160381 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.160299 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerName="kube-rbac-proxy-metric" Jul 24 14:38:20.160381 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.160305 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerName="kube-rbac-proxy-metric" Jul 24 14:38:20.160381 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.160314 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dd31e89-ba49-40e0-8975-cf179b6e7e39" containerName="console" Jul 24 14:38:20.160381 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.160319 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dd31e89-ba49-40e0-8975-cf179b6e7e39" containerName="console" Jul 24 14:38:20.160381 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.160325 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerName="init-config-reloader" Jul 24 14:38:20.160381 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.160331 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerName="init-config-reloader" Jul 24 14:38:20.160381 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.160339 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerName="prom-label-proxy" Jul 24 14:38:20.160381 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.160344 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerName="prom-label-proxy" Jul 24 14:38:20.160381 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.160354 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerName="alertmanager" Jul 24 14:38:20.160381 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.160360 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerName="alertmanager" Jul 24 14:38:20.160381 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.160369 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerName="kube-rbac-proxy-web" Jul 24 14:38:20.160381 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.160375 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerName="kube-rbac-proxy-web" Jul 24 14:38:20.160381 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.160384 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerName="kube-rbac-proxy" Jul 24 14:38:20.160789 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.160389 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerName="kube-rbac-proxy" Jul 24 14:38:20.160789 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.160442 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerName="kube-rbac-proxy" Jul 24 14:38:20.160789 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.160449 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerName="kube-rbac-proxy-metric" Jul 24 14:38:20.160789 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.160456 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerName="alertmanager" Jul 24 14:38:20.160789 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.160461 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerName="kube-rbac-proxy-web" Jul 24 14:38:20.160789 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.160467 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dd31e89-ba49-40e0-8975-cf179b6e7e39" containerName="console" Jul 24 14:38:20.160789 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.160472 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerName="config-reloader" Jul 24 14:38:20.160789 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.160479 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c84ba80-7902-4eef-bdc4-40e28d00c048" containerName="prom-label-proxy" Jul 24 14:38:20.164999 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.164229 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.166575 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.166559 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 24 14:38:20.166681 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.166660 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 24 14:38:20.166838 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.166822 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 24 14:38:20.166996 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.166978 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-62gv8\"" Jul 24 14:38:20.167039 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.167027 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 24 14:38:20.167263 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.167226 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 24 14:38:20.167338 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.167306 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 24 14:38:20.167605 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.167590 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 24 14:38:20.167654 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.167609 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 24 14:38:20.173603 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.173584 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 24 14:38:20.178369 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.178350 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 14:38:20.224167 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.224137 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-config-volume\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.224167 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.224170 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.224439 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.224195 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxk8c\" (UniqueName: \"kubernetes.io/projected/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-kube-api-access-pxk8c\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.224439 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.224289 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.224439 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.224364 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.224439 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.224406 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-config-out\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.224570 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.224439 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.224570 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.224492 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.224570 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.224527 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.224570 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.224552 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.224771 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.224586 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.224771 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.224623 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-web-config\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.224771 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.224645 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.325810 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.325765 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxk8c\" (UniqueName: \"kubernetes.io/projected/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-kube-api-access-pxk8c\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.325810 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.325821 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.326065 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.325845 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.326065 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.325872 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-config-out\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.326065 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.325892 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.326065 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.325917 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.326065 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.325939 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.326065 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.325965 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.326065 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.325998 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.326065 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.326040 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-web-config\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.326065 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.326060 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.326562 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.326081 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-config-volume\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.326562 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.326122 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.326562 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.326342 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.326942 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.326915 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.328991 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.328959 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.328991 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.328980 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.329180 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.329025 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-config-out\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.329180 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.329134 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.329180 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.329141 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.329349 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.329331 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-config-volume\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.329403 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.329345 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.329472 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.329454 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-web-config\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.329512 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.329481 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.330915 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.330895 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.334349 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.334327 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxk8c\" (UniqueName: \"kubernetes.io/projected/c3bbc7b5-1812-4c6e-a060-0bf9fb917801-kube-api-access-pxk8c\") pod \"alertmanager-main-0\" (UID: \"c3bbc7b5-1812-4c6e-a060-0bf9fb917801\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.475404 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.475373 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 14:38:20.616386 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:20.616365 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 14:38:20.618708 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:38:20.618683 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3bbc7b5_1812_4c6e_a060_0bf9fb917801.slice/crio-ef1b99663c6df6659a7590c78057f7dcfc1f3dd99409cafe3b9723785f47a2c2 WatchSource:0}: Error finding container ef1b99663c6df6659a7590c78057f7dcfc1f3dd99409cafe3b9723785f47a2c2: Status 404 returned error can't find the container with id ef1b99663c6df6659a7590c78057f7dcfc1f3dd99409cafe3b9723785f47a2c2 Jul 24 14:38:21.037130 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:21.037096 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c84ba80-7902-4eef-bdc4-40e28d00c048" path="/var/lib/kubelet/pods/6c84ba80-7902-4eef-bdc4-40e28d00c048/volumes" Jul 24 14:38:21.105796 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:21.105761 2582 generic.go:356] "Generic (PLEG): container finished" podID="c3bbc7b5-1812-4c6e-a060-0bf9fb917801" containerID="1ee677058b98d114c2fba655baece3c80b26e52eff9400b02e129670f9d0e2d9" exitCode=0 Jul 24 14:38:21.105944 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:21.105846 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3bbc7b5-1812-4c6e-a060-0bf9fb917801","Type":"ContainerDied","Data":"1ee677058b98d114c2fba655baece3c80b26e52eff9400b02e129670f9d0e2d9"} Jul 24 14:38:21.105944 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:21.105919 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3bbc7b5-1812-4c6e-a060-0bf9fb917801","Type":"ContainerStarted","Data":"ef1b99663c6df6659a7590c78057f7dcfc1f3dd99409cafe3b9723785f47a2c2"} Jul 24 14:38:22.114036 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:22.113993 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3bbc7b5-1812-4c6e-a060-0bf9fb917801","Type":"ContainerStarted","Data":"233051ca5fab2281af34d16858b65c5b9a68d6191bf5b3eafc1017449b442e65"} Jul 24 14:38:22.114458 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:22.114076 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3bbc7b5-1812-4c6e-a060-0bf9fb917801","Type":"ContainerStarted","Data":"4b53a1cc8feaa4e42787f0e4c53f9a362943ca0adedb34ccb9f7b7e2025d7882"} Jul 24 14:38:22.114458 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:22.114123 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3bbc7b5-1812-4c6e-a060-0bf9fb917801","Type":"ContainerStarted","Data":"2aeb6c853179c9236ff27ec76d7dc87a4f41131601da26312720c1f05196eb5a"} Jul 24 14:38:22.114458 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:22.114158 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3bbc7b5-1812-4c6e-a060-0bf9fb917801","Type":"ContainerStarted","Data":"3d176a0ae9c33693c7a0425d60c1883391eeebce53c8a3560488642aa70d2c3f"} Jul 24 14:38:22.114458 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:22.114194 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3bbc7b5-1812-4c6e-a060-0bf9fb917801","Type":"ContainerStarted","Data":"bdc679e1ba3dffd869a12897a21d4ab70f1b2ecfe0895a63615e607bf551a5a3"} Jul 24 14:38:22.114458 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:22.114230 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3bbc7b5-1812-4c6e-a060-0bf9fb917801","Type":"ContainerStarted","Data":"f329fcd2c957f78330bee749eec24fc95301fd2aba2b524de4347709bcfb2e26"} Jul 24 14:38:22.155575 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:22.155501 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.143670563 podStartE2EDuration="2.155485181s" totalImagesPullingTime="0s" totalInitContainerRuntime="11.814618ms" isStatefulPod=false podCreationTimestamp="2026-07-24 14:38:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:38:22.154368748 +0000 UTC m=+239.693218285" watchObservedRunningTime="2026-07-24 14:38:22.155485181 +0000 UTC m=+239.694334708" Jul 24 14:38:22.841803 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:22.841770 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 14:38:22.842074 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:22.842033 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2df90998-597e-4a98-8ddc-234cad929223" containerName="prometheus" containerID="cri-o://1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403" gracePeriod=600 Jul 24 14:38:22.842074 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:22.842045 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2df90998-597e-4a98-8ddc-234cad929223" containerName="kube-rbac-proxy-thanos" containerID="cri-o://6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc" gracePeriod=600 Jul 24 14:38:22.842074 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:22.842063 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2df90998-597e-4a98-8ddc-234cad929223" containerName="kube-rbac-proxy" containerID="cri-o://b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2" gracePeriod=600 Jul 24 14:38:22.842330 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:22.842084 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2df90998-597e-4a98-8ddc-234cad929223" containerName="thanos-sidecar" containerID="cri-o://f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38" gracePeriod=600 Jul 24 14:38:22.842330 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:22.842105 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2df90998-597e-4a98-8ddc-234cad929223" containerName="config-reloader" containerID="cri-o://e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c" gracePeriod=600 Jul 24 14:38:22.842330 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:22.842053 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2df90998-597e-4a98-8ddc-234cad929223" containerName="kube-rbac-proxy-web" containerID="cri-o://fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620" gracePeriod=600 Jul 24 14:38:23.103923 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.103896 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.122110 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.122074 2582 generic.go:356] "Generic (PLEG): container finished" podID="2df90998-597e-4a98-8ddc-234cad929223" containerID="6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc" exitCode=0 Jul 24 14:38:23.122110 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.122104 2582 generic.go:356] "Generic (PLEG): container finished" podID="2df90998-597e-4a98-8ddc-234cad929223" containerID="b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2" exitCode=0 Jul 24 14:38:23.122110 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.122115 2582 generic.go:356] "Generic (PLEG): container finished" podID="2df90998-597e-4a98-8ddc-234cad929223" containerID="fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620" exitCode=0 Jul 24 14:38:23.122712 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.122124 2582 generic.go:356] "Generic (PLEG): container finished" podID="2df90998-597e-4a98-8ddc-234cad929223" containerID="f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38" exitCode=0 Jul 24 14:38:23.122712 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.122132 2582 generic.go:356] "Generic (PLEG): container finished" podID="2df90998-597e-4a98-8ddc-234cad929223" containerID="e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c" exitCode=0 Jul 24 14:38:23.122712 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.122141 2582 generic.go:356] "Generic (PLEG): container finished" podID="2df90998-597e-4a98-8ddc-234cad929223" containerID="1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403" exitCode=0 Jul 24 14:38:23.122712 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.122272 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2df90998-597e-4a98-8ddc-234cad929223","Type":"ContainerDied","Data":"6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc"} Jul 24 14:38:23.122712 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.122364 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.122712 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.122393 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2df90998-597e-4a98-8ddc-234cad929223","Type":"ContainerDied","Data":"b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2"} Jul 24 14:38:23.122712 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.122438 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2df90998-597e-4a98-8ddc-234cad929223","Type":"ContainerDied","Data":"fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620"} Jul 24 14:38:23.122712 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.122453 2582 scope.go:117] "RemoveContainer" containerID="6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc" Jul 24 14:38:23.122712 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.122479 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2df90998-597e-4a98-8ddc-234cad929223","Type":"ContainerDied","Data":"f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38"} Jul 24 14:38:23.122712 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.122520 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2df90998-597e-4a98-8ddc-234cad929223","Type":"ContainerDied","Data":"e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c"} Jul 24 14:38:23.122712 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.122564 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2df90998-597e-4a98-8ddc-234cad929223","Type":"ContainerDied","Data":"1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403"} Jul 24 14:38:23.122712 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.122604 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2df90998-597e-4a98-8ddc-234cad929223","Type":"ContainerDied","Data":"9d1bdfe208e14dd759b3e06aec32ecbdeb567ca6ca5a8d7d3965f791e02de28b"} Jul 24 14:38:23.131481 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.131459 2582 scope.go:117] "RemoveContainer" containerID="b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2" Jul 24 14:38:23.141551 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.141490 2582 scope.go:117] "RemoveContainer" containerID="fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620" Jul 24 14:38:23.151377 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.151347 2582 scope.go:117] "RemoveContainer" containerID="f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38" Jul 24 14:38:23.151859 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.151839 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-thanos-prometheus-http-client-file\") pod \"2df90998-597e-4a98-8ddc-234cad929223\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " Jul 24 14:38:23.151978 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.151867 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2df90998-597e-4a98-8ddc-234cad929223-prometheus-k8s-db\") pod \"2df90998-597e-4a98-8ddc-234cad929223\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " Jul 24 14:38:23.151978 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.151892 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"2df90998-597e-4a98-8ddc-234cad929223\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " Jul 24 14:38:23.151978 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.151919 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrqk2\" (UniqueName: \"kubernetes.io/projected/2df90998-597e-4a98-8ddc-234cad929223-kube-api-access-qrqk2\") pod \"2df90998-597e-4a98-8ddc-234cad929223\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " Jul 24 14:38:23.151978 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.151952 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-kube-rbac-proxy\") pod \"2df90998-597e-4a98-8ddc-234cad929223\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " Jul 24 14:38:23.152190 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.151988 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-config\") pod \"2df90998-597e-4a98-8ddc-234cad929223\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " Jul 24 14:38:23.152190 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.152027 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2df90998-597e-4a98-8ddc-234cad929223-config-out\") pod \"2df90998-597e-4a98-8ddc-234cad929223\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " Jul 24 14:38:23.152190 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.152060 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-prometheus-trusted-ca-bundle\") pod \"2df90998-597e-4a98-8ddc-234cad929223\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " Jul 24 14:38:23.152190 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.152086 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-prometheus-k8s-rulefiles-2\") pod \"2df90998-597e-4a98-8ddc-234cad929223\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " Jul 24 14:38:23.152190 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.152127 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-configmap-metrics-client-ca\") pod \"2df90998-597e-4a98-8ddc-234cad929223\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " Jul 24 14:38:23.152190 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.152152 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-prometheus-k8s-rulefiles-0\") pod \"2df90998-597e-4a98-8ddc-234cad929223\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " Jul 24 14:38:23.152533 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.152213 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-configmap-serving-certs-ca-bundle\") pod \"2df90998-597e-4a98-8ddc-234cad929223\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " Jul 24 14:38:23.152533 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.152266 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-grpc-tls\") pod \"2df90998-597e-4a98-8ddc-234cad929223\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " Jul 24 14:38:23.152533 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.152290 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-metrics-client-certs\") pod \"2df90998-597e-4a98-8ddc-234cad929223\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " Jul 24 14:38:23.152533 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.152322 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-configmap-kubelet-serving-ca-bundle\") pod \"2df90998-597e-4a98-8ddc-234cad929223\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " Jul 24 14:38:23.152533 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.152344 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2df90998-597e-4a98-8ddc-234cad929223-tls-assets\") pod \"2df90998-597e-4a98-8ddc-234cad929223\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " Jul 24 14:38:23.152533 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.152379 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-prometheus-k8s-rulefiles-1\") pod \"2df90998-597e-4a98-8ddc-234cad929223\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " Jul 24 14:38:23.152533 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.152406 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-web-config\") pod \"2df90998-597e-4a98-8ddc-234cad929223\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " Jul 24 14:38:23.152533 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.152430 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"2df90998-597e-4a98-8ddc-234cad929223\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " Jul 24 14:38:23.152533 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.152459 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-prometheus-k8s-tls\") pod \"2df90998-597e-4a98-8ddc-234cad929223\" (UID: \"2df90998-597e-4a98-8ddc-234cad929223\") " Jul 24 14:38:23.153108 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.153075 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2df90998-597e-4a98-8ddc-234cad929223-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "2df90998-597e-4a98-8ddc-234cad929223" (UID: "2df90998-597e-4a98-8ddc-234cad929223"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:38:23.153440 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.153413 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "2df90998-597e-4a98-8ddc-234cad929223" (UID: "2df90998-597e-4a98-8ddc-234cad929223"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:38:23.154006 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.153973 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "2df90998-597e-4a98-8ddc-234cad929223" (UID: "2df90998-597e-4a98-8ddc-234cad929223"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:38:23.155070 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.154989 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "2df90998-597e-4a98-8ddc-234cad929223" (UID: "2df90998-597e-4a98-8ddc-234cad929223"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:38:23.155447 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.155421 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "2df90998-597e-4a98-8ddc-234cad929223" (UID: "2df90998-597e-4a98-8ddc-234cad929223"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:38:23.159364 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.158721 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "2df90998-597e-4a98-8ddc-234cad929223" (UID: "2df90998-597e-4a98-8ddc-234cad929223"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:38:23.159364 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.158873 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "2df90998-597e-4a98-8ddc-234cad929223" (UID: "2df90998-597e-4a98-8ddc-234cad929223"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:38:23.159364 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.158933 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "2df90998-597e-4a98-8ddc-234cad929223" (UID: "2df90998-597e-4a98-8ddc-234cad929223"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:38:23.159659 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.159612 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "2df90998-597e-4a98-8ddc-234cad929223" (UID: "2df90998-597e-4a98-8ddc-234cad929223"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:38:23.160057 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.160016 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "2df90998-597e-4a98-8ddc-234cad929223" (UID: "2df90998-597e-4a98-8ddc-234cad929223"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:38:23.161557 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.161518 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "2df90998-597e-4a98-8ddc-234cad929223" (UID: "2df90998-597e-4a98-8ddc-234cad929223"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:38:23.161644 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.161561 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "2df90998-597e-4a98-8ddc-234cad929223" (UID: "2df90998-597e-4a98-8ddc-234cad929223"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:38:23.161644 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.161591 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2df90998-597e-4a98-8ddc-234cad929223-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2df90998-597e-4a98-8ddc-234cad929223" (UID: "2df90998-597e-4a98-8ddc-234cad929223"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:38:23.161644 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.161626 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "2df90998-597e-4a98-8ddc-234cad929223" (UID: "2df90998-597e-4a98-8ddc-234cad929223"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:38:23.161829 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.161713 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-config" (OuterVolumeSpecName: "config") pod "2df90998-597e-4a98-8ddc-234cad929223" (UID: "2df90998-597e-4a98-8ddc-234cad929223"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:38:23.162464 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.162429 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "2df90998-597e-4a98-8ddc-234cad929223" (UID: "2df90998-597e-4a98-8ddc-234cad929223"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:38:23.162654 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.162630 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2df90998-597e-4a98-8ddc-234cad929223-kube-api-access-qrqk2" (OuterVolumeSpecName: "kube-api-access-qrqk2") pod "2df90998-597e-4a98-8ddc-234cad929223" (UID: "2df90998-597e-4a98-8ddc-234cad929223"). InnerVolumeSpecName "kube-api-access-qrqk2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:38:23.162654 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.162640 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2df90998-597e-4a98-8ddc-234cad929223-config-out" (OuterVolumeSpecName: "config-out") pod "2df90998-597e-4a98-8ddc-234cad929223" (UID: "2df90998-597e-4a98-8ddc-234cad929223"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:38:23.163260 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.163204 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "2df90998-597e-4a98-8ddc-234cad929223" (UID: "2df90998-597e-4a98-8ddc-234cad929223"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:38:23.169311 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.169287 2582 scope.go:117] "RemoveContainer" containerID="e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c" Jul 24 14:38:23.174734 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.174704 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-web-config" (OuterVolumeSpecName: "web-config") pod "2df90998-597e-4a98-8ddc-234cad929223" (UID: "2df90998-597e-4a98-8ddc-234cad929223"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:38:23.178869 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.178843 2582 scope.go:117] "RemoveContainer" containerID="1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403" Jul 24 14:38:23.186506 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.186490 2582 scope.go:117] "RemoveContainer" containerID="f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf" Jul 24 14:38:23.193525 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.193509 2582 scope.go:117] "RemoveContainer" containerID="6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc" Jul 24 14:38:23.193781 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:38:23.193762 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc\": container with ID starting with 6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc not found: ID does not exist" containerID="6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc" Jul 24 14:38:23.193821 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.193792 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc"} err="failed to get container status \"6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc\": rpc error: code = NotFound desc = could not find container \"6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc\": container with ID starting with 6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc not found: ID does not exist" Jul 24 14:38:23.193821 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.193810 2582 scope.go:117] "RemoveContainer" containerID="b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2" Jul 24 14:38:23.194061 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:38:23.194044 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2\": container with ID starting with b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2 not found: ID does not exist" containerID="b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2" Jul 24 14:38:23.194116 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.194076 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2"} err="failed to get container status \"b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2\": rpc error: code = NotFound desc = could not find container \"b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2\": container with ID starting with b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2 not found: ID does not exist" Jul 24 14:38:23.194116 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.194092 2582 scope.go:117] "RemoveContainer" containerID="fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620" Jul 24 14:38:23.194451 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:38:23.194432 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620\": container with ID starting with fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620 not found: ID does not exist" containerID="fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620" Jul 24 14:38:23.194503 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.194460 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620"} err="failed to get container status \"fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620\": rpc error: code = NotFound desc = could not find container \"fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620\": container with ID starting with fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620 not found: ID does not exist" Jul 24 14:38:23.194503 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.194477 2582 scope.go:117] "RemoveContainer" containerID="f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38" Jul 24 14:38:23.194727 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:38:23.194706 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38\": container with ID starting with f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38 not found: ID does not exist" containerID="f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38" Jul 24 14:38:23.194778 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.194732 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38"} err="failed to get container status \"f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38\": rpc error: code = NotFound desc = could not find container \"f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38\": container with ID starting with f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38 not found: ID does not exist" Jul 24 14:38:23.194778 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.194748 2582 scope.go:117] "RemoveContainer" containerID="e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c" Jul 24 14:38:23.194976 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:38:23.194959 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c\": container with ID starting with e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c not found: ID does not exist" containerID="e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c" Jul 24 14:38:23.195021 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.194980 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c"} err="failed to get container status \"e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c\": rpc error: code = NotFound desc = could not find container \"e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c\": container with ID starting with e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c not found: ID does not exist" Jul 24 14:38:23.195021 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.194995 2582 scope.go:117] "RemoveContainer" containerID="1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403" Jul 24 14:38:23.195266 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:38:23.195228 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403\": container with ID starting with 1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403 not found: ID does not exist" containerID="1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403" Jul 24 14:38:23.195337 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.195273 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403"} err="failed to get container status \"1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403\": rpc error: code = NotFound desc = could not find container \"1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403\": container with ID starting with 1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403 not found: ID does not exist" Jul 24 14:38:23.195337 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.195292 2582 scope.go:117] "RemoveContainer" containerID="f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf" Jul 24 14:38:23.195543 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:38:23.195526 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf\": container with ID starting with f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf not found: ID does not exist" containerID="f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf" Jul 24 14:38:23.195604 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.195547 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf"} err="failed to get container status \"f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf\": rpc error: code = NotFound desc = could not find container \"f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf\": container with ID starting with f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf not found: ID does not exist" Jul 24 14:38:23.195604 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.195560 2582 scope.go:117] "RemoveContainer" containerID="6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc" Jul 24 14:38:23.195836 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.195817 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc"} err="failed to get container status \"6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc\": rpc error: code = NotFound desc = could not find container \"6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc\": container with ID starting with 6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc not found: ID does not exist" Jul 24 14:38:23.195880 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.195846 2582 scope.go:117] "RemoveContainer" containerID="b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2" Jul 24 14:38:23.196070 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.196053 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2"} err="failed to get container status \"b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2\": rpc error: code = NotFound desc = could not find container \"b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2\": container with ID starting with b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2 not found: ID does not exist" Jul 24 14:38:23.196129 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.196070 2582 scope.go:117] "RemoveContainer" containerID="fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620" Jul 24 14:38:23.196342 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.196322 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620"} err="failed to get container status \"fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620\": rpc error: code = NotFound desc = could not find container \"fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620\": container with ID starting with fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620 not found: ID does not exist" Jul 24 14:38:23.196342 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.196341 2582 scope.go:117] "RemoveContainer" containerID="f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38" Jul 24 14:38:23.196593 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.196571 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38"} err="failed to get container status \"f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38\": rpc error: code = NotFound desc = could not find container \"f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38\": container with ID starting with f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38 not found: ID does not exist" Jul 24 14:38:23.196593 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.196592 2582 scope.go:117] "RemoveContainer" containerID="e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c" Jul 24 14:38:23.196848 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.196828 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c"} err="failed to get container status \"e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c\": rpc error: code = NotFound desc = could not find container \"e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c\": container with ID starting with e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c not found: ID does not exist" Jul 24 14:38:23.196848 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.196847 2582 scope.go:117] "RemoveContainer" containerID="1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403" Jul 24 14:38:23.197088 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.197070 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403"} err="failed to get container status \"1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403\": rpc error: code = NotFound desc = could not find container \"1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403\": container with ID starting with 1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403 not found: ID does not exist" Jul 24 14:38:23.197140 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.197090 2582 scope.go:117] "RemoveContainer" containerID="f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf" Jul 24 14:38:23.197318 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.197299 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf"} err="failed to get container status \"f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf\": rpc error: code = NotFound desc = could not find container \"f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf\": container with ID starting with f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf not found: ID does not exist" Jul 24 14:38:23.197402 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.197320 2582 scope.go:117] "RemoveContainer" containerID="6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc" Jul 24 14:38:23.197536 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.197519 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc"} err="failed to get container status \"6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc\": rpc error: code = NotFound desc = could not find container \"6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc\": container with ID starting with 6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc not found: ID does not exist" Jul 24 14:38:23.197579 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.197536 2582 scope.go:117] "RemoveContainer" containerID="b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2" Jul 24 14:38:23.197737 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.197718 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2"} err="failed to get container status \"b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2\": rpc error: code = NotFound desc = could not find container \"b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2\": container with ID starting with b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2 not found: ID does not exist" Jul 24 14:38:23.197737 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.197736 2582 scope.go:117] "RemoveContainer" containerID="fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620" Jul 24 14:38:23.197900 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.197884 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620"} err="failed to get container status \"fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620\": rpc error: code = NotFound desc = could not find container \"fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620\": container with ID starting with fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620 not found: ID does not exist" Jul 24 14:38:23.197945 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.197901 2582 scope.go:117] "RemoveContainer" containerID="f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38" Jul 24 14:38:23.198091 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.198068 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38"} err="failed to get container status \"f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38\": rpc error: code = NotFound desc = could not find container \"f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38\": container with ID starting with f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38 not found: ID does not exist" Jul 24 14:38:23.198138 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.198092 2582 scope.go:117] "RemoveContainer" containerID="e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c" Jul 24 14:38:23.198352 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.198316 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c"} err="failed to get container status \"e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c\": rpc error: code = NotFound desc = could not find container \"e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c\": container with ID starting with e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c not found: ID does not exist" Jul 24 14:38:23.198352 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.198347 2582 scope.go:117] "RemoveContainer" containerID="1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403" Jul 24 14:38:23.198574 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.198557 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403"} err="failed to get container status \"1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403\": rpc error: code = NotFound desc = could not find container \"1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403\": container with ID starting with 1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403 not found: ID does not exist" Jul 24 14:38:23.198639 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.198574 2582 scope.go:117] "RemoveContainer" containerID="f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf" Jul 24 14:38:23.198816 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.198794 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf"} err="failed to get container status \"f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf\": rpc error: code = NotFound desc = could not find container \"f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf\": container with ID starting with f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf not found: ID does not exist" Jul 24 14:38:23.198859 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.198825 2582 scope.go:117] "RemoveContainer" containerID="6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc" Jul 24 14:38:23.199067 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.199050 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc"} err="failed to get container status \"6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc\": rpc error: code = NotFound desc = could not find container \"6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc\": container with ID starting with 6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc not found: ID does not exist" Jul 24 14:38:23.199116 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.199067 2582 scope.go:117] "RemoveContainer" containerID="b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2" Jul 24 14:38:23.199303 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.199288 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2"} err="failed to get container status \"b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2\": rpc error: code = NotFound desc = could not find container \"b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2\": container with ID starting with b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2 not found: ID does not exist" Jul 24 14:38:23.199303 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.199303 2582 scope.go:117] "RemoveContainer" containerID="fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620" Jul 24 14:38:23.199512 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.199492 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620"} err="failed to get container status \"fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620\": rpc error: code = NotFound desc = could not find container \"fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620\": container with ID starting with fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620 not found: ID does not exist" Jul 24 14:38:23.199549 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.199514 2582 scope.go:117] "RemoveContainer" containerID="f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38" Jul 24 14:38:23.199742 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.199725 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38"} err="failed to get container status \"f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38\": rpc error: code = NotFound desc = could not find container \"f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38\": container with ID starting with f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38 not found: ID does not exist" Jul 24 14:38:23.199784 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.199741 2582 scope.go:117] "RemoveContainer" containerID="e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c" Jul 24 14:38:23.199965 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.199946 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c"} err="failed to get container status \"e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c\": rpc error: code = NotFound desc = could not find container \"e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c\": container with ID starting with e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c not found: ID does not exist" Jul 24 14:38:23.200011 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.199966 2582 scope.go:117] "RemoveContainer" containerID="1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403" Jul 24 14:38:23.200202 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.200186 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403"} err="failed to get container status \"1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403\": rpc error: code = NotFound desc = could not find container \"1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403\": container with ID starting with 1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403 not found: ID does not exist" Jul 24 14:38:23.200266 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.200203 2582 scope.go:117] "RemoveContainer" containerID="f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf" Jul 24 14:38:23.200442 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.200415 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf"} err="failed to get container status \"f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf\": rpc error: code = NotFound desc = could not find container \"f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf\": container with ID starting with f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf not found: ID does not exist" Jul 24 14:38:23.200503 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.200444 2582 scope.go:117] "RemoveContainer" containerID="6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc" Jul 24 14:38:23.200673 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.200652 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc"} err="failed to get container status \"6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc\": rpc error: code = NotFound desc = could not find container \"6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc\": container with ID starting with 6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc not found: ID does not exist" Jul 24 14:38:23.200731 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.200674 2582 scope.go:117] "RemoveContainer" containerID="b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2" Jul 24 14:38:23.200888 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.200870 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2"} err="failed to get container status \"b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2\": rpc error: code = NotFound desc = could not find container \"b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2\": container with ID starting with b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2 not found: ID does not exist" Jul 24 14:38:23.200888 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.200888 2582 scope.go:117] "RemoveContainer" containerID="fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620" Jul 24 14:38:23.201097 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.201081 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620"} err="failed to get container status \"fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620\": rpc error: code = NotFound desc = could not find container \"fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620\": container with ID starting with fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620 not found: ID does not exist" Jul 24 14:38:23.201146 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.201098 2582 scope.go:117] "RemoveContainer" containerID="f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38" Jul 24 14:38:23.201341 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.201323 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38"} err="failed to get container status \"f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38\": rpc error: code = NotFound desc = could not find container \"f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38\": container with ID starting with f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38 not found: ID does not exist" Jul 24 14:38:23.201382 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.201342 2582 scope.go:117] "RemoveContainer" containerID="e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c" Jul 24 14:38:23.201594 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.201566 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c"} err="failed to get container status \"e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c\": rpc error: code = NotFound desc = could not find container \"e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c\": container with ID starting with e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c not found: ID does not exist" Jul 24 14:38:23.201594 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.201590 2582 scope.go:117] "RemoveContainer" containerID="1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403" Jul 24 14:38:23.201827 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.201806 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403"} err="failed to get container status \"1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403\": rpc error: code = NotFound desc = could not find container \"1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403\": container with ID starting with 1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403 not found: ID does not exist" Jul 24 14:38:23.201827 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.201827 2582 scope.go:117] "RemoveContainer" containerID="f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf" Jul 24 14:38:23.202027 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.202010 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf"} err="failed to get container status \"f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf\": rpc error: code = NotFound desc = could not find container \"f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf\": container with ID starting with f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf not found: ID does not exist" Jul 24 14:38:23.202103 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.202027 2582 scope.go:117] "RemoveContainer" containerID="6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc" Jul 24 14:38:23.202278 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.202260 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc"} err="failed to get container status \"6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc\": rpc error: code = NotFound desc = could not find container \"6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc\": container with ID starting with 6d25e6c85bd10b4bbff533a67f3590aef74d9efc0555f77412acb4bfdfb8eccc not found: ID does not exist" Jul 24 14:38:23.202337 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.202279 2582 scope.go:117] "RemoveContainer" containerID="b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2" Jul 24 14:38:23.202497 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.202477 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2"} err="failed to get container status \"b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2\": rpc error: code = NotFound desc = could not find container \"b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2\": container with ID starting with b6119d00dfba05a9bb6f7d2513f4d6e806ac1fac461ea5fdf09dadd32907c1b2 not found: ID does not exist" Jul 24 14:38:23.202561 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.202498 2582 scope.go:117] "RemoveContainer" containerID="fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620" Jul 24 14:38:23.202686 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.202664 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620"} err="failed to get container status \"fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620\": rpc error: code = NotFound desc = could not find container \"fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620\": container with ID starting with fc970e122b3bd70ca90c340865cac102b32e6ea878a38936c1e80780616cf620 not found: ID does not exist" Jul 24 14:38:23.202747 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.202686 2582 scope.go:117] "RemoveContainer" containerID="f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38" Jul 24 14:38:23.202891 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.202873 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38"} err="failed to get container status \"f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38\": rpc error: code = NotFound desc = could not find container \"f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38\": container with ID starting with f82e5b28cdb6b475578a9fd210cb96677dda7c70c671649ed654c4cf99200c38 not found: ID does not exist" Jul 24 14:38:23.202948 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.202892 2582 scope.go:117] "RemoveContainer" containerID="e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c" Jul 24 14:38:23.203101 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.203085 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c"} err="failed to get container status \"e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c\": rpc error: code = NotFound desc = could not find container \"e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c\": container with ID starting with e35044a2668180b5ff4fd33c65c14387624d4968fddbd45ac7bc0a18fe17f41c not found: ID does not exist" Jul 24 14:38:23.203164 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.203101 2582 scope.go:117] "RemoveContainer" containerID="1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403" Jul 24 14:38:23.203313 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.203294 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403"} err="failed to get container status \"1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403\": rpc error: code = NotFound desc = could not find container \"1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403\": container with ID starting with 1b6cf8b6a73fd70cead8aa0af7ca7fbc6c04b54a4f5fe766aaf3a43c019cf403 not found: ID does not exist" Jul 24 14:38:23.203385 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.203312 2582 scope.go:117] "RemoveContainer" containerID="f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf" Jul 24 14:38:23.203541 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.203519 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf"} err="failed to get container status \"f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf\": rpc error: code = NotFound desc = could not find container \"f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf\": container with ID starting with f7e7f7115dbf9fc38ff651559572933ad753a2308cefc4409586823a3f9e3ebf not found: ID does not exist" Jul 24 14:38:23.253887 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.253855 2582 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-configmap-metrics-client-ca\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:23.254031 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.253909 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:23.254031 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.253923 2582 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:23.254031 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.253933 2582 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-grpc-tls\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:23.254031 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.253942 2582 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-metrics-client-certs\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:23.254031 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.253951 2582 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:23.254031 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.253960 2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2df90998-597e-4a98-8ddc-234cad929223-tls-assets\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:23.254031 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.253968 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:23.254031 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.253977 2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-web-config\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:23.254031 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.253985 2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:23.254031 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.253993 2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:23.254031 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.254002 2582 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:23.254031 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.254011 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2df90998-597e-4a98-8ddc-234cad929223-prometheus-k8s-db\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:23.254031 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.254020 2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:23.254031 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.254029 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrqk2\" (UniqueName: \"kubernetes.io/projected/2df90998-597e-4a98-8ddc-234cad929223-kube-api-access-qrqk2\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:23.254031 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.254037 2582 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-secret-kube-rbac-proxy\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:23.254459 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.254046 2582 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/2df90998-597e-4a98-8ddc-234cad929223-config\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:23.254459 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.254054 2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2df90998-597e-4a98-8ddc-234cad929223-config-out\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:23.254459 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.254062 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:23.254459 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.254070 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2df90998-597e-4a98-8ddc-234cad929223-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:38:23.446452 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.446416 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 14:38:23.452787 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.452762 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 14:38:23.481277 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.481247 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 14:38:23.481598 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.481582 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2df90998-597e-4a98-8ddc-234cad929223" containerName="thanos-sidecar" Jul 24 14:38:23.481671 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.481601 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2df90998-597e-4a98-8ddc-234cad929223" containerName="thanos-sidecar" Jul 24 14:38:23.481671 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.481614 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2df90998-597e-4a98-8ddc-234cad929223" containerName="kube-rbac-proxy-web" Jul 24 14:38:23.481671 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.481622 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2df90998-597e-4a98-8ddc-234cad929223" containerName="kube-rbac-proxy-web" Jul 24 14:38:23.481671 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.481633 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2df90998-597e-4a98-8ddc-234cad929223" containerName="kube-rbac-proxy" Jul 24 14:38:23.481671 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.481643 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2df90998-597e-4a98-8ddc-234cad929223" containerName="kube-rbac-proxy" Jul 24 14:38:23.481671 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.481658 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2df90998-597e-4a98-8ddc-234cad929223" containerName="prometheus" Jul 24 14:38:23.481671 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.481666 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2df90998-597e-4a98-8ddc-234cad929223" containerName="prometheus" Jul 24 14:38:23.481992 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.481679 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2df90998-597e-4a98-8ddc-234cad929223" containerName="init-config-reloader" Jul 24 14:38:23.481992 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.481688 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2df90998-597e-4a98-8ddc-234cad929223" containerName="init-config-reloader" Jul 24 14:38:23.481992 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.481699 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2df90998-597e-4a98-8ddc-234cad929223" containerName="config-reloader" Jul 24 14:38:23.481992 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.481708 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2df90998-597e-4a98-8ddc-234cad929223" containerName="config-reloader" Jul 24 14:38:23.481992 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.481717 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2df90998-597e-4a98-8ddc-234cad929223" containerName="kube-rbac-proxy-thanos" Jul 24 14:38:23.481992 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.481725 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2df90998-597e-4a98-8ddc-234cad929223" containerName="kube-rbac-proxy-thanos" Jul 24 14:38:23.481992 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.481837 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2df90998-597e-4a98-8ddc-234cad929223" containerName="kube-rbac-proxy-thanos" Jul 24 14:38:23.481992 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.481851 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2df90998-597e-4a98-8ddc-234cad929223" containerName="kube-rbac-proxy" Jul 24 14:38:23.481992 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.481861 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2df90998-597e-4a98-8ddc-234cad929223" containerName="thanos-sidecar" Jul 24 14:38:23.481992 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.481870 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2df90998-597e-4a98-8ddc-234cad929223" containerName="prometheus" Jul 24 14:38:23.481992 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.481878 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2df90998-597e-4a98-8ddc-234cad929223" containerName="kube-rbac-proxy-web" Jul 24 14:38:23.481992 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.481888 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2df90998-597e-4a98-8ddc-234cad929223" containerName="config-reloader" Jul 24 14:38:23.487140 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.487117 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.489497 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.489454 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 24 14:38:23.489497 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.489480 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dr77t\"" Jul 24 14:38:23.490035 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.490011 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 24 14:38:23.490109 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.490049 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 24 14:38:23.490290 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.490272 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 24 14:38:23.490364 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.490308 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 24 14:38:23.490364 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.490339 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 24 14:38:23.490475 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.490367 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-aousril6trlr2\"" Jul 24 14:38:23.490475 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.490380 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 24 14:38:23.490712 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.490678 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 24 14:38:23.490814 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.490774 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 24 14:38:23.490997 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.490976 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 24 14:38:23.491074 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.490981 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 24 14:38:23.491074 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.491053 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 24 14:38:23.493292 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.493273 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 24 14:38:23.497025 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.497003 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 24 14:38:23.502613 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.502593 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 14:38:23.556028 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.555995 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/555a9214-0a5b-419c-9d7c-fb4d768f2d05-config\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.556195 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.556036 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/555a9214-0a5b-419c-9d7c-fb4d768f2d05-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.556195 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.556064 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/555a9214-0a5b-419c-9d7c-fb4d768f2d05-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.556195 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.556124 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/555a9214-0a5b-419c-9d7c-fb4d768f2d05-web-config\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.556195 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.556171 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-529dl\" (UniqueName: \"kubernetes.io/projected/555a9214-0a5b-419c-9d7c-fb4d768f2d05-kube-api-access-529dl\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.556452 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.556200 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/555a9214-0a5b-419c-9d7c-fb4d768f2d05-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.556452 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.556230 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/555a9214-0a5b-419c-9d7c-fb4d768f2d05-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.556452 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.556288 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/555a9214-0a5b-419c-9d7c-fb4d768f2d05-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.556452 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.556325 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/555a9214-0a5b-419c-9d7c-fb4d768f2d05-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.556452 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.556355 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/555a9214-0a5b-419c-9d7c-fb4d768f2d05-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.556452 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.556387 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/555a9214-0a5b-419c-9d7c-fb4d768f2d05-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.556452 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.556411 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/555a9214-0a5b-419c-9d7c-fb4d768f2d05-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.556712 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.556454 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/555a9214-0a5b-419c-9d7c-fb4d768f2d05-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.556712 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.556499 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/555a9214-0a5b-419c-9d7c-fb4d768f2d05-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.556712 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.556522 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/555a9214-0a5b-419c-9d7c-fb4d768f2d05-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.556712 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.556563 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/555a9214-0a5b-419c-9d7c-fb4d768f2d05-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.556712 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.556585 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/555a9214-0a5b-419c-9d7c-fb4d768f2d05-config-out\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.556712 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.556601 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/555a9214-0a5b-419c-9d7c-fb4d768f2d05-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.556712 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.556638 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/555a9214-0a5b-419c-9d7c-fb4d768f2d05-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.556712 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.556655 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/555a9214-0a5b-419c-9d7c-fb4d768f2d05-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.657856 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.657809 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/555a9214-0a5b-419c-9d7c-fb4d768f2d05-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.657856 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.657859 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/555a9214-0a5b-419c-9d7c-fb4d768f2d05-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.658033 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.657878 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/555a9214-0a5b-419c-9d7c-fb4d768f2d05-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.658033 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.657942 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/555a9214-0a5b-419c-9d7c-fb4d768f2d05-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.658033 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.657982 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/555a9214-0a5b-419c-9d7c-fb4d768f2d05-config-out\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.658033 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.658006 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/555a9214-0a5b-419c-9d7c-fb4d768f2d05-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.658433 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.658035 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/555a9214-0a5b-419c-9d7c-fb4d768f2d05-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.658433 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.658061 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/555a9214-0a5b-419c-9d7c-fb4d768f2d05-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.658433 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.658094 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/555a9214-0a5b-419c-9d7c-fb4d768f2d05-config\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.658433 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.658138 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/555a9214-0a5b-419c-9d7c-fb4d768f2d05-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.658433 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.658167 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/555a9214-0a5b-419c-9d7c-fb4d768f2d05-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.658433 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.658190 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/555a9214-0a5b-419c-9d7c-fb4d768f2d05-web-config\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.658433 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.658220 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-529dl\" (UniqueName: \"kubernetes.io/projected/555a9214-0a5b-419c-9d7c-fb4d768f2d05-kube-api-access-529dl\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.658433 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.658275 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/555a9214-0a5b-419c-9d7c-fb4d768f2d05-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.658433 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.658307 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/555a9214-0a5b-419c-9d7c-fb4d768f2d05-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.658433 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.658337 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/555a9214-0a5b-419c-9d7c-fb4d768f2d05-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.658433 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.658379 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/555a9214-0a5b-419c-9d7c-fb4d768f2d05-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.658433 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.658412 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/555a9214-0a5b-419c-9d7c-fb4d768f2d05-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.659064 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.658446 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/555a9214-0a5b-419c-9d7c-fb4d768f2d05-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.659064 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.658470 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/555a9214-0a5b-419c-9d7c-fb4d768f2d05-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.659064 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.658718 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/555a9214-0a5b-419c-9d7c-fb4d768f2d05-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.659064 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.658749 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/555a9214-0a5b-419c-9d7c-fb4d768f2d05-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.659631 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.659606 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/555a9214-0a5b-419c-9d7c-fb4d768f2d05-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.659923 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.659902 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/555a9214-0a5b-419c-9d7c-fb4d768f2d05-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.660483 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.660453 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/555a9214-0a5b-419c-9d7c-fb4d768f2d05-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.660641 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.660623 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/555a9214-0a5b-419c-9d7c-fb4d768f2d05-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.660816 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.660788 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/555a9214-0a5b-419c-9d7c-fb4d768f2d05-config-out\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.660961 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.660934 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/555a9214-0a5b-419c-9d7c-fb4d768f2d05-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.661053 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.661033 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/555a9214-0a5b-419c-9d7c-fb4d768f2d05-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.661636 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.661310 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/555a9214-0a5b-419c-9d7c-fb4d768f2d05-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.661636 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.661322 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/555a9214-0a5b-419c-9d7c-fb4d768f2d05-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.661945 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.661919 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/555a9214-0a5b-419c-9d7c-fb4d768f2d05-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.662716 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.662690 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/555a9214-0a5b-419c-9d7c-fb4d768f2d05-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.663053 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.663026 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/555a9214-0a5b-419c-9d7c-fb4d768f2d05-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.663359 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.663338 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/555a9214-0a5b-419c-9d7c-fb4d768f2d05-config\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.663528 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.663506 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/555a9214-0a5b-419c-9d7c-fb4d768f2d05-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.663570 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.663542 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/555a9214-0a5b-419c-9d7c-fb4d768f2d05-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.663666 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.663650 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/555a9214-0a5b-419c-9d7c-fb4d768f2d05-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.663974 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.663959 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/555a9214-0a5b-419c-9d7c-fb4d768f2d05-web-config\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.670532 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.670511 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-529dl\" (UniqueName: \"kubernetes.io/projected/555a9214-0a5b-419c-9d7c-fb4d768f2d05-kube-api-access-529dl\") pod \"prometheus-k8s-0\" (UID: \"555a9214-0a5b-419c-9d7c-fb4d768f2d05\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.798114 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.798073 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:38:23.953484 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:23.953451 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 14:38:23.955384 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:38:23.955358 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod555a9214_0a5b_419c_9d7c_fb4d768f2d05.slice/crio-b6c2d718142229a43070ba13f34361cc2fa6ff4e881ae65c535b4321e5f7076c WatchSource:0}: Error finding container b6c2d718142229a43070ba13f34361cc2fa6ff4e881ae65c535b4321e5f7076c: Status 404 returned error can't find the container with id b6c2d718142229a43070ba13f34361cc2fa6ff4e881ae65c535b4321e5f7076c Jul 24 14:38:24.129087 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:24.129000 2582 generic.go:356] "Generic (PLEG): container finished" podID="555a9214-0a5b-419c-9d7c-fb4d768f2d05" containerID="ea7664c0c86e189b9cc04c7066c93d1641222c047dbc58201bf7d050da68deaa" exitCode=0 Jul 24 14:38:24.129624 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:24.129088 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"555a9214-0a5b-419c-9d7c-fb4d768f2d05","Type":"ContainerDied","Data":"ea7664c0c86e189b9cc04c7066c93d1641222c047dbc58201bf7d050da68deaa"} Jul 24 14:38:24.129624 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:24.129221 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"555a9214-0a5b-419c-9d7c-fb4d768f2d05","Type":"ContainerStarted","Data":"b6c2d718142229a43070ba13f34361cc2fa6ff4e881ae65c535b4321e5f7076c"} Jul 24 14:38:25.037443 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:25.037409 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2df90998-597e-4a98-8ddc-234cad929223" path="/var/lib/kubelet/pods/2df90998-597e-4a98-8ddc-234cad929223/volumes" Jul 24 14:38:25.140297 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:25.140263 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"555a9214-0a5b-419c-9d7c-fb4d768f2d05","Type":"ContainerStarted","Data":"c696f89709398455e501e0add546d1a1c5eb058038a4627d1cfc9aa7a0f34659"} Jul 24 14:38:25.140673 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:25.140328 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"555a9214-0a5b-419c-9d7c-fb4d768f2d05","Type":"ContainerStarted","Data":"9af2536b393ba581bd6bd2eda4bcec0df617900f54b6f4baa330eeacd11fba68"} Jul 24 14:38:25.140673 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:25.140357 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"555a9214-0a5b-419c-9d7c-fb4d768f2d05","Type":"ContainerStarted","Data":"4e2b6cab5d3b0b5b191c959e8e9c43852c22043f5b1882561f21c6917c90b31d"} Jul 24 14:38:25.140673 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:25.140381 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"555a9214-0a5b-419c-9d7c-fb4d768f2d05","Type":"ContainerStarted","Data":"e5e7508c07517cb7377a93b8306bcf1badb55758795184746527d7a7c4d428b2"} Jul 24 14:38:25.140673 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:25.140405 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"555a9214-0a5b-419c-9d7c-fb4d768f2d05","Type":"ContainerStarted","Data":"6b6b1e85849e44ee2ee2a4f544be0fa13806f40ecbfb487edb6a13e4db4a81f2"} Jul 24 14:38:25.140673 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:25.140432 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"555a9214-0a5b-419c-9d7c-fb4d768f2d05","Type":"ContainerStarted","Data":"27f434a5e9ab543eef7e7a4a86cd838ef1d3e5f0ace3841958f1764dcd02ad78"} Jul 24 14:38:25.176303 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:25.176215 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.153355208 podStartE2EDuration="2.176190279s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.835071ms" isStatefulPod=false podCreationTimestamp="2026-07-24 14:38:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:38:25.173117326 +0000 UTC m=+242.711966877" watchObservedRunningTime="2026-07-24 14:38:25.176190279 +0000 UTC m=+242.715039808" Jul 24 14:38:28.798201 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:38:28.798162 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:39:22.855284 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:39:22.855227 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bx87n_0d54a10a-875a-45fd-8c7a-100dd1a7d3ca/console-operator/2.log" Jul 24 14:39:22.858682 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:39:22.858657 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bx87n_0d54a10a-875a-45fd-8c7a-100dd1a7d3ca/console-operator/2.log" Jul 24 14:39:22.867078 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:39:22.867054 2582 kubelet.go:1648] "Image garbage collection succeeded" Jul 24 14:39:23.799268 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:39:23.799207 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:39:23.814716 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:39:23.814691 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:39:24.402268 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:39:24.402226 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 14:40:09.915080 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:09.915043 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88fpl"] Jul 24 14:40:09.917361 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:09.917344 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88fpl" Jul 24 14:40:09.919672 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:09.919651 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 24 14:40:09.919752 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:09.919727 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 24 14:40:09.920353 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:09.920334 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-dn2rq\"" Jul 24 14:40:09.928438 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:09.928413 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88fpl"] Jul 24 14:40:09.979184 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:09.979149 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2dd9b2aa-4f67-4d57-8640-dc374ecae590-tmp\") pod \"openshift-lws-operator-fd8ccff4c-88fpl\" (UID: \"2dd9b2aa-4f67-4d57-8640-dc374ecae590\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88fpl" Jul 24 14:40:09.979362 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:09.979198 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptp6v\" (UniqueName: \"kubernetes.io/projected/2dd9b2aa-4f67-4d57-8640-dc374ecae590-kube-api-access-ptp6v\") pod \"openshift-lws-operator-fd8ccff4c-88fpl\" (UID: \"2dd9b2aa-4f67-4d57-8640-dc374ecae590\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88fpl" Jul 24 14:40:10.079962 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:10.079924 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2dd9b2aa-4f67-4d57-8640-dc374ecae590-tmp\") pod \"openshift-lws-operator-fd8ccff4c-88fpl\" (UID: \"2dd9b2aa-4f67-4d57-8640-dc374ecae590\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88fpl" Jul 24 14:40:10.080139 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:10.079976 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptp6v\" (UniqueName: \"kubernetes.io/projected/2dd9b2aa-4f67-4d57-8640-dc374ecae590-kube-api-access-ptp6v\") pod \"openshift-lws-operator-fd8ccff4c-88fpl\" (UID: \"2dd9b2aa-4f67-4d57-8640-dc374ecae590\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88fpl" Jul 24 14:40:10.080357 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:10.080336 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2dd9b2aa-4f67-4d57-8640-dc374ecae590-tmp\") pod \"openshift-lws-operator-fd8ccff4c-88fpl\" (UID: \"2dd9b2aa-4f67-4d57-8640-dc374ecae590\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88fpl" Jul 24 14:40:10.087718 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:10.087686 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptp6v\" (UniqueName: \"kubernetes.io/projected/2dd9b2aa-4f67-4d57-8640-dc374ecae590-kube-api-access-ptp6v\") pod \"openshift-lws-operator-fd8ccff4c-88fpl\" (UID: \"2dd9b2aa-4f67-4d57-8640-dc374ecae590\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88fpl" Jul 24 14:40:10.242032 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:10.242004 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88fpl" Jul 24 14:40:10.372107 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:10.372082 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88fpl"] Jul 24 14:40:10.374528 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:40:10.374502 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2dd9b2aa_4f67_4d57_8640_dc374ecae590.slice/crio-e2b60fd4bc1cb3628de56ea631d8d5a3cda28ec2a48cc45bad247a0a2a9685ce WatchSource:0}: Error finding container e2b60fd4bc1cb3628de56ea631d8d5a3cda28ec2a48cc45bad247a0a2a9685ce: Status 404 returned error can't find the container with id e2b60fd4bc1cb3628de56ea631d8d5a3cda28ec2a48cc45bad247a0a2a9685ce Jul 24 14:40:10.376292 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:10.376271 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 14:40:10.571304 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:10.571197 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88fpl" event={"ID":"2dd9b2aa-4f67-4d57-8640-dc374ecae590","Type":"ContainerStarted","Data":"e2b60fd4bc1cb3628de56ea631d8d5a3cda28ec2a48cc45bad247a0a2a9685ce"} Jul 24 14:40:13.586672 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:13.586625 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88fpl" event={"ID":"2dd9b2aa-4f67-4d57-8640-dc374ecae590","Type":"ContainerStarted","Data":"0a93fa24fdf55951e7f760fae484db3c6efe1aecf3caccd5b77dae9ec7d06c15"} Jul 24 14:40:13.619021 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:13.618972 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88fpl" podStartSLOduration=1.888625386 podStartE2EDuration="4.618957351s" totalImagesPullingTime="2.730331965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:40:13.61740934 +0000 UTC m=+351.156258867" watchObservedRunningTime="2026-07-24 14:40:13.618957351 +0000 UTC m=+351.157806879" Jul 24 14:40:30.810958 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:30.810872 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-f8c8cf8c7-xljs8"] Jul 24 14:40:30.817427 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:30.817402 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-xljs8" Jul 24 14:40:30.820367 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:30.820343 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-c4kkn\"" Jul 24 14:40:30.820610 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:30.820596 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 24 14:40:30.823497 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:30.823469 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 24 14:40:30.827023 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:30.827006 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 24 14:40:30.835825 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:30.835791 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f8c8cf8c7-xljs8"] Jul 24 14:40:30.965681 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:30.965639 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/becef3b0-3b58-4588-a033-c3775adeb41d-manager-config\") pod \"lws-controller-manager-f8c8cf8c7-xljs8\" (UID: \"becef3b0-3b58-4588-a033-c3775adeb41d\") " pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-xljs8" Jul 24 14:40:30.965863 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:30.965694 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/becef3b0-3b58-4588-a033-c3775adeb41d-metrics-cert\") pod \"lws-controller-manager-f8c8cf8c7-xljs8\" (UID: \"becef3b0-3b58-4588-a033-c3775adeb41d\") " pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-xljs8" Jul 24 14:40:30.965863 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:30.965774 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmmzt\" (UniqueName: \"kubernetes.io/projected/becef3b0-3b58-4588-a033-c3775adeb41d-kube-api-access-vmmzt\") pod \"lws-controller-manager-f8c8cf8c7-xljs8\" (UID: \"becef3b0-3b58-4588-a033-c3775adeb41d\") " pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-xljs8" Jul 24 14:40:30.965863 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:30.965819 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/becef3b0-3b58-4588-a033-c3775adeb41d-cert\") pod \"lws-controller-manager-f8c8cf8c7-xljs8\" (UID: \"becef3b0-3b58-4588-a033-c3775adeb41d\") " pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-xljs8" Jul 24 14:40:31.067201 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:31.067125 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmmzt\" (UniqueName: \"kubernetes.io/projected/becef3b0-3b58-4588-a033-c3775adeb41d-kube-api-access-vmmzt\") pod \"lws-controller-manager-f8c8cf8c7-xljs8\" (UID: \"becef3b0-3b58-4588-a033-c3775adeb41d\") " pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-xljs8" Jul 24 14:40:31.067201 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:31.067171 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/becef3b0-3b58-4588-a033-c3775adeb41d-cert\") pod \"lws-controller-manager-f8c8cf8c7-xljs8\" (UID: \"becef3b0-3b58-4588-a033-c3775adeb41d\") " pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-xljs8" Jul 24 14:40:31.067419 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:31.067221 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/becef3b0-3b58-4588-a033-c3775adeb41d-manager-config\") pod \"lws-controller-manager-f8c8cf8c7-xljs8\" (UID: \"becef3b0-3b58-4588-a033-c3775adeb41d\") " pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-xljs8" Jul 24 14:40:31.067419 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:31.067302 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/becef3b0-3b58-4588-a033-c3775adeb41d-metrics-cert\") pod \"lws-controller-manager-f8c8cf8c7-xljs8\" (UID: \"becef3b0-3b58-4588-a033-c3775adeb41d\") " pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-xljs8" Jul 24 14:40:31.068067 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:31.068041 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/becef3b0-3b58-4588-a033-c3775adeb41d-manager-config\") pod \"lws-controller-manager-f8c8cf8c7-xljs8\" (UID: \"becef3b0-3b58-4588-a033-c3775adeb41d\") " pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-xljs8" Jul 24 14:40:31.069781 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:31.069755 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/becef3b0-3b58-4588-a033-c3775adeb41d-metrics-cert\") pod \"lws-controller-manager-f8c8cf8c7-xljs8\" (UID: \"becef3b0-3b58-4588-a033-c3775adeb41d\") " pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-xljs8" Jul 24 14:40:31.069863 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:31.069760 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/becef3b0-3b58-4588-a033-c3775adeb41d-cert\") pod \"lws-controller-manager-f8c8cf8c7-xljs8\" (UID: \"becef3b0-3b58-4588-a033-c3775adeb41d\") " pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-xljs8" Jul 24 14:40:31.081153 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:31.081128 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmmzt\" (UniqueName: \"kubernetes.io/projected/becef3b0-3b58-4588-a033-c3775adeb41d-kube-api-access-vmmzt\") pod \"lws-controller-manager-f8c8cf8c7-xljs8\" (UID: \"becef3b0-3b58-4588-a033-c3775adeb41d\") " pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-xljs8" Jul 24 14:40:31.127448 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:31.127418 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-xljs8" Jul 24 14:40:31.280166 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:31.280101 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f8c8cf8c7-xljs8"] Jul 24 14:40:31.282602 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:40:31.282570 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbecef3b0_3b58_4588_a033_c3775adeb41d.slice/crio-93b50229097af2a0a54c73eb16c0fb1d812629f2fc91ef6591588dede7f685b1 WatchSource:0}: Error finding container 93b50229097af2a0a54c73eb16c0fb1d812629f2fc91ef6591588dede7f685b1: Status 404 returned error can't find the container with id 93b50229097af2a0a54c73eb16c0fb1d812629f2fc91ef6591588dede7f685b1 Jul 24 14:40:31.661492 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:31.661454 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-xljs8" event={"ID":"becef3b0-3b58-4588-a033-c3775adeb41d","Type":"ContainerStarted","Data":"93b50229097af2a0a54c73eb16c0fb1d812629f2fc91ef6591588dede7f685b1"} Jul 24 14:40:32.667879 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:32.667835 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-xljs8" event={"ID":"becef3b0-3b58-4588-a033-c3775adeb41d","Type":"ContainerStarted","Data":"d24af7642009ae7888202fb10662df9820fcaa8977de3db3fac28ee7750f6eba"} Jul 24 14:40:32.668392 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:32.667932 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-xljs8" Jul 24 14:40:32.691062 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:32.691014 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-xljs8" podStartSLOduration=1.434424135 podStartE2EDuration="2.690998512s" totalImagesPullingTime="1.256574377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:40:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:40:32.690433469 +0000 UTC m=+370.229282996" watchObservedRunningTime="2026-07-24 14:40:32.690998512 +0000 UTC m=+370.229848039" Jul 24 14:40:33.485034 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:33.484999 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-696d5956bc-sdwgj"] Jul 24 14:40:33.488669 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:33.488649 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-sdwgj" Jul 24 14:40:33.491657 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:33.491635 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 24 14:40:33.491758 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:33.491668 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 24 14:40:33.491758 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:33.491720 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zx88k\"" Jul 24 14:40:33.491875 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:33.491773 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 24 14:40:33.495906 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:33.495889 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 24 14:40:33.503674 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:33.503650 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-696d5956bc-sdwgj"] Jul 24 14:40:33.589352 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:33.589323 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5bld\" (UniqueName: \"kubernetes.io/projected/cf8d92c7-5f4c-4d62-acb1-45f967333f92-kube-api-access-w5bld\") pod \"opendatahub-operator-controller-manager-696d5956bc-sdwgj\" (UID: \"cf8d92c7-5f4c-4d62-acb1-45f967333f92\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-sdwgj" Jul 24 14:40:33.589531 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:33.589362 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cf8d92c7-5f4c-4d62-acb1-45f967333f92-apiservice-cert\") pod \"opendatahub-operator-controller-manager-696d5956bc-sdwgj\" (UID: \"cf8d92c7-5f4c-4d62-acb1-45f967333f92\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-sdwgj" Jul 24 14:40:33.589531 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:33.589385 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cf8d92c7-5f4c-4d62-acb1-45f967333f92-manifests\") pod \"opendatahub-operator-controller-manager-696d5956bc-sdwgj\" (UID: \"cf8d92c7-5f4c-4d62-acb1-45f967333f92\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-sdwgj" Jul 24 14:40:33.589531 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:33.589458 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf8d92c7-5f4c-4d62-acb1-45f967333f92-tmp\") pod \"opendatahub-operator-controller-manager-696d5956bc-sdwgj\" (UID: \"cf8d92c7-5f4c-4d62-acb1-45f967333f92\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-sdwgj" Jul 24 14:40:33.589531 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:33.589513 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cf8d92c7-5f4c-4d62-acb1-45f967333f92-webhook-cert\") pod \"opendatahub-operator-controller-manager-696d5956bc-sdwgj\" (UID: \"cf8d92c7-5f4c-4d62-acb1-45f967333f92\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-sdwgj" Jul 24 14:40:33.690498 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:33.690457 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf8d92c7-5f4c-4d62-acb1-45f967333f92-tmp\") pod \"opendatahub-operator-controller-manager-696d5956bc-sdwgj\" (UID: \"cf8d92c7-5f4c-4d62-acb1-45f967333f92\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-sdwgj" Jul 24 14:40:33.690902 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:33.690508 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cf8d92c7-5f4c-4d62-acb1-45f967333f92-webhook-cert\") pod \"opendatahub-operator-controller-manager-696d5956bc-sdwgj\" (UID: \"cf8d92c7-5f4c-4d62-acb1-45f967333f92\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-sdwgj" Jul 24 14:40:33.690902 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:33.690556 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5bld\" (UniqueName: \"kubernetes.io/projected/cf8d92c7-5f4c-4d62-acb1-45f967333f92-kube-api-access-w5bld\") pod \"opendatahub-operator-controller-manager-696d5956bc-sdwgj\" (UID: \"cf8d92c7-5f4c-4d62-acb1-45f967333f92\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-sdwgj" Jul 24 14:40:33.690902 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:33.690580 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cf8d92c7-5f4c-4d62-acb1-45f967333f92-apiservice-cert\") pod \"opendatahub-operator-controller-manager-696d5956bc-sdwgj\" (UID: \"cf8d92c7-5f4c-4d62-acb1-45f967333f92\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-sdwgj" Jul 24 14:40:33.690902 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:33.690599 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cf8d92c7-5f4c-4d62-acb1-45f967333f92-manifests\") pod \"opendatahub-operator-controller-manager-696d5956bc-sdwgj\" (UID: \"cf8d92c7-5f4c-4d62-acb1-45f967333f92\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-sdwgj" Jul 24 14:40:33.691100 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:33.690950 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cf8d92c7-5f4c-4d62-acb1-45f967333f92-manifests\") pod \"opendatahub-operator-controller-manager-696d5956bc-sdwgj\" (UID: \"cf8d92c7-5f4c-4d62-acb1-45f967333f92\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-sdwgj" Jul 24 14:40:33.692891 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:33.692869 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf8d92c7-5f4c-4d62-acb1-45f967333f92-tmp\") pod \"opendatahub-operator-controller-manager-696d5956bc-sdwgj\" (UID: \"cf8d92c7-5f4c-4d62-acb1-45f967333f92\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-sdwgj" Jul 24 14:40:33.693094 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:33.693078 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cf8d92c7-5f4c-4d62-acb1-45f967333f92-webhook-cert\") pod \"opendatahub-operator-controller-manager-696d5956bc-sdwgj\" (UID: \"cf8d92c7-5f4c-4d62-acb1-45f967333f92\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-sdwgj" Jul 24 14:40:33.693134 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:33.693107 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cf8d92c7-5f4c-4d62-acb1-45f967333f92-apiservice-cert\") pod \"opendatahub-operator-controller-manager-696d5956bc-sdwgj\" (UID: \"cf8d92c7-5f4c-4d62-acb1-45f967333f92\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-sdwgj" Jul 24 14:40:33.714031 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:33.714004 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5bld\" (UniqueName: \"kubernetes.io/projected/cf8d92c7-5f4c-4d62-acb1-45f967333f92-kube-api-access-w5bld\") pod \"opendatahub-operator-controller-manager-696d5956bc-sdwgj\" (UID: \"cf8d92c7-5f4c-4d62-acb1-45f967333f92\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-sdwgj" Jul 24 14:40:33.798869 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:33.798783 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-sdwgj" Jul 24 14:40:33.939335 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:33.939302 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-696d5956bc-sdwgj"] Jul 24 14:40:33.942678 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:40:33.942642 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf8d92c7_5f4c_4d62_acb1_45f967333f92.slice/crio-8208a2a937d827e49dd6f01680983b93d476f778c71f97f63e630675521d5ae0 WatchSource:0}: Error finding container 8208a2a937d827e49dd6f01680983b93d476f778c71f97f63e630675521d5ae0: Status 404 returned error can't find the container with id 8208a2a937d827e49dd6f01680983b93d476f778c71f97f63e630675521d5ae0 Jul 24 14:40:34.681913 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:34.681872 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-sdwgj" event={"ID":"cf8d92c7-5f4c-4d62-acb1-45f967333f92","Type":"ContainerStarted","Data":"8208a2a937d827e49dd6f01680983b93d476f778c71f97f63e630675521d5ae0"} Jul 24 14:40:37.697689 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:37.697649 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-sdwgj" event={"ID":"cf8d92c7-5f4c-4d62-acb1-45f967333f92","Type":"ContainerStarted","Data":"7784c5234d2cc6ccd66b665c7c271855ddbe662c531a42734e2a79e2c9147ed5"} Jul 24 14:40:38.703708 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:38.703671 2582 generic.go:356] "Generic (PLEG): container finished" podID="cf8d92c7-5f4c-4d62-acb1-45f967333f92" containerID="7784c5234d2cc6ccd66b665c7c271855ddbe662c531a42734e2a79e2c9147ed5" exitCode=0 Jul 24 14:40:38.704091 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:38.703751 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-sdwgj" event={"ID":"cf8d92c7-5f4c-4d62-acb1-45f967333f92","Type":"ContainerDied","Data":"7784c5234d2cc6ccd66b665c7c271855ddbe662c531a42734e2a79e2c9147ed5"} Jul 24 14:40:39.710014 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:39.709969 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-sdwgj" event={"ID":"cf8d92c7-5f4c-4d62-acb1-45f967333f92","Type":"ContainerStarted","Data":"bf755af2c826eec6252238095015a440c5f389d4240d6c3cd8ac09ec1d9ad6b2"} Jul 24 14:40:39.710444 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:39.710057 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-sdwgj" Jul 24 14:40:39.736498 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:39.736447 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-sdwgj" podStartSLOduration=2.531977361 podStartE2EDuration="6.736430553s" totalImagesPullingTime="3.127903559s" totalInitContainerRuntime="1.076549633s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:40:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:40:39.735754693 +0000 UTC m=+377.274604286" watchObservedRunningTime="2026-07-24 14:40:39.736430553 +0000 UTC m=+377.275280081" Jul 24 14:40:43.674464 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:43.674431 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-xljs8" Jul 24 14:40:50.716139 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:50.716098 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-sdwgj" Jul 24 14:40:58.429163 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:58.429129 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-66d67d68d4-d8wjk"] Jul 24 14:40:58.432590 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:58.432572 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-66d67d68d4-d8wjk" Jul 24 14:40:58.435974 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:58.435953 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 24 14:40:58.437003 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:58.436984 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 24 14:40:58.437177 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:58.437054 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 24 14:40:58.437177 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:58.437076 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 24 14:40:58.437358 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:58.437336 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-hwx86\"" Jul 24 14:40:58.460827 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:58.460800 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-66d67d68d4-d8wjk"] Jul 24 14:40:58.495044 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:58.495008 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14a5b8b5-c4e2-42e4-912d-d75bae1b1f67-tls-certs\") pod \"kube-auth-proxy-66d67d68d4-d8wjk\" (UID: \"14a5b8b5-c4e2-42e4-912d-d75bae1b1f67\") " pod="openshift-ingress/kube-auth-proxy-66d67d68d4-d8wjk" Jul 24 14:40:58.495207 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:58.495057 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14a5b8b5-c4e2-42e4-912d-d75bae1b1f67-tmp\") pod \"kube-auth-proxy-66d67d68d4-d8wjk\" (UID: \"14a5b8b5-c4e2-42e4-912d-d75bae1b1f67\") " pod="openshift-ingress/kube-auth-proxy-66d67d68d4-d8wjk" Jul 24 14:40:58.495207 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:58.495124 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dshx\" (UniqueName: \"kubernetes.io/projected/14a5b8b5-c4e2-42e4-912d-d75bae1b1f67-kube-api-access-5dshx\") pod \"kube-auth-proxy-66d67d68d4-d8wjk\" (UID: \"14a5b8b5-c4e2-42e4-912d-d75bae1b1f67\") " pod="openshift-ingress/kube-auth-proxy-66d67d68d4-d8wjk" Jul 24 14:40:58.596389 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:58.596344 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14a5b8b5-c4e2-42e4-912d-d75bae1b1f67-tls-certs\") pod \"kube-auth-proxy-66d67d68d4-d8wjk\" (UID: \"14a5b8b5-c4e2-42e4-912d-d75bae1b1f67\") " pod="openshift-ingress/kube-auth-proxy-66d67d68d4-d8wjk" Jul 24 14:40:58.596594 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:58.596406 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14a5b8b5-c4e2-42e4-912d-d75bae1b1f67-tmp\") pod \"kube-auth-proxy-66d67d68d4-d8wjk\" (UID: \"14a5b8b5-c4e2-42e4-912d-d75bae1b1f67\") " pod="openshift-ingress/kube-auth-proxy-66d67d68d4-d8wjk" Jul 24 14:40:58.596594 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:58.596442 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dshx\" (UniqueName: \"kubernetes.io/projected/14a5b8b5-c4e2-42e4-912d-d75bae1b1f67-kube-api-access-5dshx\") pod \"kube-auth-proxy-66d67d68d4-d8wjk\" (UID: \"14a5b8b5-c4e2-42e4-912d-d75bae1b1f67\") " pod="openshift-ingress/kube-auth-proxy-66d67d68d4-d8wjk" Jul 24 14:40:58.598822 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:58.598796 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14a5b8b5-c4e2-42e4-912d-d75bae1b1f67-tmp\") pod \"kube-auth-proxy-66d67d68d4-d8wjk\" (UID: \"14a5b8b5-c4e2-42e4-912d-d75bae1b1f67\") " pod="openshift-ingress/kube-auth-proxy-66d67d68d4-d8wjk" Jul 24 14:40:58.598942 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:58.598860 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14a5b8b5-c4e2-42e4-912d-d75bae1b1f67-tls-certs\") pod \"kube-auth-proxy-66d67d68d4-d8wjk\" (UID: \"14a5b8b5-c4e2-42e4-912d-d75bae1b1f67\") " pod="openshift-ingress/kube-auth-proxy-66d67d68d4-d8wjk" Jul 24 14:40:58.610351 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:58.610323 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dshx\" (UniqueName: \"kubernetes.io/projected/14a5b8b5-c4e2-42e4-912d-d75bae1b1f67-kube-api-access-5dshx\") pod \"kube-auth-proxy-66d67d68d4-d8wjk\" (UID: \"14a5b8b5-c4e2-42e4-912d-d75bae1b1f67\") " pod="openshift-ingress/kube-auth-proxy-66d67d68d4-d8wjk" Jul 24 14:40:58.743005 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:58.742966 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-66d67d68d4-d8wjk" Jul 24 14:40:58.909946 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:58.909922 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-66d67d68d4-d8wjk"] Jul 24 14:40:58.912282 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:40:58.912255 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14a5b8b5_c4e2_42e4_912d_d75bae1b1f67.slice/crio-40dcb7b9078214b8b7454a79aed05ab5023be7729b59f21556845353f0bfc445 WatchSource:0}: Error finding container 40dcb7b9078214b8b7454a79aed05ab5023be7729b59f21556845353f0bfc445: Status 404 returned error can't find the container with id 40dcb7b9078214b8b7454a79aed05ab5023be7729b59f21556845353f0bfc445 Jul 24 14:40:59.804557 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:40:59.804507 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-66d67d68d4-d8wjk" event={"ID":"14a5b8b5-c4e2-42e4-912d-d75bae1b1f67","Type":"ContainerStarted","Data":"40dcb7b9078214b8b7454a79aed05ab5023be7729b59f21556845353f0bfc445"} Jul 24 14:41:01.821467 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:41:01.821432 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-66d67d68d4-d8wjk" event={"ID":"14a5b8b5-c4e2-42e4-912d-d75bae1b1f67","Type":"ContainerStarted","Data":"0c0815a0e18992bc1ba6301766b37a32d92f532e8f261e3d10b6ae5006378416"} Jul 24 14:41:01.842506 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:41:01.842455 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-66d67d68d4-d8wjk" podStartSLOduration=1.6578810750000001 podStartE2EDuration="3.842440152s" totalImagesPullingTime="2.184559077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:40:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:41:01.840599925 +0000 UTC m=+399.379449451" watchObservedRunningTime="2026-07-24 14:41:01.842440152 +0000 UTC m=+399.381289678" Jul 24 14:42:36.278585 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:36.278552 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-tt5fn"] Jul 24 14:42:36.282077 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:36.282051 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tt5fn" Jul 24 14:42:36.284183 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:36.284157 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 24 14:42:36.284318 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:36.284192 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 24 14:42:36.284432 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:36.284417 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 24 14:42:36.284488 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:36.284462 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-djr82\"" Jul 24 14:42:36.284827 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:36.284811 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 24 14:42:36.291834 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:36.291811 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-tt5fn"] Jul 24 14:42:36.352479 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:36.352447 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ef0701f-4348-44c4-b92e-e80af3e1e1f3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-tt5fn\" (UID: \"7ef0701f-4348-44c4-b92e-e80af3e1e1f3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tt5fn" Jul 24 14:42:36.352650 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:36.352505 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmk8n\" (UniqueName: \"kubernetes.io/projected/7ef0701f-4348-44c4-b92e-e80af3e1e1f3-kube-api-access-pmk8n\") pod \"kuadrant-console-plugin-66b5774985-tt5fn\" (UID: \"7ef0701f-4348-44c4-b92e-e80af3e1e1f3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tt5fn" Jul 24 14:42:36.352650 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:36.352618 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7ef0701f-4348-44c4-b92e-e80af3e1e1f3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-tt5fn\" (UID: \"7ef0701f-4348-44c4-b92e-e80af3e1e1f3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tt5fn" Jul 24 14:42:36.453190 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:36.453152 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmk8n\" (UniqueName: \"kubernetes.io/projected/7ef0701f-4348-44c4-b92e-e80af3e1e1f3-kube-api-access-pmk8n\") pod \"kuadrant-console-plugin-66b5774985-tt5fn\" (UID: \"7ef0701f-4348-44c4-b92e-e80af3e1e1f3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tt5fn" Jul 24 14:42:36.453384 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:36.453219 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7ef0701f-4348-44c4-b92e-e80af3e1e1f3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-tt5fn\" (UID: \"7ef0701f-4348-44c4-b92e-e80af3e1e1f3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tt5fn" Jul 24 14:42:36.453384 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:36.453260 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ef0701f-4348-44c4-b92e-e80af3e1e1f3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-tt5fn\" (UID: \"7ef0701f-4348-44c4-b92e-e80af3e1e1f3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tt5fn" Jul 24 14:42:36.453906 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:36.453885 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7ef0701f-4348-44c4-b92e-e80af3e1e1f3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-tt5fn\" (UID: \"7ef0701f-4348-44c4-b92e-e80af3e1e1f3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tt5fn" Jul 24 14:42:36.455607 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:36.455589 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ef0701f-4348-44c4-b92e-e80af3e1e1f3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-tt5fn\" (UID: \"7ef0701f-4348-44c4-b92e-e80af3e1e1f3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tt5fn" Jul 24 14:42:36.461526 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:36.461504 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmk8n\" (UniqueName: \"kubernetes.io/projected/7ef0701f-4348-44c4-b92e-e80af3e1e1f3-kube-api-access-pmk8n\") pod \"kuadrant-console-plugin-66b5774985-tt5fn\" (UID: \"7ef0701f-4348-44c4-b92e-e80af3e1e1f3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tt5fn" Jul 24 14:42:36.591971 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:36.591892 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tt5fn" Jul 24 14:42:36.722287 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:36.722255 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-tt5fn"] Jul 24 14:42:36.725713 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:42:36.725678 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ef0701f_4348_44c4_b92e_e80af3e1e1f3.slice/crio-19c33b282845c3dc3b299f1bba7cb2396d216f0c9143602049d3b05362e47adc WatchSource:0}: Error finding container 19c33b282845c3dc3b299f1bba7cb2396d216f0c9143602049d3b05362e47adc: Status 404 returned error can't find the container with id 19c33b282845c3dc3b299f1bba7cb2396d216f0c9143602049d3b05362e47adc Jul 24 14:42:37.242301 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:37.242267 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tt5fn" event={"ID":"7ef0701f-4348-44c4-b92e-e80af3e1e1f3","Type":"ContainerStarted","Data":"19c33b282845c3dc3b299f1bba7cb2396d216f0c9143602049d3b05362e47adc"} Jul 24 14:42:46.991129 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:46.991095 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bnqt2"] Jul 24 14:42:47.007726 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:47.007664 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bnqt2" Jul 24 14:42:47.007907 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:47.007812 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bnqt2"] Jul 24 14:42:47.010572 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:47.010527 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-n72xh\"" Jul 24 14:42:47.157815 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:47.157771 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gxrf\" (UniqueName: \"kubernetes.io/projected/7a3c76d2-4802-4f1a-827d-2e84317b1b03-kube-api-access-5gxrf\") pod \"limitador-operator-controller-manager-859d7b78bd-bnqt2\" (UID: \"7a3c76d2-4802-4f1a-827d-2e84317b1b03\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bnqt2" Jul 24 14:42:47.259039 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:47.258955 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gxrf\" (UniqueName: \"kubernetes.io/projected/7a3c76d2-4802-4f1a-827d-2e84317b1b03-kube-api-access-5gxrf\") pod \"limitador-operator-controller-manager-859d7b78bd-bnqt2\" (UID: \"7a3c76d2-4802-4f1a-827d-2e84317b1b03\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bnqt2" Jul 24 14:42:47.267738 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:47.267690 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gxrf\" (UniqueName: \"kubernetes.io/projected/7a3c76d2-4802-4f1a-827d-2e84317b1b03-kube-api-access-5gxrf\") pod \"limitador-operator-controller-manager-859d7b78bd-bnqt2\" (UID: \"7a3c76d2-4802-4f1a-827d-2e84317b1b03\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bnqt2" Jul 24 14:42:47.321614 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:47.321569 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bnqt2" Jul 24 14:42:59.449876 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:42:59.449845 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bnqt2"] Jul 24 14:42:59.452572 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:42:59.452536 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a3c76d2_4802_4f1a_827d_2e84317b1b03.slice/crio-c8bc421eafaf1fab3145307fadb4dfff136a1ff8492f03309dd0df995462105c WatchSource:0}: Error finding container c8bc421eafaf1fab3145307fadb4dfff136a1ff8492f03309dd0df995462105c: Status 404 returned error can't find the container with id c8bc421eafaf1fab3145307fadb4dfff136a1ff8492f03309dd0df995462105c Jul 24 14:43:00.372838 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:43:00.372799 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tt5fn" event={"ID":"7ef0701f-4348-44c4-b92e-e80af3e1e1f3","Type":"ContainerStarted","Data":"d7b48820a027cc400e21e40337458c809907735f53f823c77db2eb9aec57268c"} Jul 24 14:43:00.374762 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:43:00.374727 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bnqt2" event={"ID":"7a3c76d2-4802-4f1a-827d-2e84317b1b03","Type":"ContainerStarted","Data":"c8bc421eafaf1fab3145307fadb4dfff136a1ff8492f03309dd0df995462105c"} Jul 24 14:43:00.398660 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:43:00.398604 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tt5fn" podStartSLOduration=1.728707676 podStartE2EDuration="24.398582926s" totalImagesPullingTime="22.66987525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:42:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:43:00.395607681 +0000 UTC m=+517.934457213" watchObservedRunningTime="2026-07-24 14:43:00.398582926 +0000 UTC m=+517.937432453" Jul 24 14:43:01.380762 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:43:01.380722 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bnqt2" event={"ID":"7a3c76d2-4802-4f1a-827d-2e84317b1b03","Type":"ContainerStarted","Data":"357527a1bc2850b6521f2baf5bf869b01ffcea6a7f76b663279c59ffb7fa5e86"} Jul 24 14:43:01.381213 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:43:01.380828 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bnqt2" Jul 24 14:43:01.401036 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:43:01.400984 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bnqt2" podStartSLOduration=13.701956925 podStartE2EDuration="15.400968663s" totalImagesPullingTime="1.699011738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:42:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:43:01.398781512 +0000 UTC m=+518.937631042" watchObservedRunningTime="2026-07-24 14:43:01.400968663 +0000 UTC m=+518.939818195" Jul 24 14:43:12.387205 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:43:12.387174 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bnqt2" Jul 24 14:43:30.999376 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:43:30.999297 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-jcqk9"] Jul 24 14:43:31.144127 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:43:31.144091 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jcqk9" Jul 24 14:43:31.146481 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:43:31.146455 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hpsrh\"" Jul 24 14:43:31.150572 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:43:31.150549 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jcqk9"] Jul 24 14:43:31.264914 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:43:31.264826 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnvf5\" (UniqueName: \"kubernetes.io/projected/cc37f07f-456e-4b40-ad0e-00238eaaee94-kube-api-access-nnvf5\") pod \"authorino-75d556bd77-jcqk9\" (UID: \"cc37f07f-456e-4b40-ad0e-00238eaaee94\") " pod="kuadrant-system/authorino-75d556bd77-jcqk9" Jul 24 14:43:31.365413 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:43:31.365375 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnvf5\" (UniqueName: \"kubernetes.io/projected/cc37f07f-456e-4b40-ad0e-00238eaaee94-kube-api-access-nnvf5\") pod \"authorino-75d556bd77-jcqk9\" (UID: \"cc37f07f-456e-4b40-ad0e-00238eaaee94\") " pod="kuadrant-system/authorino-75d556bd77-jcqk9" Jul 24 14:43:31.373321 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:43:31.373295 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnvf5\" (UniqueName: \"kubernetes.io/projected/cc37f07f-456e-4b40-ad0e-00238eaaee94-kube-api-access-nnvf5\") pod \"authorino-75d556bd77-jcqk9\" (UID: \"cc37f07f-456e-4b40-ad0e-00238eaaee94\") " pod="kuadrant-system/authorino-75d556bd77-jcqk9" Jul 24 14:43:31.453901 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:43:31.453862 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jcqk9" Jul 24 14:43:31.668897 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:43:31.668862 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jcqk9"] Jul 24 14:43:31.672574 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:43:31.672545 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc37f07f_456e_4b40_ad0e_00238eaaee94.slice/crio-8ebe028f43d444df176f4e9728819832601fabe41bb2bb58db5de062458b584d WatchSource:0}: Error finding container 8ebe028f43d444df176f4e9728819832601fabe41bb2bb58db5de062458b584d: Status 404 returned error can't find the container with id 8ebe028f43d444df176f4e9728819832601fabe41bb2bb58db5de062458b584d Jul 24 14:43:32.523662 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:43:32.523596 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jcqk9" event={"ID":"cc37f07f-456e-4b40-ad0e-00238eaaee94","Type":"ContainerStarted","Data":"8ebe028f43d444df176f4e9728819832601fabe41bb2bb58db5de062458b584d"} Jul 24 14:43:35.541420 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:43:35.541379 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jcqk9" event={"ID":"cc37f07f-456e-4b40-ad0e-00238eaaee94","Type":"ContainerStarted","Data":"f91101769ed687a4aed376b2bf23394214abccef2c237a4f96867efa3c1512b6"} Jul 24 14:43:35.556150 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:43:35.556103 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-jcqk9" podStartSLOduration=2.6339554400000003 podStartE2EDuration="5.556088561s" totalImagesPullingTime="2.922133121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:43:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:43:35.555730008 +0000 UTC m=+553.094579558" watchObservedRunningTime="2026-07-24 14:43:35.556088561 +0000 UTC m=+553.094938088" Jul 24 14:44:05.659899 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:05.659866 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jcqk9"] Jul 24 14:44:05.660332 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:05.660042 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-jcqk9" podUID="cc37f07f-456e-4b40-ad0e-00238eaaee94" containerName="authorino" containerID="cri-o://f91101769ed687a4aed376b2bf23394214abccef2c237a4f96867efa3c1512b6" gracePeriod=30 Jul 24 14:44:05.898477 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:05.898452 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jcqk9" Jul 24 14:44:05.977044 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:05.977004 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnvf5\" (UniqueName: \"kubernetes.io/projected/cc37f07f-456e-4b40-ad0e-00238eaaee94-kube-api-access-nnvf5\") pod \"cc37f07f-456e-4b40-ad0e-00238eaaee94\" (UID: \"cc37f07f-456e-4b40-ad0e-00238eaaee94\") " Jul 24 14:44:05.979246 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:05.979215 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc37f07f-456e-4b40-ad0e-00238eaaee94-kube-api-access-nnvf5" (OuterVolumeSpecName: "kube-api-access-nnvf5") pod "cc37f07f-456e-4b40-ad0e-00238eaaee94" (UID: "cc37f07f-456e-4b40-ad0e-00238eaaee94"). InnerVolumeSpecName "kube-api-access-nnvf5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:44:06.077974 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:06.077915 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnvf5\" (UniqueName: \"kubernetes.io/projected/cc37f07f-456e-4b40-ad0e-00238eaaee94-kube-api-access-nnvf5\") on node \"ip-10-0-140-149.ec2.internal\" DevicePath \"\"" Jul 24 14:44:06.689094 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:06.689056 2582 generic.go:356] "Generic (PLEG): container finished" podID="cc37f07f-456e-4b40-ad0e-00238eaaee94" containerID="f91101769ed687a4aed376b2bf23394214abccef2c237a4f96867efa3c1512b6" exitCode=0 Jul 24 14:44:06.689531 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:06.689106 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jcqk9" Jul 24 14:44:06.689531 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:06.689145 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jcqk9" event={"ID":"cc37f07f-456e-4b40-ad0e-00238eaaee94","Type":"ContainerDied","Data":"f91101769ed687a4aed376b2bf23394214abccef2c237a4f96867efa3c1512b6"} Jul 24 14:44:06.689531 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:06.689188 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jcqk9" event={"ID":"cc37f07f-456e-4b40-ad0e-00238eaaee94","Type":"ContainerDied","Data":"8ebe028f43d444df176f4e9728819832601fabe41bb2bb58db5de062458b584d"} Jul 24 14:44:06.689531 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:06.689205 2582 scope.go:117] "RemoveContainer" containerID="f91101769ed687a4aed376b2bf23394214abccef2c237a4f96867efa3c1512b6" Jul 24 14:44:06.697744 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:06.697727 2582 scope.go:117] "RemoveContainer" containerID="f91101769ed687a4aed376b2bf23394214abccef2c237a4f96867efa3c1512b6" Jul 24 14:44:06.697987 ip-10-0-140-149 kubenswrapper[2582]: E0724 14:44:06.697969 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f91101769ed687a4aed376b2bf23394214abccef2c237a4f96867efa3c1512b6\": container with ID starting with f91101769ed687a4aed376b2bf23394214abccef2c237a4f96867efa3c1512b6 not found: ID does not exist" containerID="f91101769ed687a4aed376b2bf23394214abccef2c237a4f96867efa3c1512b6" Jul 24 14:44:06.698033 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:06.697995 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f91101769ed687a4aed376b2bf23394214abccef2c237a4f96867efa3c1512b6"} err="failed to get container status \"f91101769ed687a4aed376b2bf23394214abccef2c237a4f96867efa3c1512b6\": rpc error: code = NotFound desc = could not find container \"f91101769ed687a4aed376b2bf23394214abccef2c237a4f96867efa3c1512b6\": container with ID starting with f91101769ed687a4aed376b2bf23394214abccef2c237a4f96867efa3c1512b6 not found: ID does not exist" Jul 24 14:44:06.709740 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:06.709716 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jcqk9"] Jul 24 14:44:06.713650 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:06.713630 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jcqk9"] Jul 24 14:44:07.038031 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:07.038002 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc37f07f-456e-4b40-ad0e-00238eaaee94" path="/var/lib/kubelet/pods/cc37f07f-456e-4b40-ad0e-00238eaaee94/volumes" Jul 24 14:44:22.887026 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:22.886998 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bx87n_0d54a10a-875a-45fd-8c7a-100dd1a7d3ca/console-operator/2.log" Jul 24 14:44:22.887975 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:22.887955 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bx87n_0d54a10a-875a-45fd-8c7a-100dd1a7d3ca/console-operator/2.log" Jul 24 14:44:45.331391 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:45.331311 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-9z7ng"] Jul 24 14:44:45.333395 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:45.331652 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc37f07f-456e-4b40-ad0e-00238eaaee94" containerName="authorino" Jul 24 14:44:45.333395 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:45.331663 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc37f07f-456e-4b40-ad0e-00238eaaee94" containerName="authorino" Jul 24 14:44:45.333395 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:45.331740 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc37f07f-456e-4b40-ad0e-00238eaaee94" containerName="authorino" Jul 24 14:44:45.334180 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:45.334158 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-9z7ng" Jul 24 14:44:45.336344 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:45.336321 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-k2hqh\"" Jul 24 14:44:45.336450 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:45.336321 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 24 14:44:45.346280 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:45.346255 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-9z7ng"] Jul 24 14:44:45.435534 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:45.435500 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3dc9de1c-335d-47d7-b196-e7a634446e89-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-9z7ng\" (UID: \"3dc9de1c-335d-47d7-b196-e7a634446e89\") " pod="openshift-ingress/payload-processing-5cc6cd444b-9z7ng" Jul 24 14:44:45.435681 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:45.435540 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn5pt\" (UniqueName: \"kubernetes.io/projected/3dc9de1c-335d-47d7-b196-e7a634446e89-kube-api-access-zn5pt\") pod \"payload-processing-5cc6cd444b-9z7ng\" (UID: \"3dc9de1c-335d-47d7-b196-e7a634446e89\") " pod="openshift-ingress/payload-processing-5cc6cd444b-9z7ng" Jul 24 14:44:45.536195 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:45.536155 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3dc9de1c-335d-47d7-b196-e7a634446e89-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-9z7ng\" (UID: \"3dc9de1c-335d-47d7-b196-e7a634446e89\") " pod="openshift-ingress/payload-processing-5cc6cd444b-9z7ng" Jul 24 14:44:45.536195 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:45.536196 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn5pt\" (UniqueName: \"kubernetes.io/projected/3dc9de1c-335d-47d7-b196-e7a634446e89-kube-api-access-zn5pt\") pod \"payload-processing-5cc6cd444b-9z7ng\" (UID: \"3dc9de1c-335d-47d7-b196-e7a634446e89\") " pod="openshift-ingress/payload-processing-5cc6cd444b-9z7ng" Jul 24 14:44:45.536941 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:45.536920 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3dc9de1c-335d-47d7-b196-e7a634446e89-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-9z7ng\" (UID: \"3dc9de1c-335d-47d7-b196-e7a634446e89\") " pod="openshift-ingress/payload-processing-5cc6cd444b-9z7ng" Jul 24 14:44:45.544537 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:45.544511 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn5pt\" (UniqueName: \"kubernetes.io/projected/3dc9de1c-335d-47d7-b196-e7a634446e89-kube-api-access-zn5pt\") pod \"payload-processing-5cc6cd444b-9z7ng\" (UID: \"3dc9de1c-335d-47d7-b196-e7a634446e89\") " pod="openshift-ingress/payload-processing-5cc6cd444b-9z7ng" Jul 24 14:44:45.643750 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:45.643669 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-9z7ng" Jul 24 14:44:45.782813 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:45.782780 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-9z7ng"] Jul 24 14:44:45.784338 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:44:45.784304 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dc9de1c_335d_47d7_b196_e7a634446e89.slice/crio-a31ec894e8ded8e2460e8ea04fdecbbe2b230207f487b378c062d675e38a1cf2 WatchSource:0}: Error finding container a31ec894e8ded8e2460e8ea04fdecbbe2b230207f487b378c062d675e38a1cf2: Status 404 returned error can't find the container with id a31ec894e8ded8e2460e8ea04fdecbbe2b230207f487b378c062d675e38a1cf2 Jul 24 14:44:45.876351 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:45.876318 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-9z7ng" event={"ID":"3dc9de1c-335d-47d7-b196-e7a634446e89","Type":"ContainerStarted","Data":"a31ec894e8ded8e2460e8ea04fdecbbe2b230207f487b378c062d675e38a1cf2"} Jul 24 14:44:48.891711 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:48.891656 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-9z7ng" event={"ID":"3dc9de1c-335d-47d7-b196-e7a634446e89","Type":"ContainerStarted","Data":"c91a3d3e6b3adf8f778a8650f330c44f3cd7e4193b3a8e4cbe4f243baed368aa"} Jul 24 14:44:48.892154 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:48.891849 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-9z7ng" Jul 24 14:44:48.911387 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:48.911344 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-9z7ng" podStartSLOduration=1.874212754 podStartE2EDuration="3.911328218s" totalImagesPullingTime="2.037115464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:44:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:44:48.910154621 +0000 UTC m=+626.449004147" watchObservedRunningTime="2026-07-24 14:44:48.911328218 +0000 UTC m=+626.450177747" Jul 24 14:44:59.899076 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:44:59.899043 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-9z7ng" Jul 24 14:45:00.148414 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:00.148378 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748405-sxvn8"] Jul 24 14:45:00.152050 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:00.151987 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748405-sxvn8" Jul 24 14:45:00.154245 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:00.154207 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-g4jrf\"" Jul 24 14:45:00.159803 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:00.159782 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748405-sxvn8"] Jul 24 14:45:00.163638 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:00.163615 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748405-sxvn8" Jul 24 14:45:00.295686 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:00.295659 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748405-sxvn8"] Jul 24 14:45:00.297876 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:45:00.297839 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94bf6364_8949_4c3b_a754_c35b4f60b0bc.slice/crio-a37b9a4b679e29f329f408457d0dae5787a3ee9330ff553deeeb70fc70f5a738 WatchSource:0}: Error finding container a37b9a4b679e29f329f408457d0dae5787a3ee9330ff553deeeb70fc70f5a738: Status 404 returned error can't find the container with id a37b9a4b679e29f329f408457d0dae5787a3ee9330ff553deeeb70fc70f5a738 Jul 24 14:45:00.948619 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:00.948580 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748405-sxvn8" event={"ID":"94bf6364-8949-4c3b-a754-c35b4f60b0bc","Type":"ContainerStarted","Data":"a37b9a4b679e29f329f408457d0dae5787a3ee9330ff553deeeb70fc70f5a738"} Jul 24 14:45:03.965303 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:03.965262 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748405-sxvn8" event={"ID":"94bf6364-8949-4c3b-a754-c35b4f60b0bc","Type":"ContainerStarted","Data":"536bed05552249cdad9032a8e57b3f2adf6a8dd7924d4a2b26ba166408069db1"} Jul 24 14:45:04.971562 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:04.971518 2582 generic.go:356] "Generic (PLEG): container finished" podID="94bf6364-8949-4c3b-a754-c35b4f60b0bc" containerID="536bed05552249cdad9032a8e57b3f2adf6a8dd7924d4a2b26ba166408069db1" exitCode=0 Jul 24 14:45:04.971942 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:04.971596 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748405-sxvn8" event={"ID":"94bf6364-8949-4c3b-a754-c35b4f60b0bc","Type":"ContainerDied","Data":"536bed05552249cdad9032a8e57b3f2adf6a8dd7924d4a2b26ba166408069db1"} Jul 24 14:45:06.104400 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:06.104368 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748405-sxvn8" Jul 24 14:45:06.982325 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:06.982292 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748405-sxvn8" event={"ID":"94bf6364-8949-4c3b-a754-c35b4f60b0bc","Type":"ContainerDied","Data":"a37b9a4b679e29f329f408457d0dae5787a3ee9330ff553deeeb70fc70f5a738"} Jul 24 14:45:06.982325 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:06.982327 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748405-sxvn8" Jul 24 14:45:06.982530 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:06.982343 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a37b9a4b679e29f329f408457d0dae5787a3ee9330ff553deeeb70fc70f5a738" Jul 24 14:45:16.985803 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:16.985765 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9"] Jul 24 14:45:16.986161 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:16.986134 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94bf6364-8949-4c3b-a754-c35b4f60b0bc" containerName="cleanup" Jul 24 14:45:16.986161 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:16.986145 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="94bf6364-8949-4c3b-a754-c35b4f60b0bc" containerName="cleanup" Jul 24 14:45:16.986230 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:16.986202 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="94bf6364-8949-4c3b-a754-c35b4f60b0bc" containerName="cleanup" Jul 24 14:45:16.988895 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:16.988876 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9" Jul 24 14:45:16.991127 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:16.991106 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kg9tm\"" Jul 24 14:45:16.991414 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:16.991398 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 24 14:45:16.991989 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:16.991975 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 24 14:45:16.992118 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:16.992100 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 24 14:45:16.999616 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:16.999594 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9"] Jul 24 14:45:17.125181 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:17.125141 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1dde5b4-cbf2-43ba-a1be-769fc3153768-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pdvw9\" (UID: \"d1dde5b4-cbf2-43ba-a1be-769fc3153768\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9" Jul 24 14:45:17.125181 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:17.125182 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1dde5b4-cbf2-43ba-a1be-769fc3153768-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pdvw9\" (UID: \"d1dde5b4-cbf2-43ba-a1be-769fc3153768\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9" Jul 24 14:45:17.125451 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:17.125283 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1dde5b4-cbf2-43ba-a1be-769fc3153768-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pdvw9\" (UID: \"d1dde5b4-cbf2-43ba-a1be-769fc3153768\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9" Jul 24 14:45:17.125451 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:17.125347 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj8c9\" (UniqueName: \"kubernetes.io/projected/d1dde5b4-cbf2-43ba-a1be-769fc3153768-kube-api-access-nj8c9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pdvw9\" (UID: \"d1dde5b4-cbf2-43ba-a1be-769fc3153768\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9" Jul 24 14:45:17.125451 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:17.125397 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1dde5b4-cbf2-43ba-a1be-769fc3153768-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pdvw9\" (UID: \"d1dde5b4-cbf2-43ba-a1be-769fc3153768\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9" Jul 24 14:45:17.125451 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:17.125414 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1dde5b4-cbf2-43ba-a1be-769fc3153768-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pdvw9\" (UID: \"d1dde5b4-cbf2-43ba-a1be-769fc3153768\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9" Jul 24 14:45:17.226567 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:17.226526 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1dde5b4-cbf2-43ba-a1be-769fc3153768-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pdvw9\" (UID: \"d1dde5b4-cbf2-43ba-a1be-769fc3153768\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9" Jul 24 14:45:17.226765 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:17.226585 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj8c9\" (UniqueName: \"kubernetes.io/projected/d1dde5b4-cbf2-43ba-a1be-769fc3153768-kube-api-access-nj8c9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pdvw9\" (UID: \"d1dde5b4-cbf2-43ba-a1be-769fc3153768\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9" Jul 24 14:45:17.226765 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:17.226635 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1dde5b4-cbf2-43ba-a1be-769fc3153768-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pdvw9\" (UID: \"d1dde5b4-cbf2-43ba-a1be-769fc3153768\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9" Jul 24 14:45:17.226765 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:17.226657 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1dde5b4-cbf2-43ba-a1be-769fc3153768-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pdvw9\" (UID: \"d1dde5b4-cbf2-43ba-a1be-769fc3153768\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9" Jul 24 14:45:17.226765 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:17.226690 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1dde5b4-cbf2-43ba-a1be-769fc3153768-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pdvw9\" (UID: \"d1dde5b4-cbf2-43ba-a1be-769fc3153768\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9" Jul 24 14:45:17.226765 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:17.226715 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1dde5b4-cbf2-43ba-a1be-769fc3153768-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pdvw9\" (UID: \"d1dde5b4-cbf2-43ba-a1be-769fc3153768\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9" Jul 24 14:45:17.227069 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:17.226997 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1dde5b4-cbf2-43ba-a1be-769fc3153768-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pdvw9\" (UID: \"d1dde5b4-cbf2-43ba-a1be-769fc3153768\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9" Jul 24 14:45:17.227069 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:17.227011 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1dde5b4-cbf2-43ba-a1be-769fc3153768-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pdvw9\" (UID: \"d1dde5b4-cbf2-43ba-a1be-769fc3153768\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9" Jul 24 14:45:17.227161 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:17.227079 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1dde5b4-cbf2-43ba-a1be-769fc3153768-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pdvw9\" (UID: \"d1dde5b4-cbf2-43ba-a1be-769fc3153768\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9" Jul 24 14:45:17.228953 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:17.228924 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1dde5b4-cbf2-43ba-a1be-769fc3153768-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pdvw9\" (UID: \"d1dde5b4-cbf2-43ba-a1be-769fc3153768\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9" Jul 24 14:45:17.229189 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:17.229171 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1dde5b4-cbf2-43ba-a1be-769fc3153768-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pdvw9\" (UID: \"d1dde5b4-cbf2-43ba-a1be-769fc3153768\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9" Jul 24 14:45:17.235678 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:17.235657 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj8c9\" (UniqueName: \"kubernetes.io/projected/d1dde5b4-cbf2-43ba-a1be-769fc3153768-kube-api-access-nj8c9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pdvw9\" (UID: \"d1dde5b4-cbf2-43ba-a1be-769fc3153768\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9" Jul 24 14:45:17.299077 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:17.298989 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9" Jul 24 14:45:17.440404 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:17.440374 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9"] Jul 24 14:45:17.442751 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:45:17.442703 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1dde5b4_cbf2_43ba_a1be_769fc3153768.slice/crio-8d704cf99333eac35e89f1d001d009b43fa6a696028e06d78455ba5461fb94b7 WatchSource:0}: Error finding container 8d704cf99333eac35e89f1d001d009b43fa6a696028e06d78455ba5461fb94b7: Status 404 returned error can't find the container with id 8d704cf99333eac35e89f1d001d009b43fa6a696028e06d78455ba5461fb94b7 Jul 24 14:45:17.446725 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:17.446699 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 14:45:18.037127 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:18.037088 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9" event={"ID":"d1dde5b4-cbf2-43ba-a1be-769fc3153768","Type":"ContainerStarted","Data":"8d704cf99333eac35e89f1d001d009b43fa6a696028e06d78455ba5461fb94b7"} Jul 24 14:45:19.042385 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:19.042349 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9" event={"ID":"d1dde5b4-cbf2-43ba-a1be-769fc3153768","Type":"ContainerStarted","Data":"4c18aa4e2ed41db2abb89ffc7993de2e975c91cb8fd078652b80c1c0f4ab95fe"} Jul 24 14:45:19.065969 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:19.060460 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9" podStartSLOduration=2.063332156 podStartE2EDuration="3.060435353s" totalImagesPullingTime="997.103197ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:45:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:45:19.059052573 +0000 UTC m=+656.597902101" watchObservedRunningTime="2026-07-24 14:45:19.060435353 +0000 UTC m=+656.599284882" Jul 24 14:45:27.300015 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:27.299959 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9" Jul 24 14:45:27.300472 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:27.300040 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9" Jul 24 14:45:27.313024 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:27.312997 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9" Jul 24 14:45:28.094820 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:28.094781 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pdvw9" Jul 24 14:45:38.383948 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:38.383913 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj"] Jul 24 14:45:38.394534 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:38.394506 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj" Jul 24 14:45:38.397082 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:38.397055 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 24 14:45:38.398503 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:38.398480 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj"] Jul 24 14:45:38.421549 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:38.421519 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6d221ab-bfc2-4415-a7da-23be550232dd-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6hnj\" (UID: \"c6d221ab-bfc2-4415-a7da-23be550232dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj" Jul 24 14:45:38.421549 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:38.421554 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6d221ab-bfc2-4415-a7da-23be550232dd-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6hnj\" (UID: \"c6d221ab-bfc2-4415-a7da-23be550232dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj" Jul 24 14:45:38.421744 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:38.421593 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6d221ab-bfc2-4415-a7da-23be550232dd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6hnj\" (UID: \"c6d221ab-bfc2-4415-a7da-23be550232dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj" Jul 24 14:45:38.421744 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:38.421638 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6d221ab-bfc2-4415-a7da-23be550232dd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6hnj\" (UID: \"c6d221ab-bfc2-4415-a7da-23be550232dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj" Jul 24 14:45:38.421744 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:38.421699 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wpjg\" (UniqueName: \"kubernetes.io/projected/c6d221ab-bfc2-4415-a7da-23be550232dd-kube-api-access-5wpjg\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6hnj\" (UID: \"c6d221ab-bfc2-4415-a7da-23be550232dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj" Jul 24 14:45:38.421744 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:38.421742 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6d221ab-bfc2-4415-a7da-23be550232dd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6hnj\" (UID: \"c6d221ab-bfc2-4415-a7da-23be550232dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj" Jul 24 14:45:38.522444 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:38.522408 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6d221ab-bfc2-4415-a7da-23be550232dd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6hnj\" (UID: \"c6d221ab-bfc2-4415-a7da-23be550232dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj" Jul 24 14:45:38.522444 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:38.522448 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6d221ab-bfc2-4415-a7da-23be550232dd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6hnj\" (UID: \"c6d221ab-bfc2-4415-a7da-23be550232dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj" Jul 24 14:45:38.522677 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:38.522497 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wpjg\" (UniqueName: \"kubernetes.io/projected/c6d221ab-bfc2-4415-a7da-23be550232dd-kube-api-access-5wpjg\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6hnj\" (UID: \"c6d221ab-bfc2-4415-a7da-23be550232dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj" Jul 24 14:45:38.522677 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:38.522552 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6d221ab-bfc2-4415-a7da-23be550232dd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6hnj\" (UID: \"c6d221ab-bfc2-4415-a7da-23be550232dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj" Jul 24 14:45:38.522677 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:38.522593 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6d221ab-bfc2-4415-a7da-23be550232dd-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6hnj\" (UID: \"c6d221ab-bfc2-4415-a7da-23be550232dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj" Jul 24 14:45:38.522677 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:38.522623 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6d221ab-bfc2-4415-a7da-23be550232dd-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6hnj\" (UID: \"c6d221ab-bfc2-4415-a7da-23be550232dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj" Jul 24 14:45:38.523013 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:38.522984 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6d221ab-bfc2-4415-a7da-23be550232dd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6hnj\" (UID: \"c6d221ab-bfc2-4415-a7da-23be550232dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj" Jul 24 14:45:38.523144 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:38.523035 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6d221ab-bfc2-4415-a7da-23be550232dd-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6hnj\" (UID: \"c6d221ab-bfc2-4415-a7da-23be550232dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj" Jul 24 14:45:38.523144 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:38.523059 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6d221ab-bfc2-4415-a7da-23be550232dd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6hnj\" (UID: \"c6d221ab-bfc2-4415-a7da-23be550232dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj" Jul 24 14:45:38.524862 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:38.524840 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6d221ab-bfc2-4415-a7da-23be550232dd-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6hnj\" (UID: \"c6d221ab-bfc2-4415-a7da-23be550232dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj" Jul 24 14:45:38.524980 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:38.524963 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6d221ab-bfc2-4415-a7da-23be550232dd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6hnj\" (UID: \"c6d221ab-bfc2-4415-a7da-23be550232dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj" Jul 24 14:45:38.529462 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:38.529441 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wpjg\" (UniqueName: \"kubernetes.io/projected/c6d221ab-bfc2-4415-a7da-23be550232dd-kube-api-access-5wpjg\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6hnj\" (UID: \"c6d221ab-bfc2-4415-a7da-23be550232dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj" Jul 24 14:45:38.707010 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:38.706929 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj" Jul 24 14:45:38.840657 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:38.840633 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj"] Jul 24 14:45:38.842802 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:45:38.842776 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6d221ab_bfc2_4415_a7da_23be550232dd.slice/crio-aa5e1608b3bc580e54f01df881c01ff9dd79ecb6522aeae59dcfdb00a2e01e95 WatchSource:0}: Error finding container aa5e1608b3bc580e54f01df881c01ff9dd79ecb6522aeae59dcfdb00a2e01e95: Status 404 returned error can't find the container with id aa5e1608b3bc580e54f01df881c01ff9dd79ecb6522aeae59dcfdb00a2e01e95 Jul 24 14:45:39.141040 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:39.141009 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj" event={"ID":"c6d221ab-bfc2-4415-a7da-23be550232dd","Type":"ContainerStarted","Data":"be438567b3c6f8ba2e7e7807dd44372aaf621b55b63db52dd0d72c1fae13ee25"} Jul 24 14:45:39.141207 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:39.141058 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj" event={"ID":"c6d221ab-bfc2-4415-a7da-23be550232dd","Type":"ContainerStarted","Data":"aa5e1608b3bc580e54f01df881c01ff9dd79ecb6522aeae59dcfdb00a2e01e95"} Jul 24 14:45:39.159678 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:39.159627 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj" podStartSLOduration=0.97486504 podStartE2EDuration="1.159610098s" totalImagesPullingTime="184.745058ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:45:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:45:39.157754653 +0000 UTC m=+676.696604181" watchObservedRunningTime="2026-07-24 14:45:39.159610098 +0000 UTC m=+676.698459624" Jul 24 14:45:44.081956 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:44.081919 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf"] Jul 24 14:45:44.085785 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:44.085766 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf" Jul 24 14:45:44.087998 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:44.087976 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 24 14:45:44.096573 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:44.096551 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf"] Jul 24 14:45:44.172924 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:44.172893 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c91949d6-4daf-4ea5-886c-aa811e3ef426-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf\" (UID: \"c91949d6-4daf-4ea5-886c-aa811e3ef426\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf" Jul 24 14:45:44.173107 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:44.172930 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqfjz\" (UniqueName: \"kubernetes.io/projected/c91949d6-4daf-4ea5-886c-aa811e3ef426-kube-api-access-gqfjz\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf\" (UID: \"c91949d6-4daf-4ea5-886c-aa811e3ef426\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf" Jul 24 14:45:44.173107 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:44.172949 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c91949d6-4daf-4ea5-886c-aa811e3ef426-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf\" (UID: \"c91949d6-4daf-4ea5-886c-aa811e3ef426\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf" Jul 24 14:45:44.173107 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:44.173073 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c91949d6-4daf-4ea5-886c-aa811e3ef426-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf\" (UID: \"c91949d6-4daf-4ea5-886c-aa811e3ef426\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf" Jul 24 14:45:44.173107 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:44.173099 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c91949d6-4daf-4ea5-886c-aa811e3ef426-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf\" (UID: \"c91949d6-4daf-4ea5-886c-aa811e3ef426\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf" Jul 24 14:45:44.173308 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:44.173181 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c91949d6-4daf-4ea5-886c-aa811e3ef426-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf\" (UID: \"c91949d6-4daf-4ea5-886c-aa811e3ef426\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf" Jul 24 14:45:44.274491 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:44.274451 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c91949d6-4daf-4ea5-886c-aa811e3ef426-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf\" (UID: \"c91949d6-4daf-4ea5-886c-aa811e3ef426\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf" Jul 24 14:45:44.274491 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:44.274491 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c91949d6-4daf-4ea5-886c-aa811e3ef426-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf\" (UID: \"c91949d6-4daf-4ea5-886c-aa811e3ef426\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf" Jul 24 14:45:44.274727 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:44.274524 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c91949d6-4daf-4ea5-886c-aa811e3ef426-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf\" (UID: \"c91949d6-4daf-4ea5-886c-aa811e3ef426\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf" Jul 24 14:45:44.274727 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:44.274563 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c91949d6-4daf-4ea5-886c-aa811e3ef426-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf\" (UID: \"c91949d6-4daf-4ea5-886c-aa811e3ef426\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf" Jul 24 14:45:44.274727 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:44.274584 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqfjz\" (UniqueName: \"kubernetes.io/projected/c91949d6-4daf-4ea5-886c-aa811e3ef426-kube-api-access-gqfjz\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf\" (UID: \"c91949d6-4daf-4ea5-886c-aa811e3ef426\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf" Jul 24 14:45:44.274727 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:44.274601 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c91949d6-4daf-4ea5-886c-aa811e3ef426-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf\" (UID: \"c91949d6-4daf-4ea5-886c-aa811e3ef426\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf" Jul 24 14:45:44.274936 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:44.274915 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c91949d6-4daf-4ea5-886c-aa811e3ef426-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf\" (UID: \"c91949d6-4daf-4ea5-886c-aa811e3ef426\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf" Jul 24 14:45:44.275025 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:44.275009 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c91949d6-4daf-4ea5-886c-aa811e3ef426-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf\" (UID: \"c91949d6-4daf-4ea5-886c-aa811e3ef426\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf" Jul 24 14:45:44.275064 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:44.275007 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c91949d6-4daf-4ea5-886c-aa811e3ef426-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf\" (UID: \"c91949d6-4daf-4ea5-886c-aa811e3ef426\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf" Jul 24 14:45:44.276893 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:44.276870 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c91949d6-4daf-4ea5-886c-aa811e3ef426-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf\" (UID: \"c91949d6-4daf-4ea5-886c-aa811e3ef426\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf" Jul 24 14:45:44.277010 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:44.276991 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c91949d6-4daf-4ea5-886c-aa811e3ef426-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf\" (UID: \"c91949d6-4daf-4ea5-886c-aa811e3ef426\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf" Jul 24 14:45:44.282406 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:44.282382 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqfjz\" (UniqueName: \"kubernetes.io/projected/c91949d6-4daf-4ea5-886c-aa811e3ef426-kube-api-access-gqfjz\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf\" (UID: \"c91949d6-4daf-4ea5-886c-aa811e3ef426\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf" Jul 24 14:45:44.394854 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:44.394769 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf" Jul 24 14:45:44.528004 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:44.527975 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf"] Jul 24 14:45:44.529791 ip-10-0-140-149 kubenswrapper[2582]: W0724 14:45:44.529767 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc91949d6_4daf_4ea5_886c_aa811e3ef426.slice/crio-82e3b97948b69851d7fd947b33ca5f491e91feb9aa9b69e8c0e34adf5e8ca130 WatchSource:0}: Error finding container 82e3b97948b69851d7fd947b33ca5f491e91feb9aa9b69e8c0e34adf5e8ca130: Status 404 returned error can't find the container with id 82e3b97948b69851d7fd947b33ca5f491e91feb9aa9b69e8c0e34adf5e8ca130 Jul 24 14:45:45.170019 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:45.169932 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf" event={"ID":"c91949d6-4daf-4ea5-886c-aa811e3ef426","Type":"ContainerStarted","Data":"3713a65f4e9979e167fef016867d87d9ce4ddbf9313842ac54ef6d4914c6b145"} Jul 24 14:45:45.170019 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:45.169975 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf" event={"ID":"c91949d6-4daf-4ea5-886c-aa811e3ef426","Type":"ContainerStarted","Data":"82e3b97948b69851d7fd947b33ca5f491e91feb9aa9b69e8c0e34adf5e8ca130"} Jul 24 14:45:45.189308 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:45.189251 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf" podStartSLOduration=0.972203043 podStartE2EDuration="1.189217663s" totalImagesPullingTime="217.01462ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:45:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:45:45.18820445 +0000 UTC m=+682.727053994" watchObservedRunningTime="2026-07-24 14:45:45.189217663 +0000 UTC m=+682.728067189" Jul 24 14:45:48.707813 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:48.707770 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj" Jul 24 14:45:48.708310 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:48.707841 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj" Jul 24 14:45:48.720585 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:48.720563 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj" Jul 24 14:45:49.205325 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:49.205229 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6hnj" Jul 24 14:45:54.395269 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:54.395223 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf" Jul 24 14:45:54.395737 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:54.395295 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf" Jul 24 14:45:54.408382 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:54.408353 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf" Jul 24 14:45:55.234797 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:45:55.234759 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf" Jul 24 14:49:22.926324 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:49:22.926222 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bx87n_0d54a10a-875a-45fd-8c7a-100dd1a7d3ca/console-operator/2.log" Jul 24 14:49:22.926820 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:49:22.926642 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bx87n_0d54a10a-875a-45fd-8c7a-100dd1a7d3ca/console-operator/2.log" Jul 24 14:54:22.958540 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:54:22.958503 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bx87n_0d54a10a-875a-45fd-8c7a-100dd1a7d3ca/console-operator/2.log" Jul 24 14:54:22.959054 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:54:22.959033 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bx87n_0d54a10a-875a-45fd-8c7a-100dd1a7d3ca/console-operator/2.log" Jul 24 14:59:22.989549 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:59:22.989519 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bx87n_0d54a10a-875a-45fd-8c7a-100dd1a7d3ca/console-operator/2.log" Jul 24 14:59:22.992080 ip-10-0-140-149 kubenswrapper[2582]: I0724 14:59:22.992057 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bx87n_0d54a10a-875a-45fd-8c7a-100dd1a7d3ca/console-operator/2.log" Jul 24 15:04:23.021087 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:04:23.021058 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bx87n_0d54a10a-875a-45fd-8c7a-100dd1a7d3ca/console-operator/2.log" Jul 24 15:04:23.024705 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:04:23.024681 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bx87n_0d54a10a-875a-45fd-8c7a-100dd1a7d3ca/console-operator/2.log" Jul 24 15:09:23.059356 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:09:23.059281 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bx87n_0d54a10a-875a-45fd-8c7a-100dd1a7d3ca/console-operator/2.log" Jul 24 15:09:23.060384 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:09:23.060365 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bx87n_0d54a10a-875a-45fd-8c7a-100dd1a7d3ca/console-operator/2.log" Jul 24 15:14:23.091498 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:14:23.091469 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bx87n_0d54a10a-875a-45fd-8c7a-100dd1a7d3ca/console-operator/2.log" Jul 24 15:14:23.093849 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:14:23.093827 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bx87n_0d54a10a-875a-45fd-8c7a-100dd1a7d3ca/console-operator/2.log" Jul 24 15:15:18.180985 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:18.180952 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-696d5956bc-sdwgj_cf8d92c7-5f4c-4d62-acb1-45f967333f92/copy-manifests/0.log" Jul 24 15:15:18.189871 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:18.189848 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-696d5956bc-sdwgj_cf8d92c7-5f4c-4d62-acb1-45f967333f92/manager/0.log" Jul 24 15:15:18.673394 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:18.673366 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29748405-sxvn8_94bf6364-8949-4c3b-a754-c35b4f60b0bc/cleanup/0.log" Jul 24 15:15:20.813897 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:20.813859 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-tt5fn_7ef0701f-4348-44c4-b92e-e80af3e1e1f3/kuadrant-console-plugin/0.log" Jul 24 15:15:21.333507 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:21.333476 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-bnqt2_7a3c76d2-4802-4f1a-827d-2e84317b1b03/manager/0.log" Jul 24 15:15:21.936017 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:21.935989 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66d67d68d4-d8wjk_14a5b8b5-c4e2-42e4-912d-d75bae1b1f67/kube-auth-proxy/0.log" Jul 24 15:15:22.435461 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:22.435434 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-9z7ng_3dc9de1c-335d-47d7-b196-e7a634446e89/payload-processing/0.log" Jul 24 15:15:23.065873 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:23.065845 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-pdvw9_d1dde5b4-cbf2-43ba-a1be-769fc3153768/main/0.log" Jul 24 15:15:23.417911 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:23.417830 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-v6hnj_c6d221ab-bfc2-4415-a7da-23be550232dd/main/0.log" Jul 24 15:15:23.535882 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:23.535850 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-9gxmf_c91949d6-4daf-4ea5-886c-aa811e3ef426/main/0.log" Jul 24 15:15:32.678491 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:32.678459 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tcdq5_e8948e1d-72b0-43bd-972d-5767963f2837/global-pull-secret-syncer/0.log" Jul 24 15:15:32.812491 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:32.812460 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zw72w_c682b4d8-97db-4538-931d-93b229e4f2b9/konnectivity-agent/0.log" Jul 24 15:15:32.864009 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:32.863968 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-149.ec2.internal_50e1130ea2c6a2d58cc431a3aa9c96ce/haproxy/0.log" Jul 24 15:15:37.905560 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:37.905531 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-tt5fn_7ef0701f-4348-44c4-b92e-e80af3e1e1f3/kuadrant-console-plugin/0.log" Jul 24 15:15:38.195972 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:38.195891 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-bnqt2_7a3c76d2-4802-4f1a-827d-2e84317b1b03/manager/0.log" Jul 24 15:15:39.824674 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:39.824648 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c3bbc7b5-1812-4c6e-a060-0bf9fb917801/alertmanager/0.log" Jul 24 15:15:39.851331 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:39.851303 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c3bbc7b5-1812-4c6e-a060-0bf9fb917801/config-reloader/0.log" Jul 24 15:15:39.884565 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:39.884535 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c3bbc7b5-1812-4c6e-a060-0bf9fb917801/kube-rbac-proxy-web/0.log" Jul 24 15:15:39.913840 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:39.913814 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c3bbc7b5-1812-4c6e-a060-0bf9fb917801/kube-rbac-proxy/0.log" Jul 24 15:15:39.942888 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:39.942815 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c3bbc7b5-1812-4c6e-a060-0bf9fb917801/kube-rbac-proxy-metric/0.log" Jul 24 15:15:39.975118 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:39.975091 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c3bbc7b5-1812-4c6e-a060-0bf9fb917801/prom-label-proxy/0.log" Jul 24 15:15:40.016481 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:40.016453 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c3bbc7b5-1812-4c6e-a060-0bf9fb917801/init-config-reloader/0.log" Jul 24 15:15:40.177707 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:40.177679 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-85b888bf9d-qpmjq_b148f0b1-a634-4d15-8d1b-ec368de4c202/metrics-server/0.log" Jul 24 15:15:40.441690 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:40.441657 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dlfsf_f17bc84b-00dc-4451-9ae9-5c56d2f87db7/node-exporter/0.log" Jul 24 15:15:40.466106 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:40.466071 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dlfsf_f17bc84b-00dc-4451-9ae9-5c56d2f87db7/kube-rbac-proxy/0.log" Jul 24 15:15:40.502706 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:40.502634 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dlfsf_f17bc84b-00dc-4451-9ae9-5c56d2f87db7/init-textfile/0.log" Jul 24 15:15:40.532605 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:40.532574 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-gmgh4_f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad/kube-rbac-proxy-main/0.log" Jul 24 15:15:40.555337 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:40.555308 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-gmgh4_f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad/kube-rbac-proxy-self/0.log" Jul 24 15:15:40.577509 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:40.577481 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-gmgh4_f8aa3fd0-aeb6-488d-b5aa-4adbdc2203ad/openshift-state-metrics/0.log" Jul 24 15:15:40.617050 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:40.617020 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_555a9214-0a5b-419c-9d7c-fb4d768f2d05/prometheus/0.log" Jul 24 15:15:40.640792 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:40.640766 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_555a9214-0a5b-419c-9d7c-fb4d768f2d05/config-reloader/0.log" Jul 24 15:15:40.664761 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:40.664737 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_555a9214-0a5b-419c-9d7c-fb4d768f2d05/thanos-sidecar/0.log" Jul 24 15:15:40.686639 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:40.686613 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_555a9214-0a5b-419c-9d7c-fb4d768f2d05/kube-rbac-proxy-web/0.log" Jul 24 15:15:40.708277 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:40.708231 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_555a9214-0a5b-419c-9d7c-fb4d768f2d05/kube-rbac-proxy/0.log" Jul 24 15:15:40.729696 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:40.729675 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_555a9214-0a5b-419c-9d7c-fb4d768f2d05/kube-rbac-proxy-thanos/0.log" Jul 24 15:15:40.751649 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:40.751626 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_555a9214-0a5b-419c-9d7c-fb4d768f2d05/init-config-reloader/0.log" Jul 24 15:15:40.779166 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:40.779094 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-w4vzk_be8c8f2c-3baf-48ad-8932-cf3eb9fa3719/prometheus-operator/0.log" Jul 24 15:15:40.803946 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:40.803918 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-w4vzk_be8c8f2c-3baf-48ad-8932-cf3eb9fa3719/kube-rbac-proxy/0.log" Jul 24 15:15:40.826672 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:40.826648 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-pcqg7_1420cbda-3fe4-4f8d-b8bc-ec7f44d8c15b/prometheus-operator-admission-webhook/0.log" Jul 24 15:15:41.919781 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:41.919745 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qd87v/perf-node-gather-daemonset-kcxtf"] Jul 24 15:15:41.923248 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:41.923214 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-kcxtf" Jul 24 15:15:41.925619 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:41.925594 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qd87v\"/\"openshift-service-ca.crt\"" Jul 24 15:15:41.925746 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:41.925594 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qd87v\"/\"kube-root-ca.crt\"" Jul 24 15:15:41.925746 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:41.925663 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qd87v\"/\"default-dockercfg-m4jjv\"" Jul 24 15:15:41.935828 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:41.935806 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qd87v/perf-node-gather-daemonset-kcxtf"] Jul 24 15:15:42.085208 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:42.085172 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/837ad9fc-600c-4933-b4ad-613265e8ffc1-lib-modules\") pod \"perf-node-gather-daemonset-kcxtf\" (UID: \"837ad9fc-600c-4933-b4ad-613265e8ffc1\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-kcxtf" Jul 24 15:15:42.085208 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:42.085207 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9ndm\" (UniqueName: \"kubernetes.io/projected/837ad9fc-600c-4933-b4ad-613265e8ffc1-kube-api-access-w9ndm\") pod \"perf-node-gather-daemonset-kcxtf\" (UID: \"837ad9fc-600c-4933-b4ad-613265e8ffc1\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-kcxtf" Jul 24 15:15:42.085451 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:42.085269 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/837ad9fc-600c-4933-b4ad-613265e8ffc1-podres\") pod \"perf-node-gather-daemonset-kcxtf\" (UID: \"837ad9fc-600c-4933-b4ad-613265e8ffc1\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-kcxtf" Jul 24 15:15:42.085451 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:42.085355 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/837ad9fc-600c-4933-b4ad-613265e8ffc1-sys\") pod \"perf-node-gather-daemonset-kcxtf\" (UID: \"837ad9fc-600c-4933-b4ad-613265e8ffc1\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-kcxtf" Jul 24 15:15:42.085451 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:42.085389 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/837ad9fc-600c-4933-b4ad-613265e8ffc1-proc\") pod \"perf-node-gather-daemonset-kcxtf\" (UID: \"837ad9fc-600c-4933-b4ad-613265e8ffc1\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-kcxtf" Jul 24 15:15:42.186937 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:42.186843 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/837ad9fc-600c-4933-b4ad-613265e8ffc1-lib-modules\") pod \"perf-node-gather-daemonset-kcxtf\" (UID: \"837ad9fc-600c-4933-b4ad-613265e8ffc1\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-kcxtf" Jul 24 15:15:42.186937 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:42.186879 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9ndm\" (UniqueName: \"kubernetes.io/projected/837ad9fc-600c-4933-b4ad-613265e8ffc1-kube-api-access-w9ndm\") pod \"perf-node-gather-daemonset-kcxtf\" (UID: \"837ad9fc-600c-4933-b4ad-613265e8ffc1\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-kcxtf" Jul 24 15:15:42.187164 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:42.187000 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/837ad9fc-600c-4933-b4ad-613265e8ffc1-podres\") pod \"perf-node-gather-daemonset-kcxtf\" (UID: \"837ad9fc-600c-4933-b4ad-613265e8ffc1\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-kcxtf" Jul 24 15:15:42.187164 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:42.187049 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/837ad9fc-600c-4933-b4ad-613265e8ffc1-sys\") pod \"perf-node-gather-daemonset-kcxtf\" (UID: \"837ad9fc-600c-4933-b4ad-613265e8ffc1\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-kcxtf" Jul 24 15:15:42.187164 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:42.187068 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/837ad9fc-600c-4933-b4ad-613265e8ffc1-proc\") pod \"perf-node-gather-daemonset-kcxtf\" (UID: \"837ad9fc-600c-4933-b4ad-613265e8ffc1\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-kcxtf" Jul 24 15:15:42.187164 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:42.187064 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/837ad9fc-600c-4933-b4ad-613265e8ffc1-lib-modules\") pod \"perf-node-gather-daemonset-kcxtf\" (UID: \"837ad9fc-600c-4933-b4ad-613265e8ffc1\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-kcxtf" Jul 24 15:15:42.187164 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:42.187129 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/837ad9fc-600c-4933-b4ad-613265e8ffc1-sys\") pod \"perf-node-gather-daemonset-kcxtf\" (UID: \"837ad9fc-600c-4933-b4ad-613265e8ffc1\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-kcxtf" Jul 24 15:15:42.187427 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:42.187213 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/837ad9fc-600c-4933-b4ad-613265e8ffc1-podres\") pod \"perf-node-gather-daemonset-kcxtf\" (UID: \"837ad9fc-600c-4933-b4ad-613265e8ffc1\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-kcxtf" Jul 24 15:15:42.187427 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:42.187222 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/837ad9fc-600c-4933-b4ad-613265e8ffc1-proc\") pod \"perf-node-gather-daemonset-kcxtf\" (UID: \"837ad9fc-600c-4933-b4ad-613265e8ffc1\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-kcxtf" Jul 24 15:15:42.195478 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:42.195451 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9ndm\" (UniqueName: \"kubernetes.io/projected/837ad9fc-600c-4933-b4ad-613265e8ffc1-kube-api-access-w9ndm\") pod \"perf-node-gather-daemonset-kcxtf\" (UID: \"837ad9fc-600c-4933-b4ad-613265e8ffc1\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-kcxtf" Jul 24 15:15:42.233559 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:42.233526 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-kcxtf" Jul 24 15:15:42.372626 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:42.372544 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qd87v/perf-node-gather-daemonset-kcxtf"] Jul 24 15:15:42.375442 ip-10-0-140-149 kubenswrapper[2582]: W0724 15:15:42.375416 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod837ad9fc_600c_4933_b4ad_613265e8ffc1.slice/crio-30a30a7a7e8c1685124e69aad06e4c7ca6eea9880d931d2f0e62cf3767be927b WatchSource:0}: Error finding container 30a30a7a7e8c1685124e69aad06e4c7ca6eea9880d931d2f0e62cf3767be927b: Status 404 returned error can't find the container with id 30a30a7a7e8c1685124e69aad06e4c7ca6eea9880d931d2f0e62cf3767be927b Jul 24 15:15:42.860250 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:42.860202 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bx87n_0d54a10a-875a-45fd-8c7a-100dd1a7d3ca/console-operator/2.log" Jul 24 15:15:42.864399 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:42.864375 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bx87n_0d54a10a-875a-45fd-8c7a-100dd1a7d3ca/console-operator/3.log" Jul 24 15:15:43.023618 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:43.023580 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-kcxtf" event={"ID":"837ad9fc-600c-4933-b4ad-613265e8ffc1","Type":"ContainerStarted","Data":"8358fde3f7871d55be7d17f0ee52407223aa4314d2c6e8d243c103fda85a37a8"} Jul 24 15:15:43.024035 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:43.023629 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-kcxtf" event={"ID":"837ad9fc-600c-4933-b4ad-613265e8ffc1","Type":"ContainerStarted","Data":"30a30a7a7e8c1685124e69aad06e4c7ca6eea9880d931d2f0e62cf3767be927b"} Jul 24 15:15:43.024035 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:43.023711 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-kcxtf" Jul 24 15:15:43.043365 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:43.043315 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-kcxtf" podStartSLOduration=2.043299896 podStartE2EDuration="2.043299896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:15:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:15:43.041735927 +0000 UTC m=+2480.580585456" watchObservedRunningTime="2026-07-24 15:15:43.043299896 +0000 UTC m=+2480.582149422" Jul 24 15:15:43.354403 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:43.354370 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-2p8mm_232c5bdd-4b0e-4448-ad5a-edff8c40a933/download-server/0.log" Jul 24 15:15:43.938211 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:43.938161 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-gnfwq_9312eedd-5786-4fba-8ac5-0ca3311853c3/volume-data-source-validator/0.log" Jul 24 15:15:45.007384 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:45.007355 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g7zlw_836ce326-bf5d-4c96-9a71-da5ab147043f/dns/0.log" Jul 24 15:15:45.033737 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:45.033702 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g7zlw_836ce326-bf5d-4c96-9a71-da5ab147043f/kube-rbac-proxy/0.log" Jul 24 15:15:45.221227 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:45.221199 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tknp6_480812e2-0ab3-4c07-b971-d222f629b250/dns-node-resolver/0.log" Jul 24 15:15:45.861420 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:45.861391 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t646b_f51ed1d0-a38c-44c3-83c0-865ce0465977/node-ca/0.log" Jul 24 15:15:46.897147 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:46.897116 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66d67d68d4-d8wjk_14a5b8b5-c4e2-42e4-912d-d75bae1b1f67/kube-auth-proxy/0.log" Jul 24 15:15:47.098278 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:47.098228 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-9z7ng_3dc9de1c-335d-47d7-b196-e7a634446e89/payload-processing/0.log" Jul 24 15:15:48.082832 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:48.082796 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j5g25_affd1875-04ba-449a-bd65-df82fc62df91/serve-healthcheck-canary/0.log" Jul 24 15:15:48.583993 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:48.583961 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-425z6_a0909119-831a-46d5-9ac9-36b277728f89/insights-operator/0.log" Jul 24 15:15:48.585303 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:48.585276 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-425z6_a0909119-831a-46d5-9ac9-36b277728f89/insights-operator/1.log" Jul 24 15:15:48.894458 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:48.894354 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ljkrw_84400f39-82b9-4c0a-9755-2ce1e6baa0f3/kube-rbac-proxy/0.log" Jul 24 15:15:48.945753 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:48.945729 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ljkrw_84400f39-82b9-4c0a-9755-2ce1e6baa0f3/exporter/0.log" Jul 24 15:15:48.977542 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:48.977519 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ljkrw_84400f39-82b9-4c0a-9755-2ce1e6baa0f3/extractor/0.log" Jul 24 15:15:49.038899 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:49.038873 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-kcxtf" Jul 24 15:15:51.540712 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:51.540681 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66d67d68d4-d8wjk_14a5b8b5-c4e2-42e4-912d-d75bae1b1f67/kube-auth-proxy/0.log" Jul 24 15:15:51.703027 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:51.702931 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-9z7ng_3dc9de1c-335d-47d7-b196-e7a634446e89/payload-processing/0.log" Jul 24 15:15:52.251883 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:52.251859 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-696d5956bc-sdwgj_cf8d92c7-5f4c-4d62-acb1-45f967333f92/manager/0.log" Jul 24 15:15:52.278108 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:52.278082 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-696d5956bc-sdwgj_cf8d92c7-5f4c-4d62-acb1-45f967333f92/copy-manifests/0.log" Jul 24 15:15:53.076804 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:53.076759 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66d67d68d4-d8wjk_14a5b8b5-c4e2-42e4-912d-d75bae1b1f67/kube-auth-proxy/0.log" Jul 24 15:15:53.206103 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:53.205995 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-9z7ng_3dc9de1c-335d-47d7-b196-e7a634446e89/payload-processing/0.log" Jul 24 15:15:53.544031 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:53.544005 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-f8c8cf8c7-xljs8_becef3b0-3b58-4588-a033-c3775adeb41d/manager/0.log" Jul 24 15:15:53.592178 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:53.592147 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-88fpl_2dd9b2aa-4f67-4d57-8640-dc374ecae590/openshift-lws-operator/0.log" Jul 24 15:15:58.466723 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:58.466689 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w_972377ec-7ec3-492e-83e7-3a65e365274c/kube-storage-version-migrator-operator/1.log" Jul 24 15:15:58.467597 ip-10-0-140-149 kubenswrapper[2582]: I0724 15:15:58.467572 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-4r57w_972377ec-7ec3-492e-83e7-3a65e365274c/kube-storage-version-migrator-operator/0.log"