Jul 29 18:34:18.647791 ip-10-0-135-190 systemd[1]: Starting Kubernetes Kubelet... Jul 29 18:34:19.036158 ip-10-0-135-190 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 18:34:19.036158 ip-10-0-135-190 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 29 18:34:19.036158 ip-10-0-135-190 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 18:34:19.036158 ip-10-0-135-190 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 29 18:34:19.036158 ip-10-0-135-190 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 18:34:19.036837 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.036230 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 29 18:34:19.040904 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040889 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 18:34:19.040904 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040903 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 18:34:19.040904 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040907 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 18:34:19.041005 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040911 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 18:34:19.041005 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040915 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 18:34:19.041005 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040923 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 18:34:19.041005 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040926 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 18:34:19.041005 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040929 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 18:34:19.041005 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040932 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 18:34:19.041005 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040935 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 18:34:19.041005 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040938 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 18:34:19.041005 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040940 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 18:34:19.041005 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040943 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 18:34:19.041005 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040946 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 18:34:19.041005 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040949 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 18:34:19.041005 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040952 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 18:34:19.041005 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040954 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 18:34:19.041005 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040957 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 18:34:19.041005 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040960 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 18:34:19.041005 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040962 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 18:34:19.041005 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040965 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 18:34:19.041005 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040967 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 18:34:19.041005 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040970 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 18:34:19.041608 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040972 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 18:34:19.041608 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040975 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 18:34:19.041608 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040978 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 18:34:19.041608 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040982 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 18:34:19.041608 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040986 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 18:34:19.041608 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040988 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 18:34:19.041608 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040991 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 18:34:19.041608 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040994 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 18:34:19.041608 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.040997 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 18:34:19.041608 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041000 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 18:34:19.041608 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041002 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 18:34:19.041608 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041005 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 18:34:19.041608 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041007 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 18:34:19.041608 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041010 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 18:34:19.041608 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041013 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 18:34:19.041608 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041016 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 18:34:19.041608 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041019 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 18:34:19.041608 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041022 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 18:34:19.041608 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041024 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 18:34:19.042070 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041027 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 18:34:19.042070 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041035 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 18:34:19.042070 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041037 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 18:34:19.042070 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041040 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 18:34:19.042070 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041042 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 18:34:19.042070 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041045 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 18:34:19.042070 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041048 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 18:34:19.042070 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041050 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 18:34:19.042070 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041053 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 18:34:19.042070 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041056 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 18:34:19.042070 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041058 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 18:34:19.042070 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041061 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 18:34:19.042070 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041063 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 18:34:19.042070 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041066 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 18:34:19.042070 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041069 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 18:34:19.042070 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041072 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 29 18:34:19.042070 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041074 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 18:34:19.042070 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041077 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 18:34:19.042070 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041080 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 18:34:19.042070 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041084 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 18:34:19.042587 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041089 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 18:34:19.042587 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041092 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 18:34:19.042587 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041095 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 18:34:19.042587 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041097 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 18:34:19.042587 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041100 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 18:34:19.042587 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041103 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 18:34:19.042587 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041105 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 18:34:19.042587 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041107 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 18:34:19.042587 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041110 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 18:34:19.042587 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041113 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 18:34:19.042587 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041115 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 18:34:19.042587 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041118 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 18:34:19.042587 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041120 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 18:34:19.042587 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041123 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 18:34:19.042587 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041125 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 18:34:19.042587 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041128 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 18:34:19.042587 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041130 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 18:34:19.042587 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041133 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 18:34:19.042587 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041135 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 18:34:19.043050 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041138 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 18:34:19.043050 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041140 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 18:34:19.043050 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041143 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 18:34:19.043050 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041145 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 18:34:19.043050 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041148 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 18:34:19.043050 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041150 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 18:34:19.043050 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041153 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 18:34:19.043050 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041156 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 18:34:19.043050 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041159 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 18:34:19.043050 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041161 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 18:34:19.043050 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041164 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 18:34:19.043050 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041167 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 18:34:19.043050 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041169 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 18:34:19.043050 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041173 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 18:34:19.043050 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041177 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 18:34:19.043050 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041179 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 18:34:19.043050 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041182 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 18:34:19.043050 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041185 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 18:34:19.043050 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041907 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 18:34:19.043549 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041914 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 18:34:19.043549 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041917 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 18:34:19.043549 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041920 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 18:34:19.043549 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041923 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 18:34:19.043549 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041926 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 18:34:19.043549 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041940 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 18:34:19.043549 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041944 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 18:34:19.043549 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041947 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 18:34:19.043549 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041950 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 18:34:19.043549 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041954 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 18:34:19.043549 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041958 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 18:34:19.043549 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041962 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 18:34:19.043549 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041965 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 18:34:19.043549 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041967 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 18:34:19.043549 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041970 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 18:34:19.043549 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041973 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 18:34:19.043549 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041975 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 18:34:19.043549 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041978 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 18:34:19.043549 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041980 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 18:34:19.043549 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041983 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 18:34:19.044052 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041986 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 18:34:19.044052 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041988 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 18:34:19.044052 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041991 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 18:34:19.044052 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041994 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 18:34:19.044052 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041996 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 18:34:19.044052 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.041999 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 18:34:19.044052 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042002 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 18:34:19.044052 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042004 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 18:34:19.044052 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042007 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 29 18:34:19.044052 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042010 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 18:34:19.044052 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042013 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 18:34:19.044052 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042016 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 18:34:19.044052 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042018 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 18:34:19.044052 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042021 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 18:34:19.044052 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042025 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 18:34:19.044052 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042028 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 18:34:19.044052 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042031 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 18:34:19.044052 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042034 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 18:34:19.044052 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042037 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 18:34:19.044567 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042040 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 18:34:19.044567 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042043 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 18:34:19.044567 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042047 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 18:34:19.044567 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042050 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 18:34:19.044567 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042053 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 18:34:19.044567 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042055 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 18:34:19.044567 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042058 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 18:34:19.044567 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042060 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 18:34:19.044567 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042063 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 18:34:19.044567 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042066 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 18:34:19.044567 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042068 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 18:34:19.044567 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042071 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 18:34:19.044567 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042074 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 18:34:19.044567 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042077 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 18:34:19.044567 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042079 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 18:34:19.044567 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042082 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 18:34:19.044567 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042084 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 18:34:19.044567 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042087 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 18:34:19.044567 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042090 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 18:34:19.044567 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042092 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 18:34:19.045071 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042095 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 18:34:19.045071 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042097 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 18:34:19.045071 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042101 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 18:34:19.045071 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042103 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 18:34:19.045071 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042106 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 18:34:19.045071 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042108 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 18:34:19.045071 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042111 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 18:34:19.045071 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042113 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 18:34:19.045071 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042116 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 18:34:19.045071 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042119 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 18:34:19.045071 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042121 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 18:34:19.045071 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042124 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 18:34:19.045071 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042126 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 18:34:19.045071 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042130 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 18:34:19.045071 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042134 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 18:34:19.045071 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042136 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 18:34:19.045071 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042139 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 18:34:19.045071 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042142 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 18:34:19.045071 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042145 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 18:34:19.045071 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042148 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 18:34:19.045585 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042150 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 18:34:19.045585 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042153 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 18:34:19.045585 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042155 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 18:34:19.045585 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042158 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 18:34:19.045585 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042160 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 18:34:19.045585 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042162 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 18:34:19.045585 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042165 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 18:34:19.045585 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042167 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 18:34:19.045585 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042170 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 18:34:19.045585 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042172 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 18:34:19.045585 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042175 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 18:34:19.045585 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042177 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 18:34:19.045585 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042180 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 18:34:19.045585 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042182 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 18:34:19.045585 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042185 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 18:34:19.045585 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042188 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 18:34:19.045585 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042190 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 18:34:19.045585 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042193 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 18:34:19.045585 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042196 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 18:34:19.045585 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042558 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 18:34:19.046066 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042563 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 18:34:19.046066 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042566 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 18:34:19.046066 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042569 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 18:34:19.046066 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042572 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 18:34:19.046066 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042574 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 18:34:19.046066 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042579 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 18:34:19.046066 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042583 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 18:34:19.046066 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042586 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 18:34:19.046066 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042589 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 18:34:19.046066 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042592 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 18:34:19.046066 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042595 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 18:34:19.046066 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042597 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 18:34:19.046066 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042600 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 18:34:19.046066 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042603 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 18:34:19.046066 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042605 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 18:34:19.046066 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042608 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 18:34:19.046066 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042611 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 18:34:19.046066 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042614 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 18:34:19.046066 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042616 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 18:34:19.046539 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042619 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 18:34:19.046539 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042621 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 18:34:19.046539 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042625 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 18:34:19.046539 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042628 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 18:34:19.046539 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042631 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 18:34:19.046539 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042634 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 18:34:19.046539 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042637 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 18:34:19.046539 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042640 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 18:34:19.046539 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042643 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 18:34:19.046539 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042646 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 18:34:19.046539 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042649 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 18:34:19.046539 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042651 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 18:34:19.046539 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042654 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 18:34:19.046539 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042657 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 18:34:19.046539 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042659 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 18:34:19.046539 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042662 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 18:34:19.046539 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042664 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 18:34:19.046539 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042667 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 18:34:19.046539 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042669 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 18:34:19.047006 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042672 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 18:34:19.047006 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042674 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 18:34:19.047006 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042677 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 18:34:19.047006 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042679 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 18:34:19.047006 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042682 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 18:34:19.047006 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042685 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 18:34:19.047006 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042687 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 29 18:34:19.047006 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042690 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 18:34:19.047006 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042692 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 18:34:19.047006 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042695 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 18:34:19.047006 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042697 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 18:34:19.047006 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042700 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 18:34:19.047006 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042702 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 18:34:19.047006 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042704 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 18:34:19.047006 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042707 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 18:34:19.047006 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042710 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 18:34:19.047006 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042712 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 18:34:19.047006 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042714 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 18:34:19.047006 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042717 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 18:34:19.047006 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042720 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 18:34:19.047489 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042722 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 18:34:19.047489 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042725 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 18:34:19.047489 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042727 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 18:34:19.047489 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042731 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 18:34:19.047489 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042733 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 18:34:19.047489 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042736 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 18:34:19.047489 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042738 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 18:34:19.047489 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042741 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 18:34:19.047489 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042743 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 18:34:19.047489 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042746 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 18:34:19.047489 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042748 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 18:34:19.047489 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042750 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 18:34:19.047489 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042753 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 18:34:19.047489 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042755 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 18:34:19.047489 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042758 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 18:34:19.047489 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042761 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 18:34:19.047489 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042763 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 18:34:19.047489 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042766 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 18:34:19.047489 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042768 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 18:34:19.047489 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042771 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 18:34:19.047991 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042773 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 18:34:19.047991 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042776 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 18:34:19.047991 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042778 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 18:34:19.047991 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042781 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 18:34:19.047991 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042784 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 18:34:19.047991 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042786 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 18:34:19.047991 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042789 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 18:34:19.047991 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042792 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 18:34:19.047991 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042795 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 18:34:19.047991 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042797 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 18:34:19.047991 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042800 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 18:34:19.047991 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042802 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 18:34:19.047991 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042805 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 18:34:19.047991 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042809 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 18:34:19.047991 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042812 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 18:34:19.047991 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042815 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 18:34:19.047991 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042818 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 18:34:19.047991 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042820 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 18:34:19.047991 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042822 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 18:34:19.047991 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.042825 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 18:34:19.048476 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042891 2562 flags.go:64] FLAG: --address="0.0.0.0" Jul 29 18:34:19.048476 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042898 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 29 18:34:19.048476 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042904 2562 flags.go:64] FLAG: --anonymous-auth="true" Jul 29 18:34:19.048476 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042908 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 29 18:34:19.048476 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042912 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 29 18:34:19.048476 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042916 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 29 18:34:19.048476 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042920 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 29 18:34:19.048476 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042926 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 29 18:34:19.048476 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042929 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 29 18:34:19.048476 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042932 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 29 18:34:19.048476 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042935 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 29 18:34:19.048476 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042939 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 29 18:34:19.048476 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042942 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 29 18:34:19.048476 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042945 2562 flags.go:64] FLAG: --cgroup-root="" Jul 29 18:34:19.048476 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042948 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 29 18:34:19.048476 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042950 2562 flags.go:64] FLAG: --client-ca-file="" Jul 29 18:34:19.048476 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042953 2562 flags.go:64] FLAG: --cloud-provider="external" Jul 29 18:34:19.048476 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042956 2562 flags.go:64] FLAG: --cluster-dns="[]" Jul 29 18:34:19.048476 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042960 2562 flags.go:64] FLAG: --cluster-domain="" Jul 29 18:34:19.048476 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042963 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 29 18:34:19.048476 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042966 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 29 18:34:19.048476 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042969 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 29 18:34:19.048476 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042972 2562 flags.go:64] FLAG: --container-log-max-files="5" Jul 29 18:34:19.048476 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042976 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 29 18:34:19.049064 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042979 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 29 18:34:19.049064 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042982 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 29 18:34:19.049064 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042986 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 29 18:34:19.049064 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042989 2562 flags.go:64] FLAG: --contention-profiling="false" Jul 29 18:34:19.049064 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042993 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 29 18:34:19.049064 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042995 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 29 18:34:19.049064 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.042998 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 29 18:34:19.049064 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043001 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 29 18:34:19.049064 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043005 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 29 18:34:19.049064 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043008 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 29 18:34:19.049064 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043011 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 29 18:34:19.049064 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043014 2562 flags.go:64] FLAG: --enable-load-reader="false" Jul 29 18:34:19.049064 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043017 2562 flags.go:64] FLAG: --enable-server="true" Jul 29 18:34:19.049064 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043020 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 29 18:34:19.049064 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043024 2562 flags.go:64] FLAG: --event-burst="100" Jul 29 18:34:19.049064 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043028 2562 flags.go:64] FLAG: --event-qps="50" Jul 29 18:34:19.049064 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043031 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 29 18:34:19.049064 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043033 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 29 18:34:19.049064 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043036 2562 flags.go:64] FLAG: --eviction-hard="" Jul 29 18:34:19.049064 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043040 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 29 18:34:19.049064 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043043 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 29 18:34:19.049064 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043046 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 29 18:34:19.049064 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043049 2562 flags.go:64] FLAG: --eviction-soft="" Jul 29 18:34:19.049064 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043052 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 29 18:34:19.049064 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043055 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 29 18:34:19.049730 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043058 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 29 18:34:19.049730 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043060 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jul 29 18:34:19.049730 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043063 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 29 18:34:19.049730 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043066 2562 flags.go:64] FLAG: --fail-swap-on="true" Jul 29 18:34:19.049730 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043069 2562 flags.go:64] FLAG: --feature-gates="" Jul 29 18:34:19.049730 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043072 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jul 29 18:34:19.049730 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043075 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 29 18:34:19.049730 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043078 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 29 18:34:19.049730 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043081 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 29 18:34:19.049730 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043086 2562 flags.go:64] FLAG: --healthz-port="10248" Jul 29 18:34:19.049730 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043089 2562 flags.go:64] FLAG: --help="false" Jul 29 18:34:19.049730 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043092 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-135-190.ec2.internal" Jul 29 18:34:19.049730 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043096 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 29 18:34:19.049730 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043099 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jul 29 18:34:19.049730 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043102 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 29 18:34:19.049730 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043105 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 29 18:34:19.049730 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043108 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 29 18:34:19.049730 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043111 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 29 18:34:19.049730 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043114 2562 flags.go:64] FLAG: --image-service-endpoint="" Jul 29 18:34:19.049730 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043117 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 29 18:34:19.049730 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043119 2562 flags.go:64] FLAG: --kube-api-burst="100" Jul 29 18:34:19.049730 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043122 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 29 18:34:19.049730 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043126 2562 flags.go:64] FLAG: --kube-api-qps="50" Jul 29 18:34:19.049730 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043129 2562 flags.go:64] FLAG: --kube-reserved="" Jul 29 18:34:19.050312 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043132 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 29 18:34:19.050312 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043135 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 29 18:34:19.050312 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043138 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jul 29 18:34:19.050312 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043140 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 29 18:34:19.050312 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043143 2562 flags.go:64] FLAG: --lock-file="" Jul 29 18:34:19.050312 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043146 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 29 18:34:19.050312 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043149 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 29 18:34:19.050312 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043151 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 29 18:34:19.050312 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043156 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jul 29 18:34:19.050312 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043159 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 29 18:34:19.050312 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043162 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jul 29 18:34:19.050312 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043165 2562 flags.go:64] FLAG: --logging-format="text" Jul 29 18:34:19.050312 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043168 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 29 18:34:19.050312 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043171 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 29 18:34:19.050312 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043174 2562 flags.go:64] FLAG: --manifest-url="" Jul 29 18:34:19.050312 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043176 2562 flags.go:64] FLAG: --manifest-url-header="" Jul 29 18:34:19.050312 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043180 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 29 18:34:19.050312 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043185 2562 flags.go:64] FLAG: --max-open-files="1000000" Jul 29 18:34:19.050312 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043188 2562 flags.go:64] FLAG: --max-pods="110" Jul 29 18:34:19.050312 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043191 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 29 18:34:19.050312 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043194 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 29 18:34:19.050312 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043198 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jul 29 18:34:19.050312 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043200 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 29 18:34:19.050312 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043203 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 29 18:34:19.050312 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043206 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 29 18:34:19.050933 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043209 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 29 18:34:19.050933 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043215 2562 flags.go:64] FLAG: --node-status-max-images="50" Jul 29 18:34:19.050933 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043218 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 29 18:34:19.050933 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043221 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jul 29 18:34:19.050933 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043224 2562 flags.go:64] FLAG: --pod-cidr="" Jul 29 18:34:19.050933 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043229 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 29 18:34:19.050933 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043234 2562 flags.go:64] FLAG: --pod-manifest-path="" Jul 29 18:34:19.050933 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043237 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jul 29 18:34:19.050933 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043240 2562 flags.go:64] FLAG: --pods-per-core="0" Jul 29 18:34:19.050933 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043243 2562 flags.go:64] FLAG: --port="10250" Jul 29 18:34:19.050933 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043246 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 29 18:34:19.050933 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043249 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02b2df8d57fbbc751" Jul 29 18:34:19.050933 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043252 2562 flags.go:64] FLAG: --qos-reserved="" Jul 29 18:34:19.050933 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043255 2562 flags.go:64] FLAG: --read-only-port="10255" Jul 29 18:34:19.050933 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043257 2562 flags.go:64] FLAG: --register-node="true" Jul 29 18:34:19.050933 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043260 2562 flags.go:64] FLAG: --register-with-taints="" Jul 29 18:34:19.050933 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043264 2562 flags.go:64] FLAG: --registry-burst="10" Jul 29 18:34:19.050933 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043267 2562 flags.go:64] FLAG: --registry-qps="5" Jul 29 18:34:19.050933 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043269 2562 flags.go:64] FLAG: --reserved-cpus="" Jul 29 18:34:19.050933 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043272 2562 flags.go:64] FLAG: --reserved-memory="" Jul 29 18:34:19.050933 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043276 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 29 18:34:19.050933 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043279 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 29 18:34:19.050933 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043282 2562 flags.go:64] FLAG: --rotate-certificates="false" Jul 29 18:34:19.050933 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043285 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 29 18:34:19.050933 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043289 2562 flags.go:64] FLAG: --runonce="false" Jul 29 18:34:19.051554 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043291 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 29 18:34:19.051554 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043294 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 29 18:34:19.051554 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043298 2562 flags.go:64] FLAG: --seccomp-default="false" Jul 29 18:34:19.051554 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043300 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 29 18:34:19.051554 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043304 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 29 18:34:19.051554 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043307 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 29 18:34:19.051554 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043309 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 29 18:34:19.051554 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043312 2562 flags.go:64] FLAG: --storage-driver-password="root" Jul 29 18:34:19.051554 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043315 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jul 29 18:34:19.051554 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043318 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jul 29 18:34:19.051554 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043321 2562 flags.go:64] FLAG: --storage-driver-user="root" Jul 29 18:34:19.051554 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043324 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 29 18:34:19.051554 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043327 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 29 18:34:19.051554 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043331 2562 flags.go:64] FLAG: --system-cgroups="" Jul 29 18:34:19.051554 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043334 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 29 18:34:19.051554 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043339 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 29 18:34:19.051554 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043342 2562 flags.go:64] FLAG: --tls-cert-file="" Jul 29 18:34:19.051554 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043344 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 29 18:34:19.051554 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043348 2562 flags.go:64] FLAG: --tls-min-version="" Jul 29 18:34:19.051554 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043351 2562 flags.go:64] FLAG: --tls-private-key-file="" Jul 29 18:34:19.051554 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043353 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jul 29 18:34:19.051554 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043367 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 29 18:34:19.051554 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043370 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jul 29 18:34:19.051554 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043374 2562 flags.go:64] FLAG: --v="2" Jul 29 18:34:19.051554 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043378 2562 flags.go:64] FLAG: --version="false" Jul 29 18:34:19.052227 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043382 2562 flags.go:64] FLAG: --vmodule="" Jul 29 18:34:19.052227 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043385 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 29 18:34:19.052227 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.043388 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 29 18:34:19.052227 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043501 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 18:34:19.052227 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043504 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 18:34:19.052227 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043507 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 18:34:19.052227 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043523 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 18:34:19.052227 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043526 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 18:34:19.052227 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043529 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 18:34:19.052227 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043531 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 18:34:19.052227 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043534 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 18:34:19.052227 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043537 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 18:34:19.052227 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043541 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 18:34:19.052227 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043545 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 18:34:19.052227 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043548 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 18:34:19.052227 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043551 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 18:34:19.052227 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043553 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 18:34:19.052227 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043556 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 18:34:19.052227 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043559 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 18:34:19.052227 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043562 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 18:34:19.053080 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043566 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 18:34:19.053080 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043569 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 18:34:19.053080 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043571 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 18:34:19.053080 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043574 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 18:34:19.053080 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043577 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 18:34:19.053080 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043579 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 18:34:19.053080 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043582 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 18:34:19.053080 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043585 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 18:34:19.053080 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043587 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 18:34:19.053080 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043590 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 18:34:19.053080 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043592 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 18:34:19.053080 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043595 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 18:34:19.053080 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043597 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 18:34:19.053080 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043600 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 18:34:19.053080 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043603 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 18:34:19.053080 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043605 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 18:34:19.053080 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043608 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 18:34:19.053080 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043610 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 18:34:19.053080 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043613 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 18:34:19.053080 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043616 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 18:34:19.053632 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043618 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 18:34:19.053632 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043621 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 18:34:19.053632 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043623 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 18:34:19.053632 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043626 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 18:34:19.053632 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043629 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 18:34:19.053632 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043631 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 18:34:19.053632 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043634 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 18:34:19.053632 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043636 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 18:34:19.053632 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043639 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 18:34:19.053632 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043642 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 18:34:19.053632 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043644 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 18:34:19.053632 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043647 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 18:34:19.053632 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043651 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 18:34:19.053632 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043653 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 18:34:19.053632 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043656 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 18:34:19.053632 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043659 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 18:34:19.053632 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043661 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 18:34:19.053632 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043664 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 18:34:19.053632 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043666 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 18:34:19.053632 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043669 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 18:34:19.054142 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043672 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 18:34:19.054142 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043676 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 18:34:19.054142 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043680 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 18:34:19.054142 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043683 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 18:34:19.054142 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043686 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 18:34:19.054142 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043689 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 18:34:19.054142 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043691 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 18:34:19.054142 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043694 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 18:34:19.054142 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043696 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 18:34:19.054142 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043699 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 18:34:19.054142 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043701 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 18:34:19.054142 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043704 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 18:34:19.054142 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043707 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 18:34:19.054142 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043709 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 18:34:19.054142 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043712 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 18:34:19.054142 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043714 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 18:34:19.054142 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043717 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 18:34:19.054142 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043719 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 18:34:19.054142 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043722 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 29 18:34:19.054629 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043725 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 18:34:19.054629 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043727 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 18:34:19.054629 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043730 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 18:34:19.054629 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043732 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 18:34:19.054629 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043735 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 18:34:19.054629 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043739 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 18:34:19.054629 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043741 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 18:34:19.054629 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043744 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 18:34:19.054629 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043747 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 18:34:19.054629 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043749 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 18:34:19.054629 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043751 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 18:34:19.054629 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043754 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 18:34:19.054629 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043757 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 18:34:19.054629 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043759 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 18:34:19.054629 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043763 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 18:34:19.054629 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043766 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 18:34:19.054629 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043769 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 18:34:19.054629 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043772 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 18:34:19.054629 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043775 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 18:34:19.055090 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043778 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 18:34:19.055090 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043780 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 18:34:19.055090 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043783 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 18:34:19.055090 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.043785 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 18:34:19.055090 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.044876 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 18:34:19.055090 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.053778 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 29 18:34:19.055090 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.053794 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 29 18:34:19.055090 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.054598 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 29 18:34:19.055090 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.054605 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 29 18:34:19.055090 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054659 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 18:34:19.055090 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054665 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 18:34:19.055090 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054668 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 18:34:19.055090 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054671 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 18:34:19.055090 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054674 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 18:34:19.055090 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054678 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 18:34:19.055473 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054681 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 18:34:19.055473 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054683 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 18:34:19.055473 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054686 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 18:34:19.055473 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054689 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 18:34:19.055473 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054693 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 18:34:19.055473 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054696 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 18:34:19.055473 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054699 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 18:34:19.055473 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054701 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 18:34:19.055473 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054704 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 18:34:19.055473 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054707 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 18:34:19.055473 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054710 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 18:34:19.055473 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054713 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 18:34:19.055473 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054716 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 18:34:19.055473 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054720 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 18:34:19.055473 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054723 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 18:34:19.055473 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054727 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 18:34:19.055473 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054730 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 29 18:34:19.055473 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054733 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 18:34:19.055473 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054736 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 18:34:19.055952 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054739 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 18:34:19.055952 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054742 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 18:34:19.055952 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054744 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 18:34:19.055952 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054747 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 18:34:19.055952 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054750 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 18:34:19.055952 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054753 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 18:34:19.055952 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054755 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 18:34:19.055952 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054758 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 18:34:19.055952 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054761 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 18:34:19.055952 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054763 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 18:34:19.055952 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054766 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 18:34:19.055952 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054768 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 18:34:19.055952 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054771 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 18:34:19.055952 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054773 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 18:34:19.055952 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054776 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 18:34:19.055952 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054778 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 18:34:19.055952 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054780 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 18:34:19.055952 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054783 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 18:34:19.055952 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054786 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 18:34:19.056408 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054789 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 18:34:19.056408 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054791 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 18:34:19.056408 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054794 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 18:34:19.056408 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054797 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 18:34:19.056408 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054799 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 18:34:19.056408 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054802 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 18:34:19.056408 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054804 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 18:34:19.056408 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054807 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 18:34:19.056408 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054809 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 18:34:19.056408 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054812 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 18:34:19.056408 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054814 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 18:34:19.056408 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054817 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 18:34:19.056408 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054820 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 18:34:19.056408 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054822 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 18:34:19.056408 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054825 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 18:34:19.056408 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054827 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 18:34:19.056408 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054830 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 18:34:19.056408 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054833 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 18:34:19.056408 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054836 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 18:34:19.056408 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054839 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 18:34:19.056914 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054841 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 18:34:19.056914 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054844 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 18:34:19.056914 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054846 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 18:34:19.056914 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054849 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 18:34:19.056914 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054851 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 18:34:19.056914 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054854 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 18:34:19.056914 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054857 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 18:34:19.056914 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054859 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 18:34:19.056914 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054862 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 18:34:19.056914 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054864 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 18:34:19.056914 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054867 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 18:34:19.056914 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054869 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 18:34:19.056914 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054872 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 18:34:19.056914 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054874 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 18:34:19.056914 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054877 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 18:34:19.056914 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054880 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 18:34:19.056914 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054882 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 18:34:19.056914 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054885 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 18:34:19.056914 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054887 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 18:34:19.056914 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054890 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 18:34:19.057416 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054892 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 18:34:19.057416 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054895 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 18:34:19.057416 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054897 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 18:34:19.057416 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054900 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 18:34:19.057416 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054902 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 18:34:19.057416 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054905 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 18:34:19.057416 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054907 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 18:34:19.057416 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054911 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 18:34:19.057416 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054914 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 18:34:19.057416 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054917 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 18:34:19.057416 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054920 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 18:34:19.057416 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054923 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 18:34:19.057416 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054925 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 18:34:19.057416 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054928 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 18:34:19.057416 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.054930 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 18:34:19.057870 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.054935 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 18:34:19.057870 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055055 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 18:34:19.057870 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055061 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 18:34:19.057870 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055064 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 18:34:19.057870 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055067 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 18:34:19.057870 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055070 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 18:34:19.057870 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055072 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 18:34:19.057870 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055075 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 18:34:19.057870 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055077 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 18:34:19.057870 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055080 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 18:34:19.057870 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055083 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 18:34:19.057870 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055085 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 18:34:19.057870 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055088 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 18:34:19.057870 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055091 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 18:34:19.057870 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055094 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 18:34:19.058258 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055097 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 18:34:19.058258 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055099 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 18:34:19.058258 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055102 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 18:34:19.058258 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055105 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 18:34:19.058258 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055109 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 18:34:19.058258 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055111 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 18:34:19.058258 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055114 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 18:34:19.058258 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055116 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 18:34:19.058258 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055119 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 18:34:19.058258 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055121 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 18:34:19.058258 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055125 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 18:34:19.058258 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055128 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 18:34:19.058258 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055130 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 18:34:19.058258 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055133 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 18:34:19.058258 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055135 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 18:34:19.058258 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055138 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 18:34:19.058258 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055141 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 18:34:19.058258 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055143 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 18:34:19.058258 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055146 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 18:34:19.058258 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055149 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 18:34:19.058750 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055151 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 18:34:19.058750 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055154 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 18:34:19.058750 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055156 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 18:34:19.058750 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055159 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 18:34:19.058750 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055162 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 18:34:19.058750 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055165 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 18:34:19.058750 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055168 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 18:34:19.058750 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055171 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 18:34:19.058750 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055173 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 29 18:34:19.058750 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055176 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 18:34:19.058750 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055178 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 18:34:19.058750 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055181 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 18:34:19.058750 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055184 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 18:34:19.058750 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055187 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 18:34:19.058750 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055189 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 18:34:19.058750 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055192 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 18:34:19.058750 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055194 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 18:34:19.058750 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055197 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 18:34:19.058750 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055199 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 18:34:19.058750 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055202 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 18:34:19.059228 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055204 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 18:34:19.059228 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055207 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 18:34:19.059228 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055209 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 18:34:19.059228 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055212 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 18:34:19.059228 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055215 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 18:34:19.059228 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055218 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 18:34:19.059228 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055220 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 18:34:19.059228 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055223 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 18:34:19.059228 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055226 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 18:34:19.059228 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055228 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 18:34:19.059228 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055231 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 18:34:19.059228 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055233 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 18:34:19.059228 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055236 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 18:34:19.059228 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055238 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 18:34:19.059228 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055240 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 18:34:19.059228 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055243 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 18:34:19.059228 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055245 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 18:34:19.059228 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055248 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 18:34:19.059228 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055250 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 18:34:19.059228 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055253 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 18:34:19.059717 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055255 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 18:34:19.059717 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055257 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 18:34:19.059717 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055260 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 18:34:19.059717 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055262 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 18:34:19.059717 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055265 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 18:34:19.059717 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055268 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 18:34:19.059717 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055271 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 18:34:19.059717 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055275 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 18:34:19.059717 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055278 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 18:34:19.059717 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055281 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 18:34:19.059717 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055284 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 18:34:19.059717 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055287 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 18:34:19.059717 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055289 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 18:34:19.059717 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055292 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 18:34:19.059717 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055295 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 18:34:19.059717 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055298 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 18:34:19.059717 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055301 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 18:34:19.059717 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055303 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 18:34:19.059717 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055306 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 18:34:19.059717 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055309 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 18:34:19.060208 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055311 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 18:34:19.060208 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055314 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 18:34:19.060208 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055318 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 18:34:19.060208 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055321 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 18:34:19.060208 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:19.055324 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 18:34:19.060208 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.055328 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 18:34:19.060208 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.055429 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jul 29 18:34:19.060208 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.059372 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 29 18:34:19.060528 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.060507 2562 server.go:1019] "Starting client certificate rotation" Jul 29 18:34:19.060638 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.060621 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 18:34:19.060673 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.060663 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 18:34:19.063054 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.063041 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 18:34:19.066802 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.066784 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 18:34:19.079559 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.079539 2562 log.go:25] "Validated CRI v1 runtime API" Jul 29 18:34:19.082271 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.082257 2562 log.go:25] "Validated CRI v1 image API" Jul 29 18:34:19.083069 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.083052 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 29 18:34:19.086084 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.086069 2562 fs.go:135] Filesystem UUIDs: map[075030db-9fd2-443a-b11d-321b99a30adc:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b6f95b65-0849-4859-80c0-72ffc5de3640:/dev/nvme0n1p4] Jul 29 18:34:19.086149 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.086084 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 29 18:34:19.091628 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.091505 2562 manager.go:216] Machine: {Timestamp:2026-07-29 18:34:19.089452119 +0000 UTC m=+0.331629266 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100137 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec240597c8d60ead97a9fe52491ed8ba SystemUUID:ec240597-c8d6-0ead-97a9-fe52491ed8ba BootID:4e4bdff1-4b4f-40da-962e-fa6a5f51f4c0 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:16:01:60:1b:57 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:16:01:60:1b:57 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:50:6b:1b:6a:f9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 29 18:34:19.091628 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.091626 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 29 18:34:19.091730 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.091697 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 29 18:34:19.094244 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.094224 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 29 18:34:19.094368 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.094247 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-190.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 29 18:34:19.094873 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.094862 2562 topology_manager.go:138] "Creating topology manager with none policy" Jul 29 18:34:19.094905 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.094877 2562 container_manager_linux.go:309] "Creating device plugin manager" Jul 29 18:34:19.094905 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.094884 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 18:34:19.095508 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.095497 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 18:34:19.096203 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.096189 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 29 18:34:19.097735 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.097724 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 29 18:34:19.097849 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.097840 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 29 18:34:19.097889 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.097868 2562 kubelet.go:486] "Attempting to sync node with API server" Jul 29 18:34:19.097889 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.097877 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 29 18:34:19.097889 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.097889 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 29 18:34:19.098001 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.097898 2562 kubelet.go:398] "Adding apiserver pod source" Jul 29 18:34:19.098001 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.097906 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 29 18:34:19.099230 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.099205 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 18:34:19.099318 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.099245 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 18:34:19.100335 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.100316 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 18:34:19.102387 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.102362 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 29 18:34:19.103988 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.103972 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 29 18:34:19.104046 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.104002 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 29 18:34:19.105424 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.105410 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 29 18:34:19.105482 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.105429 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 29 18:34:19.105482 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.105435 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 29 18:34:19.105482 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.105441 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 29 18:34:19.105482 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.105449 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 29 18:34:19.105482 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.105454 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 29 18:34:19.105482 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.105462 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 29 18:34:19.105482 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.105469 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 29 18:34:19.105482 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.105479 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 29 18:34:19.105482 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.105485 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 29 18:34:19.105736 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.105495 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 29 18:34:19.105736 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.105500 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 29 18:34:19.106793 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.106782 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 29 18:34:19.106793 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.106793 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 29 18:34:19.109914 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.109901 2562 server.go:1268] "Started kubelet" Jul 29 18:34:19.109998 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.109974 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 29 18:34:19.110048 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.109970 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 29 18:34:19.110048 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.110027 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 29 18:34:19.110623 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:19.110595 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 29 18:34:19.110722 ip-10-0-135-190 systemd[1]: Started Kubernetes Kubelet. Jul 29 18:34:19.110883 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.110715 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-190.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 29 18:34:19.110883 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:19.110841 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-190.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 29 18:34:19.112247 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.112223 2562 server.go:310] "Adding debug handlers to kubelet server" Jul 29 18:34:19.114215 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.114196 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 29 18:34:19.115791 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:19.114643 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-190.ec2.internal.18c6d66b68f780ca default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-190.ec2.internal,UID:ip-10-0-135-190.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-190.ec2.internal,},FirstTimestamp:2026-07-29 18:34:19.109875914 +0000 UTC m=+0.352053061,LastTimestamp:2026-07-29 18:34:19.109875914 +0000 UTC m=+0.352053061,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-190.ec2.internal,}" Jul 29 18:34:19.116864 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:19.116846 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 29 18:34:19.119828 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.119807 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 29 18:34:19.119828 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.119822 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 29 18:34:19.119980 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:19.119963 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-190.ec2.internal\" not found" Jul 29 18:34:19.120712 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.120695 2562 factory.go:55] Registering systemd factory Jul 29 18:34:19.120794 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.120723 2562 factory.go:223] Registration of the systemd container factory successfully Jul 29 18:34:19.120794 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.120698 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 29 18:34:19.120794 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.120702 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 29 18:34:19.120794 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.120782 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 29 18:34:19.120995 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.120853 2562 reconstruct.go:97] "Volume reconstruction finished" Jul 29 18:34:19.120995 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.120863 2562 reconciler.go:29] "Reconciler: start to sync state" Jul 29 18:34:19.120995 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.120950 2562 factory.go:153] Registering CRI-O factory Jul 29 18:34:19.120995 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.120965 2562 factory.go:223] Registration of the crio container factory successfully Jul 29 18:34:19.121144 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.121022 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 29 18:34:19.121144 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.121048 2562 factory.go:103] Registering Raw factory Jul 29 18:34:19.121144 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.121063 2562 manager.go:1196] Started watching for new ooms in manager Jul 29 18:34:19.121791 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.121776 2562 manager.go:349] Starting recovery of all containers Jul 29 18:34:19.123038 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:19.123011 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 29 18:34:19.123133 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:19.123068 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-190.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 29 18:34:19.134395 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.134276 2562 manager.go:354] Recovery completed Jul 29 18:34:19.135015 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.134998 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lvr75" Jul 29 18:34:19.138640 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.138627 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 18:34:19.140601 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.140562 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-190.ec2.internal" event="NodeHasSufficientMemory" Jul 29 18:34:19.140601 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.140591 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-190.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 18:34:19.140601 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.140601 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-190.ec2.internal" event="NodeHasSufficientPID" Jul 29 18:34:19.141165 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.141148 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 29 18:34:19.141165 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.141159 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 18:34:19.141165 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.141164 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 29 18:34:19.141334 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.141185 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 29 18:34:19.141902 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.141886 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-190.ec2.internal" event="NodeHasSufficientMemory" Jul 29 18:34:19.142000 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.141919 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-190.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 18:34:19.142000 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.141936 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-190.ec2.internal" event="NodeHasSufficientPID" Jul 29 18:34:19.143616 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.143603 2562 policy_none.go:49] "None policy: Start" Jul 29 18:34:19.143678 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.143620 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 29 18:34:19.143678 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.143632 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 29 18:34:19.144632 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.144621 2562 policy_none.go:47] "Start" Jul 29 18:34:19.145035 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.145017 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lvr75" Jul 29 18:34:19.150309 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:19.150238 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-190.ec2.internal.18c6d66b6acbf6d6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-190.ec2.internal,UID:ip-10-0-135-190.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-190.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-190.ec2.internal,},FirstTimestamp:2026-07-29 18:34:19.140576982 +0000 UTC m=+0.382754132,LastTimestamp:2026-07-29 18:34:19.140576982 +0000 UTC m=+0.382754132,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-190.ec2.internal,}" Jul 29 18:34:19.180150 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.180137 2562 manager.go:337] "Starting Device Plugin manager" Jul 29 18:34:19.180232 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:19.180173 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 29 18:34:19.180232 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.180183 2562 server.go:87] "Starting device plugin registration server" Jul 29 18:34:19.180431 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.180418 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 29 18:34:19.180466 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.180434 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 29 18:34:19.180595 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.180570 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 29 18:34:19.180713 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.180661 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 29 18:34:19.180713 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.180670 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 29 18:34:19.181159 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:19.181134 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 29 18:34:19.181228 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:19.181198 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-190.ec2.internal\" not found" Jul 29 18:34:19.280889 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.280862 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 18:34:19.281841 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.281827 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-190.ec2.internal" event="NodeHasSufficientMemory" Jul 29 18:34:19.281893 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.281857 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-190.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 18:34:19.281893 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.281867 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-190.ec2.internal" event="NodeHasSufficientPID" Jul 29 18:34:19.281893 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.281894 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-190.ec2.internal" Jul 29 18:34:19.289265 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.289228 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-190.ec2.internal" Jul 29 18:34:19.289265 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:19.289248 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-190.ec2.internal\": node \"ip-10-0-135-190.ec2.internal\" not found" Jul 29 18:34:19.317759 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:19.317734 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-190.ec2.internal\" not found" Jul 29 18:34:19.342793 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.342752 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 29 18:34:19.344187 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.344171 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 29 18:34:19.344284 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.344208 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 29 18:34:19.344284 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.344229 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jul 29 18:34:19.344284 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:19.344264 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 29 18:34:19.346948 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.346923 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 18:34:19.417938 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:19.417892 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-190.ec2.internal\" not found" Jul 29 18:34:19.445346 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.445317 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-190.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-190.ec2.internal"] Jul 29 18:34:19.445413 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.445401 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 18:34:19.446400 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.446384 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-190.ec2.internal" event="NodeHasSufficientMemory" Jul 29 18:34:19.446473 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.446415 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-190.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 18:34:19.446473 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.446431 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-190.ec2.internal" event="NodeHasSufficientPID" Jul 29 18:34:19.447609 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.447590 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 18:34:19.447744 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.447729 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-190.ec2.internal" Jul 29 18:34:19.447805 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.447765 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 18:34:19.448429 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.448412 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-190.ec2.internal" event="NodeHasSufficientMemory" Jul 29 18:34:19.448529 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.448436 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-190.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 18:34:19.448529 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.448448 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-190.ec2.internal" event="NodeHasSufficientPID" Jul 29 18:34:19.448529 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.448437 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-190.ec2.internal" event="NodeHasSufficientMemory" Jul 29 18:34:19.448634 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.448558 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-190.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 18:34:19.448634 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.448572 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-190.ec2.internal" event="NodeHasSufficientPID" Jul 29 18:34:19.449636 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.449620 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-190.ec2.internal" Jul 29 18:34:19.449695 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.449648 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 18:34:19.450284 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.450267 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-190.ec2.internal" event="NodeHasSufficientMemory" Jul 29 18:34:19.450354 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.450293 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-190.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 18:34:19.450354 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.450306 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-190.ec2.internal" event="NodeHasSufficientPID" Jul 29 18:34:19.473317 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:19.473295 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-190.ec2.internal\" not found" node="ip-10-0-135-190.ec2.internal" Jul 29 18:34:19.478059 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:19.478044 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-190.ec2.internal\" not found" node="ip-10-0-135-190.ec2.internal" Jul 29 18:34:19.518590 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:19.518571 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-190.ec2.internal\" not found" Jul 29 18:34:19.523122 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.523105 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d62cc98f7984cd1fdc5d04ac3167f99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-190.ec2.internal\" (UID: \"1d62cc98f7984cd1fdc5d04ac3167f99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-190.ec2.internal" Jul 29 18:34:19.523182 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.523130 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d62cc98f7984cd1fdc5d04ac3167f99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-190.ec2.internal\" (UID: \"1d62cc98f7984cd1fdc5d04ac3167f99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-190.ec2.internal" Jul 29 18:34:19.523182 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.523147 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/305d6500b5831efe5fa1deaa8b353f63-config\") pod \"kube-apiserver-proxy-ip-10-0-135-190.ec2.internal\" (UID: \"305d6500b5831efe5fa1deaa8b353f63\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-190.ec2.internal" Jul 29 18:34:19.619831 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:19.619758 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-190.ec2.internal\" not found" Jul 29 18:34:19.624387 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.624369 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d62cc98f7984cd1fdc5d04ac3167f99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-190.ec2.internal\" (UID: \"1d62cc98f7984cd1fdc5d04ac3167f99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-190.ec2.internal" Jul 29 18:34:19.624460 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.624396 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d62cc98f7984cd1fdc5d04ac3167f99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-190.ec2.internal\" (UID: \"1d62cc98f7984cd1fdc5d04ac3167f99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-190.ec2.internal" Jul 29 18:34:19.624460 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.624414 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/305d6500b5831efe5fa1deaa8b353f63-config\") pod \"kube-apiserver-proxy-ip-10-0-135-190.ec2.internal\" (UID: \"305d6500b5831efe5fa1deaa8b353f63\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-190.ec2.internal" Jul 29 18:34:19.624460 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.624446 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/305d6500b5831efe5fa1deaa8b353f63-config\") pod \"kube-apiserver-proxy-ip-10-0-135-190.ec2.internal\" (UID: \"305d6500b5831efe5fa1deaa8b353f63\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-190.ec2.internal" Jul 29 18:34:19.624460 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.624456 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d62cc98f7984cd1fdc5d04ac3167f99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-190.ec2.internal\" (UID: \"1d62cc98f7984cd1fdc5d04ac3167f99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-190.ec2.internal" Jul 29 18:34:19.624628 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.624461 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d62cc98f7984cd1fdc5d04ac3167f99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-190.ec2.internal\" (UID: \"1d62cc98f7984cd1fdc5d04ac3167f99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-190.ec2.internal" Jul 29 18:34:19.727172 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:19.727132 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-190.ec2.internal\" not found" Jul 29 18:34:19.779260 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.779236 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-190.ec2.internal" Jul 29 18:34:19.781517 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.781499 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-190.ec2.internal" Jul 29 18:34:19.828243 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:19.828202 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-190.ec2.internal\" not found" Jul 29 18:34:19.928344 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:19.928264 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-190.ec2.internal\" not found" Jul 29 18:34:19.987595 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:19.987571 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 18:34:20.028557 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:20.028508 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-190.ec2.internal\" not found" Jul 29 18:34:20.051459 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:20.051434 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 18:34:20.060372 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:20.060351 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 29 18:34:20.060510 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:20.060490 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 18:34:20.060591 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:20.060535 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 18:34:20.060591 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:20.060535 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 18:34:20.129349 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:20.129315 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-190.ec2.internal\" not found" Jul 29 18:34:20.149489 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:20.149454 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 18:29:19 +0000 UTC" deadline="2028-04-14 19:04:09.576902374 +0000 UTC" Jul 29 18:34:20.149489 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:20.149485 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15000h29m49.427421003s" Jul 29 18:34:20.230179 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:20.230118 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-190.ec2.internal\" not found" Jul 29 18:34:20.328071 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:20.328045 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 18:34:20.329256 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:20.329228 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-190.ec2.internal" event="NodeHasSufficientMemory" Jul 29 18:34:20.329378 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:20.329276 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-190.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 18:34:20.329378 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:20.329293 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-190.ec2.internal" event="NodeHasSufficientPID" Jul 29 18:34:20.330408 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:20.330391 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-190.ec2.internal\" not found" Jul 29 18:34:20.360727 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:20.360685 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d62cc98f7984cd1fdc5d04ac3167f99.slice/crio-e7a766a647f61abf27cb682ff664562252416d15662b8753335ab4ac454d6b9a WatchSource:0}: Error finding container e7a766a647f61abf27cb682ff664562252416d15662b8753335ab4ac454d6b9a: Status 404 returned error can't find the container with id e7a766a647f61abf27cb682ff664562252416d15662b8753335ab4ac454d6b9a Jul 29 18:34:20.361138 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:20.361116 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod305d6500b5831efe5fa1deaa8b353f63.slice/crio-7915800a707c1b95ec1d937cdca1820a831017619b6b688d4e64d01c6c3645e5 WatchSource:0}: Error finding container 7915800a707c1b95ec1d937cdca1820a831017619b6b688d4e64d01c6c3645e5: Status 404 returned error can't find the container with id 7915800a707c1b95ec1d937cdca1820a831017619b6b688d4e64d01c6c3645e5 Jul 29 18:34:20.365444 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:20.365431 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 18:34:20.430524 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:20.430485 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-190.ec2.internal\" not found" Jul 29 18:34:20.530845 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:20.530778 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-190.ec2.internal\" not found" Jul 29 18:34:20.606315 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:20.606292 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 18:34:20.620407 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:20.620382 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-190.ec2.internal" Jul 29 18:34:20.633010 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:20.632989 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 18:34:20.634581 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:20.634568 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-190.ec2.internal" Jul 29 18:34:20.647489 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:20.647466 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 18:34:21.101614 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.101573 2562 apiserver.go:52] "Watching apiserver" Jul 29 18:34:21.109858 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.109826 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 29 18:34:21.110458 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.110434 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-5ddbt","openshift-multus/multus-additional-cni-plugins-q72xw","openshift-network-diagnostics/network-check-target-xtdjk","openshift-ovn-kubernetes/ovnkube-node-j8mjg","kube-system/global-pull-secret-syncer-8cc84","kube-system/kube-apiserver-proxy-ip-10-0-135-190.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-190.ec2.internal","openshift-multus/multus-tzwxd","openshift-multus/network-metrics-daemon-w69sl","openshift-network-operator/iptables-alerter-44lqv","kube-system/konnectivity-agent-4dqf5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm","openshift-cluster-node-tuning-operator/tuned-qgmsv","openshift-dns/node-resolver-skm5p"] Jul 29 18:34:21.112241 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.112218 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.113508 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.113353 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.116024 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.114656 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm" Jul 29 18:34:21.116024 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.115127 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-d49nr\"" Jul 29 18:34:21.116024 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.115527 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 29 18:34:21.116024 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.115682 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 29 18:34:21.116024 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.115542 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 29 18:34:21.116024 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.115900 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 29 18:34:21.116378 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.116347 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 29 18:34:21.116783 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.116766 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tlnjw\"" Jul 29 18:34:21.116997 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.116975 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 29 18:34:21.117179 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.117140 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-44lqv" Jul 29 18:34:21.117481 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.117311 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 29 18:34:21.117481 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.117410 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5dkvt\"" Jul 29 18:34:21.117770 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.117714 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 29 18:34:21.118007 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.117987 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.118742 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.118722 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 29 18:34:21.119306 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.119287 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:21.119409 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:21.119382 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8cc84" podUID="c1f1308a-865e-4a0f-ad80-7a8602155966" Jul 29 18:34:21.119906 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.119886 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 29 18:34:21.121155 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.120399 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 29 18:34:21.121485 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.121465 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:21.121582 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:21.121562 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w69sl" podUID="95f0df74-cd8c-4c76-ac89-62b675ce368f" Jul 29 18:34:21.122276 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.122251 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 29 18:34:21.122505 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.122489 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 29 18:34:21.125383 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.122826 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 29 18:34:21.125383 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.122993 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l9h5c\"" Jul 29 18:34:21.125383 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.123129 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 29 18:34:21.125383 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.124161 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5n7tp\"" Jul 29 18:34:21.125383 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.124347 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 29 18:34:21.125383 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.124672 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 29 18:34:21.125383 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.124904 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 29 18:34:21.125383 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.125302 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 29 18:34:21.125383 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.125336 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5ddbt" Jul 29 18:34:21.129197 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.126857 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4dqf5" Jul 29 18:34:21.129197 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.128240 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 29 18:34:21.129197 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.129184 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:34:21.129421 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:21.129246 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtdjk" podUID="7961d8da-66e2-4b1b-9f5a-37beefbd47eb" Jul 29 18:34:21.129487 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.129446 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-w5whs\"" Jul 29 18:34:21.129542 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.129485 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 29 18:34:21.130101 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.129721 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 29 18:34:21.130101 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.129796 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 29 18:34:21.131195 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.131173 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-q72xw" Jul 29 18:34:21.131693 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.131447 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 29 18:34:21.132581 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.132560 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-skm5p" Jul 29 18:34:21.132848 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.132823 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dz89s\"" Jul 29 18:34:21.133428 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.133410 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 29 18:34:21.133646 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.133627 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xrtvn\"" Jul 29 18:34:21.134030 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.134014 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 29 18:34:21.134366 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.134344 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-host-run-k8s-cni-cncf-io\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.134456 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.134382 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6bd12426-d81c-40eb-ab01-ee24cbd47be2-env-overrides\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.134456 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.134409 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-host-kubelet\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.134456 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.134432 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-multus-cni-dir\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.134750 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.134466 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-host-run-multus-certs\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.134750 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.134584 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcsv4\" (UniqueName: \"kubernetes.io/projected/0ba5d633-3365-42f2-9956-0409775e3fa2-kube-api-access-xcsv4\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.134750 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.134617 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-lib-modules\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.134750 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.134651 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-tmp\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.134750 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.134676 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f54f65a5-9d9b-4516-8bd7-dc90f5e3dad6-host-slash\") pod \"iptables-alerter-44lqv\" (UID: \"f54f65a5-9d9b-4516-8bd7-dc90f5e3dad6\") " pod="openshift-network-operator/iptables-alerter-44lqv" Jul 29 18:34:21.134750 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.134740 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1f1308a-865e-4a0f-ad80-7a8602155966-kubelet-config\") pod \"global-pull-secret-syncer-8cc84\" (UID: \"c1f1308a-865e-4a0f-ad80-7a8602155966\") " pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:21.135103 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.134772 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-os-release\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.135103 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.134823 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-host-var-lib-cni-bin\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.135103 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.134849 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-run\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.135103 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.134873 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb2b7\" (UniqueName: \"kubernetes.io/projected/f54f65a5-9d9b-4516-8bd7-dc90f5e3dad6-kube-api-access-pb2b7\") pod \"iptables-alerter-44lqv\" (UID: \"f54f65a5-9d9b-4516-8bd7-dc90f5e3dad6\") " pod="openshift-network-operator/iptables-alerter-44lqv" Jul 29 18:34:21.135103 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.134921 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5d933486-a30c-4f85-83ff-e1a190e2f95b-host\") pod \"node-ca-5ddbt\" (UID: \"5d933486-a30c-4f85-83ff-e1a190e2f95b\") " pod="openshift-image-registry/node-ca-5ddbt" Jul 29 18:34:21.135103 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.134947 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-run-systemd\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.135103 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135004 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-var-lib-openvswitch\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.135103 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135030 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-host-cni-bin\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.135103 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135057 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfd6b\" (UniqueName: \"kubernetes.io/projected/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-kube-api-access-xfd6b\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.135103 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135099 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a1dc9839-215b-400e-ada4-ed1779ec7c68-registration-dir\") pod \"aws-ebs-csi-driver-node-gdddm\" (UID: \"a1dc9839-215b-400e-ada4-ed1779ec7c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm" Jul 29 18:34:21.135643 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135134 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-var-lib-kubelet\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.135643 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135206 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7xmj\" (UniqueName: \"kubernetes.io/projected/a1dc9839-215b-400e-ada4-ed1779ec7c68-kube-api-access-j7xmj\") pod \"aws-ebs-csi-driver-node-gdddm\" (UID: \"a1dc9839-215b-400e-ada4-ed1779ec7c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm" Jul 29 18:34:21.135643 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135233 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-etc-openvswitch\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.135643 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135269 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6bd12426-d81c-40eb-ab01-ee24cbd47be2-ovnkube-config\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.135643 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135302 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-multus-conf-dir\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.135643 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135338 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a1dc9839-215b-400e-ada4-ed1779ec7c68-etc-selinux\") pod \"aws-ebs-csi-driver-node-gdddm\" (UID: \"a1dc9839-215b-400e-ada4-ed1779ec7c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm" Jul 29 18:34:21.135643 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135377 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-host-var-lib-kubelet\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.135643 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135418 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-etc-sysctl-conf\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.135643 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135447 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1f1308a-865e-4a0f-ad80-7a8602155966-dbus\") pod \"global-pull-secret-syncer-8cc84\" (UID: \"c1f1308a-865e-4a0f-ad80-7a8602155966\") " pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:21.135643 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135473 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95f0df74-cd8c-4c76-ac89-62b675ce368f-metrics-certs\") pod \"network-metrics-daemon-w69sl\" (UID: \"95f0df74-cd8c-4c76-ac89-62b675ce368f\") " pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:21.135643 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135520 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9tjm\" (UniqueName: \"kubernetes.io/projected/95f0df74-cd8c-4c76-ac89-62b675ce368f-kube-api-access-t9tjm\") pod \"network-metrics-daemon-w69sl\" (UID: \"95f0df74-cd8c-4c76-ac89-62b675ce368f\") " pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:21.135643 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135558 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4b6t\" (UniqueName: \"kubernetes.io/projected/5d933486-a30c-4f85-83ff-e1a190e2f95b-kube-api-access-g4b6t\") pod \"node-ca-5ddbt\" (UID: \"5d933486-a30c-4f85-83ff-e1a190e2f95b\") " pod="openshift-image-registry/node-ca-5ddbt" Jul 29 18:34:21.135643 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135607 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-etc-systemd\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.135643 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135643 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1f1308a-865e-4a0f-ad80-7a8602155966-original-pull-secret\") pod \"global-pull-secret-syncer-8cc84\" (UID: \"c1f1308a-865e-4a0f-ad80-7a8602155966\") " pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:21.136391 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135673 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-host-slash\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.136391 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135699 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-node-log\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.136391 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135723 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5d933486-a30c-4f85-83ff-e1a190e2f95b-serviceca\") pod \"node-ca-5ddbt\" (UID: \"5d933486-a30c-4f85-83ff-e1a190e2f95b\") " pod="openshift-image-registry/node-ca-5ddbt" Jul 29 18:34:21.136391 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135752 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a1dc9839-215b-400e-ada4-ed1779ec7c68-device-dir\") pod \"aws-ebs-csi-driver-node-gdddm\" (UID: \"a1dc9839-215b-400e-ada4-ed1779ec7c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm" Jul 29 18:34:21.136391 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135775 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-systemd-units\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.136391 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135801 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-run-ovn\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.136391 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135823 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-host-cni-netd\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.136391 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135887 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6bd12426-d81c-40eb-ab01-ee24cbd47be2-ovnkube-script-lib\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.136391 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135920 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-host-var-lib-cni-multus\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.136391 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135949 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-hostroot\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.136391 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.135994 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-etc-kubernetes\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.136391 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.136019 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-etc-tuned\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.136391 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.136037 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a1dc9839-215b-400e-ada4-ed1779ec7c68-socket-dir\") pod \"aws-ebs-csi-driver-node-gdddm\" (UID: \"a1dc9839-215b-400e-ada4-ed1779ec7c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm" Jul 29 18:34:21.136391 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.136090 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-host-run-ovn-kubernetes\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.136391 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.136106 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-host-run-netns\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.136391 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.136124 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f54f65a5-9d9b-4516-8bd7-dc90f5e3dad6-iptables-alerter-script\") pod \"iptables-alerter-44lqv\" (UID: \"f54f65a5-9d9b-4516-8bd7-dc90f5e3dad6\") " pod="openshift-network-operator/iptables-alerter-44lqv" Jul 29 18:34:21.137419 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.136163 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a1dc9839-215b-400e-ada4-ed1779ec7c68-sys-fs\") pod \"aws-ebs-csi-driver-node-gdddm\" (UID: \"a1dc9839-215b-400e-ada4-ed1779ec7c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm" Jul 29 18:34:21.137419 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.136189 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 29 18:34:21.137419 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.136189 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6bd12426-d81c-40eb-ab01-ee24cbd47be2-ovn-node-metrics-cert\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.137419 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.136241 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbvl7\" (UniqueName: \"kubernetes.io/projected/6bd12426-d81c-40eb-ab01-ee24cbd47be2-kube-api-access-pbvl7\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.137419 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.136249 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-84ldp\"" Jul 29 18:34:21.137419 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.136269 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ba5d633-3365-42f2-9956-0409775e3fa2-cni-binary-copy\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.137419 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.136294 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-etc-kubernetes\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.137419 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.136338 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-etc-sysconfig\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.137419 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.136361 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-etc-sysctl-d\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.137419 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.136399 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-host-run-netns\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.137419 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.136440 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.137419 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.136461 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 29 18:34:21.137419 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.136512 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ba5d633-3365-42f2-9956-0409775e3fa2-multus-daemon-config\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.137419 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.136539 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-sys\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.137419 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.136589 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-host\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.137419 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.136616 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-run-openvswitch\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.137419 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.136660 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-cnibin\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.137419 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.136692 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a1dc9839-215b-400e-ada4-ed1779ec7c68-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gdddm\" (UID: \"a1dc9839-215b-400e-ada4-ed1779ec7c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm" Jul 29 18:34:21.138397 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.136723 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-etc-modprobe-d\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.138397 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.136755 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-log-socket\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.138397 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.136780 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-system-cni-dir\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.138397 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.136811 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-multus-socket-dir-parent\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.139998 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.139975 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 18:34:21.159576 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.159506 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xxcrt" Jul 29 18:34:21.168731 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.168656 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xxcrt" Jul 29 18:34:21.222203 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.222166 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 29 18:34:21.237788 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.237756 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-system-cni-dir\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.237934 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.237795 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-multus-socket-dir-parent\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.237934 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.237833 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-host-run-k8s-cni-cncf-io\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.237934 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.237913 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-host-run-k8s-cni-cncf-io\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.238075 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.237953 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-system-cni-dir\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.238075 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.237963 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-multus-socket-dir-parent\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.238075 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238018 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6bd12426-d81c-40eb-ab01-ee24cbd47be2-env-overrides\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.238075 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238049 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-host-kubelet\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.238258 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238074 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-multus-cni-dir\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.238258 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238099 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-host-run-multus-certs\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.238258 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238134 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcsv4\" (UniqueName: \"kubernetes.io/projected/0ba5d633-3365-42f2-9956-0409775e3fa2-kube-api-access-xcsv4\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.238258 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238170 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-lib-modules\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.238258 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238207 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-tmp\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.238258 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238223 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-host-run-multus-certs\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.238641 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238275 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f54f65a5-9d9b-4516-8bd7-dc90f5e3dad6-host-slash\") pod \"iptables-alerter-44lqv\" (UID: \"f54f65a5-9d9b-4516-8bd7-dc90f5e3dad6\") " pod="openshift-network-operator/iptables-alerter-44lqv" Jul 29 18:34:21.238641 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238230 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f54f65a5-9d9b-4516-8bd7-dc90f5e3dad6-host-slash\") pod \"iptables-alerter-44lqv\" (UID: \"f54f65a5-9d9b-4516-8bd7-dc90f5e3dad6\") " pod="openshift-network-operator/iptables-alerter-44lqv" Jul 29 18:34:21.238641 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238295 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-multus-cni-dir\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.238641 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238178 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-host-kubelet\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.238641 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238323 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1f1308a-865e-4a0f-ad80-7a8602155966-kubelet-config\") pod \"global-pull-secret-syncer-8cc84\" (UID: \"c1f1308a-865e-4a0f-ad80-7a8602155966\") " pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:21.238641 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238382 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1f1308a-865e-4a0f-ad80-7a8602155966-kubelet-config\") pod \"global-pull-secret-syncer-8cc84\" (UID: \"c1f1308a-865e-4a0f-ad80-7a8602155966\") " pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:21.238641 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238462 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-lib-modules\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.238641 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238501 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-os-release\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.238641 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238545 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-host-var-lib-cni-bin\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.238641 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238587 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-run\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.238641 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238625 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-os-release\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.238641 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238646 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb2b7\" (UniqueName: \"kubernetes.io/projected/f54f65a5-9d9b-4516-8bd7-dc90f5e3dad6-kube-api-access-pb2b7\") pod \"iptables-alerter-44lqv\" (UID: \"f54f65a5-9d9b-4516-8bd7-dc90f5e3dad6\") " pod="openshift-network-operator/iptables-alerter-44lqv" Jul 29 18:34:21.239217 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238673 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5d933486-a30c-4f85-83ff-e1a190e2f95b-host\") pod \"node-ca-5ddbt\" (UID: \"5d933486-a30c-4f85-83ff-e1a190e2f95b\") " pod="openshift-image-registry/node-ca-5ddbt" Jul 29 18:34:21.239217 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238675 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6bd12426-d81c-40eb-ab01-ee24cbd47be2-env-overrides\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.239217 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238734 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-run-systemd\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.239217 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238757 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 29 18:34:21.239217 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238776 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-run\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.239217 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238818 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-var-lib-openvswitch\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.239217 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238675 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-host-var-lib-cni-bin\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.239217 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238834 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5d933486-a30c-4f85-83ff-e1a190e2f95b-host\") pod \"node-ca-5ddbt\" (UID: \"5d933486-a30c-4f85-83ff-e1a190e2f95b\") " pod="openshift-image-registry/node-ca-5ddbt" Jul 29 18:34:21.239217 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238766 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-var-lib-openvswitch\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.239217 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238881 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-run-systemd\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.239217 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238890 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-host-cni-bin\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.239217 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238915 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfd6b\" (UniqueName: \"kubernetes.io/projected/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-kube-api-access-xfd6b\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.239217 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238940 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a1dc9839-215b-400e-ada4-ed1779ec7c68-registration-dir\") pod \"aws-ebs-csi-driver-node-gdddm\" (UID: \"a1dc9839-215b-400e-ada4-ed1779ec7c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm" Jul 29 18:34:21.239217 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.238974 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-var-lib-kubelet\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.239217 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.239000 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-host-cni-bin\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.239217 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.239023 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7xmj\" (UniqueName: \"kubernetes.io/projected/a1dc9839-215b-400e-ada4-ed1779ec7c68-kube-api-access-j7xmj\") pod \"aws-ebs-csi-driver-node-gdddm\" (UID: \"a1dc9839-215b-400e-ada4-ed1779ec7c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm" Jul 29 18:34:21.239217 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.239058 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a1dc9839-215b-400e-ada4-ed1779ec7c68-registration-dir\") pod \"aws-ebs-csi-driver-node-gdddm\" (UID: \"a1dc9839-215b-400e-ada4-ed1779ec7c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm" Jul 29 18:34:21.239217 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.239050 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-etc-openvswitch\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.240126 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.239092 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-var-lib-kubelet\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.240126 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.239097 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6bd12426-d81c-40eb-ab01-ee24cbd47be2-ovnkube-config\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.240126 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.239099 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-etc-openvswitch\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.240126 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.239151 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e7c71e3-553b-4508-a7e3-1e823a72af11-hosts-file\") pod \"node-resolver-skm5p\" (UID: \"9e7c71e3-553b-4508-a7e3-1e823a72af11\") " pod="openshift-dns/node-resolver-skm5p" Jul 29 18:34:21.240126 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.239197 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-multus-conf-dir\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.240126 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.239221 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a1dc9839-215b-400e-ada4-ed1779ec7c68-etc-selinux\") pod \"aws-ebs-csi-driver-node-gdddm\" (UID: \"a1dc9839-215b-400e-ada4-ed1779ec7c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm" Jul 29 18:34:21.240126 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.239267 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/15ad40c9-68c8-4602-8911-603bd60f8de3-konnectivity-ca\") pod \"konnectivity-agent-4dqf5\" (UID: \"15ad40c9-68c8-4602-8911-603bd60f8de3\") " pod="kube-system/konnectivity-agent-4dqf5" Jul 29 18:34:21.240126 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.239278 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-multus-conf-dir\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.240126 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.239294 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-host-var-lib-kubelet\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.240126 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.239360 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-etc-sysctl-conf\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.240126 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.239399 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a1dc9839-215b-400e-ada4-ed1779ec7c68-etc-selinux\") pod \"aws-ebs-csi-driver-node-gdddm\" (UID: \"a1dc9839-215b-400e-ada4-ed1779ec7c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm" Jul 29 18:34:21.240126 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.239462 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1f1308a-865e-4a0f-ad80-7a8602155966-dbus\") pod \"global-pull-secret-syncer-8cc84\" (UID: \"c1f1308a-865e-4a0f-ad80-7a8602155966\") " pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:21.240126 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.239491 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95f0df74-cd8c-4c76-ac89-62b675ce368f-metrics-certs\") pod \"network-metrics-daemon-w69sl\" (UID: \"95f0df74-cd8c-4c76-ac89-62b675ce368f\") " pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:21.240126 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.239557 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1f1308a-865e-4a0f-ad80-7a8602155966-dbus\") pod \"global-pull-secret-syncer-8cc84\" (UID: \"c1f1308a-865e-4a0f-ad80-7a8602155966\") " pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:21.240126 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.239586 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-etc-sysctl-conf\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.240126 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.239596 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9tjm\" (UniqueName: \"kubernetes.io/projected/95f0df74-cd8c-4c76-ac89-62b675ce368f-kube-api-access-t9tjm\") pod \"network-metrics-daemon-w69sl\" (UID: \"95f0df74-cd8c-4c76-ac89-62b675ce368f\") " pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:21.240126 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.239623 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4b6t\" (UniqueName: \"kubernetes.io/projected/5d933486-a30c-4f85-83ff-e1a190e2f95b-kube-api-access-g4b6t\") pod \"node-ca-5ddbt\" (UID: \"5d933486-a30c-4f85-83ff-e1a190e2f95b\") " pod="openshift-image-registry/node-ca-5ddbt" Jul 29 18:34:21.241033 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.239627 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-host-var-lib-kubelet\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.241033 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.239672 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6bd12426-d81c-40eb-ab01-ee24cbd47be2-ovnkube-config\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.241033 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:21.239810 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:21.241033 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.239856 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-etc-systemd\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.241033 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:21.239916 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95f0df74-cd8c-4c76-ac89-62b675ce368f-metrics-certs podName:95f0df74-cd8c-4c76-ac89-62b675ce368f nodeName:}" failed. No retries permitted until 2026-07-29 18:34:21.739875171 +0000 UTC m=+2.982052323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95f0df74-cd8c-4c76-ac89-62b675ce368f-metrics-certs") pod "network-metrics-daemon-w69sl" (UID: "95f0df74-cd8c-4c76-ac89-62b675ce368f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:21.241033 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.239935 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-etc-systemd\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.241033 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.239963 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1f1308a-865e-4a0f-ad80-7a8602155966-original-pull-secret\") pod \"global-pull-secret-syncer-8cc84\" (UID: \"c1f1308a-865e-4a0f-ad80-7a8602155966\") " pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:21.241033 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240009 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-host-slash\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.241033 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240039 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-node-log\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.241033 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240069 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5d933486-a30c-4f85-83ff-e1a190e2f95b-serviceca\") pod \"node-ca-5ddbt\" (UID: \"5d933486-a30c-4f85-83ff-e1a190e2f95b\") " pod="openshift-image-registry/node-ca-5ddbt" Jul 29 18:34:21.241033 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240080 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-host-slash\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.241033 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:21.240124 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:21.241033 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240141 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-node-log\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.241033 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:21.240181 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f1308a-865e-4a0f-ad80-7a8602155966-original-pull-secret podName:c1f1308a-865e-4a0f-ad80-7a8602155966 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:21.740163448 +0000 UTC m=+2.982340586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1f1308a-865e-4a0f-ad80-7a8602155966-original-pull-secret") pod "global-pull-secret-syncer-8cc84" (UID: "c1f1308a-865e-4a0f-ad80-7a8602155966") : object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:21.241033 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240213 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a1dc9839-215b-400e-ada4-ed1779ec7c68-device-dir\") pod \"aws-ebs-csi-driver-node-gdddm\" (UID: \"a1dc9839-215b-400e-ada4-ed1779ec7c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm" Jul 29 18:34:21.241033 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240270 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-systemd-units\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.241033 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240306 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-run-ovn\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.241912 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240359 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a1dc9839-215b-400e-ada4-ed1779ec7c68-device-dir\") pod \"aws-ebs-csi-driver-node-gdddm\" (UID: \"a1dc9839-215b-400e-ada4-ed1779ec7c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm" Jul 29 18:34:21.241912 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240373 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-host-cni-netd\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.241912 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240414 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-systemd-units\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.241912 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240438 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-host-cni-netd\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.241912 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240445 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6bd12426-d81c-40eb-ab01-ee24cbd47be2-ovnkube-script-lib\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.241912 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240450 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-run-ovn\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.241912 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240477 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4092d9a7-0970-48af-9e09-e0cd691fcc02-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q72xw\" (UID: \"4092d9a7-0970-48af-9e09-e0cd691fcc02\") " pod="openshift-multus/multus-additional-cni-plugins-q72xw" Jul 29 18:34:21.241912 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240506 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-host-var-lib-cni-multus\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.241912 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240555 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-hostroot\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.241912 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240627 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-etc-kubernetes\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.241912 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240656 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-etc-tuned\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.241912 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240700 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-etc-kubernetes\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.241912 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240729 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a1dc9839-215b-400e-ada4-ed1779ec7c68-socket-dir\") pod \"aws-ebs-csi-driver-node-gdddm\" (UID: \"a1dc9839-215b-400e-ada4-ed1779ec7c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm" Jul 29 18:34:21.241912 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240762 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-hostroot\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.241912 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240767 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-host-run-ovn-kubernetes\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.241912 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240802 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-host-var-lib-cni-multus\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.241912 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240805 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4092d9a7-0970-48af-9e09-e0cd691fcc02-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q72xw\" (UID: \"4092d9a7-0970-48af-9e09-e0cd691fcc02\") " pod="openshift-multus/multus-additional-cni-plugins-q72xw" Jul 29 18:34:21.247975 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240628 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5d933486-a30c-4f85-83ff-e1a190e2f95b-serviceca\") pod \"node-ca-5ddbt\" (UID: \"5d933486-a30c-4f85-83ff-e1a190e2f95b\") " pod="openshift-image-registry/node-ca-5ddbt" Jul 29 18:34:21.247975 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240865 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-host-run-netns\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.247975 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240903 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f54f65a5-9d9b-4516-8bd7-dc90f5e3dad6-iptables-alerter-script\") pod \"iptables-alerter-44lqv\" (UID: \"f54f65a5-9d9b-4516-8bd7-dc90f5e3dad6\") " pod="openshift-network-operator/iptables-alerter-44lqv" Jul 29 18:34:21.247975 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240931 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a1dc9839-215b-400e-ada4-ed1779ec7c68-sys-fs\") pod \"aws-ebs-csi-driver-node-gdddm\" (UID: \"a1dc9839-215b-400e-ada4-ed1779ec7c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm" Jul 29 18:34:21.247975 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240877 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-host-run-ovn-kubernetes\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.247975 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240969 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a1dc9839-215b-400e-ada4-ed1779ec7c68-socket-dir\") pod \"aws-ebs-csi-driver-node-gdddm\" (UID: \"a1dc9839-215b-400e-ada4-ed1779ec7c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm" Jul 29 18:34:21.247975 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.240980 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6bd12426-d81c-40eb-ab01-ee24cbd47be2-ovn-node-metrics-cert\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.247975 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.241060 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbvl7\" (UniqueName: \"kubernetes.io/projected/6bd12426-d81c-40eb-ab01-ee24cbd47be2-kube-api-access-pbvl7\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.247975 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.241074 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-host-run-netns\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.247975 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.241097 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ba5d633-3365-42f2-9956-0409775e3fa2-cni-binary-copy\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.247975 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.241149 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-etc-kubernetes\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.247975 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.241178 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-etc-sysconfig\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.247975 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.241223 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-etc-sysctl-d\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.247975 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.241249 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-host-run-netns\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.247975 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.241277 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.247975 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.241313 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ba5d633-3365-42f2-9956-0409775e3fa2-multus-daemon-config\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.247975 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.241340 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-sys\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.248972 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.241318 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6bd12426-d81c-40eb-ab01-ee24cbd47be2-ovnkube-script-lib\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.248972 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.241368 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-host\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.248972 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.241395 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-run-openvswitch\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.248972 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.241424 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-host-run-netns\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.248972 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.241424 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxgnt\" (UniqueName: \"kubernetes.io/projected/7961d8da-66e2-4b1b-9f5a-37beefbd47eb-kube-api-access-dxgnt\") pod \"network-check-target-xtdjk\" (UID: \"7961d8da-66e2-4b1b-9f5a-37beefbd47eb\") " pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:34:21.248972 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.241466 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-etc-kubernetes\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.248972 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.241477 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4092d9a7-0970-48af-9e09-e0cd691fcc02-cni-binary-copy\") pod \"multus-additional-cni-plugins-q72xw\" (UID: \"4092d9a7-0970-48af-9e09-e0cd691fcc02\") " pod="openshift-multus/multus-additional-cni-plugins-q72xw" Jul 29 18:34:21.248972 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.241522 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-etc-sysconfig\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.248972 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.241530 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4092d9a7-0970-48af-9e09-e0cd691fcc02-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q72xw\" (UID: \"4092d9a7-0970-48af-9e09-e0cd691fcc02\") " pod="openshift-multus/multus-additional-cni-plugins-q72xw" Jul 29 18:34:21.248972 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.241559 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-cnibin\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.248972 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.241589 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4092d9a7-0970-48af-9e09-e0cd691fcc02-system-cni-dir\") pod \"multus-additional-cni-plugins-q72xw\" (UID: \"4092d9a7-0970-48af-9e09-e0cd691fcc02\") " pod="openshift-multus/multus-additional-cni-plugins-q72xw" Jul 29 18:34:21.248972 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.241616 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a1dc9839-215b-400e-ada4-ed1779ec7c68-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gdddm\" (UID: \"a1dc9839-215b-400e-ada4-ed1779ec7c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm" Jul 29 18:34:21.248972 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.241574 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-etc-sysctl-d\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.248972 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.241624 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a1dc9839-215b-400e-ada4-ed1779ec7c68-sys-fs\") pod \"aws-ebs-csi-driver-node-gdddm\" (UID: \"a1dc9839-215b-400e-ada4-ed1779ec7c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm" Jul 29 18:34:21.248972 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.241643 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-etc-modprobe-d\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.248972 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.241668 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-log-socket\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.248972 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.241698 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4092d9a7-0970-48af-9e09-e0cd691fcc02-os-release\") pod \"multus-additional-cni-plugins-q72xw\" (UID: \"4092d9a7-0970-48af-9e09-e0cd691fcc02\") " pod="openshift-multus/multus-additional-cni-plugins-q72xw" Jul 29 18:34:21.250740 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.242171 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgjpz\" (UniqueName: \"kubernetes.io/projected/9e7c71e3-553b-4508-a7e3-1e823a72af11-kube-api-access-lgjpz\") pod \"node-resolver-skm5p\" (UID: \"9e7c71e3-553b-4508-a7e3-1e823a72af11\") " pod="openshift-dns/node-resolver-skm5p" Jul 29 18:34:21.250740 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.242221 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4092d9a7-0970-48af-9e09-e0cd691fcc02-cnibin\") pod \"multus-additional-cni-plugins-q72xw\" (UID: \"4092d9a7-0970-48af-9e09-e0cd691fcc02\") " pod="openshift-multus/multus-additional-cni-plugins-q72xw" Jul 29 18:34:21.250740 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.242271 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvrqm\" (UniqueName: \"kubernetes.io/projected/4092d9a7-0970-48af-9e09-e0cd691fcc02-kube-api-access-gvrqm\") pod \"multus-additional-cni-plugins-q72xw\" (UID: \"4092d9a7-0970-48af-9e09-e0cd691fcc02\") " pod="openshift-multus/multus-additional-cni-plugins-q72xw" Jul 29 18:34:21.250740 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.242309 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e7c71e3-553b-4508-a7e3-1e823a72af11-tmp-dir\") pod \"node-resolver-skm5p\" (UID: \"9e7c71e3-553b-4508-a7e3-1e823a72af11\") " pod="openshift-dns/node-resolver-skm5p" Jul 29 18:34:21.250740 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.242337 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/15ad40c9-68c8-4602-8911-603bd60f8de3-agent-certs\") pod \"konnectivity-agent-4dqf5\" (UID: \"15ad40c9-68c8-4602-8911-603bd60f8de3\") " pod="kube-system/konnectivity-agent-4dqf5" Jul 29 18:34:21.250740 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.242498 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-host\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.250740 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.242589 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-run-openvswitch\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.250740 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.242644 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ba5d633-3365-42f2-9956-0409775e3fa2-cnibin\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.250740 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.242739 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a1dc9839-215b-400e-ada4-ed1779ec7c68-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gdddm\" (UID: \"a1dc9839-215b-400e-ada4-ed1779ec7c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm" Jul 29 18:34:21.250740 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.242843 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-etc-modprobe-d\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.250740 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.242909 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-log-socket\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.250740 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.243087 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ba5d633-3365-42f2-9956-0409775e3fa2-cni-binary-copy\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.250740 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.241746 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f54f65a5-9d9b-4516-8bd7-dc90f5e3dad6-iptables-alerter-script\") pod \"iptables-alerter-44lqv\" (UID: \"f54f65a5-9d9b-4516-8bd7-dc90f5e3dad6\") " pod="openshift-network-operator/iptables-alerter-44lqv" Jul 29 18:34:21.250740 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.243429 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ba5d633-3365-42f2-9956-0409775e3fa2-multus-daemon-config\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.250740 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.243535 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-sys\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.250740 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.243558 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-tmp\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.250740 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.243784 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6bd12426-d81c-40eb-ab01-ee24cbd47be2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.251620 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.245735 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-etc-tuned\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.251620 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.248137 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6bd12426-d81c-40eb-ab01-ee24cbd47be2-ovn-node-metrics-cert\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.251620 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.251308 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9tjm\" (UniqueName: \"kubernetes.io/projected/95f0df74-cd8c-4c76-ac89-62b675ce368f-kube-api-access-t9tjm\") pod \"network-metrics-daemon-w69sl\" (UID: \"95f0df74-cd8c-4c76-ac89-62b675ce368f\") " pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:21.251620 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.251465 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4b6t\" (UniqueName: \"kubernetes.io/projected/5d933486-a30c-4f85-83ff-e1a190e2f95b-kube-api-access-g4b6t\") pod \"node-ca-5ddbt\" (UID: \"5d933486-a30c-4f85-83ff-e1a190e2f95b\") " pod="openshift-image-registry/node-ca-5ddbt" Jul 29 18:34:21.253741 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.253721 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb2b7\" (UniqueName: \"kubernetes.io/projected/f54f65a5-9d9b-4516-8bd7-dc90f5e3dad6-kube-api-access-pb2b7\") pod \"iptables-alerter-44lqv\" (UID: \"f54f65a5-9d9b-4516-8bd7-dc90f5e3dad6\") " pod="openshift-network-operator/iptables-alerter-44lqv" Jul 29 18:34:21.253981 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.253822 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7xmj\" (UniqueName: \"kubernetes.io/projected/a1dc9839-215b-400e-ada4-ed1779ec7c68-kube-api-access-j7xmj\") pod \"aws-ebs-csi-driver-node-gdddm\" (UID: \"a1dc9839-215b-400e-ada4-ed1779ec7c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm" Jul 29 18:34:21.255176 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.255018 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfd6b\" (UniqueName: \"kubernetes.io/projected/fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de-kube-api-access-xfd6b\") pod \"tuned-qgmsv\" (UID: \"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de\") " pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.255176 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.255142 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbvl7\" (UniqueName: \"kubernetes.io/projected/6bd12426-d81c-40eb-ab01-ee24cbd47be2-kube-api-access-pbvl7\") pod \"ovnkube-node-j8mjg\" (UID: \"6bd12426-d81c-40eb-ab01-ee24cbd47be2\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.255324 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.255205 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcsv4\" (UniqueName: \"kubernetes.io/projected/0ba5d633-3365-42f2-9956-0409775e3fa2-kube-api-access-xcsv4\") pod \"multus-tzwxd\" (UID: \"0ba5d633-3365-42f2-9956-0409775e3fa2\") " pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.342704 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.342666 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxgnt\" (UniqueName: \"kubernetes.io/projected/7961d8da-66e2-4b1b-9f5a-37beefbd47eb-kube-api-access-dxgnt\") pod \"network-check-target-xtdjk\" (UID: \"7961d8da-66e2-4b1b-9f5a-37beefbd47eb\") " pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:34:21.342868 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.342713 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4092d9a7-0970-48af-9e09-e0cd691fcc02-cni-binary-copy\") pod \"multus-additional-cni-plugins-q72xw\" (UID: \"4092d9a7-0970-48af-9e09-e0cd691fcc02\") " pod="openshift-multus/multus-additional-cni-plugins-q72xw" Jul 29 18:34:21.342981 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.342958 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4092d9a7-0970-48af-9e09-e0cd691fcc02-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q72xw\" (UID: \"4092d9a7-0970-48af-9e09-e0cd691fcc02\") " pod="openshift-multus/multus-additional-cni-plugins-q72xw" Jul 29 18:34:21.343040 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.343000 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4092d9a7-0970-48af-9e09-e0cd691fcc02-system-cni-dir\") pod \"multus-additional-cni-plugins-q72xw\" (UID: \"4092d9a7-0970-48af-9e09-e0cd691fcc02\") " pod="openshift-multus/multus-additional-cni-plugins-q72xw" Jul 29 18:34:21.343040 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.343030 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4092d9a7-0970-48af-9e09-e0cd691fcc02-os-release\") pod \"multus-additional-cni-plugins-q72xw\" (UID: \"4092d9a7-0970-48af-9e09-e0cd691fcc02\") " pod="openshift-multus/multus-additional-cni-plugins-q72xw" Jul 29 18:34:21.343149 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.343056 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgjpz\" (UniqueName: \"kubernetes.io/projected/9e7c71e3-553b-4508-a7e3-1e823a72af11-kube-api-access-lgjpz\") pod \"node-resolver-skm5p\" (UID: \"9e7c71e3-553b-4508-a7e3-1e823a72af11\") " pod="openshift-dns/node-resolver-skm5p" Jul 29 18:34:21.343149 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.343084 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4092d9a7-0970-48af-9e09-e0cd691fcc02-cnibin\") pod \"multus-additional-cni-plugins-q72xw\" (UID: \"4092d9a7-0970-48af-9e09-e0cd691fcc02\") " pod="openshift-multus/multus-additional-cni-plugins-q72xw" Jul 29 18:34:21.343252 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.343156 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4092d9a7-0970-48af-9e09-e0cd691fcc02-system-cni-dir\") pod \"multus-additional-cni-plugins-q72xw\" (UID: \"4092d9a7-0970-48af-9e09-e0cd691fcc02\") " pod="openshift-multus/multus-additional-cni-plugins-q72xw" Jul 29 18:34:21.343252 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.343190 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4092d9a7-0970-48af-9e09-e0cd691fcc02-os-release\") pod \"multus-additional-cni-plugins-q72xw\" (UID: \"4092d9a7-0970-48af-9e09-e0cd691fcc02\") " pod="openshift-multus/multus-additional-cni-plugins-q72xw" Jul 29 18:34:21.343252 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.343215 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvrqm\" (UniqueName: \"kubernetes.io/projected/4092d9a7-0970-48af-9e09-e0cd691fcc02-kube-api-access-gvrqm\") pod \"multus-additional-cni-plugins-q72xw\" (UID: \"4092d9a7-0970-48af-9e09-e0cd691fcc02\") " pod="openshift-multus/multus-additional-cni-plugins-q72xw" Jul 29 18:34:21.343252 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.343238 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e7c71e3-553b-4508-a7e3-1e823a72af11-tmp-dir\") pod \"node-resolver-skm5p\" (UID: \"9e7c71e3-553b-4508-a7e3-1e823a72af11\") " pod="openshift-dns/node-resolver-skm5p" Jul 29 18:34:21.343252 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.343242 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4092d9a7-0970-48af-9e09-e0cd691fcc02-cnibin\") pod \"multus-additional-cni-plugins-q72xw\" (UID: \"4092d9a7-0970-48af-9e09-e0cd691fcc02\") " pod="openshift-multus/multus-additional-cni-plugins-q72xw" Jul 29 18:34:21.343510 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.343258 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/15ad40c9-68c8-4602-8911-603bd60f8de3-agent-certs\") pod \"konnectivity-agent-4dqf5\" (UID: \"15ad40c9-68c8-4602-8911-603bd60f8de3\") " pod="kube-system/konnectivity-agent-4dqf5" Jul 29 18:34:21.343510 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.343301 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e7c71e3-553b-4508-a7e3-1e823a72af11-hosts-file\") pod \"node-resolver-skm5p\" (UID: \"9e7c71e3-553b-4508-a7e3-1e823a72af11\") " pod="openshift-dns/node-resolver-skm5p" Jul 29 18:34:21.343510 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.343321 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/15ad40c9-68c8-4602-8911-603bd60f8de3-konnectivity-ca\") pod \"konnectivity-agent-4dqf5\" (UID: \"15ad40c9-68c8-4602-8911-603bd60f8de3\") " pod="kube-system/konnectivity-agent-4dqf5" Jul 29 18:34:21.343510 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.343394 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e7c71e3-553b-4508-a7e3-1e823a72af11-hosts-file\") pod \"node-resolver-skm5p\" (UID: \"9e7c71e3-553b-4508-a7e3-1e823a72af11\") " pod="openshift-dns/node-resolver-skm5p" Jul 29 18:34:21.343510 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.343396 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4092d9a7-0970-48af-9e09-e0cd691fcc02-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q72xw\" (UID: \"4092d9a7-0970-48af-9e09-e0cd691fcc02\") " pod="openshift-multus/multus-additional-cni-plugins-q72xw" Jul 29 18:34:21.343510 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.343452 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4092d9a7-0970-48af-9e09-e0cd691fcc02-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q72xw\" (UID: \"4092d9a7-0970-48af-9e09-e0cd691fcc02\") " pod="openshift-multus/multus-additional-cni-plugins-q72xw" Jul 29 18:34:21.343820 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.343605 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e7c71e3-553b-4508-a7e3-1e823a72af11-tmp-dir\") pod \"node-resolver-skm5p\" (UID: \"9e7c71e3-553b-4508-a7e3-1e823a72af11\") " pod="openshift-dns/node-resolver-skm5p" Jul 29 18:34:21.343820 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.343608 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4092d9a7-0970-48af-9e09-e0cd691fcc02-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q72xw\" (UID: \"4092d9a7-0970-48af-9e09-e0cd691fcc02\") " pod="openshift-multus/multus-additional-cni-plugins-q72xw" Jul 29 18:34:21.344086 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.344044 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/15ad40c9-68c8-4602-8911-603bd60f8de3-konnectivity-ca\") pod \"konnectivity-agent-4dqf5\" (UID: \"15ad40c9-68c8-4602-8911-603bd60f8de3\") " pod="kube-system/konnectivity-agent-4dqf5" Jul 29 18:34:21.344086 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.344051 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4092d9a7-0970-48af-9e09-e0cd691fcc02-cni-binary-copy\") pod \"multus-additional-cni-plugins-q72xw\" (UID: \"4092d9a7-0970-48af-9e09-e0cd691fcc02\") " pod="openshift-multus/multus-additional-cni-plugins-q72xw" Jul 29 18:34:21.344226 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.344072 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4092d9a7-0970-48af-9e09-e0cd691fcc02-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q72xw\" (UID: \"4092d9a7-0970-48af-9e09-e0cd691fcc02\") " pod="openshift-multus/multus-additional-cni-plugins-q72xw" Jul 29 18:34:21.344226 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.344134 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4092d9a7-0970-48af-9e09-e0cd691fcc02-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q72xw\" (UID: \"4092d9a7-0970-48af-9e09-e0cd691fcc02\") " pod="openshift-multus/multus-additional-cni-plugins-q72xw" Jul 29 18:34:21.345960 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.345922 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/15ad40c9-68c8-4602-8911-603bd60f8de3-agent-certs\") pod \"konnectivity-agent-4dqf5\" (UID: \"15ad40c9-68c8-4602-8911-603bd60f8de3\") " pod="kube-system/konnectivity-agent-4dqf5" Jul 29 18:34:21.348863 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.348820 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-190.ec2.internal" event={"ID":"1d62cc98f7984cd1fdc5d04ac3167f99","Type":"ContainerStarted","Data":"e7a766a647f61abf27cb682ff664562252416d15662b8753335ab4ac454d6b9a"} Jul 29 18:34:21.350027 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.349953 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-190.ec2.internal" event={"ID":"305d6500b5831efe5fa1deaa8b353f63","Type":"ContainerStarted","Data":"7915800a707c1b95ec1d937cdca1820a831017619b6b688d4e64d01c6c3645e5"} Jul 29 18:34:21.352757 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:21.352704 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 18:34:21.352757 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:21.352729 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 18:34:21.352757 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:21.352743 2562 projected.go:196] Error preparing data for projected volume kube-api-access-dxgnt for pod openshift-network-diagnostics/network-check-target-xtdjk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:21.352960 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:21.352816 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7961d8da-66e2-4b1b-9f5a-37beefbd47eb-kube-api-access-dxgnt podName:7961d8da-66e2-4b1b-9f5a-37beefbd47eb nodeName:}" failed. No retries permitted until 2026-07-29 18:34:21.85279507 +0000 UTC m=+3.094972209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dxgnt" (UniqueName: "kubernetes.io/projected/7961d8da-66e2-4b1b-9f5a-37beefbd47eb-kube-api-access-dxgnt") pod "network-check-target-xtdjk" (UID: "7961d8da-66e2-4b1b-9f5a-37beefbd47eb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:21.355277 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.355216 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgjpz\" (UniqueName: \"kubernetes.io/projected/9e7c71e3-553b-4508-a7e3-1e823a72af11-kube-api-access-lgjpz\") pod \"node-resolver-skm5p\" (UID: \"9e7c71e3-553b-4508-a7e3-1e823a72af11\") " pod="openshift-dns/node-resolver-skm5p" Jul 29 18:34:21.355676 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.355657 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvrqm\" (UniqueName: \"kubernetes.io/projected/4092d9a7-0970-48af-9e09-e0cd691fcc02-kube-api-access-gvrqm\") pod \"multus-additional-cni-plugins-q72xw\" (UID: \"4092d9a7-0970-48af-9e09-e0cd691fcc02\") " pod="openshift-multus/multus-additional-cni-plugins-q72xw" Jul 29 18:34:21.430383 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.430344 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tzwxd" Jul 29 18:34:21.442481 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.442456 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:21.452353 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.452331 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" Jul 29 18:34:21.459341 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.459319 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm" Jul 29 18:34:21.467115 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.467094 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-44lqv" Jul 29 18:34:21.474578 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.474560 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5ddbt" Jul 29 18:34:21.483500 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.483477 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4dqf5" Jul 29 18:34:21.491263 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.491240 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-q72xw" Jul 29 18:34:21.496031 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.496014 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-skm5p" Jul 29 18:34:21.627564 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.627470 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 18:34:21.746382 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.746337 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95f0df74-cd8c-4c76-ac89-62b675ce368f-metrics-certs\") pod \"network-metrics-daemon-w69sl\" (UID: \"95f0df74-cd8c-4c76-ac89-62b675ce368f\") " pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:21.746382 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.746386 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1f1308a-865e-4a0f-ad80-7a8602155966-original-pull-secret\") pod \"global-pull-secret-syncer-8cc84\" (UID: \"c1f1308a-865e-4a0f-ad80-7a8602155966\") " pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:21.746665 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:21.746488 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:21.746665 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:21.746506 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:21.746665 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:21.746565 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f1308a-865e-4a0f-ad80-7a8602155966-original-pull-secret podName:c1f1308a-865e-4a0f-ad80-7a8602155966 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:22.746532115 +0000 UTC m=+3.988709259 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1f1308a-865e-4a0f-ad80-7a8602155966-original-pull-secret") pod "global-pull-secret-syncer-8cc84" (UID: "c1f1308a-865e-4a0f-ad80-7a8602155966") : object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:21.746665 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:21.746582 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95f0df74-cd8c-4c76-ac89-62b675ce368f-metrics-certs podName:95f0df74-cd8c-4c76-ac89-62b675ce368f nodeName:}" failed. No retries permitted until 2026-07-29 18:34:22.746574937 +0000 UTC m=+3.988752073 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95f0df74-cd8c-4c76-ac89-62b675ce368f-metrics-certs") pod "network-metrics-daemon-w69sl" (UID: "95f0df74-cd8c-4c76-ac89-62b675ce368f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:21.948095 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:21.948006 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxgnt\" (UniqueName: \"kubernetes.io/projected/7961d8da-66e2-4b1b-9f5a-37beefbd47eb-kube-api-access-dxgnt\") pod \"network-check-target-xtdjk\" (UID: \"7961d8da-66e2-4b1b-9f5a-37beefbd47eb\") " pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:34:21.948271 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:21.948166 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 18:34:21.948271 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:21.948190 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 18:34:21.948271 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:21.948203 2562 projected.go:196] Error preparing data for projected volume kube-api-access-dxgnt for pod openshift-network-diagnostics/network-check-target-xtdjk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:21.948406 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:21.948278 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7961d8da-66e2-4b1b-9f5a-37beefbd47eb-kube-api-access-dxgnt podName:7961d8da-66e2-4b1b-9f5a-37beefbd47eb nodeName:}" failed. No retries permitted until 2026-07-29 18:34:22.948257652 +0000 UTC m=+4.190434812 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dxgnt" (UniqueName: "kubernetes.io/projected/7961d8da-66e2-4b1b-9f5a-37beefbd47eb-kube-api-access-dxgnt") pod "network-check-target-xtdjk" (UID: "7961d8da-66e2-4b1b-9f5a-37beefbd47eb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:22.056660 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:22.056631 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 18:34:22.170454 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:22.170417 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 18:29:21 +0000 UTC" deadline="2028-04-27 04:44:57.662486126 +0000 UTC" Jul 29 18:34:22.170454 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:22.170445 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15298h10m35.492044633s" Jul 29 18:34:22.345137 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:22.345108 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:34:22.345292 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:22.345266 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtdjk" podUID="7961d8da-66e2-4b1b-9f5a-37beefbd47eb" Jul 29 18:34:22.353618 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:22.353539 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bd12426_d81c_40eb_ab01_ee24cbd47be2.slice/crio-086665ad1385dc52e91694385b6fa2745753a95eeaf4a152a481f34be2f83b49 WatchSource:0}: Error finding container 086665ad1385dc52e91694385b6fa2745753a95eeaf4a152a481f34be2f83b49: Status 404 returned error can't find the container with id 086665ad1385dc52e91694385b6fa2745753a95eeaf4a152a481f34be2f83b49 Jul 29 18:34:22.362408 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:22.362351 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ad40c9_68c8_4602_8911_603bd60f8de3.slice/crio-08d0a0b9341b15fd610612b2047a729bbe0732288c4cc8e9cf2201f937282aea WatchSource:0}: Error finding container 08d0a0b9341b15fd610612b2047a729bbe0732288c4cc8e9cf2201f937282aea: Status 404 returned error can't find the container with id 08d0a0b9341b15fd610612b2047a729bbe0732288c4cc8e9cf2201f937282aea Jul 29 18:34:22.363473 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:22.363447 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf54f65a5_9d9b_4516_8bd7_dc90f5e3dad6.slice/crio-b31a7d79c25d762e22c6f8d77e39810649302b48ac6d02a638f8d4fef015b153 WatchSource:0}: Error finding container b31a7d79c25d762e22c6f8d77e39810649302b48ac6d02a638f8d4fef015b153: Status 404 returned error can't find the container with id b31a7d79c25d762e22c6f8d77e39810649302b48ac6d02a638f8d4fef015b153 Jul 29 18:34:22.364822 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:22.364786 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ba5d633_3365_42f2_9956_0409775e3fa2.slice/crio-562b478dd150f35ce1957057b8b2dffe088599a8dfaa1e2eaae4d278bac8d976 WatchSource:0}: Error finding container 562b478dd150f35ce1957057b8b2dffe088599a8dfaa1e2eaae4d278bac8d976: Status 404 returned error can't find the container with id 562b478dd150f35ce1957057b8b2dffe088599a8dfaa1e2eaae4d278bac8d976 Jul 29 18:34:22.365385 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:22.365356 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e7c71e3_553b_4508_a7e3_1e823a72af11.slice/crio-4843db6cee17334538f15aa29496b7959a14b599ac08afad4dbabdbd7806b791 WatchSource:0}: Error finding container 4843db6cee17334538f15aa29496b7959a14b599ac08afad4dbabdbd7806b791: Status 404 returned error can't find the container with id 4843db6cee17334538f15aa29496b7959a14b599ac08afad4dbabdbd7806b791 Jul 29 18:34:22.366420 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:22.366378 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1dc9839_215b_400e_ada4_ed1779ec7c68.slice/crio-f7e71eb8f1d3d6439c3cccd7744ad284e7b88e5c21c3f713bf97cfdf26347d8f WatchSource:0}: Error finding container f7e71eb8f1d3d6439c3cccd7744ad284e7b88e5c21c3f713bf97cfdf26347d8f: Status 404 returned error can't find the container with id f7e71eb8f1d3d6439c3cccd7744ad284e7b88e5c21c3f713bf97cfdf26347d8f Jul 29 18:34:22.367050 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:22.366979 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe3ec65e_1d9e_4ab3_9a1c_078bca4e78de.slice/crio-923636c1d3f37f02a925abe7b02b48fc7105f8e577c18cd4cb299732c7bcf2b1 WatchSource:0}: Error finding container 923636c1d3f37f02a925abe7b02b48fc7105f8e577c18cd4cb299732c7bcf2b1: Status 404 returned error can't find the container with id 923636c1d3f37f02a925abe7b02b48fc7105f8e577c18cd4cb299732c7bcf2b1 Jul 29 18:34:22.368225 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:22.368081 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4092d9a7_0970_48af_9e09_e0cd691fcc02.slice/crio-341673c6dbf0d1a26b06717745cc20fb85f09e7dc17245df2e11b7f78e51f3a4 WatchSource:0}: Error finding container 341673c6dbf0d1a26b06717745cc20fb85f09e7dc17245df2e11b7f78e51f3a4: Status 404 returned error can't find the container with id 341673c6dbf0d1a26b06717745cc20fb85f09e7dc17245df2e11b7f78e51f3a4 Jul 29 18:34:22.369018 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:22.368995 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d933486_a30c_4f85_83ff_e1a190e2f95b.slice/crio-c91ce6b729d7114ba1dbcc739aa06400714799e39c7f56b36bf6001d7258bf8e WatchSource:0}: Error finding container c91ce6b729d7114ba1dbcc739aa06400714799e39c7f56b36bf6001d7258bf8e: Status 404 returned error can't find the container with id c91ce6b729d7114ba1dbcc739aa06400714799e39c7f56b36bf6001d7258bf8e Jul 29 18:34:22.521825 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:22.521653 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 18:34:22.754159 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:22.754117 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95f0df74-cd8c-4c76-ac89-62b675ce368f-metrics-certs\") pod \"network-metrics-daemon-w69sl\" (UID: \"95f0df74-cd8c-4c76-ac89-62b675ce368f\") " pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:22.754332 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:22.754173 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1f1308a-865e-4a0f-ad80-7a8602155966-original-pull-secret\") pod \"global-pull-secret-syncer-8cc84\" (UID: \"c1f1308a-865e-4a0f-ad80-7a8602155966\") " pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:22.754332 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:22.754293 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:22.754332 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:22.754294 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:22.754496 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:22.754361 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f1308a-865e-4a0f-ad80-7a8602155966-original-pull-secret podName:c1f1308a-865e-4a0f-ad80-7a8602155966 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:24.75434215 +0000 UTC m=+5.996519287 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1f1308a-865e-4a0f-ad80-7a8602155966-original-pull-secret") pod "global-pull-secret-syncer-8cc84" (UID: "c1f1308a-865e-4a0f-ad80-7a8602155966") : object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:22.754496 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:22.754384 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95f0df74-cd8c-4c76-ac89-62b675ce368f-metrics-certs podName:95f0df74-cd8c-4c76-ac89-62b675ce368f nodeName:}" failed. No retries permitted until 2026-07-29 18:34:24.754373716 +0000 UTC m=+5.996550854 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95f0df74-cd8c-4c76-ac89-62b675ce368f-metrics-certs") pod "network-metrics-daemon-w69sl" (UID: "95f0df74-cd8c-4c76-ac89-62b675ce368f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:22.960660 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:22.960615 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxgnt\" (UniqueName: \"kubernetes.io/projected/7961d8da-66e2-4b1b-9f5a-37beefbd47eb-kube-api-access-dxgnt\") pod \"network-check-target-xtdjk\" (UID: \"7961d8da-66e2-4b1b-9f5a-37beefbd47eb\") " pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:34:22.960848 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:22.960821 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 18:34:22.960914 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:22.960851 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 18:34:22.960914 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:22.960866 2562 projected.go:196] Error preparing data for projected volume kube-api-access-dxgnt for pod openshift-network-diagnostics/network-check-target-xtdjk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:22.961015 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:22.960938 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7961d8da-66e2-4b1b-9f5a-37beefbd47eb-kube-api-access-dxgnt podName:7961d8da-66e2-4b1b-9f5a-37beefbd47eb nodeName:}" failed. No retries permitted until 2026-07-29 18:34:24.96091793 +0000 UTC m=+6.203095070 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dxgnt" (UniqueName: "kubernetes.io/projected/7961d8da-66e2-4b1b-9f5a-37beefbd47eb-kube-api-access-dxgnt") pod "network-check-target-xtdjk" (UID: "7961d8da-66e2-4b1b-9f5a-37beefbd47eb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:23.170890 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:23.170821 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 18:29:21 +0000 UTC" deadline="2028-01-03 01:29:42.176616559 +0000 UTC" Jul 29 18:34:23.170890 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:23.170888 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12534h55m19.005733365s" Jul 29 18:34:23.345342 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:23.344810 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:23.345342 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:23.344952 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8cc84" podUID="c1f1308a-865e-4a0f-ad80-7a8602155966" Jul 29 18:34:23.345879 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:23.345723 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:23.345879 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:23.345843 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w69sl" podUID="95f0df74-cd8c-4c76-ac89-62b675ce368f" Jul 29 18:34:23.358256 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:23.358152 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" event={"ID":"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de","Type":"ContainerStarted","Data":"923636c1d3f37f02a925abe7b02b48fc7105f8e577c18cd4cb299732c7bcf2b1"} Jul 29 18:34:23.360189 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:23.360153 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-skm5p" event={"ID":"9e7c71e3-553b-4508-a7e3-1e823a72af11","Type":"ContainerStarted","Data":"4843db6cee17334538f15aa29496b7959a14b599ac08afad4dbabdbd7806b791"} Jul 29 18:34:23.364412 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:23.364385 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tzwxd" event={"ID":"0ba5d633-3365-42f2-9956-0409775e3fa2","Type":"ContainerStarted","Data":"562b478dd150f35ce1957057b8b2dffe088599a8dfaa1e2eaae4d278bac8d976"} Jul 29 18:34:23.365881 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:23.365856 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4dqf5" event={"ID":"15ad40c9-68c8-4602-8911-603bd60f8de3","Type":"ContainerStarted","Data":"08d0a0b9341b15fd610612b2047a729bbe0732288c4cc8e9cf2201f937282aea"} Jul 29 18:34:23.367879 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:23.367853 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5ddbt" event={"ID":"5d933486-a30c-4f85-83ff-e1a190e2f95b","Type":"ContainerStarted","Data":"c91ce6b729d7114ba1dbcc739aa06400714799e39c7f56b36bf6001d7258bf8e"} Jul 29 18:34:23.370505 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:23.370476 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-44lqv" event={"ID":"f54f65a5-9d9b-4516-8bd7-dc90f5e3dad6","Type":"ContainerStarted","Data":"b31a7d79c25d762e22c6f8d77e39810649302b48ac6d02a638f8d4fef015b153"} Jul 29 18:34:23.378050 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:23.378024 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" event={"ID":"6bd12426-d81c-40eb-ab01-ee24cbd47be2","Type":"ContainerStarted","Data":"086665ad1385dc52e91694385b6fa2745753a95eeaf4a152a481f34be2f83b49"} Jul 29 18:34:23.383615 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:23.383314 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-190.ec2.internal" event={"ID":"305d6500b5831efe5fa1deaa8b353f63","Type":"ContainerStarted","Data":"2d1137e9544f600b80678d56ab243b4b73eefdac8e90de93a530c18ccb18c422"} Jul 29 18:34:23.389120 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:23.389091 2562 generic.go:356] "Generic (PLEG): container finished" podID="1d62cc98f7984cd1fdc5d04ac3167f99" containerID="0f35f85db4a3a0cfe261b35e04104cc6d23397f1f20bb78eebafd87a35f9c48c" exitCode=0 Jul 29 18:34:23.389242 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:23.389173 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-190.ec2.internal" event={"ID":"1d62cc98f7984cd1fdc5d04ac3167f99","Type":"ContainerDied","Data":"0f35f85db4a3a0cfe261b35e04104cc6d23397f1f20bb78eebafd87a35f9c48c"} Jul 29 18:34:23.393070 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:23.393044 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q72xw" event={"ID":"4092d9a7-0970-48af-9e09-e0cd691fcc02","Type":"ContainerStarted","Data":"341673c6dbf0d1a26b06717745cc20fb85f09e7dc17245df2e11b7f78e51f3a4"} Jul 29 18:34:23.411506 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:23.407310 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm" event={"ID":"a1dc9839-215b-400e-ada4-ed1779ec7c68","Type":"ContainerStarted","Data":"f7e71eb8f1d3d6439c3cccd7744ad284e7b88e5c21c3f713bf97cfdf26347d8f"} Jul 29 18:34:23.414647 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:23.414579 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-190.ec2.internal" podStartSLOduration=2.414562033 podStartE2EDuration="2.414562033s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:23.399364876 +0000 UTC m=+4.641542036" watchObservedRunningTime="2026-07-29 18:34:23.414562033 +0000 UTC m=+4.656739191" Jul 29 18:34:24.344991 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:24.344958 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:34:24.345465 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:24.345096 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtdjk" podUID="7961d8da-66e2-4b1b-9f5a-37beefbd47eb" Jul 29 18:34:24.419324 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:24.419208 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-190.ec2.internal" event={"ID":"1d62cc98f7984cd1fdc5d04ac3167f99","Type":"ContainerStarted","Data":"26d54ff953cc64f7ebf417a2013be9eefe6395f251df53c5bec6c6244c46b62a"} Jul 29 18:34:24.780047 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:24.779092 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95f0df74-cd8c-4c76-ac89-62b675ce368f-metrics-certs\") pod \"network-metrics-daemon-w69sl\" (UID: \"95f0df74-cd8c-4c76-ac89-62b675ce368f\") " pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:24.780047 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:24.779142 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1f1308a-865e-4a0f-ad80-7a8602155966-original-pull-secret\") pod \"global-pull-secret-syncer-8cc84\" (UID: \"c1f1308a-865e-4a0f-ad80-7a8602155966\") " pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:24.780047 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:24.779332 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:24.780047 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:24.779415 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f1308a-865e-4a0f-ad80-7a8602155966-original-pull-secret podName:c1f1308a-865e-4a0f-ad80-7a8602155966 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:28.779374781 +0000 UTC m=+10.021551920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1f1308a-865e-4a0f-ad80-7a8602155966-original-pull-secret") pod "global-pull-secret-syncer-8cc84" (UID: "c1f1308a-865e-4a0f-ad80-7a8602155966") : object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:24.780047 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:24.779911 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:24.780047 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:24.779967 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95f0df74-cd8c-4c76-ac89-62b675ce368f-metrics-certs podName:95f0df74-cd8c-4c76-ac89-62b675ce368f nodeName:}" failed. No retries permitted until 2026-07-29 18:34:28.779950405 +0000 UTC m=+10.022127546 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95f0df74-cd8c-4c76-ac89-62b675ce368f-metrics-certs") pod "network-metrics-daemon-w69sl" (UID: "95f0df74-cd8c-4c76-ac89-62b675ce368f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:24.981206 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:24.981159 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxgnt\" (UniqueName: \"kubernetes.io/projected/7961d8da-66e2-4b1b-9f5a-37beefbd47eb-kube-api-access-dxgnt\") pod \"network-check-target-xtdjk\" (UID: \"7961d8da-66e2-4b1b-9f5a-37beefbd47eb\") " pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:34:24.981482 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:24.981331 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 18:34:24.981482 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:24.981350 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 18:34:24.981482 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:24.981369 2562 projected.go:196] Error preparing data for projected volume kube-api-access-dxgnt for pod openshift-network-diagnostics/network-check-target-xtdjk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:24.981482 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:24.981428 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7961d8da-66e2-4b1b-9f5a-37beefbd47eb-kube-api-access-dxgnt podName:7961d8da-66e2-4b1b-9f5a-37beefbd47eb nodeName:}" failed. No retries permitted until 2026-07-29 18:34:28.981408991 +0000 UTC m=+10.223586159 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dxgnt" (UniqueName: "kubernetes.io/projected/7961d8da-66e2-4b1b-9f5a-37beefbd47eb-kube-api-access-dxgnt") pod "network-check-target-xtdjk" (UID: "7961d8da-66e2-4b1b-9f5a-37beefbd47eb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:25.347715 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:25.347682 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:25.348196 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:25.347735 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:25.348196 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:25.347858 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8cc84" podUID="c1f1308a-865e-4a0f-ad80-7a8602155966" Jul 29 18:34:25.348309 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:25.348242 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w69sl" podUID="95f0df74-cd8c-4c76-ac89-62b675ce368f" Jul 29 18:34:26.344882 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:26.344851 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:34:26.345082 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:26.344984 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtdjk" podUID="7961d8da-66e2-4b1b-9f5a-37beefbd47eb" Jul 29 18:34:27.344992 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:27.344604 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:27.344992 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:27.344620 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:27.344992 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:27.344744 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8cc84" podUID="c1f1308a-865e-4a0f-ad80-7a8602155966" Jul 29 18:34:27.344992 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:27.344890 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w69sl" podUID="95f0df74-cd8c-4c76-ac89-62b675ce368f" Jul 29 18:34:28.345831 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:28.345336 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:34:28.345831 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:28.345467 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtdjk" podUID="7961d8da-66e2-4b1b-9f5a-37beefbd47eb" Jul 29 18:34:28.814661 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:28.814538 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95f0df74-cd8c-4c76-ac89-62b675ce368f-metrics-certs\") pod \"network-metrics-daemon-w69sl\" (UID: \"95f0df74-cd8c-4c76-ac89-62b675ce368f\") " pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:28.814661 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:28.814582 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1f1308a-865e-4a0f-ad80-7a8602155966-original-pull-secret\") pod \"global-pull-secret-syncer-8cc84\" (UID: \"c1f1308a-865e-4a0f-ad80-7a8602155966\") " pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:28.814878 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:28.814697 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:28.814878 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:28.814709 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:28.814878 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:28.814757 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f1308a-865e-4a0f-ad80-7a8602155966-original-pull-secret podName:c1f1308a-865e-4a0f-ad80-7a8602155966 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:36.814738014 +0000 UTC m=+18.056915171 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1f1308a-865e-4a0f-ad80-7a8602155966-original-pull-secret") pod "global-pull-secret-syncer-8cc84" (UID: "c1f1308a-865e-4a0f-ad80-7a8602155966") : object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:28.814878 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:28.814778 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95f0df74-cd8c-4c76-ac89-62b675ce368f-metrics-certs podName:95f0df74-cd8c-4c76-ac89-62b675ce368f nodeName:}" failed. No retries permitted until 2026-07-29 18:34:36.814767429 +0000 UTC m=+18.056944565 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95f0df74-cd8c-4c76-ac89-62b675ce368f-metrics-certs") pod "network-metrics-daemon-w69sl" (UID: "95f0df74-cd8c-4c76-ac89-62b675ce368f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:29.015837 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:29.015801 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxgnt\" (UniqueName: \"kubernetes.io/projected/7961d8da-66e2-4b1b-9f5a-37beefbd47eb-kube-api-access-dxgnt\") pod \"network-check-target-xtdjk\" (UID: \"7961d8da-66e2-4b1b-9f5a-37beefbd47eb\") " pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:34:29.015999 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:29.015985 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 18:34:29.016079 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:29.016006 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 18:34:29.016079 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:29.016015 2562 projected.go:196] Error preparing data for projected volume kube-api-access-dxgnt for pod openshift-network-diagnostics/network-check-target-xtdjk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:29.016079 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:29.016070 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7961d8da-66e2-4b1b-9f5a-37beefbd47eb-kube-api-access-dxgnt podName:7961d8da-66e2-4b1b-9f5a-37beefbd47eb nodeName:}" failed. No retries permitted until 2026-07-29 18:34:37.016052731 +0000 UTC m=+18.258229864 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dxgnt" (UniqueName: "kubernetes.io/projected/7961d8da-66e2-4b1b-9f5a-37beefbd47eb-kube-api-access-dxgnt") pod "network-check-target-xtdjk" (UID: "7961d8da-66e2-4b1b-9f5a-37beefbd47eb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:29.345682 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:29.345649 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:29.345852 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:29.345765 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8cc84" podUID="c1f1308a-865e-4a0f-ad80-7a8602155966" Jul 29 18:34:29.346189 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:29.346027 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:29.346189 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:29.346122 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w69sl" podUID="95f0df74-cd8c-4c76-ac89-62b675ce368f" Jul 29 18:34:30.345174 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:30.345141 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:34:30.345355 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:30.345254 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtdjk" podUID="7961d8da-66e2-4b1b-9f5a-37beefbd47eb" Jul 29 18:34:31.347082 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:31.345942 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:31.347082 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:31.346066 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8cc84" podUID="c1f1308a-865e-4a0f-ad80-7a8602155966" Jul 29 18:34:31.347082 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:31.346877 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:31.347082 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:31.347007 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w69sl" podUID="95f0df74-cd8c-4c76-ac89-62b675ce368f" Jul 29 18:34:32.345082 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:32.345047 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:34:32.345261 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:32.345159 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtdjk" podUID="7961d8da-66e2-4b1b-9f5a-37beefbd47eb" Jul 29 18:34:33.345215 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:33.345183 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:33.345652 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:33.345326 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8cc84" podUID="c1f1308a-865e-4a0f-ad80-7a8602155966" Jul 29 18:34:33.345652 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:33.345363 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:33.345652 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:33.345455 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w69sl" podUID="95f0df74-cd8c-4c76-ac89-62b675ce368f" Jul 29 18:34:34.344655 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:34.344621 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:34:34.344806 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:34.344744 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtdjk" podUID="7961d8da-66e2-4b1b-9f5a-37beefbd47eb" Jul 29 18:34:35.345184 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:35.345135 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:35.345650 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:35.345270 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8cc84" podUID="c1f1308a-865e-4a0f-ad80-7a8602155966" Jul 29 18:34:35.345650 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:35.345329 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:35.345650 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:35.345472 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w69sl" podUID="95f0df74-cd8c-4c76-ac89-62b675ce368f" Jul 29 18:34:36.344627 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:36.344596 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:34:36.344786 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:36.344701 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtdjk" podUID="7961d8da-66e2-4b1b-9f5a-37beefbd47eb" Jul 29 18:34:36.875144 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:36.875112 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95f0df74-cd8c-4c76-ac89-62b675ce368f-metrics-certs\") pod \"network-metrics-daemon-w69sl\" (UID: \"95f0df74-cd8c-4c76-ac89-62b675ce368f\") " pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:36.875599 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:36.875154 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1f1308a-865e-4a0f-ad80-7a8602155966-original-pull-secret\") pod \"global-pull-secret-syncer-8cc84\" (UID: \"c1f1308a-865e-4a0f-ad80-7a8602155966\") " pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:36.875599 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:36.875261 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:36.875599 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:36.875262 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:36.875599 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:36.875315 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f1308a-865e-4a0f-ad80-7a8602155966-original-pull-secret podName:c1f1308a-865e-4a0f-ad80-7a8602155966 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:52.875298576 +0000 UTC m=+34.117475710 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1f1308a-865e-4a0f-ad80-7a8602155966-original-pull-secret") pod "global-pull-secret-syncer-8cc84" (UID: "c1f1308a-865e-4a0f-ad80-7a8602155966") : object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:36.875599 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:36.875335 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95f0df74-cd8c-4c76-ac89-62b675ce368f-metrics-certs podName:95f0df74-cd8c-4c76-ac89-62b675ce368f nodeName:}" failed. No retries permitted until 2026-07-29 18:34:52.875325613 +0000 UTC m=+34.117502747 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95f0df74-cd8c-4c76-ac89-62b675ce368f-metrics-certs") pod "network-metrics-daemon-w69sl" (UID: "95f0df74-cd8c-4c76-ac89-62b675ce368f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:37.077071 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:37.077039 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxgnt\" (UniqueName: \"kubernetes.io/projected/7961d8da-66e2-4b1b-9f5a-37beefbd47eb-kube-api-access-dxgnt\") pod \"network-check-target-xtdjk\" (UID: \"7961d8da-66e2-4b1b-9f5a-37beefbd47eb\") " pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:34:37.077225 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:37.077197 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 18:34:37.077225 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:37.077217 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 18:34:37.077225 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:37.077226 2562 projected.go:196] Error preparing data for projected volume kube-api-access-dxgnt for pod openshift-network-diagnostics/network-check-target-xtdjk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:37.077354 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:37.077279 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7961d8da-66e2-4b1b-9f5a-37beefbd47eb-kube-api-access-dxgnt podName:7961d8da-66e2-4b1b-9f5a-37beefbd47eb nodeName:}" failed. No retries permitted until 2026-07-29 18:34:53.077264789 +0000 UTC m=+34.319441922 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dxgnt" (UniqueName: "kubernetes.io/projected/7961d8da-66e2-4b1b-9f5a-37beefbd47eb-kube-api-access-dxgnt") pod "network-check-target-xtdjk" (UID: "7961d8da-66e2-4b1b-9f5a-37beefbd47eb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:37.345238 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:37.345211 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:37.345404 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:37.345328 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8cc84" podUID="c1f1308a-865e-4a0f-ad80-7a8602155966" Jul 29 18:34:37.345404 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:37.345383 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:37.345495 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:37.345461 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w69sl" podUID="95f0df74-cd8c-4c76-ac89-62b675ce368f" Jul 29 18:34:38.345336 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:38.345305 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:34:38.345779 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:38.345424 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtdjk" podUID="7961d8da-66e2-4b1b-9f5a-37beefbd47eb" Jul 29 18:34:39.348944 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:39.348914 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:39.349288 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:39.349028 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w69sl" podUID="95f0df74-cd8c-4c76-ac89-62b675ce368f" Jul 29 18:34:39.349288 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:39.349084 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:39.349288 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:39.349180 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8cc84" podUID="c1f1308a-865e-4a0f-ad80-7a8602155966" Jul 29 18:34:40.345400 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:40.345364 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:34:40.345589 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:40.345500 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtdjk" podUID="7961d8da-66e2-4b1b-9f5a-37beefbd47eb" Jul 29 18:34:41.345668 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:41.345481 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:41.346218 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:41.345481 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:41.346218 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:41.345755 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w69sl" podUID="95f0df74-cd8c-4c76-ac89-62b675ce368f" Jul 29 18:34:41.346218 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:41.345870 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8cc84" podUID="c1f1308a-865e-4a0f-ad80-7a8602155966" Jul 29 18:34:41.451549 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:41.451496 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tzwxd" event={"ID":"0ba5d633-3365-42f2-9956-0409775e3fa2","Type":"ContainerStarted","Data":"ed5108bc6404153bf8811fd4a43e1fa05ded2eb33bae97c53b63975f4aa0816a"} Jul 29 18:34:41.452996 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:41.452974 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4dqf5" event={"ID":"15ad40c9-68c8-4602-8911-603bd60f8de3","Type":"ContainerStarted","Data":"2f0c1085e3bb31ba4e9d48afdac7932aac2fc515d5ddf35104c59d51442852aa"} Jul 29 18:34:41.454403 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:41.454376 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5ddbt" event={"ID":"5d933486-a30c-4f85-83ff-e1a190e2f95b","Type":"ContainerStarted","Data":"dbb20f28f55de483f24cce4929fa593884373e914affa07e8700772fb641636a"} Jul 29 18:34:41.455988 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:41.455968 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8mjg_6bd12426-d81c-40eb-ab01-ee24cbd47be2/ovn-acl-logging/0.log" Jul 29 18:34:41.456308 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:41.456286 2562 generic.go:356] "Generic (PLEG): container finished" podID="6bd12426-d81c-40eb-ab01-ee24cbd47be2" containerID="bb276039ac068d6ca237e4a7f3bf735af3985e8858cbc1cc2e7f80f9b11831c2" exitCode=1 Jul 29 18:34:41.456385 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:41.456351 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" event={"ID":"6bd12426-d81c-40eb-ab01-ee24cbd47be2","Type":"ContainerDied","Data":"bb276039ac068d6ca237e4a7f3bf735af3985e8858cbc1cc2e7f80f9b11831c2"} Jul 29 18:34:41.456444 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:41.456403 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" event={"ID":"6bd12426-d81c-40eb-ab01-ee24cbd47be2","Type":"ContainerStarted","Data":"807bdd9a6082e0599653c37c9eb9194379080c3c41408c43caa3c6168e6740c8"} Jul 29 18:34:41.457859 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:41.457833 2562 generic.go:356] "Generic (PLEG): container finished" podID="4092d9a7-0970-48af-9e09-e0cd691fcc02" containerID="c683cb3010c3afacbe03f3d9daa2ee13ef5d7e9fab7d584e17f161a598954b1f" exitCode=0 Jul 29 18:34:41.457935 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:41.457907 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q72xw" event={"ID":"4092d9a7-0970-48af-9e09-e0cd691fcc02","Type":"ContainerDied","Data":"c683cb3010c3afacbe03f3d9daa2ee13ef5d7e9fab7d584e17f161a598954b1f"} Jul 29 18:34:41.459415 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:41.459394 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm" event={"ID":"a1dc9839-215b-400e-ada4-ed1779ec7c68","Type":"ContainerStarted","Data":"b9423ad6ac872a38e0316920cbf865e57889a1a8a8241e9b30834a03a733e7d4"} Jul 29 18:34:41.461207 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:41.461184 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" event={"ID":"fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de","Type":"ContainerStarted","Data":"7f43ceaf5c01566b3a3b62acd1cb17d5abd98061ffd9fae837c9f8567152600e"} Jul 29 18:34:41.464771 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:41.464753 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-skm5p" event={"ID":"9e7c71e3-553b-4508-a7e3-1e823a72af11","Type":"ContainerStarted","Data":"f26b1be15b34126a57bfc9dcac6e76afa3955afd208bbceed470cacfd4762da0"} Jul 29 18:34:41.468216 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:41.468181 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-190.ec2.internal" podStartSLOduration=20.468170758 podStartE2EDuration="20.468170758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:24.436919402 +0000 UTC m=+5.679096563" watchObservedRunningTime="2026-07-29 18:34:41.468170758 +0000 UTC m=+22.710347913" Jul 29 18:34:41.468306 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:41.468252 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tzwxd" podStartSLOduration=3.799638244 podStartE2EDuration="22.468246747s" totalImagesPullingTime="18.668608503s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:41.467886902 +0000 UTC m=+22.710064059" watchObservedRunningTime="2026-07-29 18:34:41.468246747 +0000 UTC m=+22.710423902" Jul 29 18:34:41.481783 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:41.481724 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-skm5p" podStartSLOduration=2.856188335 podStartE2EDuration="21.481712227s" totalImagesPullingTime="18.625523892s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:41.481580678 +0000 UTC m=+22.723757835" watchObservedRunningTime="2026-07-29 18:34:41.481712227 +0000 UTC m=+22.723889383" Jul 29 18:34:41.521274 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:41.521234 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qgmsv" podStartSLOduration=3.879338319 podStartE2EDuration="22.521220848s" totalImagesPullingTime="18.641882529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:41.521097569 +0000 UTC m=+22.763274727" watchObservedRunningTime="2026-07-29 18:34:41.521220848 +0000 UTC m=+22.763398003" Jul 29 18:34:41.540249 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:41.540214 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5ddbt" podStartSLOduration=2.9212190319999998 podStartE2EDuration="21.540202085s" totalImagesPullingTime="18.618983053s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:41.539772526 +0000 UTC m=+22.781949681" watchObservedRunningTime="2026-07-29 18:34:41.540202085 +0000 UTC m=+22.782379280" Jul 29 18:34:42.344875 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:42.344648 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:34:42.345027 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:42.344987 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtdjk" podUID="7961d8da-66e2-4b1b-9f5a-37beefbd47eb" Jul 29 18:34:42.469112 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:42.469083 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-44lqv" event={"ID":"f54f65a5-9d9b-4516-8bd7-dc90f5e3dad6","Type":"ContainerStarted","Data":"6736d82c87589acbe2ff1acbb75a20457352e654ae386b9e603706217d41bce4"} Jul 29 18:34:42.472169 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:42.472144 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8mjg_6bd12426-d81c-40eb-ab01-ee24cbd47be2/ovn-acl-logging/0.log" Jul 29 18:34:42.472553 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:42.472525 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" event={"ID":"6bd12426-d81c-40eb-ab01-ee24cbd47be2","Type":"ContainerStarted","Data":"2a40202a91db82d7285d74435f38e90f754f483f84d03da91b917acd8aae6457"} Jul 29 18:34:42.472636 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:42.472592 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" event={"ID":"6bd12426-d81c-40eb-ab01-ee24cbd47be2","Type":"ContainerStarted","Data":"244dc59dc69769012115f7a4d07d8528715b46c4eef34994be8b8b1a3e3a4894"} Jul 29 18:34:42.472636 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:42.472623 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" event={"ID":"6bd12426-d81c-40eb-ab01-ee24cbd47be2","Type":"ContainerStarted","Data":"db32286c286e928159732f3c04264d4f179956abc473632ff79ac0f0980bb3df"} Jul 29 18:34:42.472750 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:42.472650 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" event={"ID":"6bd12426-d81c-40eb-ab01-ee24cbd47be2","Type":"ContainerStarted","Data":"316e58a9133e4f2421b88b135cab62ff4a57486c33efdbaff4d6dd2a3a59fe40"} Jul 29 18:34:42.487390 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:42.487334 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-44lqv" podStartSLOduration=4.842859834 podStartE2EDuration="23.487316211s" totalImagesPullingTime="18.644456377s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:42.486352691 +0000 UTC m=+23.728529850" watchObservedRunningTime="2026-07-29 18:34:42.487316211 +0000 UTC m=+23.729493369" Jul 29 18:34:42.487535 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:42.487492 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4dqf5" podStartSLOduration=3.858815572 podStartE2EDuration="22.487480063s" totalImagesPullingTime="18.628664491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:41.555065731 +0000 UTC m=+22.797242886" watchObservedRunningTime="2026-07-29 18:34:42.487480063 +0000 UTC m=+23.729657220" Jul 29 18:34:42.496471 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:42.496451 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 29 18:34:43.194351 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:43.194226 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T18:34:42.496468581Z","UUID":"310df144-4811-429e-8582-884b4fd673c1","Handler":null,"Name":"","Endpoint":""} Jul 29 18:34:43.195886 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:43.195867 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 29 18:34:43.196004 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:43.195902 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 29 18:34:43.345376 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:43.345344 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:43.345556 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:43.345462 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8cc84" podUID="c1f1308a-865e-4a0f-ad80-7a8602155966" Jul 29 18:34:43.346069 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:43.345923 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:43.346069 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:43.346022 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w69sl" podUID="95f0df74-cd8c-4c76-ac89-62b675ce368f" Jul 29 18:34:43.477379 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:43.477354 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm" event={"ID":"a1dc9839-215b-400e-ada4-ed1779ec7c68","Type":"ContainerStarted","Data":"9c547868591120f01e6a8692aaec3c1fbed1be61d6db1bc80816d7115889799a"} Jul 29 18:34:44.345299 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:44.345109 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:34:44.345471 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:44.345405 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtdjk" podUID="7961d8da-66e2-4b1b-9f5a-37beefbd47eb" Jul 29 18:34:44.467812 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:44.467781 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4dqf5" Jul 29 18:34:44.468400 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:44.468379 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4dqf5" Jul 29 18:34:44.483440 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:44.483419 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8mjg_6bd12426-d81c-40eb-ab01-ee24cbd47be2/ovn-acl-logging/0.log" Jul 29 18:34:44.483899 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:44.483870 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" event={"ID":"6bd12426-d81c-40eb-ab01-ee24cbd47be2","Type":"ContainerStarted","Data":"cc901e8797d57a3bc64a47135a64b1607a2f708f1e62035974b88ad61d772965"} Jul 29 18:34:44.486085 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:44.486062 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm" event={"ID":"a1dc9839-215b-400e-ada4-ed1779ec7c68","Type":"ContainerStarted","Data":"68630838b85202026343bd5eca01ed984be1e79d80ad0bc91d75a9dae542fbb0"} Jul 29 18:34:44.486339 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:44.486322 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4dqf5" Jul 29 18:34:44.486712 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:44.486696 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4dqf5" Jul 29 18:34:44.503857 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:44.503811 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gdddm" podStartSLOduration=4.868332538 podStartE2EDuration="25.503794038s" totalImagesPullingTime="20.6354615s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:44.503241607 +0000 UTC m=+25.745418764" watchObservedRunningTime="2026-07-29 18:34:44.503794038 +0000 UTC m=+25.745971198" Jul 29 18:34:44.608095 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:44.608018 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:34:44.694074 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:44.694040 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:34:45.345072 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:45.345041 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:45.345253 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:45.345160 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8cc84" podUID="c1f1308a-865e-4a0f-ad80-7a8602155966" Jul 29 18:34:45.345253 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:45.345211 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:45.345378 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:45.345307 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w69sl" podUID="95f0df74-cd8c-4c76-ac89-62b675ce368f" Jul 29 18:34:45.662696 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:45.662623 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:34:45.765670 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:45.765640 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:34:45.873365 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:45.873336 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:34:46.344686 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:46.344536 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:34:46.344815 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:46.344757 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtdjk" podUID="7961d8da-66e2-4b1b-9f5a-37beefbd47eb" Jul 29 18:34:46.492240 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:46.492208 2562 generic.go:356] "Generic (PLEG): container finished" podID="4092d9a7-0970-48af-9e09-e0cd691fcc02" containerID="b11afeafa56ed8bcdb77c5ad6452d1fe6eaed4a84fa45132d7d1244e7dc84c0f" exitCode=0 Jul 29 18:34:46.492400 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:46.492306 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q72xw" event={"ID":"4092d9a7-0970-48af-9e09-e0cd691fcc02","Type":"ContainerDied","Data":"b11afeafa56ed8bcdb77c5ad6452d1fe6eaed4a84fa45132d7d1244e7dc84c0f"} Jul 29 18:34:46.495927 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:46.495911 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8mjg_6bd12426-d81c-40eb-ab01-ee24cbd47be2/ovn-acl-logging/0.log" Jul 29 18:34:46.496314 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:46.496296 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" event={"ID":"6bd12426-d81c-40eb-ab01-ee24cbd47be2","Type":"ContainerStarted","Data":"3a67565664934d14fca07a2116ab099e16ad9df7ae95554136bda68e20cc2819"} Jul 29 18:34:46.496563 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:46.496544 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:46.496660 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:46.496644 2562 scope.go:117] "RemoveContainer" containerID="bb276039ac068d6ca237e4a7f3bf735af3985e8858cbc1cc2e7f80f9b11831c2" Jul 29 18:34:46.512346 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:46.512329 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:47.344825 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:47.344796 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:47.345537 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:47.344898 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8cc84" podUID="c1f1308a-865e-4a0f-ad80-7a8602155966" Jul 29 18:34:47.345537 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:47.344961 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:47.345537 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:47.345078 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w69sl" podUID="95f0df74-cd8c-4c76-ac89-62b675ce368f" Jul 29 18:34:47.500611 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:47.500574 2562 generic.go:356] "Generic (PLEG): container finished" podID="4092d9a7-0970-48af-9e09-e0cd691fcc02" containerID="6412ee0b3627cebeb565a6e4eda3851c4752e3a078f38816d4da952465bb7624" exitCode=0 Jul 29 18:34:47.500740 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:47.500652 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q72xw" event={"ID":"4092d9a7-0970-48af-9e09-e0cd691fcc02","Type":"ContainerDied","Data":"6412ee0b3627cebeb565a6e4eda3851c4752e3a078f38816d4da952465bb7624"} Jul 29 18:34:47.504769 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:47.504753 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8mjg_6bd12426-d81c-40eb-ab01-ee24cbd47be2/ovn-acl-logging/0.log" Jul 29 18:34:47.505106 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:47.505083 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" event={"ID":"6bd12426-d81c-40eb-ab01-ee24cbd47be2","Type":"ContainerStarted","Data":"3e25dbd2046dc345b14067c159729699023f2963f1dbe657939292b73c6c0dd2"} Jul 29 18:34:47.505297 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:47.505277 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:47.505402 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:47.505344 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:47.513348 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:47.513322 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:34:47.520308 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:47.520285 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:34:47.552788 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:47.552743 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" podStartSLOduration=8.842555894 podStartE2EDuration="27.552730901s" totalImagesPullingTime="18.710175007s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:47.551008414 +0000 UTC m=+28.793185569" watchObservedRunningTime="2026-07-29 18:34:47.552730901 +0000 UTC m=+28.794908057" Jul 29 18:34:47.587832 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:47.587806 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:34:47.737582 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:47.737390 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:34:47.837226 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:47.837188 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:34:47.913639 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:47.913614 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w69sl"] Jul 29 18:34:47.913802 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:47.913708 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:47.913875 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:47.913804 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w69sl" podUID="95f0df74-cd8c-4c76-ac89-62b675ce368f" Jul 29 18:34:47.918184 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:47.918149 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8cc84"] Jul 29 18:34:47.918307 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:47.918224 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:47.918369 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:47.918320 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8cc84" podUID="c1f1308a-865e-4a0f-ad80-7a8602155966" Jul 29 18:34:47.918839 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:47.918812 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xtdjk"] Jul 29 18:34:47.918935 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:47.918900 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:34:47.918985 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:47.918964 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtdjk" podUID="7961d8da-66e2-4b1b-9f5a-37beefbd47eb" Jul 29 18:34:48.509274 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:48.509193 2562 generic.go:356] "Generic (PLEG): container finished" podID="4092d9a7-0970-48af-9e09-e0cd691fcc02" containerID="78f46b413e9706af1f94aa00978298512b0a9a597e0472d41ca2322e8e9ac962" exitCode=0 Jul 29 18:34:48.509677 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:48.509281 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q72xw" event={"ID":"4092d9a7-0970-48af-9e09-e0cd691fcc02","Type":"ContainerDied","Data":"78f46b413e9706af1f94aa00978298512b0a9a597e0472d41ca2322e8e9ac962"} Jul 29 18:34:48.715723 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:48.715684 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:34:49.038401 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:49.038354 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:34:49.097604 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:49.097572 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:34:49.345886 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:49.345856 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:49.346039 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:49.345931 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:49.346039 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:49.345965 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:34:49.346039 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:49.345992 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8cc84" podUID="c1f1308a-865e-4a0f-ad80-7a8602155966" Jul 29 18:34:49.346039 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:49.346026 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtdjk" podUID="7961d8da-66e2-4b1b-9f5a-37beefbd47eb" Jul 29 18:34:49.346238 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:49.346084 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w69sl" podUID="95f0df74-cd8c-4c76-ac89-62b675ce368f" Jul 29 18:34:51.344630 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:51.344598 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:51.345420 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:51.344722 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8cc84" podUID="c1f1308a-865e-4a0f-ad80-7a8602155966" Jul 29 18:34:51.345420 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:51.344770 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:51.345420 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:51.344841 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:34:51.345420 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:51.344909 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtdjk" podUID="7961d8da-66e2-4b1b-9f5a-37beefbd47eb" Jul 29 18:34:51.345420 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:51.345000 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w69sl" podUID="95f0df74-cd8c-4c76-ac89-62b675ce368f" Jul 29 18:34:52.220501 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:52.220453 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:34:52.300992 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:52.300915 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:34:52.900746 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:52.900717 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95f0df74-cd8c-4c76-ac89-62b675ce368f-metrics-certs\") pod \"network-metrics-daemon-w69sl\" (UID: \"95f0df74-cd8c-4c76-ac89-62b675ce368f\") " pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:52.900746 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:52.900748 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1f1308a-865e-4a0f-ad80-7a8602155966-original-pull-secret\") pod \"global-pull-secret-syncer-8cc84\" (UID: \"c1f1308a-865e-4a0f-ad80-7a8602155966\") " pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:52.901207 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:52.900871 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:52.901207 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:52.900912 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f1308a-865e-4a0f-ad80-7a8602155966-original-pull-secret podName:c1f1308a-865e-4a0f-ad80-7a8602155966 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:24.900900276 +0000 UTC m=+66.143077409 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1f1308a-865e-4a0f-ad80-7a8602155966-original-pull-secret") pod "global-pull-secret-syncer-8cc84" (UID: "c1f1308a-865e-4a0f-ad80-7a8602155966") : object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:52.901207 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:52.900870 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:52.901207 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:52.900994 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95f0df74-cd8c-4c76-ac89-62b675ce368f-metrics-certs podName:95f0df74-cd8c-4c76-ac89-62b675ce368f nodeName:}" failed. No retries permitted until 2026-07-29 18:35:24.900980945 +0000 UTC m=+66.143158082 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95f0df74-cd8c-4c76-ac89-62b675ce368f-metrics-certs") pod "network-metrics-daemon-w69sl" (UID: "95f0df74-cd8c-4c76-ac89-62b675ce368f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:53.101839 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:53.101808 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxgnt\" (UniqueName: \"kubernetes.io/projected/7961d8da-66e2-4b1b-9f5a-37beefbd47eb-kube-api-access-dxgnt\") pod \"network-check-target-xtdjk\" (UID: \"7961d8da-66e2-4b1b-9f5a-37beefbd47eb\") " pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:34:53.102012 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:53.101919 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 18:34:53.102012 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:53.101933 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 18:34:53.102012 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:53.101941 2562 projected.go:196] Error preparing data for projected volume kube-api-access-dxgnt for pod openshift-network-diagnostics/network-check-target-xtdjk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:53.102012 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:53.101985 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7961d8da-66e2-4b1b-9f5a-37beefbd47eb-kube-api-access-dxgnt podName:7961d8da-66e2-4b1b-9f5a-37beefbd47eb nodeName:}" failed. No retries permitted until 2026-07-29 18:35:25.101973448 +0000 UTC m=+66.344150585 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dxgnt" (UniqueName: "kubernetes.io/projected/7961d8da-66e2-4b1b-9f5a-37beefbd47eb-kube-api-access-dxgnt") pod "network-check-target-xtdjk" (UID: "7961d8da-66e2-4b1b-9f5a-37beefbd47eb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:53.344846 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:53.344816 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:34:53.345047 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:53.344815 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:53.345047 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:53.344926 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtdjk" podUID="7961d8da-66e2-4b1b-9f5a-37beefbd47eb" Jul 29 18:34:53.345047 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:53.344814 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:53.345047 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:53.344997 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w69sl" podUID="95f0df74-cd8c-4c76-ac89-62b675ce368f" Jul 29 18:34:53.345259 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:53.345054 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8cc84" podUID="c1f1308a-865e-4a0f-ad80-7a8602155966" Jul 29 18:34:53.523243 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:53.523211 2562 generic.go:356] "Generic (PLEG): container finished" podID="4092d9a7-0970-48af-9e09-e0cd691fcc02" containerID="5606470ad705c67cebd813387253e36d219590dcdcdbd1a22d57541e1f54b637" exitCode=0 Jul 29 18:34:53.523428 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:53.523255 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q72xw" event={"ID":"4092d9a7-0970-48af-9e09-e0cd691fcc02","Type":"ContainerDied","Data":"5606470ad705c67cebd813387253e36d219590dcdcdbd1a22d57541e1f54b637"} Jul 29 18:34:54.531427 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:54.531215 2562 generic.go:356] "Generic (PLEG): container finished" podID="4092d9a7-0970-48af-9e09-e0cd691fcc02" containerID="58b7b277f7c15ccb4c9de6ab0ed20429cf081a256ed9fb3fd5d80e5f5811d5f9" exitCode=0 Jul 29 18:34:54.531897 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:54.531318 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q72xw" event={"ID":"4092d9a7-0970-48af-9e09-e0cd691fcc02","Type":"ContainerDied","Data":"58b7b277f7c15ccb4c9de6ab0ed20429cf081a256ed9fb3fd5d80e5f5811d5f9"} Jul 29 18:34:55.088659 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.088634 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-190.ec2.internal" event="NodeReady" Jul 29 18:34:55.088812 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.088738 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 29 18:34:55.135072 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.135031 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-h8pgd"] Jul 29 18:34:55.156591 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.156567 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2gvrs"] Jul 29 18:34:55.156700 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.156687 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h8pgd" Jul 29 18:34:55.159001 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.158975 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 29 18:34:55.159126 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.159072 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mk972\"" Jul 29 18:34:55.159126 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.159097 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 29 18:34:55.182920 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.182899 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h8pgd"] Jul 29 18:34:55.183007 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.182928 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2gvrs"] Jul 29 18:34:55.183007 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.183000 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2gvrs" Jul 29 18:34:55.185448 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.185432 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 29 18:34:55.185448 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.185436 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 29 18:34:55.185666 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.185564 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ctdgq\"" Jul 29 18:34:55.185666 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.185621 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 29 18:34:55.217702 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.217685 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ed6ab3b-0c74-4957-be43-c96816a41d1a-cert\") pod \"ingress-canary-2gvrs\" (UID: \"2ed6ab3b-0c74-4957-be43-c96816a41d1a\") " pod="openshift-ingress-canary/ingress-canary-2gvrs" Jul 29 18:34:55.217801 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.217725 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gjff\" (UniqueName: \"kubernetes.io/projected/2ed6ab3b-0c74-4957-be43-c96816a41d1a-kube-api-access-8gjff\") pod \"ingress-canary-2gvrs\" (UID: \"2ed6ab3b-0c74-4957-be43-c96816a41d1a\") " pod="openshift-ingress-canary/ingress-canary-2gvrs" Jul 29 18:34:55.217801 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.217744 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbd0aa69-cc0c-4c79-9460-26e246d285f1-metrics-tls\") pod \"dns-default-h8pgd\" (UID: \"bbd0aa69-cc0c-4c79-9460-26e246d285f1\") " pod="openshift-dns/dns-default-h8pgd" Jul 29 18:34:55.217801 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.217765 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv6xk\" (UniqueName: \"kubernetes.io/projected/bbd0aa69-cc0c-4c79-9460-26e246d285f1-kube-api-access-kv6xk\") pod \"dns-default-h8pgd\" (UID: \"bbd0aa69-cc0c-4c79-9460-26e246d285f1\") " pod="openshift-dns/dns-default-h8pgd" Jul 29 18:34:55.217915 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.217816 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbd0aa69-cc0c-4c79-9460-26e246d285f1-tmp-dir\") pod \"dns-default-h8pgd\" (UID: \"bbd0aa69-cc0c-4c79-9460-26e246d285f1\") " pod="openshift-dns/dns-default-h8pgd" Jul 29 18:34:55.217915 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.217848 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bbd0aa69-cc0c-4c79-9460-26e246d285f1-config-volume\") pod \"dns-default-h8pgd\" (UID: \"bbd0aa69-cc0c-4c79-9460-26e246d285f1\") " pod="openshift-dns/dns-default-h8pgd" Jul 29 18:34:55.268112 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.268083 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:34:55.318622 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.318602 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbd0aa69-cc0c-4c79-9460-26e246d285f1-tmp-dir\") pod \"dns-default-h8pgd\" (UID: \"bbd0aa69-cc0c-4c79-9460-26e246d285f1\") " pod="openshift-dns/dns-default-h8pgd" Jul 29 18:34:55.318701 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.318630 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bbd0aa69-cc0c-4c79-9460-26e246d285f1-config-volume\") pod \"dns-default-h8pgd\" (UID: \"bbd0aa69-cc0c-4c79-9460-26e246d285f1\") " pod="openshift-dns/dns-default-h8pgd" Jul 29 18:34:55.318701 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.318677 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ed6ab3b-0c74-4957-be43-c96816a41d1a-cert\") pod \"ingress-canary-2gvrs\" (UID: \"2ed6ab3b-0c74-4957-be43-c96816a41d1a\") " pod="openshift-ingress-canary/ingress-canary-2gvrs" Jul 29 18:34:55.318786 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.318713 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gjff\" (UniqueName: \"kubernetes.io/projected/2ed6ab3b-0c74-4957-be43-c96816a41d1a-kube-api-access-8gjff\") pod \"ingress-canary-2gvrs\" (UID: \"2ed6ab3b-0c74-4957-be43-c96816a41d1a\") " pod="openshift-ingress-canary/ingress-canary-2gvrs" Jul 29 18:34:55.318786 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.318729 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbd0aa69-cc0c-4c79-9460-26e246d285f1-metrics-tls\") pod \"dns-default-h8pgd\" (UID: \"bbd0aa69-cc0c-4c79-9460-26e246d285f1\") " pod="openshift-dns/dns-default-h8pgd" Jul 29 18:34:55.318786 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.318743 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv6xk\" (UniqueName: \"kubernetes.io/projected/bbd0aa69-cc0c-4c79-9460-26e246d285f1-kube-api-access-kv6xk\") pod \"dns-default-h8pgd\" (UID: \"bbd0aa69-cc0c-4c79-9460-26e246d285f1\") " pod="openshift-dns/dns-default-h8pgd" Jul 29 18:34:55.318930 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:55.318832 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 18:34:55.318930 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:55.318909 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbd0aa69-cc0c-4c79-9460-26e246d285f1-metrics-tls podName:bbd0aa69-cc0c-4c79-9460-26e246d285f1 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:55.818888818 +0000 UTC m=+37.061065970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bbd0aa69-cc0c-4c79-9460-26e246d285f1-metrics-tls") pod "dns-default-h8pgd" (UID: "bbd0aa69-cc0c-4c79-9460-26e246d285f1") : secret "dns-default-metrics-tls" not found Jul 29 18:34:55.319017 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.318951 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbd0aa69-cc0c-4c79-9460-26e246d285f1-tmp-dir\") pod \"dns-default-h8pgd\" (UID: \"bbd0aa69-cc0c-4c79-9460-26e246d285f1\") " pod="openshift-dns/dns-default-h8pgd" Jul 29 18:34:55.319241 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.319224 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bbd0aa69-cc0c-4c79-9460-26e246d285f1-config-volume\") pod \"dns-default-h8pgd\" (UID: \"bbd0aa69-cc0c-4c79-9460-26e246d285f1\") " pod="openshift-dns/dns-default-h8pgd" Jul 29 18:34:55.322787 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.322769 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ed6ab3b-0c74-4957-be43-c96816a41d1a-cert\") pod \"ingress-canary-2gvrs\" (UID: \"2ed6ab3b-0c74-4957-be43-c96816a41d1a\") " pod="openshift-ingress-canary/ingress-canary-2gvrs" Jul 29 18:34:55.330674 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.330649 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gjff\" (UniqueName: \"kubernetes.io/projected/2ed6ab3b-0c74-4957-be43-c96816a41d1a-kube-api-access-8gjff\") pod \"ingress-canary-2gvrs\" (UID: \"2ed6ab3b-0c74-4957-be43-c96816a41d1a\") " pod="openshift-ingress-canary/ingress-canary-2gvrs" Jul 29 18:34:55.330775 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.330717 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv6xk\" (UniqueName: \"kubernetes.io/projected/bbd0aa69-cc0c-4c79-9460-26e246d285f1-kube-api-access-kv6xk\") pod \"dns-default-h8pgd\" (UID: \"bbd0aa69-cc0c-4c79-9460-26e246d285f1\") " pod="openshift-dns/dns-default-h8pgd" Jul 29 18:34:55.344823 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.344773 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:34:55.344823 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.344782 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:34:55.344980 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.344956 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:34:55.347352 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.347308 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 18:34:55.347352 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.347311 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 18:34:55.347504 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.347483 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-86fcw\"" Jul 29 18:34:55.347565 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.347527 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 18:34:55.347612 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.347573 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 18:34:55.347670 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.347654 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tqv42\"" Jul 29 18:34:55.368016 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.367995 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:34:55.490752 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.490731 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2gvrs" Jul 29 18:34:55.536303 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.536281 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q72xw" event={"ID":"4092d9a7-0970-48af-9e09-e0cd691fcc02","Type":"ContainerStarted","Data":"353cd26e26641d72f024a905e16be7c82c13b3b194f207d8a0f6df5cf8ab756f"} Jul 29 18:34:55.558796 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.558755 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-q72xw" podStartSLOduration=7.276951197 podStartE2EDuration="35.558739019s" totalImagesPullingTime="28.281787822s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:55.557403778 +0000 UTC m=+36.799580929" watchObservedRunningTime="2026-07-29 18:34:55.558739019 +0000 UTC m=+36.800916174" Jul 29 18:34:55.696102 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.695939 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:34:55.707324 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.707299 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2gvrs"] Jul 29 18:34:55.711385 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:34:55.711359 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ed6ab3b_0c74_4957_be43_c96816a41d1a.slice/crio-2550163d6975493dfbd8c4cf50684a429a228ff2e583adf148d855056edcc203 WatchSource:0}: Error finding container 2550163d6975493dfbd8c4cf50684a429a228ff2e583adf148d855056edcc203: Status 404 returned error can't find the container with id 2550163d6975493dfbd8c4cf50684a429a228ff2e583adf148d855056edcc203 Jul 29 18:34:55.783595 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.783550 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:34:55.822470 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:55.822446 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbd0aa69-cc0c-4c79-9460-26e246d285f1-metrics-tls\") pod \"dns-default-h8pgd\" (UID: \"bbd0aa69-cc0c-4c79-9460-26e246d285f1\") " pod="openshift-dns/dns-default-h8pgd" Jul 29 18:34:55.822643 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:55.822624 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 18:34:55.822694 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:55.822685 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbd0aa69-cc0c-4c79-9460-26e246d285f1-metrics-tls podName:bbd0aa69-cc0c-4c79-9460-26e246d285f1 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:56.822670377 +0000 UTC m=+38.064847511 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bbd0aa69-cc0c-4c79-9460-26e246d285f1-metrics-tls") pod "dns-default-h8pgd" (UID: "bbd0aa69-cc0c-4c79-9460-26e246d285f1") : secret "dns-default-metrics-tls" not found Jul 29 18:34:56.540766 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:56.540735 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2gvrs" event={"ID":"2ed6ab3b-0c74-4957-be43-c96816a41d1a","Type":"ContainerStarted","Data":"2550163d6975493dfbd8c4cf50684a429a228ff2e583adf148d855056edcc203"} Jul 29 18:34:56.829658 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:56.829584 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbd0aa69-cc0c-4c79-9460-26e246d285f1-metrics-tls\") pod \"dns-default-h8pgd\" (UID: \"bbd0aa69-cc0c-4c79-9460-26e246d285f1\") " pod="openshift-dns/dns-default-h8pgd" Jul 29 18:34:56.829819 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:56.829743 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 18:34:56.829819 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:56.829812 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbd0aa69-cc0c-4c79-9460-26e246d285f1-metrics-tls podName:bbd0aa69-cc0c-4c79-9460-26e246d285f1 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:58.829796553 +0000 UTC m=+40.071973687 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bbd0aa69-cc0c-4c79-9460-26e246d285f1-metrics-tls") pod "dns-default-h8pgd" (UID: "bbd0aa69-cc0c-4c79-9460-26e246d285f1") : secret "dns-default-metrics-tls" not found Jul 29 18:34:58.335961 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:58.335931 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:34:58.389997 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:58.389954 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:34:58.546904 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:58.546876 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2gvrs" event={"ID":"2ed6ab3b-0c74-4957-be43-c96816a41d1a","Type":"ContainerStarted","Data":"8c8147a6c41f904c56d8793c2c2105fb347c166ac8569ea2448acefff482cbf4"} Jul 29 18:34:58.562658 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:58.562611 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2gvrs" podStartSLOduration=1.264936487 podStartE2EDuration="3.562594146s" totalImagesPullingTime="2.297657659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:34:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:58.56230221 +0000 UTC m=+39.804479368" watchObservedRunningTime="2026-07-29 18:34:58.562594146 +0000 UTC m=+39.804771302" Jul 29 18:34:58.842465 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:58.842390 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbd0aa69-cc0c-4c79-9460-26e246d285f1-metrics-tls\") pod \"dns-default-h8pgd\" (UID: \"bbd0aa69-cc0c-4c79-9460-26e246d285f1\") " pod="openshift-dns/dns-default-h8pgd" Jul 29 18:34:58.842604 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:58.842550 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 18:34:58.842652 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:34:58.842607 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbd0aa69-cc0c-4c79-9460-26e246d285f1-metrics-tls podName:bbd0aa69-cc0c-4c79-9460-26e246d285f1 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:02.842592468 +0000 UTC m=+44.084769602 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bbd0aa69-cc0c-4c79-9460-26e246d285f1-metrics-tls") pod "dns-default-h8pgd" (UID: "bbd0aa69-cc0c-4c79-9460-26e246d285f1") : secret "dns-default-metrics-tls" not found Jul 29 18:34:59.208777 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:59.208701 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:34:59.263530 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:34:59.263474 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:01.408996 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.408961 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x96sp"] Jul 29 18:35:01.445062 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.445035 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x96sp"] Jul 29 18:35:01.445211 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.445138 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x96sp" Jul 29 18:35:01.447778 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.447753 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 29 18:35:01.447778 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.447764 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-w7dkm\"" Jul 29 18:35:01.448607 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.448592 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 29 18:35:01.461423 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.461402 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b9mr\" (UniqueName: \"kubernetes.io/projected/64b54268-b3fd-4a74-9ed7-a57e6883cb70-kube-api-access-9b9mr\") pod \"volume-data-source-validator-549c6d54cf-x96sp\" (UID: \"64b54268-b3fd-4a74-9ed7-a57e6883cb70\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x96sp" Jul 29 18:35:01.480799 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.480778 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-hlwzj"] Jul 29 18:35:01.499690 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.499672 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-2cfx4"] Jul 29 18:35:01.499821 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.499806 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-hlwzj" Jul 29 18:35:01.502924 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.502901 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 29 18:35:01.503040 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.502919 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-jmn2v\"" Jul 29 18:35:01.503104 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.503039 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 29 18:35:01.503104 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.503072 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 29 18:35:01.503784 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.503738 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 29 18:35:01.511569 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.511551 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 29 18:35:01.513182 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.513164 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c75fd788d-7zq7r"] Jul 29 18:35:01.513278 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.513266 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2cfx4" Jul 29 18:35:01.516990 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.516972 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 29 18:35:01.518021 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.518005 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-f8zbv\"" Jul 29 18:35:01.518103 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.518022 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 29 18:35:01.518103 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.518037 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 29 18:35:01.518330 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.518313 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 29 18:35:01.533169 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.533147 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-hlwzj"] Jul 29 18:35:01.533245 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.533187 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-2cfx4"] Jul 29 18:35:01.533245 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.533204 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c75fd788d-7zq7r"] Jul 29 18:35:01.533245 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.533155 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:01.536582 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.536562 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 29 18:35:01.536659 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.536564 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 29 18:35:01.536659 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.536603 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 29 18:35:01.540095 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.540081 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qvqdd\"" Jul 29 18:35:01.547338 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.547315 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 29 18:35:01.561939 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.561909 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-registry-tls\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:01.562026 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.561937 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de51fc41-4f39-4224-9f3d-13f3e113a694-tmp\") pod \"insights-operator-5885fdb759-hlwzj\" (UID: \"de51fc41-4f39-4224-9f3d-13f3e113a694\") " pod="openshift-insights/insights-operator-5885fdb759-hlwzj" Jul 29 18:35:01.562026 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.561963 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c8190cca-b804-457d-8db5-1dc89fe61e1d-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-2cfx4\" (UID: \"c8190cca-b804-457d-8db5-1dc89fe61e1d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2cfx4" Jul 29 18:35:01.562119 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.562032 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-bound-sa-token\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:01.562119 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.562088 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de51fc41-4f39-4224-9f3d-13f3e113a694-service-ca-bundle\") pod \"insights-operator-5885fdb759-hlwzj\" (UID: \"de51fc41-4f39-4224-9f3d-13f3e113a694\") " pod="openshift-insights/insights-operator-5885fdb759-hlwzj" Jul 29 18:35:01.562221 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.562119 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de51fc41-4f39-4224-9f3d-13f3e113a694-serving-cert\") pod \"insights-operator-5885fdb759-hlwzj\" (UID: \"de51fc41-4f39-4224-9f3d-13f3e113a694\") " pod="openshift-insights/insights-operator-5885fdb759-hlwzj" Jul 29 18:35:01.562221 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.562186 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz8ml\" (UniqueName: \"kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-kube-api-access-gz8ml\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:01.562320 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.562230 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/67b65c5d-6767-4e9f-a044-36167a6a11b5-registry-certificates\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:01.562320 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.562254 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jdz2\" (UniqueName: \"kubernetes.io/projected/de51fc41-4f39-4224-9f3d-13f3e113a694-kube-api-access-6jdz2\") pod \"insights-operator-5885fdb759-hlwzj\" (UID: \"de51fc41-4f39-4224-9f3d-13f3e113a694\") " pod="openshift-insights/insights-operator-5885fdb759-hlwzj" Jul 29 18:35:01.562320 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.562281 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/67b65c5d-6767-4e9f-a044-36167a6a11b5-ca-trust-extracted\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:01.562320 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.562307 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khrg2\" (UniqueName: \"kubernetes.io/projected/c8190cca-b804-457d-8db5-1dc89fe61e1d-kube-api-access-khrg2\") pod \"cluster-monitoring-operator-548b489cb8-2cfx4\" (UID: \"c8190cca-b804-457d-8db5-1dc89fe61e1d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2cfx4" Jul 29 18:35:01.562486 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.562335 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/de51fc41-4f39-4224-9f3d-13f3e113a694-snapshots\") pod \"insights-operator-5885fdb759-hlwzj\" (UID: \"de51fc41-4f39-4224-9f3d-13f3e113a694\") " pod="openshift-insights/insights-operator-5885fdb759-hlwzj" Jul 29 18:35:01.562486 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.562387 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/67b65c5d-6767-4e9f-a044-36167a6a11b5-image-registry-private-configuration\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:01.562486 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.562420 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/67b65c5d-6767-4e9f-a044-36167a6a11b5-installation-pull-secrets\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:01.562486 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.562472 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de51fc41-4f39-4224-9f3d-13f3e113a694-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-hlwzj\" (UID: \"de51fc41-4f39-4224-9f3d-13f3e113a694\") " pod="openshift-insights/insights-operator-5885fdb759-hlwzj" Jul 29 18:35:01.562694 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.562492 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8190cca-b804-457d-8db5-1dc89fe61e1d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-2cfx4\" (UID: \"c8190cca-b804-457d-8db5-1dc89fe61e1d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2cfx4" Jul 29 18:35:01.562694 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.562541 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b9mr\" (UniqueName: \"kubernetes.io/projected/64b54268-b3fd-4a74-9ed7-a57e6883cb70-kube-api-access-9b9mr\") pod \"volume-data-source-validator-549c6d54cf-x96sp\" (UID: \"64b54268-b3fd-4a74-9ed7-a57e6883cb70\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x96sp" Jul 29 18:35:01.562694 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.562562 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67b65c5d-6767-4e9f-a044-36167a6a11b5-trusted-ca\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:01.572189 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.572169 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b9mr\" (UniqueName: \"kubernetes.io/projected/64b54268-b3fd-4a74-9ed7-a57e6883cb70-kube-api-access-9b9mr\") pod \"volume-data-source-validator-549c6d54cf-x96sp\" (UID: \"64b54268-b3fd-4a74-9ed7-a57e6883cb70\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x96sp" Jul 29 18:35:01.663612 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.663538 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de51fc41-4f39-4224-9f3d-13f3e113a694-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-hlwzj\" (UID: \"de51fc41-4f39-4224-9f3d-13f3e113a694\") " pod="openshift-insights/insights-operator-5885fdb759-hlwzj" Jul 29 18:35:01.663612 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.663574 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8190cca-b804-457d-8db5-1dc89fe61e1d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-2cfx4\" (UID: \"c8190cca-b804-457d-8db5-1dc89fe61e1d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2cfx4" Jul 29 18:35:01.663612 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.663603 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67b65c5d-6767-4e9f-a044-36167a6a11b5-trusted-ca\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:01.663837 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.663629 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-registry-tls\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:01.663837 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.663650 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de51fc41-4f39-4224-9f3d-13f3e113a694-tmp\") pod \"insights-operator-5885fdb759-hlwzj\" (UID: \"de51fc41-4f39-4224-9f3d-13f3e113a694\") " pod="openshift-insights/insights-operator-5885fdb759-hlwzj" Jul 29 18:35:01.663837 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.663671 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c8190cca-b804-457d-8db5-1dc89fe61e1d-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-2cfx4\" (UID: \"c8190cca-b804-457d-8db5-1dc89fe61e1d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2cfx4" Jul 29 18:35:01.663837 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:01.663695 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 18:35:01.663837 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.663713 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-bound-sa-token\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:01.663837 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.663750 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de51fc41-4f39-4224-9f3d-13f3e113a694-service-ca-bundle\") pod \"insights-operator-5885fdb759-hlwzj\" (UID: \"de51fc41-4f39-4224-9f3d-13f3e113a694\") " pod="openshift-insights/insights-operator-5885fdb759-hlwzj" Jul 29 18:35:01.663837 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:01.663765 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 18:35:01.663837 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:01.663785 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c75fd788d-7zq7r: secret "image-registry-tls" not found Jul 29 18:35:01.663837 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:01.663770 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8190cca-b804-457d-8db5-1dc89fe61e1d-cluster-monitoring-operator-tls podName:c8190cca-b804-457d-8db5-1dc89fe61e1d nodeName:}" failed. No retries permitted until 2026-07-29 18:35:02.163748879 +0000 UTC m=+43.405926016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c8190cca-b804-457d-8db5-1dc89fe61e1d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-2cfx4" (UID: "c8190cca-b804-457d-8db5-1dc89fe61e1d") : secret "cluster-monitoring-operator-tls" not found Jul 29 18:35:01.664252 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:01.663864 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-registry-tls podName:67b65c5d-6767-4e9f-a044-36167a6a11b5 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:02.163847183 +0000 UTC m=+43.406024318 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-registry-tls") pod "image-registry-6c75fd788d-7zq7r" (UID: "67b65c5d-6767-4e9f-a044-36167a6a11b5") : secret "image-registry-tls" not found Jul 29 18:35:01.664252 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.663882 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de51fc41-4f39-4224-9f3d-13f3e113a694-serving-cert\") pod \"insights-operator-5885fdb759-hlwzj\" (UID: \"de51fc41-4f39-4224-9f3d-13f3e113a694\") " pod="openshift-insights/insights-operator-5885fdb759-hlwzj" Jul 29 18:35:01.664252 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.663931 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz8ml\" (UniqueName: \"kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-kube-api-access-gz8ml\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:01.664252 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.663977 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/67b65c5d-6767-4e9f-a044-36167a6a11b5-registry-certificates\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:01.664252 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.664003 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jdz2\" (UniqueName: \"kubernetes.io/projected/de51fc41-4f39-4224-9f3d-13f3e113a694-kube-api-access-6jdz2\") pod \"insights-operator-5885fdb759-hlwzj\" (UID: \"de51fc41-4f39-4224-9f3d-13f3e113a694\") " pod="openshift-insights/insights-operator-5885fdb759-hlwzj" Jul 29 18:35:01.664252 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.664032 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/67b65c5d-6767-4e9f-a044-36167a6a11b5-ca-trust-extracted\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:01.664252 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.664056 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khrg2\" (UniqueName: \"kubernetes.io/projected/c8190cca-b804-457d-8db5-1dc89fe61e1d-kube-api-access-khrg2\") pod \"cluster-monitoring-operator-548b489cb8-2cfx4\" (UID: \"c8190cca-b804-457d-8db5-1dc89fe61e1d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2cfx4" Jul 29 18:35:01.664252 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.664083 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/de51fc41-4f39-4224-9f3d-13f3e113a694-snapshots\") pod \"insights-operator-5885fdb759-hlwzj\" (UID: \"de51fc41-4f39-4224-9f3d-13f3e113a694\") " pod="openshift-insights/insights-operator-5885fdb759-hlwzj" Jul 29 18:35:01.664252 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.664124 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/67b65c5d-6767-4e9f-a044-36167a6a11b5-image-registry-private-configuration\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:01.664252 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.664135 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de51fc41-4f39-4224-9f3d-13f3e113a694-tmp\") pod \"insights-operator-5885fdb759-hlwzj\" (UID: \"de51fc41-4f39-4224-9f3d-13f3e113a694\") " pod="openshift-insights/insights-operator-5885fdb759-hlwzj" Jul 29 18:35:01.664252 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.664150 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/67b65c5d-6767-4e9f-a044-36167a6a11b5-installation-pull-secrets\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:01.664804 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.664506 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/67b65c5d-6767-4e9f-a044-36167a6a11b5-ca-trust-extracted\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:01.664804 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.664661 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c8190cca-b804-457d-8db5-1dc89fe61e1d-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-2cfx4\" (UID: \"c8190cca-b804-457d-8db5-1dc89fe61e1d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2cfx4" Jul 29 18:35:01.664804 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.664669 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de51fc41-4f39-4224-9f3d-13f3e113a694-service-ca-bundle\") pod \"insights-operator-5885fdb759-hlwzj\" (UID: \"de51fc41-4f39-4224-9f3d-13f3e113a694\") " pod="openshift-insights/insights-operator-5885fdb759-hlwzj" Jul 29 18:35:01.664804 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.664695 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de51fc41-4f39-4224-9f3d-13f3e113a694-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-hlwzj\" (UID: \"de51fc41-4f39-4224-9f3d-13f3e113a694\") " pod="openshift-insights/insights-operator-5885fdb759-hlwzj" Jul 29 18:35:01.664804 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.664769 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/de51fc41-4f39-4224-9f3d-13f3e113a694-snapshots\") pod \"insights-operator-5885fdb759-hlwzj\" (UID: \"de51fc41-4f39-4224-9f3d-13f3e113a694\") " pod="openshift-insights/insights-operator-5885fdb759-hlwzj" Jul 29 18:35:01.665049 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.664919 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67b65c5d-6767-4e9f-a044-36167a6a11b5-trusted-ca\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:01.665049 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.664976 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/67b65c5d-6767-4e9f-a044-36167a6a11b5-registry-certificates\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:01.666604 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.666584 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/67b65c5d-6767-4e9f-a044-36167a6a11b5-installation-pull-secrets\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:01.666761 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.666740 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de51fc41-4f39-4224-9f3d-13f3e113a694-serving-cert\") pod \"insights-operator-5885fdb759-hlwzj\" (UID: \"de51fc41-4f39-4224-9f3d-13f3e113a694\") " pod="openshift-insights/insights-operator-5885fdb759-hlwzj" Jul 29 18:35:01.666830 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.666742 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/67b65c5d-6767-4e9f-a044-36167a6a11b5-image-registry-private-configuration\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:01.677532 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.677481 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz8ml\" (UniqueName: \"kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-kube-api-access-gz8ml\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:01.677726 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.677709 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-bound-sa-token\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:01.680449 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.680428 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jdz2\" (UniqueName: \"kubernetes.io/projected/de51fc41-4f39-4224-9f3d-13f3e113a694-kube-api-access-6jdz2\") pod \"insights-operator-5885fdb759-hlwzj\" (UID: \"de51fc41-4f39-4224-9f3d-13f3e113a694\") " pod="openshift-insights/insights-operator-5885fdb759-hlwzj" Jul 29 18:35:01.686324 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.686306 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khrg2\" (UniqueName: \"kubernetes.io/projected/c8190cca-b804-457d-8db5-1dc89fe61e1d-kube-api-access-khrg2\") pod \"cluster-monitoring-operator-548b489cb8-2cfx4\" (UID: \"c8190cca-b804-457d-8db5-1dc89fe61e1d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2cfx4" Jul 29 18:35:01.736574 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.736551 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:01.753457 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.753442 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x96sp" Jul 29 18:35:01.798365 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.798338 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:01.809257 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.809237 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-hlwzj" Jul 29 18:35:01.910962 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.910933 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x96sp"] Jul 29 18:35:01.913820 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:35:01.913759 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64b54268_b3fd_4a74_9ed7_a57e6883cb70.slice/crio-6422da772a4b6d49e7993517da62a9b40968884dfe4af790b5e1ddb643d95035 WatchSource:0}: Error finding container 6422da772a4b6d49e7993517da62a9b40968884dfe4af790b5e1ddb643d95035: Status 404 returned error can't find the container with id 6422da772a4b6d49e7993517da62a9b40968884dfe4af790b5e1ddb643d95035 Jul 29 18:35:01.966657 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:01.966630 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-hlwzj"] Jul 29 18:35:01.969645 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:35:01.969617 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde51fc41_4f39_4224_9f3d_13f3e113a694.slice/crio-91f9f9a35e84042525817ef893dfc35f62711d2ddf3ca15d2ebb0cd0f3e5ea8d WatchSource:0}: Error finding container 91f9f9a35e84042525817ef893dfc35f62711d2ddf3ca15d2ebb0cd0f3e5ea8d: Status 404 returned error can't find the container with id 91f9f9a35e84042525817ef893dfc35f62711d2ddf3ca15d2ebb0cd0f3e5ea8d Jul 29 18:35:02.165872 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:02.165802 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:02.169323 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:02.169304 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8190cca-b804-457d-8db5-1dc89fe61e1d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-2cfx4\" (UID: \"c8190cca-b804-457d-8db5-1dc89fe61e1d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2cfx4" Jul 29 18:35:02.169384 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:02.169338 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-registry-tls\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:02.169453 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:02.169439 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 18:35:02.169523 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:02.169455 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 18:35:02.169523 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:02.169465 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c75fd788d-7zq7r: secret "image-registry-tls" not found Jul 29 18:35:02.169590 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:02.169528 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8190cca-b804-457d-8db5-1dc89fe61e1d-cluster-monitoring-operator-tls podName:c8190cca-b804-457d-8db5-1dc89fe61e1d nodeName:}" failed. No retries permitted until 2026-07-29 18:35:03.1694996 +0000 UTC m=+44.411676734 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c8190cca-b804-457d-8db5-1dc89fe61e1d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-2cfx4" (UID: "c8190cca-b804-457d-8db5-1dc89fe61e1d") : secret "cluster-monitoring-operator-tls" not found Jul 29 18:35:02.169590 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:02.169543 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-registry-tls podName:67b65c5d-6767-4e9f-a044-36167a6a11b5 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:03.169537185 +0000 UTC m=+44.411714319 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-registry-tls") pod "image-registry-6c75fd788d-7zq7r" (UID: "67b65c5d-6767-4e9f-a044-36167a6a11b5") : secret "image-registry-tls" not found Jul 29 18:35:02.266559 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:02.266530 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:02.556524 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:02.556433 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-hlwzj" event={"ID":"de51fc41-4f39-4224-9f3d-13f3e113a694","Type":"ContainerStarted","Data":"91f9f9a35e84042525817ef893dfc35f62711d2ddf3ca15d2ebb0cd0f3e5ea8d"} Jul 29 18:35:02.557637 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:02.557613 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x96sp" event={"ID":"64b54268-b3fd-4a74-9ed7-a57e6883cb70","Type":"ContainerStarted","Data":"6422da772a4b6d49e7993517da62a9b40968884dfe4af790b5e1ddb643d95035"} Jul 29 18:35:02.576670 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:02.576639 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:02.648199 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:02.648151 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:02.875899 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:02.875865 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbd0aa69-cc0c-4c79-9460-26e246d285f1-metrics-tls\") pod \"dns-default-h8pgd\" (UID: \"bbd0aa69-cc0c-4c79-9460-26e246d285f1\") " pod="openshift-dns/dns-default-h8pgd" Jul 29 18:35:02.876069 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:02.876037 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 18:35:02.876119 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:02.876113 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbd0aa69-cc0c-4c79-9460-26e246d285f1-metrics-tls podName:bbd0aa69-cc0c-4c79-9460-26e246d285f1 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:10.876097477 +0000 UTC m=+52.118274746 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bbd0aa69-cc0c-4c79-9460-26e246d285f1-metrics-tls") pod "dns-default-h8pgd" (UID: "bbd0aa69-cc0c-4c79-9460-26e246d285f1") : secret "dns-default-metrics-tls" not found Jul 29 18:35:03.178792 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:03.178697 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8190cca-b804-457d-8db5-1dc89fe61e1d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-2cfx4\" (UID: \"c8190cca-b804-457d-8db5-1dc89fe61e1d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2cfx4" Jul 29 18:35:03.178792 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:03.178760 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-registry-tls\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:03.179038 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:03.178843 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 18:35:03.179038 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:03.178916 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8190cca-b804-457d-8db5-1dc89fe61e1d-cluster-monitoring-operator-tls podName:c8190cca-b804-457d-8db5-1dc89fe61e1d nodeName:}" failed. No retries permitted until 2026-07-29 18:35:05.178897106 +0000 UTC m=+46.421074252 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c8190cca-b804-457d-8db5-1dc89fe61e1d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-2cfx4" (UID: "c8190cca-b804-457d-8db5-1dc89fe61e1d") : secret "cluster-monitoring-operator-tls" not found Jul 29 18:35:03.179038 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:03.178915 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 18:35:03.179038 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:03.178934 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c75fd788d-7zq7r: secret "image-registry-tls" not found Jul 29 18:35:03.179038 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:03.178964 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-registry-tls podName:67b65c5d-6767-4e9f-a044-36167a6a11b5 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:05.178954619 +0000 UTC m=+46.421131754 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-registry-tls") pod "image-registry-6c75fd788d-7zq7r" (UID: "67b65c5d-6767-4e9f-a044-36167a6a11b5") : secret "image-registry-tls" not found Jul 29 18:35:03.425178 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:03.425154 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:03.483127 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:03.483100 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:03.562077 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:03.562041 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x96sp" event={"ID":"64b54268-b3fd-4a74-9ed7-a57e6883cb70","Type":"ContainerStarted","Data":"11ec7ae09d30606f4e34c198a19d6d520ee35d59fb7ae5188a19192263826e16"} Jul 29 18:35:03.578385 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:03.578334 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x96sp" podStartSLOduration=1.08442212 podStartE2EDuration="2.578318273s" totalImagesPullingTime="1.493896153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:35:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:35:03.577671547 +0000 UTC m=+44.819848706" watchObservedRunningTime="2026-07-29 18:35:03.578318273 +0000 UTC m=+44.820495430" Jul 29 18:35:03.684907 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:03.684817 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:03.745624 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:03.745591 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:04.566472 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:04.566435 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-hlwzj" event={"ID":"de51fc41-4f39-4224-9f3d-13f3e113a694","Type":"ContainerStarted","Data":"c9e4eb9c876917ffd27b95fee30dae1b9e7b3d0b87c40a6745cbe3b3911756a6"} Jul 29 18:35:04.585138 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:04.585092 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-hlwzj" podStartSLOduration=1.160231848 podStartE2EDuration="3.585076447s" totalImagesPullingTime="2.424844599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:35:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:35:04.584086505 +0000 UTC m=+45.826263660" watchObservedRunningTime="2026-07-29 18:35:04.585076447 +0000 UTC m=+45.827253603" Jul 29 18:35:05.193120 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:05.193078 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8190cca-b804-457d-8db5-1dc89fe61e1d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-2cfx4\" (UID: \"c8190cca-b804-457d-8db5-1dc89fe61e1d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2cfx4" Jul 29 18:35:05.193275 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:05.193135 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-registry-tls\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:05.193275 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:05.193242 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 18:35:05.193275 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:05.193264 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 18:35:05.193371 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:05.193278 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c75fd788d-7zq7r: secret "image-registry-tls" not found Jul 29 18:35:05.193371 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:05.193340 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8190cca-b804-457d-8db5-1dc89fe61e1d-cluster-monitoring-operator-tls podName:c8190cca-b804-457d-8db5-1dc89fe61e1d nodeName:}" failed. No retries permitted until 2026-07-29 18:35:09.193319992 +0000 UTC m=+50.435497128 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c8190cca-b804-457d-8db5-1dc89fe61e1d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-2cfx4" (UID: "c8190cca-b804-457d-8db5-1dc89fe61e1d") : secret "cluster-monitoring-operator-tls" not found Jul 29 18:35:05.193371 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:05.193360 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-registry-tls podName:67b65c5d-6767-4e9f-a044-36167a6a11b5 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:09.193351867 +0000 UTC m=+50.435529007 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-registry-tls") pod "image-registry-6c75fd788d-7zq7r" (UID: "67b65c5d-6767-4e9f-a044-36167a6a11b5") : secret "image-registry-tls" not found Jul 29 18:35:05.410210 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:05.410177 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:05.465629 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:05.465547 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:05.659814 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:05.659771 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:05.760221 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:05.760141 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:06.227271 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:06.227232 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:06.291200 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:06.291164 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:06.367747 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:06.367716 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l5mk5"] Jul 29 18:35:06.388115 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:06.388091 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l5mk5"] Jul 29 18:35:06.388246 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:06.388215 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l5mk5" Jul 29 18:35:06.390594 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:06.390577 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 29 18:35:06.390688 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:06.390599 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 29 18:35:06.390688 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:06.390609 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l89px\"" Jul 29 18:35:06.395997 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:06.395969 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:06.402497 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:06.402477 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fc6m\" (UniqueName: \"kubernetes.io/projected/a34ff964-79be-4feb-9960-a027467c77e7-kube-api-access-7fc6m\") pod \"insights-runtime-extractor-l5mk5\" (UID: \"a34ff964-79be-4feb-9960-a027467c77e7\") " pod="openshift-insights/insights-runtime-extractor-l5mk5" Jul 29 18:35:06.402601 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:06.402506 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a34ff964-79be-4feb-9960-a027467c77e7-crio-socket\") pod \"insights-runtime-extractor-l5mk5\" (UID: \"a34ff964-79be-4feb-9960-a027467c77e7\") " pod="openshift-insights/insights-runtime-extractor-l5mk5" Jul 29 18:35:06.402601 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:06.402589 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a34ff964-79be-4feb-9960-a027467c77e7-data-volume\") pod \"insights-runtime-extractor-l5mk5\" (UID: \"a34ff964-79be-4feb-9960-a027467c77e7\") " pod="openshift-insights/insights-runtime-extractor-l5mk5" Jul 29 18:35:06.402672 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:06.402660 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a34ff964-79be-4feb-9960-a027467c77e7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5mk5\" (UID: \"a34ff964-79be-4feb-9960-a027467c77e7\") " pod="openshift-insights/insights-runtime-extractor-l5mk5" Jul 29 18:35:06.402719 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:06.402705 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a34ff964-79be-4feb-9960-a027467c77e7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5mk5\" (UID: \"a34ff964-79be-4feb-9960-a027467c77e7\") " pod="openshift-insights/insights-runtime-extractor-l5mk5" Jul 29 18:35:06.452611 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:06.452581 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:06.503643 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:06.503584 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a34ff964-79be-4feb-9960-a027467c77e7-data-volume\") pod \"insights-runtime-extractor-l5mk5\" (UID: \"a34ff964-79be-4feb-9960-a027467c77e7\") " pod="openshift-insights/insights-runtime-extractor-l5mk5" Jul 29 18:35:06.503643 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:06.503627 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a34ff964-79be-4feb-9960-a027467c77e7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5mk5\" (UID: \"a34ff964-79be-4feb-9960-a027467c77e7\") " pod="openshift-insights/insights-runtime-extractor-l5mk5" Jul 29 18:35:06.503859 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:06.503660 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a34ff964-79be-4feb-9960-a027467c77e7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5mk5\" (UID: \"a34ff964-79be-4feb-9960-a027467c77e7\") " pod="openshift-insights/insights-runtime-extractor-l5mk5" Jul 29 18:35:06.503859 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:06.503706 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fc6m\" (UniqueName: \"kubernetes.io/projected/a34ff964-79be-4feb-9960-a027467c77e7-kube-api-access-7fc6m\") pod \"insights-runtime-extractor-l5mk5\" (UID: \"a34ff964-79be-4feb-9960-a027467c77e7\") " pod="openshift-insights/insights-runtime-extractor-l5mk5" Jul 29 18:35:06.503859 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:06.503725 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a34ff964-79be-4feb-9960-a027467c77e7-crio-socket\") pod \"insights-runtime-extractor-l5mk5\" (UID: \"a34ff964-79be-4feb-9960-a027467c77e7\") " pod="openshift-insights/insights-runtime-extractor-l5mk5" Jul 29 18:35:06.503859 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:06.503743 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 18:35:06.503859 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:06.503792 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 18:35:06.503859 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:06.503801 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a34ff964-79be-4feb-9960-a027467c77e7-insights-runtime-extractor-tls podName:a34ff964-79be-4feb-9960-a027467c77e7 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:07.003786253 +0000 UTC m=+48.245963400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a34ff964-79be-4feb-9960-a027467c77e7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l5mk5" (UID: "a34ff964-79be-4feb-9960-a027467c77e7") : secret "insights-runtime-extractor-tls" not found Jul 29 18:35:06.503859 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:06.503853 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a34ff964-79be-4feb-9960-a027467c77e7-kube-rbac-proxy-cm podName:a34ff964-79be-4feb-9960-a027467c77e7 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:07.00383577 +0000 UTC m=+48.246012907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a34ff964-79be-4feb-9960-a027467c77e7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l5mk5" (UID: "a34ff964-79be-4feb-9960-a027467c77e7") : configmap "kube-rbac-proxy" not found Jul 29 18:35:06.504186 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:06.503978 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a34ff964-79be-4feb-9960-a027467c77e7-crio-socket\") pod \"insights-runtime-extractor-l5mk5\" (UID: \"a34ff964-79be-4feb-9960-a027467c77e7\") " pod="openshift-insights/insights-runtime-extractor-l5mk5" Jul 29 18:35:06.504186 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:06.503975 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a34ff964-79be-4feb-9960-a027467c77e7-data-volume\") pod \"insights-runtime-extractor-l5mk5\" (UID: \"a34ff964-79be-4feb-9960-a027467c77e7\") " pod="openshift-insights/insights-runtime-extractor-l5mk5" Jul 29 18:35:06.514657 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:06.514637 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fc6m\" (UniqueName: \"kubernetes.io/projected/a34ff964-79be-4feb-9960-a027467c77e7-kube-api-access-7fc6m\") pod \"insights-runtime-extractor-l5mk5\" (UID: \"a34ff964-79be-4feb-9960-a027467c77e7\") " pod="openshift-insights/insights-runtime-extractor-l5mk5" Jul 29 18:35:07.006544 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:07.006496 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a34ff964-79be-4feb-9960-a027467c77e7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5mk5\" (UID: \"a34ff964-79be-4feb-9960-a027467c77e7\") " pod="openshift-insights/insights-runtime-extractor-l5mk5" Jul 29 18:35:07.006971 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:07.006569 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a34ff964-79be-4feb-9960-a027467c77e7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5mk5\" (UID: \"a34ff964-79be-4feb-9960-a027467c77e7\") " pod="openshift-insights/insights-runtime-extractor-l5mk5" Jul 29 18:35:07.006971 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:07.006641 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 18:35:07.006971 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:07.006692 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 18:35:07.006971 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:07.006716 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a34ff964-79be-4feb-9960-a027467c77e7-insights-runtime-extractor-tls podName:a34ff964-79be-4feb-9960-a027467c77e7 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:08.006699493 +0000 UTC m=+49.248876628 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a34ff964-79be-4feb-9960-a027467c77e7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l5mk5" (UID: "a34ff964-79be-4feb-9960-a027467c77e7") : secret "insights-runtime-extractor-tls" not found Jul 29 18:35:07.006971 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:07.006739 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a34ff964-79be-4feb-9960-a027467c77e7-kube-rbac-proxy-cm podName:a34ff964-79be-4feb-9960-a027467c77e7 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:08.006727626 +0000 UTC m=+49.248904761 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a34ff964-79be-4feb-9960-a027467c77e7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l5mk5" (UID: "a34ff964-79be-4feb-9960-a027467c77e7") : configmap "kube-rbac-proxy" not found Jul 29 18:35:07.710578 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:07.710537 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:07.799192 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:07.799160 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:07.899660 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:07.899634 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:08.012905 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:08.012831 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a34ff964-79be-4feb-9960-a027467c77e7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5mk5\" (UID: \"a34ff964-79be-4feb-9960-a027467c77e7\") " pod="openshift-insights/insights-runtime-extractor-l5mk5" Jul 29 18:35:08.012905 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:08.012876 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a34ff964-79be-4feb-9960-a027467c77e7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5mk5\" (UID: \"a34ff964-79be-4feb-9960-a027467c77e7\") " pod="openshift-insights/insights-runtime-extractor-l5mk5" Jul 29 18:35:08.013324 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:08.012935 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 18:35:08.013324 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:08.012968 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 18:35:08.013324 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:08.012985 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a34ff964-79be-4feb-9960-a027467c77e7-kube-rbac-proxy-cm podName:a34ff964-79be-4feb-9960-a027467c77e7 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:10.012967996 +0000 UTC m=+51.255145130 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a34ff964-79be-4feb-9960-a027467c77e7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l5mk5" (UID: "a34ff964-79be-4feb-9960-a027467c77e7") : configmap "kube-rbac-proxy" not found Jul 29 18:35:08.013324 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:08.013032 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a34ff964-79be-4feb-9960-a027467c77e7-insights-runtime-extractor-tls podName:a34ff964-79be-4feb-9960-a027467c77e7 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:10.013019254 +0000 UTC m=+51.255196388 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a34ff964-79be-4feb-9960-a027467c77e7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l5mk5" (UID: "a34ff964-79be-4feb-9960-a027467c77e7") : secret "insights-runtime-extractor-tls" not found Jul 29 18:35:08.146010 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:08.145984 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-skm5p_9e7c71e3-553b-4508-a7e3-1e823a72af11/dns-node-resolver/0.log" Jul 29 18:35:08.651574 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:08.651539 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:09.146940 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:09.146918 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5ddbt_5d933486-a30c-4f85-83ff-e1a190e2f95b/node-ca/0.log" Jul 29 18:35:09.222607 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:09.222581 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8190cca-b804-457d-8db5-1dc89fe61e1d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-2cfx4\" (UID: \"c8190cca-b804-457d-8db5-1dc89fe61e1d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2cfx4" Jul 29 18:35:09.222798 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:09.222631 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-registry-tls\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:09.222798 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:09.222715 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 18:35:09.222798 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:09.222736 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 18:35:09.222798 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:09.222749 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c75fd788d-7zq7r: secret "image-registry-tls" not found Jul 29 18:35:09.222798 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:09.222767 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8190cca-b804-457d-8db5-1dc89fe61e1d-cluster-monitoring-operator-tls podName:c8190cca-b804-457d-8db5-1dc89fe61e1d nodeName:}" failed. No retries permitted until 2026-07-29 18:35:17.222753224 +0000 UTC m=+58.464930358 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c8190cca-b804-457d-8db5-1dc89fe61e1d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-2cfx4" (UID: "c8190cca-b804-457d-8db5-1dc89fe61e1d") : secret "cluster-monitoring-operator-tls" not found Jul 29 18:35:09.222798 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:09.222793 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-registry-tls podName:67b65c5d-6767-4e9f-a044-36167a6a11b5 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:17.222778391 +0000 UTC m=+58.464955539 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-registry-tls") pod "image-registry-6c75fd788d-7zq7r" (UID: "67b65c5d-6767-4e9f-a044-36167a6a11b5") : secret "image-registry-tls" not found Jul 29 18:35:09.370099 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:09.370063 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:09.759835 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:09.759799 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:09.855948 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:09.855918 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:09.948945 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:09.948920 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2gvrs_2ed6ab3b-0c74-4957-be43-c96816a41d1a/serve-healthcheck-canary/0.log" Jul 29 18:35:09.963505 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:09.963481 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:10.029311 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:10.029247 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a34ff964-79be-4feb-9960-a027467c77e7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5mk5\" (UID: \"a34ff964-79be-4feb-9960-a027467c77e7\") " pod="openshift-insights/insights-runtime-extractor-l5mk5" Jul 29 18:35:10.029311 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:10.029295 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a34ff964-79be-4feb-9960-a027467c77e7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5mk5\" (UID: \"a34ff964-79be-4feb-9960-a027467c77e7\") " pod="openshift-insights/insights-runtime-extractor-l5mk5" Jul 29 18:35:10.029586 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:10.029402 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 18:35:10.029586 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:10.029442 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 18:35:10.029586 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:10.029453 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a34ff964-79be-4feb-9960-a027467c77e7-insights-runtime-extractor-tls podName:a34ff964-79be-4feb-9960-a027467c77e7 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:14.029437809 +0000 UTC m=+55.271614946 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a34ff964-79be-4feb-9960-a027467c77e7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l5mk5" (UID: "a34ff964-79be-4feb-9960-a027467c77e7") : secret "insights-runtime-extractor-tls" not found Jul 29 18:35:10.029586 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:10.029506 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a34ff964-79be-4feb-9960-a027467c77e7-kube-rbac-proxy-cm podName:a34ff964-79be-4feb-9960-a027467c77e7 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:14.029482539 +0000 UTC m=+55.271659677 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a34ff964-79be-4feb-9960-a027467c77e7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l5mk5" (UID: "a34ff964-79be-4feb-9960-a027467c77e7") : configmap "kube-rbac-proxy" not found Jul 29 18:35:10.057332 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:10.057305 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:10.157036 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:10.157007 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:10.530906 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:10.530878 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:10.936100 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:10.936068 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbd0aa69-cc0c-4c79-9460-26e246d285f1-metrics-tls\") pod \"dns-default-h8pgd\" (UID: \"bbd0aa69-cc0c-4c79-9460-26e246d285f1\") " pod="openshift-dns/dns-default-h8pgd" Jul 29 18:35:10.936322 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:10.936215 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 18:35:10.936322 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:10.936279 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbd0aa69-cc0c-4c79-9460-26e246d285f1-metrics-tls podName:bbd0aa69-cc0c-4c79-9460-26e246d285f1 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:26.93626202 +0000 UTC m=+68.178439154 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bbd0aa69-cc0c-4c79-9460-26e246d285f1-metrics-tls") pod "dns-default-h8pgd" (UID: "bbd0aa69-cc0c-4c79-9460-26e246d285f1") : secret "dns-default-metrics-tls" not found Jul 29 18:35:11.550944 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:11.550911 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:11.746245 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:11.746213 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:12.098647 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:12.098616 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:12.196111 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:12.196082 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:12.342697 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:12.342671 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:12.971881 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:12.971853 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:13.080465 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:13.080431 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:13.309634 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:13.309551 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:13.667703 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:13.667662 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:13.769063 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:13.769037 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:13.941583 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:13.941472 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:14.004737 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:14.004705 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:14.059944 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:14.059917 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a34ff964-79be-4feb-9960-a027467c77e7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5mk5\" (UID: \"a34ff964-79be-4feb-9960-a027467c77e7\") " pod="openshift-insights/insights-runtime-extractor-l5mk5" Jul 29 18:35:14.060075 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:14.059960 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a34ff964-79be-4feb-9960-a027467c77e7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5mk5\" (UID: \"a34ff964-79be-4feb-9960-a027467c77e7\") " pod="openshift-insights/insights-runtime-extractor-l5mk5" Jul 29 18:35:14.060075 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:14.060039 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 18:35:14.060075 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:14.060055 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 18:35:14.060185 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:14.060086 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a34ff964-79be-4feb-9960-a027467c77e7-kube-rbac-proxy-cm podName:a34ff964-79be-4feb-9960-a027467c77e7 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:22.06007381 +0000 UTC m=+63.302250944 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a34ff964-79be-4feb-9960-a027467c77e7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l5mk5" (UID: "a34ff964-79be-4feb-9960-a027467c77e7") : configmap "kube-rbac-proxy" not found Jul 29 18:35:14.060185 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:14.060104 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a34ff964-79be-4feb-9960-a027467c77e7-insights-runtime-extractor-tls podName:a34ff964-79be-4feb-9960-a027467c77e7 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:22.060091413 +0000 UTC m=+63.302268547 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a34ff964-79be-4feb-9960-a027467c77e7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l5mk5" (UID: "a34ff964-79be-4feb-9960-a027467c77e7") : secret "insights-runtime-extractor-tls" not found Jul 29 18:35:14.341821 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:14.341796 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:15.134893 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:15.134857 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:15.264995 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:15.264962 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:15.531532 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:15.531430 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:15.734990 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:15.734960 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:15.930535 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:15.930489 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:16.332569 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:16.332467 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:16.735698 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:16.735662 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:17.288331 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:17.288297 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8190cca-b804-457d-8db5-1dc89fe61e1d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-2cfx4\" (UID: \"c8190cca-b804-457d-8db5-1dc89fe61e1d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2cfx4" Jul 29 18:35:17.288547 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:17.288339 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-registry-tls\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:17.290706 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:17.290675 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8190cca-b804-457d-8db5-1dc89fe61e1d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-2cfx4\" (UID: \"c8190cca-b804-457d-8db5-1dc89fe61e1d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2cfx4" Jul 29 18:35:17.290833 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:17.290719 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-registry-tls\") pod \"image-registry-6c75fd788d-7zq7r\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:17.421238 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:17.421202 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2cfx4" Jul 29 18:35:17.440916 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:17.440893 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:17.539843 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:17.539760 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:17.555411 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:17.555384 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-2cfx4"] Jul 29 18:35:17.558438 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:35:17.558410 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8190cca_b804_457d_8db5_1dc89fe61e1d.slice/crio-5b7a9fa451d8862a00f90d2727ab95a8084553a6704340d3d2dd155e6fef8d37 WatchSource:0}: Error finding container 5b7a9fa451d8862a00f90d2727ab95a8084553a6704340d3d2dd155e6fef8d37: Status 404 returned error can't find the container with id 5b7a9fa451d8862a00f90d2727ab95a8084553a6704340d3d2dd155e6fef8d37 Jul 29 18:35:17.573415 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:17.573383 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c75fd788d-7zq7r"] Jul 29 18:35:17.577055 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:35:17.577033 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67b65c5d_6767_4e9f_a044_36167a6a11b5.slice/crio-98c44fdcc6ee7cfe38acc095567d5e37dcf9cacdf6cfd23bdecc51fff857ddc2 WatchSource:0}: Error finding container 98c44fdcc6ee7cfe38acc095567d5e37dcf9cacdf6cfd23bdecc51fff857ddc2: Status 404 returned error can't find the container with id 98c44fdcc6ee7cfe38acc095567d5e37dcf9cacdf6cfd23bdecc51fff857ddc2 Jul 29 18:35:17.605699 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:17.605669 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" event={"ID":"67b65c5d-6767-4e9f-a044-36167a6a11b5","Type":"ContainerStarted","Data":"98c44fdcc6ee7cfe38acc095567d5e37dcf9cacdf6cfd23bdecc51fff857ddc2"} Jul 29 18:35:17.606803 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:17.606772 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2cfx4" event={"ID":"c8190cca-b804-457d-8db5-1dc89fe61e1d","Type":"ContainerStarted","Data":"5b7a9fa451d8862a00f90d2727ab95a8084553a6704340d3d2dd155e6fef8d37"} Jul 29 18:35:17.740871 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:17.740834 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:17.937681 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:17.937644 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:18.341303 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:18.341276 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:18.610972 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:18.610893 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" event={"ID":"67b65c5d-6767-4e9f-a044-36167a6a11b5","Type":"ContainerStarted","Data":"2b011ba5004b860404be54bdc79a0bd8c90dedb9ab7050a689cae944db18e04d"} Jul 29 18:35:18.611332 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:18.611005 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:18.634805 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:18.634758 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" podStartSLOduration=17.634742876 podStartE2EDuration="17.634742876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:35:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:35:18.633385507 +0000 UTC m=+59.875562674" watchObservedRunningTime="2026-07-29 18:35:18.634742876 +0000 UTC m=+59.876920032" Jul 29 18:35:18.741089 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:18.741061 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:18.841864 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:18.841823 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:19.142352 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:19.142212 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:19.524013 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:19.523942 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8mjg" Jul 29 18:35:19.527795 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:19.527763 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:19.615492 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:19.615455 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2cfx4" event={"ID":"c8190cca-b804-457d-8db5-1dc89fe61e1d","Type":"ContainerStarted","Data":"19dd8e13d99a8a50d98b6fdf186d696ece46410985bf81a3fc303e973aa087a2"} Jul 29 18:35:19.628069 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:19.628039 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:19.635061 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:19.635012 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2cfx4" podStartSLOduration=16.97865955 podStartE2EDuration="18.634997561s" totalImagesPullingTime="1.656338011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:35:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:35:19.63404274 +0000 UTC m=+60.876219897" watchObservedRunningTime="2026-07-29 18:35:19.634997561 +0000 UTC m=+60.877174716" Jul 29 18:35:19.727873 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:19.727844 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:19.784350 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:19.784281 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:20.332676 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:20.332643 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:20.533528 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:20.533475 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:21.395193 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:21.395157 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:22.125348 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:22.125303 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a34ff964-79be-4feb-9960-a027467c77e7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5mk5\" (UID: \"a34ff964-79be-4feb-9960-a027467c77e7\") " pod="openshift-insights/insights-runtime-extractor-l5mk5" Jul 29 18:35:22.125557 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:22.125436 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a34ff964-79be-4feb-9960-a027467c77e7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5mk5\" (UID: \"a34ff964-79be-4feb-9960-a027467c77e7\") " pod="openshift-insights/insights-runtime-extractor-l5mk5" Jul 29 18:35:22.126001 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:22.125979 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a34ff964-79be-4feb-9960-a027467c77e7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5mk5\" (UID: \"a34ff964-79be-4feb-9960-a027467c77e7\") " pod="openshift-insights/insights-runtime-extractor-l5mk5" Jul 29 18:35:22.127693 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:22.127671 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a34ff964-79be-4feb-9960-a027467c77e7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5mk5\" (UID: \"a34ff964-79be-4feb-9960-a027467c77e7\") " pod="openshift-insights/insights-runtime-extractor-l5mk5" Jul 29 18:35:22.195915 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:22.195877 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:22.300388 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:22.300361 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l89px\"" Jul 29 18:35:22.301393 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:22.301366 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:22.308707 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:22.308683 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l5mk5" Jul 29 18:35:22.428152 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:22.428126 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l5mk5"] Jul 29 18:35:22.431500 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:35:22.431476 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda34ff964_79be_4feb_9960_a027467c77e7.slice/crio-d72231bc97ebaca0ad3574e5e2089a3eec164511b2bc326d1f11af236404ba92 WatchSource:0}: Error finding container d72231bc97ebaca0ad3574e5e2089a3eec164511b2bc326d1f11af236404ba92: Status 404 returned error can't find the container with id d72231bc97ebaca0ad3574e5e2089a3eec164511b2bc326d1f11af236404ba92 Jul 29 18:35:22.624641 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:22.624604 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l5mk5" event={"ID":"a34ff964-79be-4feb-9960-a027467c77e7","Type":"ContainerStarted","Data":"d72231bc97ebaca0ad3574e5e2089a3eec164511b2bc326d1f11af236404ba92"} Jul 29 18:35:24.951416 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:24.951380 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1f1308a-865e-4a0f-ad80-7a8602155966-original-pull-secret\") pod \"global-pull-secret-syncer-8cc84\" (UID: \"c1f1308a-865e-4a0f-ad80-7a8602155966\") " pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:35:24.951846 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:24.951471 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95f0df74-cd8c-4c76-ac89-62b675ce368f-metrics-certs\") pod \"network-metrics-daemon-w69sl\" (UID: \"95f0df74-cd8c-4c76-ac89-62b675ce368f\") " pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:35:24.954526 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:24.954482 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 18:35:24.954651 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:24.954530 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 18:35:24.964313 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:24.964285 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1f1308a-865e-4a0f-ad80-7a8602155966-original-pull-secret\") pod \"global-pull-secret-syncer-8cc84\" (UID: \"c1f1308a-865e-4a0f-ad80-7a8602155966\") " pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:35:24.964449 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:24.964343 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95f0df74-cd8c-4c76-ac89-62b675ce368f-metrics-certs\") pod \"network-metrics-daemon-w69sl\" (UID: \"95f0df74-cd8c-4c76-ac89-62b675ce368f\") " pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:35:25.059641 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:25.059604 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8cc84" Jul 29 18:35:25.067259 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:25.067234 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tqv42\"" Jul 29 18:35:25.075293 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:25.075270 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w69sl" Jul 29 18:35:25.153870 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:25.153819 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxgnt\" (UniqueName: \"kubernetes.io/projected/7961d8da-66e2-4b1b-9f5a-37beefbd47eb-kube-api-access-dxgnt\") pod \"network-check-target-xtdjk\" (UID: \"7961d8da-66e2-4b1b-9f5a-37beefbd47eb\") " pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:35:25.156500 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:25.156475 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 18:35:25.166704 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:25.166679 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 18:35:25.177975 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:25.177952 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxgnt\" (UniqueName: \"kubernetes.io/projected/7961d8da-66e2-4b1b-9f5a-37beefbd47eb-kube-api-access-dxgnt\") pod \"network-check-target-xtdjk\" (UID: \"7961d8da-66e2-4b1b-9f5a-37beefbd47eb\") " pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:35:25.357066 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:25.357037 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-86fcw\"" Jul 29 18:35:25.364869 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:25.364846 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:35:26.968141 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:26.968098 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbd0aa69-cc0c-4c79-9460-26e246d285f1-metrics-tls\") pod \"dns-default-h8pgd\" (UID: \"bbd0aa69-cc0c-4c79-9460-26e246d285f1\") " pod="openshift-dns/dns-default-h8pgd" Jul 29 18:35:26.970529 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:26.970494 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbd0aa69-cc0c-4c79-9460-26e246d285f1-metrics-tls\") pod \"dns-default-h8pgd\" (UID: \"bbd0aa69-cc0c-4c79-9460-26e246d285f1\") " pod="openshift-dns/dns-default-h8pgd" Jul 29 18:35:27.270817 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:27.270792 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mk972\"" Jul 29 18:35:27.278759 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:27.278737 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h8pgd" Jul 29 18:35:27.337694 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:27.337156 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w69sl"] Jul 29 18:35:27.342161 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:35:27.342121 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95f0df74_cd8c_4c76_ac89_62b675ce368f.slice/crio-6366f6f9a02450db0abb65c0c221f7d6466c435eddee456f2f0d0eb8e583fe0d WatchSource:0}: Error finding container 6366f6f9a02450db0abb65c0c221f7d6466c435eddee456f2f0d0eb8e583fe0d: Status 404 returned error can't find the container with id 6366f6f9a02450db0abb65c0c221f7d6466c435eddee456f2f0d0eb8e583fe0d Jul 29 18:35:27.414396 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:27.414361 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h8pgd"] Jul 29 18:35:27.417108 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:35:27.417082 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbd0aa69_cc0c_4c79_9460_26e246d285f1.slice/crio-4b7f085f32876d76d5eaa47abf2425069ac492e9271e84362eed47230c492fb2 WatchSource:0}: Error finding container 4b7f085f32876d76d5eaa47abf2425069ac492e9271e84362eed47230c492fb2: Status 404 returned error can't find the container with id 4b7f085f32876d76d5eaa47abf2425069ac492e9271e84362eed47230c492fb2 Jul 29 18:35:27.559328 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:27.559262 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8cc84"] Jul 29 18:35:27.562368 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:27.562345 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xtdjk"] Jul 29 18:35:27.562608 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:35:27.562588 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1f1308a_865e_4a0f_ad80_7a8602155966.slice/crio-7106520eb0efba45294fe8a1af55b5075075211735e8cbf550b120032be308a4 WatchSource:0}: Error finding container 7106520eb0efba45294fe8a1af55b5075075211735e8cbf550b120032be308a4: Status 404 returned error can't find the container with id 7106520eb0efba45294fe8a1af55b5075075211735e8cbf550b120032be308a4 Jul 29 18:35:27.564752 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:35:27.564714 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7961d8da_66e2_4b1b_9f5a_37beefbd47eb.slice/crio-84a773ac9fce7accbce34ce3aafbe522008140c5c3477575f527b2bdac38e422 WatchSource:0}: Error finding container 84a773ac9fce7accbce34ce3aafbe522008140c5c3477575f527b2bdac38e422: Status 404 returned error can't find the container with id 84a773ac9fce7accbce34ce3aafbe522008140c5c3477575f527b2bdac38e422 Jul 29 18:35:27.643343 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:27.643311 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l5mk5" event={"ID":"a34ff964-79be-4feb-9960-a027467c77e7","Type":"ContainerStarted","Data":"84ecb880b866129590093f5207aa4450026c10470974e40bf2bd6fa63a1bf0c3"} Jul 29 18:35:27.644364 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:27.644333 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h8pgd" event={"ID":"bbd0aa69-cc0c-4c79-9460-26e246d285f1","Type":"ContainerStarted","Data":"4b7f085f32876d76d5eaa47abf2425069ac492e9271e84362eed47230c492fb2"} Jul 29 18:35:27.645311 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:27.645283 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8cc84" event={"ID":"c1f1308a-865e-4a0f-ad80-7a8602155966","Type":"ContainerStarted","Data":"7106520eb0efba45294fe8a1af55b5075075211735e8cbf550b120032be308a4"} Jul 29 18:35:27.646419 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:27.646403 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w69sl" event={"ID":"95f0df74-cd8c-4c76-ac89-62b675ce368f","Type":"ContainerStarted","Data":"6366f6f9a02450db0abb65c0c221f7d6466c435eddee456f2f0d0eb8e583fe0d"} Jul 29 18:35:27.647410 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:27.647394 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xtdjk" event={"ID":"7961d8da-66e2-4b1b-9f5a-37beefbd47eb","Type":"ContainerStarted","Data":"84a773ac9fce7accbce34ce3aafbe522008140c5c3477575f527b2bdac38e422"} Jul 29 18:35:28.250712 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:28.250680 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:28.352780 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:28.352730 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:28.549587 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:28.549435 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:28.781964 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:28.781780 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7884b84f54-n8z4p"] Jul 29 18:35:28.788381 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:28.788357 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7884b84f54-n8z4p" Jul 29 18:35:28.790494 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:28.790396 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7884b84f54-n8z4p"] Jul 29 18:35:28.791430 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:28.791409 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 29 18:35:28.793630 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:28.792640 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 29 18:35:28.793630 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:28.792843 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-mpn6d\"" Jul 29 18:35:28.793630 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:28.793021 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 29 18:35:28.793630 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:28.793241 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 29 18:35:28.850757 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:28.850730 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c75fd788d-7zq7r"] Jul 29 18:35:28.882664 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:28.882498 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf9kx\" (UniqueName: \"kubernetes.io/projected/4d483849-ec07-4597-938b-2627f1a841c1-kube-api-access-lf9kx\") pod \"managed-serviceaccount-addon-agent-7884b84f54-n8z4p\" (UID: \"4d483849-ec07-4597-938b-2627f1a841c1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7884b84f54-n8z4p" Jul 29 18:35:28.882664 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:28.882556 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d483849-ec07-4597-938b-2627f1a841c1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7884b84f54-n8z4p\" (UID: \"4d483849-ec07-4597-938b-2627f1a841c1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7884b84f54-n8z4p" Jul 29 18:35:28.910965 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:28.910245 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-2njf9"] Jul 29 18:35:28.919263 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:28.918335 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-2njf9" Jul 29 18:35:28.935600 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:28.935379 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-lz9cw\"" Jul 29 18:35:28.936759 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:28.936239 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 29 18:35:28.936759 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:28.936604 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 29 18:35:28.976683 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:28.976654 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-2njf9"] Jul 29 18:35:28.983361 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:28.983334 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d483849-ec07-4597-938b-2627f1a841c1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7884b84f54-n8z4p\" (UID: \"4d483849-ec07-4597-938b-2627f1a841c1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7884b84f54-n8z4p" Jul 29 18:35:28.983471 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:28.983421 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf9kx\" (UniqueName: \"kubernetes.io/projected/4d483849-ec07-4597-938b-2627f1a841c1-kube-api-access-lf9kx\") pod \"managed-serviceaccount-addon-agent-7884b84f54-n8z4p\" (UID: \"4d483849-ec07-4597-938b-2627f1a841c1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7884b84f54-n8z4p" Jul 29 18:35:28.983471 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:28.983456 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krf4w\" (UniqueName: \"kubernetes.io/projected/80336745-5e1f-4c2c-9901-d77c85536227-kube-api-access-krf4w\") pod \"downloads-7c97dc4555-2njf9\" (UID: \"80336745-5e1f-4c2c-9901-d77c85536227\") " pod="openshift-console/downloads-7c97dc4555-2njf9" Jul 29 18:35:28.988355 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:28.988329 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d483849-ec07-4597-938b-2627f1a841c1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7884b84f54-n8z4p\" (UID: \"4d483849-ec07-4597-938b-2627f1a841c1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7884b84f54-n8z4p" Jul 29 18:35:29.022755 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.022721 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68df6d685c-2662d"] Jul 29 18:35:29.025207 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.025185 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68df6d685c-2662d" Jul 29 18:35:29.031036 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.030960 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf9kx\" (UniqueName: \"kubernetes.io/projected/4d483849-ec07-4597-938b-2627f1a841c1-kube-api-access-lf9kx\") pod \"managed-serviceaccount-addon-agent-7884b84f54-n8z4p\" (UID: \"4d483849-ec07-4597-938b-2627f1a841c1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7884b84f54-n8z4p" Jul 29 18:35:29.057549 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.056624 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68df6d685c-2662d"] Jul 29 18:35:29.084549 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.084100 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/81fb55a1-fc39-4fe2-9892-96639ea676cf-ca-trust-extracted\") pod \"image-registry-68df6d685c-2662d\" (UID: \"81fb55a1-fc39-4fe2-9892-96639ea676cf\") " pod="openshift-image-registry/image-registry-68df6d685c-2662d" Jul 29 18:35:29.084549 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.084142 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/81fb55a1-fc39-4fe2-9892-96639ea676cf-trusted-ca\") pod \"image-registry-68df6d685c-2662d\" (UID: \"81fb55a1-fc39-4fe2-9892-96639ea676cf\") " pod="openshift-image-registry/image-registry-68df6d685c-2662d" Jul 29 18:35:29.084549 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.084179 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/81fb55a1-fc39-4fe2-9892-96639ea676cf-bound-sa-token\") pod \"image-registry-68df6d685c-2662d\" (UID: \"81fb55a1-fc39-4fe2-9892-96639ea676cf\") " pod="openshift-image-registry/image-registry-68df6d685c-2662d" Jul 29 18:35:29.084549 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.084218 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/81fb55a1-fc39-4fe2-9892-96639ea676cf-registry-tls\") pod \"image-registry-68df6d685c-2662d\" (UID: \"81fb55a1-fc39-4fe2-9892-96639ea676cf\") " pod="openshift-image-registry/image-registry-68df6d685c-2662d" Jul 29 18:35:29.084549 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.084257 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/81fb55a1-fc39-4fe2-9892-96639ea676cf-image-registry-private-configuration\") pod \"image-registry-68df6d685c-2662d\" (UID: \"81fb55a1-fc39-4fe2-9892-96639ea676cf\") " pod="openshift-image-registry/image-registry-68df6d685c-2662d" Jul 29 18:35:29.084549 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.084321 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/81fb55a1-fc39-4fe2-9892-96639ea676cf-registry-certificates\") pod \"image-registry-68df6d685c-2662d\" (UID: \"81fb55a1-fc39-4fe2-9892-96639ea676cf\") " pod="openshift-image-registry/image-registry-68df6d685c-2662d" Jul 29 18:35:29.084549 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.084344 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/81fb55a1-fc39-4fe2-9892-96639ea676cf-installation-pull-secrets\") pod \"image-registry-68df6d685c-2662d\" (UID: \"81fb55a1-fc39-4fe2-9892-96639ea676cf\") " pod="openshift-image-registry/image-registry-68df6d685c-2662d" Jul 29 18:35:29.084549 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.084379 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krf4w\" (UniqueName: \"kubernetes.io/projected/80336745-5e1f-4c2c-9901-d77c85536227-kube-api-access-krf4w\") pod \"downloads-7c97dc4555-2njf9\" (UID: \"80336745-5e1f-4c2c-9901-d77c85536227\") " pod="openshift-console/downloads-7c97dc4555-2njf9" Jul 29 18:35:29.084549 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.084405 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrw9g\" (UniqueName: \"kubernetes.io/projected/81fb55a1-fc39-4fe2-9892-96639ea676cf-kube-api-access-zrw9g\") pod \"image-registry-68df6d685c-2662d\" (UID: \"81fb55a1-fc39-4fe2-9892-96639ea676cf\") " pod="openshift-image-registry/image-registry-68df6d685c-2662d" Jul 29 18:35:29.088161 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.088132 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:29.098214 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.098129 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krf4w\" (UniqueName: \"kubernetes.io/projected/80336745-5e1f-4c2c-9901-d77c85536227-kube-api-access-krf4w\") pod \"downloads-7c97dc4555-2njf9\" (UID: \"80336745-5e1f-4c2c-9901-d77c85536227\") " pod="openshift-console/downloads-7c97dc4555-2njf9" Jul 29 18:35:29.116033 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.115999 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7884b84f54-n8z4p" Jul 29 18:35:29.185007 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.184973 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/81fb55a1-fc39-4fe2-9892-96639ea676cf-image-registry-private-configuration\") pod \"image-registry-68df6d685c-2662d\" (UID: \"81fb55a1-fc39-4fe2-9892-96639ea676cf\") " pod="openshift-image-registry/image-registry-68df6d685c-2662d" Jul 29 18:35:29.185190 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.185070 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/81fb55a1-fc39-4fe2-9892-96639ea676cf-registry-certificates\") pod \"image-registry-68df6d685c-2662d\" (UID: \"81fb55a1-fc39-4fe2-9892-96639ea676cf\") " pod="openshift-image-registry/image-registry-68df6d685c-2662d" Jul 29 18:35:29.185190 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.185106 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/81fb55a1-fc39-4fe2-9892-96639ea676cf-installation-pull-secrets\") pod \"image-registry-68df6d685c-2662d\" (UID: \"81fb55a1-fc39-4fe2-9892-96639ea676cf\") " pod="openshift-image-registry/image-registry-68df6d685c-2662d" Jul 29 18:35:29.185190 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.185134 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrw9g\" (UniqueName: \"kubernetes.io/projected/81fb55a1-fc39-4fe2-9892-96639ea676cf-kube-api-access-zrw9g\") pod \"image-registry-68df6d685c-2662d\" (UID: \"81fb55a1-fc39-4fe2-9892-96639ea676cf\") " pod="openshift-image-registry/image-registry-68df6d685c-2662d" Jul 29 18:35:29.185190 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.185173 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/81fb55a1-fc39-4fe2-9892-96639ea676cf-ca-trust-extracted\") pod \"image-registry-68df6d685c-2662d\" (UID: \"81fb55a1-fc39-4fe2-9892-96639ea676cf\") " pod="openshift-image-registry/image-registry-68df6d685c-2662d" Jul 29 18:35:29.185397 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.185203 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/81fb55a1-fc39-4fe2-9892-96639ea676cf-trusted-ca\") pod \"image-registry-68df6d685c-2662d\" (UID: \"81fb55a1-fc39-4fe2-9892-96639ea676cf\") " pod="openshift-image-registry/image-registry-68df6d685c-2662d" Jul 29 18:35:29.185397 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.185240 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/81fb55a1-fc39-4fe2-9892-96639ea676cf-bound-sa-token\") pod \"image-registry-68df6d685c-2662d\" (UID: \"81fb55a1-fc39-4fe2-9892-96639ea676cf\") " pod="openshift-image-registry/image-registry-68df6d685c-2662d" Jul 29 18:35:29.185397 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.185280 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/81fb55a1-fc39-4fe2-9892-96639ea676cf-registry-tls\") pod \"image-registry-68df6d685c-2662d\" (UID: \"81fb55a1-fc39-4fe2-9892-96639ea676cf\") " pod="openshift-image-registry/image-registry-68df6d685c-2662d" Jul 29 18:35:29.186556 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.186531 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/81fb55a1-fc39-4fe2-9892-96639ea676cf-registry-certificates\") pod \"image-registry-68df6d685c-2662d\" (UID: \"81fb55a1-fc39-4fe2-9892-96639ea676cf\") " pod="openshift-image-registry/image-registry-68df6d685c-2662d" Jul 29 18:35:29.187457 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.187423 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/81fb55a1-fc39-4fe2-9892-96639ea676cf-ca-trust-extracted\") pod \"image-registry-68df6d685c-2662d\" (UID: \"81fb55a1-fc39-4fe2-9892-96639ea676cf\") " pod="openshift-image-registry/image-registry-68df6d685c-2662d" Jul 29 18:35:29.187831 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.187726 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/81fb55a1-fc39-4fe2-9892-96639ea676cf-trusted-ca\") pod \"image-registry-68df6d685c-2662d\" (UID: \"81fb55a1-fc39-4fe2-9892-96639ea676cf\") " pod="openshift-image-registry/image-registry-68df6d685c-2662d" Jul 29 18:35:29.189070 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.189031 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/81fb55a1-fc39-4fe2-9892-96639ea676cf-registry-tls\") pod \"image-registry-68df6d685c-2662d\" (UID: \"81fb55a1-fc39-4fe2-9892-96639ea676cf\") " pod="openshift-image-registry/image-registry-68df6d685c-2662d" Jul 29 18:35:29.190107 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.190085 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/81fb55a1-fc39-4fe2-9892-96639ea676cf-installation-pull-secrets\") pod \"image-registry-68df6d685c-2662d\" (UID: \"81fb55a1-fc39-4fe2-9892-96639ea676cf\") " pod="openshift-image-registry/image-registry-68df6d685c-2662d" Jul 29 18:35:29.191733 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.191694 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/81fb55a1-fc39-4fe2-9892-96639ea676cf-image-registry-private-configuration\") pod \"image-registry-68df6d685c-2662d\" (UID: \"81fb55a1-fc39-4fe2-9892-96639ea676cf\") " pod="openshift-image-registry/image-registry-68df6d685c-2662d" Jul 29 18:35:29.207624 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.207600 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrw9g\" (UniqueName: \"kubernetes.io/projected/81fb55a1-fc39-4fe2-9892-96639ea676cf-kube-api-access-zrw9g\") pod \"image-registry-68df6d685c-2662d\" (UID: \"81fb55a1-fc39-4fe2-9892-96639ea676cf\") " pod="openshift-image-registry/image-registry-68df6d685c-2662d" Jul 29 18:35:29.215919 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.215890 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/81fb55a1-fc39-4fe2-9892-96639ea676cf-bound-sa-token\") pod \"image-registry-68df6d685c-2662d\" (UID: \"81fb55a1-fc39-4fe2-9892-96639ea676cf\") " pod="openshift-image-registry/image-registry-68df6d685c-2662d" Jul 29 18:35:29.233315 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.233104 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-2njf9" Jul 29 18:35:29.236036 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.236009 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:29.345588 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.345560 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68df6d685c-2662d" Jul 29 18:35:29.662812 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.662701 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w69sl" event={"ID":"95f0df74-cd8c-4c76-ac89-62b675ce368f","Type":"ContainerStarted","Data":"195dc0acccac04aaf749563612cd8e9aca9466379ae60ce89249d1c1aa0894dc"} Jul 29 18:35:29.662812 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.662764 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w69sl" event={"ID":"95f0df74-cd8c-4c76-ac89-62b675ce368f","Type":"ContainerStarted","Data":"6b409b805166fd08d468d9d996794d1330099150e623bc46f168f985f1d21de1"} Jul 29 18:35:29.689436 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:29.689382 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-w69sl" podStartSLOduration=68.408313084 podStartE2EDuration="1m9.689360613s" totalImagesPullingTime="1.281047529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:35:29.685851496 +0000 UTC m=+70.928028653" watchObservedRunningTime="2026-07-29 18:35:29.689360613 +0000 UTC m=+70.931537770" Jul 29 18:35:30.004015 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:30.003939 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:30.080021 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:30.079907 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:30.140444 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:30.140409 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:30.240003 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:30.239906 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:30.340116 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:30.340081 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:30.587258 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:30.587154 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:30.660008 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:30.659919 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:31.514782 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:31.514741 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:33.671206 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:33.671173 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-2njf9"] Jul 29 18:35:34.123533 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:35:34.123486 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80336745_5e1f_4c2c_9901_d77c85536227.slice/crio-34db9446bb8ea7e35e5530514342576813072620d31309b5c53df733cd7bc77a WatchSource:0}: Error finding container 34db9446bb8ea7e35e5530514342576813072620d31309b5c53df733cd7bc77a: Status 404 returned error can't find the container with id 34db9446bb8ea7e35e5530514342576813072620d31309b5c53df733cd7bc77a Jul 29 18:35:34.251420 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:34.251317 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7884b84f54-n8z4p"] Jul 29 18:35:34.255271 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:35:34.255243 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d483849_ec07_4597_938b_2627f1a841c1.slice/crio-571338c24687d3a78ffbd74d7546936f59b561cf25f895a3a8eba9e349f790f9 WatchSource:0}: Error finding container 571338c24687d3a78ffbd74d7546936f59b561cf25f895a3a8eba9e349f790f9: Status 404 returned error can't find the container with id 571338c24687d3a78ffbd74d7546936f59b561cf25f895a3a8eba9e349f790f9 Jul 29 18:35:34.363838 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:35:34.361801 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81fb55a1_fc39_4fe2_9892_96639ea676cf.slice/crio-95dfdc6fa7e5a2cadefe437a2a88831935aa8d2c3f5d146055a23a59cae337c9 WatchSource:0}: Error finding container 95dfdc6fa7e5a2cadefe437a2a88831935aa8d2c3f5d146055a23a59cae337c9: Status 404 returned error can't find the container with id 95dfdc6fa7e5a2cadefe437a2a88831935aa8d2c3f5d146055a23a59cae337c9 Jul 29 18:35:34.366264 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:34.366196 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68df6d685c-2662d"] Jul 29 18:35:34.683579 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:34.683484 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7884b84f54-n8z4p" event={"ID":"4d483849-ec07-4597-938b-2627f1a841c1","Type":"ContainerStarted","Data":"571338c24687d3a78ffbd74d7546936f59b561cf25f895a3a8eba9e349f790f9"} Jul 29 18:35:34.686088 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:34.686061 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l5mk5" event={"ID":"a34ff964-79be-4feb-9960-a027467c77e7","Type":"ContainerStarted","Data":"afeac78efae33c2608b3e8a7ecfb796a5f70b491c0e9ac058a8fc005a5c93d19"} Jul 29 18:35:34.688709 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:34.688200 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h8pgd" event={"ID":"bbd0aa69-cc0c-4c79-9460-26e246d285f1","Type":"ContainerStarted","Data":"522d97d055cfc2b889af7ff5a450e35bf1d92d54f86e77c9cc3544004ca56cf6"} Jul 29 18:35:34.688709 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:34.688251 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h8pgd" event={"ID":"bbd0aa69-cc0c-4c79-9460-26e246d285f1","Type":"ContainerStarted","Data":"38720d4a2fe12c89798c737210bfb3b8b52f9dd3076b6522811e9d74afb1b61c"} Jul 29 18:35:34.688709 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:34.688502 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-h8pgd" Jul 29 18:35:34.689979 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:34.689956 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8cc84" event={"ID":"c1f1308a-865e-4a0f-ad80-7a8602155966","Type":"ContainerStarted","Data":"f8fac4a64f897308bfc359f2e9a1417f345b8f0e80a91366cecc6da1a4cd4006"} Jul 29 18:35:34.692063 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:34.691952 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xtdjk" event={"ID":"7961d8da-66e2-4b1b-9f5a-37beefbd47eb","Type":"ContainerStarted","Data":"7becb99e5701454bac2ede82e0d087e43586d19ffe6c7ccbdd603a2f4cd8eb0e"} Jul 29 18:35:34.692063 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:34.692013 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:35:34.693681 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:34.693619 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68df6d685c-2662d" event={"ID":"81fb55a1-fc39-4fe2-9892-96639ea676cf","Type":"ContainerStarted","Data":"1cfb32bf6e8a2e1d533961774cd3e7edc460d7d6010d6e196f6c976d1c1e264a"} Jul 29 18:35:34.693681 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:34.693661 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68df6d685c-2662d" event={"ID":"81fb55a1-fc39-4fe2-9892-96639ea676cf","Type":"ContainerStarted","Data":"95dfdc6fa7e5a2cadefe437a2a88831935aa8d2c3f5d146055a23a59cae337c9"} Jul 29 18:35:34.693834 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:34.693685 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68df6d685c-2662d" Jul 29 18:35:34.695143 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:34.695120 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-2njf9" event={"ID":"80336745-5e1f-4c2c-9901-d77c85536227","Type":"ContainerStarted","Data":"34db9446bb8ea7e35e5530514342576813072620d31309b5c53df733cd7bc77a"} Jul 29 18:35:34.707838 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:34.707787 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-h8pgd" podStartSLOduration=32.914113152 podStartE2EDuration="39.707770138s" totalImagesPullingTime="6.793656986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:34:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:35:34.706002835 +0000 UTC m=+75.948179992" watchObservedRunningTime="2026-07-29 18:35:34.707770138 +0000 UTC m=+75.949947294" Jul 29 18:35:34.727068 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:34.727011 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68df6d685c-2662d" podStartSLOduration=6.726990584 podStartE2EDuration="6.726990584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:35:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:35:34.724690134 +0000 UTC m=+75.966867301" watchObservedRunningTime="2026-07-29 18:35:34.726990584 +0000 UTC m=+75.969167738" Jul 29 18:35:34.740189 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:34.740062 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8cc84" podStartSLOduration=68.091784525 podStartE2EDuration="1m14.740046319s" totalImagesPullingTime="6.648261794s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:35:34.739686222 +0000 UTC m=+75.981863403" watchObservedRunningTime="2026-07-29 18:35:34.740046319 +0000 UTC m=+75.982223476" Jul 29 18:35:34.755504 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:34.755431 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xtdjk" podStartSLOduration=68.10987232 podStartE2EDuration="1m14.755413501s" totalImagesPullingTime="6.645541181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:35:34.754011665 +0000 UTC m=+75.996188821" watchObservedRunningTime="2026-07-29 18:35:34.755413501 +0000 UTC m=+75.997590656" Jul 29 18:35:37.851153 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:37.851108 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:37.913460 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:37.913408 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:38.015430 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:38.015395 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:38.078234 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:38.078201 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:38.730603 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:38.730498 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:38.774073 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:38.774046 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-bffgm"] Jul 29 18:35:38.782103 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:38.782075 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-bffgm" Jul 29 18:35:38.786283 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:38.786147 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pbjw7\"" Jul 29 18:35:38.786283 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:38.786191 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 29 18:35:38.786283 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:38.786215 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 29 18:35:38.786283 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:38.786228 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 29 18:35:38.795365 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:38.795262 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-bffgm"] Jul 29 18:35:38.819493 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:38.819434 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:38.858105 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:38.858075 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:38.871817 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:38.871787 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e56bdea-f7cf-48f2-8497-c79950514e4c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-bffgm\" (UID: \"5e56bdea-f7cf-48f2-8497-c79950514e4c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-bffgm" Jul 29 18:35:38.872010 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:38.871841 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e56bdea-f7cf-48f2-8497-c79950514e4c-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-bffgm\" (UID: \"5e56bdea-f7cf-48f2-8497-c79950514e4c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-bffgm" Jul 29 18:35:38.872010 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:38.871877 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpk8g\" (UniqueName: \"kubernetes.io/projected/5e56bdea-f7cf-48f2-8497-c79950514e4c-kube-api-access-jpk8g\") pod \"prometheus-operator-84d69f794d-bffgm\" (UID: \"5e56bdea-f7cf-48f2-8497-c79950514e4c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-bffgm" Jul 29 18:35:38.872010 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:38.871913 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e56bdea-f7cf-48f2-8497-c79950514e4c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-bffgm\" (UID: \"5e56bdea-f7cf-48f2-8497-c79950514e4c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-bffgm" Jul 29 18:35:38.964752 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:38.964719 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:38.972983 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:38.972816 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e56bdea-f7cf-48f2-8497-c79950514e4c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-bffgm\" (UID: \"5e56bdea-f7cf-48f2-8497-c79950514e4c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-bffgm" Jul 29 18:35:38.972983 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:38.972867 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e56bdea-f7cf-48f2-8497-c79950514e4c-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-bffgm\" (UID: \"5e56bdea-f7cf-48f2-8497-c79950514e4c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-bffgm" Jul 29 18:35:38.972983 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:38.972891 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpk8g\" (UniqueName: \"kubernetes.io/projected/5e56bdea-f7cf-48f2-8497-c79950514e4c-kube-api-access-jpk8g\") pod \"prometheus-operator-84d69f794d-bffgm\" (UID: \"5e56bdea-f7cf-48f2-8497-c79950514e4c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-bffgm" Jul 29 18:35:38.972983 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:38.972928 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e56bdea-f7cf-48f2-8497-c79950514e4c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-bffgm\" (UID: \"5e56bdea-f7cf-48f2-8497-c79950514e4c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-bffgm" Jul 29 18:35:38.973808 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:38.973783 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e56bdea-f7cf-48f2-8497-c79950514e4c-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-bffgm\" (UID: \"5e56bdea-f7cf-48f2-8497-c79950514e4c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-bffgm" Jul 29 18:35:38.975896 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:38.975867 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e56bdea-f7cf-48f2-8497-c79950514e4c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-bffgm\" (UID: \"5e56bdea-f7cf-48f2-8497-c79950514e4c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-bffgm" Jul 29 18:35:38.975999 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:38.975873 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e56bdea-f7cf-48f2-8497-c79950514e4c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-bffgm\" (UID: \"5e56bdea-f7cf-48f2-8497-c79950514e4c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-bffgm" Jul 29 18:35:38.984585 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:38.984493 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpk8g\" (UniqueName: \"kubernetes.io/projected/5e56bdea-f7cf-48f2-8497-c79950514e4c-kube-api-access-jpk8g\") pod \"prometheus-operator-84d69f794d-bffgm\" (UID: \"5e56bdea-f7cf-48f2-8497-c79950514e4c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-bffgm" Jul 29 18:35:39.097180 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:39.097140 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-bffgm" Jul 29 18:35:39.719633 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:39.719588 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l5mk5" event={"ID":"a34ff964-79be-4feb-9960-a027467c77e7","Type":"ContainerStarted","Data":"fc47bbb8d57175cae14ed68894022f7e93cd36564d3cbf5a94ea280a4ecc2712"} Jul 29 18:35:39.721888 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:39.721856 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7884b84f54-n8z4p" event={"ID":"4d483849-ec07-4597-938b-2627f1a841c1","Type":"ContainerStarted","Data":"088ba82c8c5195e46740ee955edcdb34ecf7aa7a5fb079c04d3772b76e2286e2"} Jul 29 18:35:39.722178 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:39.722118 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-bffgm"] Jul 29 18:35:39.725374 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:35:39.725347 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e56bdea_f7cf_48f2_8497_c79950514e4c.slice/crio-718d0d66679dbd949a31882f350f066ac73aa15ee2ab1d6fd6062127b68ab26c WatchSource:0}: Error finding container 718d0d66679dbd949a31882f350f066ac73aa15ee2ab1d6fd6062127b68ab26c: Status 404 returned error can't find the container with id 718d0d66679dbd949a31882f350f066ac73aa15ee2ab1d6fd6062127b68ab26c Jul 29 18:35:39.749410 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:39.749346 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l5mk5" podStartSLOduration=16.773748597 podStartE2EDuration="33.749326841s" totalImagesPullingTime="16.975578244s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:35:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:35:39.747749293 +0000 UTC m=+80.989926450" watchObservedRunningTime="2026-07-29 18:35:39.749326841 +0000 UTC m=+80.991503998" Jul 29 18:35:39.766853 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:39.766795 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7884b84f54-n8z4p" podStartSLOduration=6.390102683 podStartE2EDuration="11.766781385s" totalImagesPullingTime="5.376678702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:35:39.766166883 +0000 UTC m=+81.008344040" watchObservedRunningTime="2026-07-29 18:35:39.766781385 +0000 UTC m=+81.008958540" Jul 29 18:35:40.726558 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:40.726401 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-bffgm" event={"ID":"5e56bdea-f7cf-48f2-8497-c79950514e4c","Type":"ContainerStarted","Data":"718d0d66679dbd949a31882f350f066ac73aa15ee2ab1d6fd6062127b68ab26c"} Jul 29 18:35:41.252042 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:41.251958 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:41.732628 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:41.732584 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-bffgm" event={"ID":"5e56bdea-f7cf-48f2-8497-c79950514e4c","Type":"ContainerStarted","Data":"c1c0e64e155bec97f16a347891df2fa0570411aabf5403218040c8eed00f98e8"} Jul 29 18:35:41.733057 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:41.732647 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-bffgm" event={"ID":"5e56bdea-f7cf-48f2-8497-c79950514e4c","Type":"ContainerStarted","Data":"23c456b73437a75e84fb7b42e1e2f577608d30f1d85aa58dbb6369c1f253185d"} Jul 29 18:35:41.754152 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:41.754092 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-bffgm" podStartSLOduration=2.50293106 podStartE2EDuration="3.754070335s" totalImagesPullingTime="1.251139275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:35:41.752878692 +0000 UTC m=+82.995055850" watchObservedRunningTime="2026-07-29 18:35:41.754070335 +0000 UTC m=+82.996247492" Jul 29 18:35:42.169486 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:42.169448 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:42.445966 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:42.445879 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:42.555012 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:42.554975 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:42.654146 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:42.654112 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:43.114593 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:43.114559 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:43.215117 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:43.215085 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:43.339503 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:43.339467 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:43.931680 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:43.931643 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:44.017086 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.017047 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:44.139563 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.139498 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:44.186973 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.186895 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-9p9z9"] Jul 29 18:35:44.191748 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.191725 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9p9z9" Jul 29 18:35:44.194562 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.194531 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 29 18:35:44.194562 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.194561 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 29 18:35:44.194727 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.194626 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lfjlz\"" Jul 29 18:35:44.203442 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.203407 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-9p9z9"] Jul 29 18:35:44.233899 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.233864 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tsw7n"] Jul 29 18:35:44.237353 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.237326 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.239641 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.239618 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 29 18:35:44.239987 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.239969 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 29 18:35:44.240087 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.239990 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nq64k\"" Jul 29 18:35:44.240087 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.239974 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 29 18:35:44.249227 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.249193 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:44.319643 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.319609 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320-node-exporter-wtmp\") pod \"node-exporter-tsw7n\" (UID: \"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320\") " pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.319643 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.319653 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg68g\" (UniqueName: \"kubernetes.io/projected/f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320-kube-api-access-kg68g\") pod \"node-exporter-tsw7n\" (UID: \"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320\") " pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.319878 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.319686 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320-node-exporter-tls\") pod \"node-exporter-tsw7n\" (UID: \"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320\") " pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.319878 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.319708 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320-node-exporter-accelerators-collector-config\") pod \"node-exporter-tsw7n\" (UID: \"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320\") " pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.319878 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.319790 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320-metrics-client-ca\") pod \"node-exporter-tsw7n\" (UID: \"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320\") " pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.319878 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.319825 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87gx2\" (UniqueName: \"kubernetes.io/projected/2a4adfc3-3297-4688-9122-4c8a6a588525-kube-api-access-87gx2\") pod \"openshift-state-metrics-b8f49f5c6-9p9z9\" (UID: \"2a4adfc3-3297-4688-9122-4c8a6a588525\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9p9z9" Jul 29 18:35:44.319878 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.319860 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320-node-exporter-textfile\") pod \"node-exporter-tsw7n\" (UID: \"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320\") " pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.320094 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.319934 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a4adfc3-3297-4688-9122-4c8a6a588525-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-9p9z9\" (UID: \"2a4adfc3-3297-4688-9122-4c8a6a588525\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9p9z9" Jul 29 18:35:44.320094 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.319972 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320-sys\") pod \"node-exporter-tsw7n\" (UID: \"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320\") " pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.320094 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.320002 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a4adfc3-3297-4688-9122-4c8a6a588525-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-9p9z9\" (UID: \"2a4adfc3-3297-4688-9122-4c8a6a588525\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9p9z9" Jul 29 18:35:44.320094 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.320081 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tsw7n\" (UID: \"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320\") " pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.320243 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.320103 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320-root\") pod \"node-exporter-tsw7n\" (UID: \"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320\") " pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.320243 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.320121 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a4adfc3-3297-4688-9122-4c8a6a588525-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-9p9z9\" (UID: \"2a4adfc3-3297-4688-9122-4c8a6a588525\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9p9z9" Jul 29 18:35:44.343840 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.343803 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:44.376138 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.376107 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f944f964b-gq77w"] Jul 29 18:35:44.379597 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.379577 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f944f964b-gq77w" Jul 29 18:35:44.382346 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.382325 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 18:35:44.382686 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.382662 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 18:35:44.382793 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.382699 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 18:35:44.382968 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.382954 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 18:35:44.383294 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.383279 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 18:35:44.384478 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.384281 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sz2d9\"" Jul 29 18:35:44.387995 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.387973 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 29 18:35:44.399892 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.399868 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f944f964b-gq77w"] Jul 29 18:35:44.421070 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.421027 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg68g\" (UniqueName: \"kubernetes.io/projected/f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320-kube-api-access-kg68g\") pod \"node-exporter-tsw7n\" (UID: \"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320\") " pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.421222 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.421079 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320-node-exporter-tls\") pod \"node-exporter-tsw7n\" (UID: \"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320\") " pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.421222 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.421104 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320-node-exporter-accelerators-collector-config\") pod \"node-exporter-tsw7n\" (UID: \"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320\") " pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.421222 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.421128 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320-metrics-client-ca\") pod \"node-exporter-tsw7n\" (UID: \"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320\") " pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.421222 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.421152 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87gx2\" (UniqueName: \"kubernetes.io/projected/2a4adfc3-3297-4688-9122-4c8a6a588525-kube-api-access-87gx2\") pod \"openshift-state-metrics-b8f49f5c6-9p9z9\" (UID: \"2a4adfc3-3297-4688-9122-4c8a6a588525\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9p9z9" Jul 29 18:35:44.421222 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.421177 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320-node-exporter-textfile\") pod \"node-exporter-tsw7n\" (UID: \"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320\") " pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.421488 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.421224 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a4adfc3-3297-4688-9122-4c8a6a588525-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-9p9z9\" (UID: \"2a4adfc3-3297-4688-9122-4c8a6a588525\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9p9z9" Jul 29 18:35:44.421488 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.421282 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320-sys\") pod \"node-exporter-tsw7n\" (UID: \"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320\") " pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.421488 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.421322 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a4adfc3-3297-4688-9122-4c8a6a588525-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-9p9z9\" (UID: \"2a4adfc3-3297-4688-9122-4c8a6a588525\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9p9z9" Jul 29 18:35:44.421488 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.421380 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tsw7n\" (UID: \"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320\") " pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.421488 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.421413 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320-root\") pod \"node-exporter-tsw7n\" (UID: \"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320\") " pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.421488 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.421420 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320-sys\") pod \"node-exporter-tsw7n\" (UID: \"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320\") " pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.421488 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.421462 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a4adfc3-3297-4688-9122-4c8a6a588525-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-9p9z9\" (UID: \"2a4adfc3-3297-4688-9122-4c8a6a588525\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9p9z9" Jul 29 18:35:44.421488 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.421471 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320-root\") pod \"node-exporter-tsw7n\" (UID: \"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320\") " pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.421890 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.421501 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320-node-exporter-wtmp\") pod \"node-exporter-tsw7n\" (UID: \"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320\") " pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.421890 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.421703 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320-node-exporter-wtmp\") pod \"node-exporter-tsw7n\" (UID: \"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320\") " pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.421890 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.421749 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320-node-exporter-accelerators-collector-config\") pod \"node-exporter-tsw7n\" (UID: \"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320\") " pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.422064 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.421901 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320-node-exporter-textfile\") pod \"node-exporter-tsw7n\" (UID: \"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320\") " pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.422242 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.422214 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320-metrics-client-ca\") pod \"node-exporter-tsw7n\" (UID: \"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320\") " pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.422449 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.422422 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a4adfc3-3297-4688-9122-4c8a6a588525-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-9p9z9\" (UID: \"2a4adfc3-3297-4688-9122-4c8a6a588525\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9p9z9" Jul 29 18:35:44.423926 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.423900 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tsw7n\" (UID: \"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320\") " pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.424042 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.423977 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a4adfc3-3297-4688-9122-4c8a6a588525-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-9p9z9\" (UID: \"2a4adfc3-3297-4688-9122-4c8a6a588525\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9p9z9" Jul 29 18:35:44.424147 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.424128 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a4adfc3-3297-4688-9122-4c8a6a588525-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-9p9z9\" (UID: \"2a4adfc3-3297-4688-9122-4c8a6a588525\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9p9z9" Jul 29 18:35:44.424634 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.424615 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320-node-exporter-tls\") pod \"node-exporter-tsw7n\" (UID: \"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320\") " pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.426898 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.426874 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:44.430284 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.430264 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87gx2\" (UniqueName: \"kubernetes.io/projected/2a4adfc3-3297-4688-9122-4c8a6a588525-kube-api-access-87gx2\") pod \"openshift-state-metrics-b8f49f5c6-9p9z9\" (UID: \"2a4adfc3-3297-4688-9122-4c8a6a588525\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9p9z9" Jul 29 18:35:44.430431 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.430407 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg68g\" (UniqueName: \"kubernetes.io/projected/f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320-kube-api-access-kg68g\") pod \"node-exporter-tsw7n\" (UID: \"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320\") " pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.503770 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.503690 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9p9z9" Jul 29 18:35:44.508457 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.508427 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:44.522469 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.522433 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6f4a94c-52c5-4885-aa63-ec48453fba9a-console-config\") pod \"console-f944f964b-gq77w\" (UID: \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\") " pod="openshift-console/console-f944f964b-gq77w" Jul 29 18:35:44.522586 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.522570 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6f4a94c-52c5-4885-aa63-ec48453fba9a-console-oauth-config\") pod \"console-f944f964b-gq77w\" (UID: \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\") " pod="openshift-console/console-f944f964b-gq77w" Jul 29 18:35:44.522641 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.522605 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6f4a94c-52c5-4885-aa63-ec48453fba9a-oauth-serving-cert\") pod \"console-f944f964b-gq77w\" (UID: \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\") " pod="openshift-console/console-f944f964b-gq77w" Jul 29 18:35:44.522685 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.522639 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6f4a94c-52c5-4885-aa63-ec48453fba9a-service-ca\") pod \"console-f944f964b-gq77w\" (UID: \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\") " pod="openshift-console/console-f944f964b-gq77w" Jul 29 18:35:44.522735 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.522678 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6f4a94c-52c5-4885-aa63-ec48453fba9a-console-serving-cert\") pod \"console-f944f964b-gq77w\" (UID: \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\") " pod="openshift-console/console-f944f964b-gq77w" Jul 29 18:35:44.522735 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.522704 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6f4a94c-52c5-4885-aa63-ec48453fba9a-trusted-ca-bundle\") pod \"console-f944f964b-gq77w\" (UID: \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\") " pod="openshift-console/console-f944f964b-gq77w" Jul 29 18:35:44.522805 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.522742 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh76j\" (UniqueName: \"kubernetes.io/projected/c6f4a94c-52c5-4885-aa63-ec48453fba9a-kube-api-access-sh76j\") pod \"console-f944f964b-gq77w\" (UID: \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\") " pod="openshift-console/console-f944f964b-gq77w" Jul 29 18:35:44.548537 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.548483 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tsw7n" Jul 29 18:35:44.563753 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:35:44.563718 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8dcbf30_cb3d_4f00_9d8c_8cbff78b3320.slice/crio-2a579958e734f677ab4f2a269f110918ad780db2e0e8071611357fa7c3a00e5e WatchSource:0}: Error finding container 2a579958e734f677ab4f2a269f110918ad780db2e0e8071611357fa7c3a00e5e: Status 404 returned error can't find the container with id 2a579958e734f677ab4f2a269f110918ad780db2e0e8071611357fa7c3a00e5e Jul 29 18:35:44.623378 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.623315 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6f4a94c-52c5-4885-aa63-ec48453fba9a-console-config\") pod \"console-f944f964b-gq77w\" (UID: \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\") " pod="openshift-console/console-f944f964b-gq77w" Jul 29 18:35:44.623736 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.623385 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6f4a94c-52c5-4885-aa63-ec48453fba9a-console-oauth-config\") pod \"console-f944f964b-gq77w\" (UID: \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\") " pod="openshift-console/console-f944f964b-gq77w" Jul 29 18:35:44.623736 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.623408 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6f4a94c-52c5-4885-aa63-ec48453fba9a-oauth-serving-cert\") pod \"console-f944f964b-gq77w\" (UID: \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\") " pod="openshift-console/console-f944f964b-gq77w" Jul 29 18:35:44.623736 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.623434 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6f4a94c-52c5-4885-aa63-ec48453fba9a-service-ca\") pod \"console-f944f964b-gq77w\" (UID: \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\") " pod="openshift-console/console-f944f964b-gq77w" Jul 29 18:35:44.623736 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.623460 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6f4a94c-52c5-4885-aa63-ec48453fba9a-console-serving-cert\") pod \"console-f944f964b-gq77w\" (UID: \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\") " pod="openshift-console/console-f944f964b-gq77w" Jul 29 18:35:44.623736 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.623616 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6f4a94c-52c5-4885-aa63-ec48453fba9a-trusted-ca-bundle\") pod \"console-f944f964b-gq77w\" (UID: \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\") " pod="openshift-console/console-f944f964b-gq77w" Jul 29 18:35:44.623736 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.623653 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh76j\" (UniqueName: \"kubernetes.io/projected/c6f4a94c-52c5-4885-aa63-ec48453fba9a-kube-api-access-sh76j\") pod \"console-f944f964b-gq77w\" (UID: \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\") " pod="openshift-console/console-f944f964b-gq77w" Jul 29 18:35:44.624207 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.624164 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6f4a94c-52c5-4885-aa63-ec48453fba9a-oauth-serving-cert\") pod \"console-f944f964b-gq77w\" (UID: \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\") " pod="openshift-console/console-f944f964b-gq77w" Jul 29 18:35:44.625021 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.624996 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6f4a94c-52c5-4885-aa63-ec48453fba9a-console-config\") pod \"console-f944f964b-gq77w\" (UID: \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\") " pod="openshift-console/console-f944f964b-gq77w" Jul 29 18:35:44.625327 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.625308 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6f4a94c-52c5-4885-aa63-ec48453fba9a-trusted-ca-bundle\") pod \"console-f944f964b-gq77w\" (UID: \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\") " pod="openshift-console/console-f944f964b-gq77w" Jul 29 18:35:44.625489 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.625470 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6f4a94c-52c5-4885-aa63-ec48453fba9a-service-ca\") pod \"console-f944f964b-gq77w\" (UID: \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\") " pod="openshift-console/console-f944f964b-gq77w" Jul 29 18:35:44.626633 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.626615 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6f4a94c-52c5-4885-aa63-ec48453fba9a-console-oauth-config\") pod \"console-f944f964b-gq77w\" (UID: \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\") " pod="openshift-console/console-f944f964b-gq77w" Jul 29 18:35:44.626807 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.626784 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6f4a94c-52c5-4885-aa63-ec48453fba9a-console-serving-cert\") pod \"console-f944f964b-gq77w\" (UID: \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\") " pod="openshift-console/console-f944f964b-gq77w" Jul 29 18:35:44.632307 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.632285 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh76j\" (UniqueName: \"kubernetes.io/projected/c6f4a94c-52c5-4885-aa63-ec48453fba9a-kube-api-access-sh76j\") pod \"console-f944f964b-gq77w\" (UID: \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\") " pod="openshift-console/console-f944f964b-gq77w" Jul 29 18:35:44.645638 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.645565 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-9p9z9"] Jul 29 18:35:44.648029 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:35:44.648004 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a4adfc3_3297_4688_9122_4c8a6a588525.slice/crio-4a19eb34c59bf2aa70f18768e56bb86d94dae70cd4832f7401eeaa418e090319 WatchSource:0}: Error finding container 4a19eb34c59bf2aa70f18768e56bb86d94dae70cd4832f7401eeaa418e090319: Status 404 returned error can't find the container with id 4a19eb34c59bf2aa70f18768e56bb86d94dae70cd4832f7401eeaa418e090319 Jul 29 18:35:44.648829 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.648807 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:44.690605 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.690494 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f944f964b-gq77w" Jul 29 18:35:44.702962 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.702940 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-h8pgd" Jul 29 18:35:44.748284 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.748208 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tsw7n" event={"ID":"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320","Type":"ContainerStarted","Data":"2a579958e734f677ab4f2a269f110918ad780db2e0e8071611357fa7c3a00e5e"} Jul 29 18:35:44.752167 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.752047 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9p9z9" event={"ID":"2a4adfc3-3297-4688-9122-4c8a6a588525","Type":"ContainerStarted","Data":"6b53d615d9679eaa0bee03656ef8c2955ced1837043b201f896703fb0228912c"} Jul 29 18:35:44.752167 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.752120 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9p9z9" event={"ID":"2a4adfc3-3297-4688-9122-4c8a6a588525","Type":"ContainerStarted","Data":"4a19eb34c59bf2aa70f18768e56bb86d94dae70cd4832f7401eeaa418e090319"} Jul 29 18:35:44.824193 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.824132 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:44.859463 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:44.859376 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f944f964b-gq77w"] Jul 29 18:35:44.862324 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:35:44.862281 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6f4a94c_52c5_4885_aa63_ec48453fba9a.slice/crio-48d5ceb5bd3abe1acfb33360998b1cbda31b158d0dccc3a92ee06bf6c75c15ec WatchSource:0}: Error finding container 48d5ceb5bd3abe1acfb33360998b1cbda31b158d0dccc3a92ee06bf6c75c15ec: Status 404 returned error can't find the container with id 48d5ceb5bd3abe1acfb33360998b1cbda31b158d0dccc3a92ee06bf6c75c15ec Jul 29 18:35:45.038004 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.037895 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:45.138359 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.138323 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:45.197551 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.197428 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:45.203420 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.203223 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 18:35:45.207163 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.207129 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.209825 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.209805 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 29 18:35:45.211575 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.211122 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 29 18:35:45.211575 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.211154 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 29 18:35:45.211575 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.211247 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 29 18:35:45.211575 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.211361 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 29 18:35:45.211575 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.211442 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 29 18:35:45.211575 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.211451 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 29 18:35:45.211928 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.211688 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 29 18:35:45.211928 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.211844 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 29 18:35:45.212082 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.212064 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qldg9\"" Jul 29 18:35:45.225186 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.225154 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 18:35:45.331042 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.330369 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-config-volume\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.331042 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.330419 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/edeff186-6274-4f3d-bbfd-20cad5259e75-tls-assets\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.331042 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.330450 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-web-config\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.331042 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.330474 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/edeff186-6274-4f3d-bbfd-20cad5259e75-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.331042 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.330503 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.331042 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.330580 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.331042 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.330602 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5gjg\" (UniqueName: \"kubernetes.io/projected/edeff186-6274-4f3d-bbfd-20cad5259e75-kube-api-access-t5gjg\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.331042 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.330634 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/edeff186-6274-4f3d-bbfd-20cad5259e75-config-out\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.331042 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.330674 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.331042 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.330730 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.331042 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.330770 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/edeff186-6274-4f3d-bbfd-20cad5259e75-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.331042 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.330796 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.331042 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.330824 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edeff186-6274-4f3d-bbfd-20cad5259e75-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.350874 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.350777 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:45.431584 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.431547 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/edeff186-6274-4f3d-bbfd-20cad5259e75-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.431759 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.431600 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.431759 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.431630 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edeff186-6274-4f3d-bbfd-20cad5259e75-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.431759 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.431665 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-config-volume\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.431759 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.431689 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/edeff186-6274-4f3d-bbfd-20cad5259e75-tls-assets\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.431759 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.431715 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-web-config\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.431759 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.431736 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/edeff186-6274-4f3d-bbfd-20cad5259e75-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.432059 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.431760 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.432059 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.431813 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.432059 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.431835 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5gjg\" (UniqueName: \"kubernetes.io/projected/edeff186-6274-4f3d-bbfd-20cad5259e75-kube-api-access-t5gjg\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.432059 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.431863 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/edeff186-6274-4f3d-bbfd-20cad5259e75-config-out\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.432059 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.431900 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.432059 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.431943 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.432059 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.431993 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/edeff186-6274-4f3d-bbfd-20cad5259e75-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.432681 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.432661 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/edeff186-6274-4f3d-bbfd-20cad5259e75-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.432826 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:35:45.432809 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/edeff186-6274-4f3d-bbfd-20cad5259e75-alertmanager-trusted-ca-bundle podName:edeff186-6274-4f3d-bbfd-20cad5259e75 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:45.93278794 +0000 UTC m=+87.174965076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/edeff186-6274-4f3d-bbfd-20cad5259e75-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "edeff186-6274-4f3d-bbfd-20cad5259e75") : configmap references non-existent config key: ca-bundle.crt Jul 29 18:35:45.435547 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.435460 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-config-volume\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.438288 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.438048 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.439256 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.438820 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-web-config\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.440150 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.440105 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.440766 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.440693 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/edeff186-6274-4f3d-bbfd-20cad5259e75-config-out\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.440928 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.440909 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/edeff186-6274-4f3d-bbfd-20cad5259e75-tls-assets\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.441458 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.441388 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.441458 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.441417 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.442535 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.442465 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5gjg\" (UniqueName: \"kubernetes.io/projected/edeff186-6274-4f3d-bbfd-20cad5259e75-kube-api-access-t5gjg\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.443491 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.443465 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.758866 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.758784 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9p9z9" event={"ID":"2a4adfc3-3297-4688-9122-4c8a6a588525","Type":"ContainerStarted","Data":"642c3d9a2af85c0f57c934e6251fb26f53bb66cea7d843943b2495fd09f0ac7f"} Jul 29 18:35:45.760549 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.760480 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f944f964b-gq77w" event={"ID":"c6f4a94c-52c5-4885-aa63-ec48453fba9a","Type":"ContainerStarted","Data":"48d5ceb5bd3abe1acfb33360998b1cbda31b158d0dccc3a92ee06bf6c75c15ec"} Jul 29 18:35:45.769970 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.769894 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:45.870060 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.870007 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:45.936547 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.936424 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edeff186-6274-4f3d-bbfd-20cad5259e75-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:45.937361 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:45.937330 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edeff186-6274-4f3d-bbfd-20cad5259e75-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:46.121313 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:46.121276 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:35:47.323289 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:47.323250 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:47.423555 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:47.423494 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:47.644183 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:47.644149 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:48.178855 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:48.178817 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:48.252347 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:48.252308 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:48.763004 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:48.762972 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:48.919732 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:48.919695 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-xvbnz"] Jul 29 18:35:48.954847 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:48.954788 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:49.018251 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:49.018169 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-xvbnz"] Jul 29 18:35:49.018412 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:49.018304 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xvbnz" Jul 29 18:35:49.022416 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:49.022360 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 29 18:35:49.022416 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:49.022376 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-nfs8t\"" Jul 29 18:35:49.041185 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:49.041139 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:49.165788 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:49.165739 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf6cp\" (UniqueName: \"kubernetes.io/projected/0e644921-b0ea-4a01-9cf2-75af74d2f7f4-kube-api-access-gf6cp\") pod \"monitoring-plugin-68b7fc9574-xvbnz\" (UID: \"0e644921-b0ea-4a01-9cf2-75af74d2f7f4\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xvbnz" Jul 29 18:35:49.165976 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:49.165829 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e644921-b0ea-4a01-9cf2-75af74d2f7f4-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-xvbnz\" (UID: \"0e644921-b0ea-4a01-9cf2-75af74d2f7f4\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xvbnz" Jul 29 18:35:49.250798 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:49.250750 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:49.266771 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:49.266736 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf6cp\" (UniqueName: \"kubernetes.io/projected/0e644921-b0ea-4a01-9cf2-75af74d2f7f4-kube-api-access-gf6cp\") pod \"monitoring-plugin-68b7fc9574-xvbnz\" (UID: \"0e644921-b0ea-4a01-9cf2-75af74d2f7f4\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xvbnz" Jul 29 18:35:49.266940 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:49.266896 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e644921-b0ea-4a01-9cf2-75af74d2f7f4-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-xvbnz\" (UID: \"0e644921-b0ea-4a01-9cf2-75af74d2f7f4\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xvbnz" Jul 29 18:35:49.269706 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:49.269638 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e644921-b0ea-4a01-9cf2-75af74d2f7f4-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-xvbnz\" (UID: \"0e644921-b0ea-4a01-9cf2-75af74d2f7f4\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xvbnz" Jul 29 18:35:49.276279 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:49.276223 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf6cp\" (UniqueName: \"kubernetes.io/projected/0e644921-b0ea-4a01-9cf2-75af74d2f7f4-kube-api-access-gf6cp\") pod \"monitoring-plugin-68b7fc9574-xvbnz\" (UID: \"0e644921-b0ea-4a01-9cf2-75af74d2f7f4\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xvbnz" Jul 29 18:35:49.331943 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:49.331906 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xvbnz" Jul 29 18:35:50.254105 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:50.254048 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:50.407695 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:50.407655 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:50.670016 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:50.668087 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:50.777842 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:50.777809 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:51.624965 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:51.624928 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:51.682039 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:51.681999 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:52.194651 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:52.194613 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:52.294171 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:52.294122 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:53.579639 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:53.579595 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:53.593887 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:53.593857 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f944f964b-gq77w"] Jul 29 18:35:53.881848 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:53.881809 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" podUID="67b65c5d-6767-4e9f-a044-36167a6a11b5" containerName="registry" containerID="cri-o://2b011ba5004b860404be54bdc79a0bd8c90dedb9ab7050a689cae944db18e04d" gracePeriod=30 Jul 29 18:35:54.801778 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:54.801742 2562 generic.go:356] "Generic (PLEG): container finished" podID="67b65c5d-6767-4e9f-a044-36167a6a11b5" containerID="2b011ba5004b860404be54bdc79a0bd8c90dedb9ab7050a689cae944db18e04d" exitCode=0 Jul 29 18:35:54.802296 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:54.801818 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" event={"ID":"67b65c5d-6767-4e9f-a044-36167a6a11b5","Type":"ContainerDied","Data":"2b011ba5004b860404be54bdc79a0bd8c90dedb9ab7050a689cae944db18e04d"} Jul 29 18:35:54.905663 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:54.902803 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:55.019011 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.016702 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/67b65c5d-6767-4e9f-a044-36167a6a11b5-installation-pull-secrets\") pod \"67b65c5d-6767-4e9f-a044-36167a6a11b5\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " Jul 29 18:35:55.019011 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.016749 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67b65c5d-6767-4e9f-a044-36167a6a11b5-trusted-ca\") pod \"67b65c5d-6767-4e9f-a044-36167a6a11b5\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " Jul 29 18:35:55.019011 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.016808 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/67b65c5d-6767-4e9f-a044-36167a6a11b5-image-registry-private-configuration\") pod \"67b65c5d-6767-4e9f-a044-36167a6a11b5\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " Jul 29 18:35:55.019011 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.016843 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-bound-sa-token\") pod \"67b65c5d-6767-4e9f-a044-36167a6a11b5\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " Jul 29 18:35:55.019011 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.016873 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/67b65c5d-6767-4e9f-a044-36167a6a11b5-ca-trust-extracted\") pod \"67b65c5d-6767-4e9f-a044-36167a6a11b5\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " Jul 29 18:35:55.019011 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.016924 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gz8ml\" (UniqueName: \"kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-kube-api-access-gz8ml\") pod \"67b65c5d-6767-4e9f-a044-36167a6a11b5\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " Jul 29 18:35:55.019011 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.016954 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-registry-tls\") pod \"67b65c5d-6767-4e9f-a044-36167a6a11b5\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " Jul 29 18:35:55.019011 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.017007 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/67b65c5d-6767-4e9f-a044-36167a6a11b5-registry-certificates\") pod \"67b65c5d-6767-4e9f-a044-36167a6a11b5\" (UID: \"67b65c5d-6767-4e9f-a044-36167a6a11b5\") " Jul 29 18:35:55.019011 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.017754 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67b65c5d-6767-4e9f-a044-36167a6a11b5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "67b65c5d-6767-4e9f-a044-36167a6a11b5" (UID: "67b65c5d-6767-4e9f-a044-36167a6a11b5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:35:55.019011 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.018023 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67b65c5d-6767-4e9f-a044-36167a6a11b5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "67b65c5d-6767-4e9f-a044-36167a6a11b5" (UID: "67b65c5d-6767-4e9f-a044-36167a6a11b5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:35:55.035204 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.034010 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "67b65c5d-6767-4e9f-a044-36167a6a11b5" (UID: "67b65c5d-6767-4e9f-a044-36167a6a11b5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 18:35:55.035204 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.034152 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "67b65c5d-6767-4e9f-a044-36167a6a11b5" (UID: "67b65c5d-6767-4e9f-a044-36167a6a11b5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 18:35:55.035204 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.034368 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67b65c5d-6767-4e9f-a044-36167a6a11b5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "67b65c5d-6767-4e9f-a044-36167a6a11b5" (UID: "67b65c5d-6767-4e9f-a044-36167a6a11b5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 18:35:55.036457 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.036385 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67b65c5d-6767-4e9f-a044-36167a6a11b5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "67b65c5d-6767-4e9f-a044-36167a6a11b5" (UID: "67b65c5d-6767-4e9f-a044-36167a6a11b5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:35:55.037236 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.037153 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-kube-api-access-gz8ml" (OuterVolumeSpecName: "kube-api-access-gz8ml") pod "67b65c5d-6767-4e9f-a044-36167a6a11b5" (UID: "67b65c5d-6767-4e9f-a044-36167a6a11b5"). InnerVolumeSpecName "kube-api-access-gz8ml". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 18:35:55.038585 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.038557 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67b65c5d-6767-4e9f-a044-36167a6a11b5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "67b65c5d-6767-4e9f-a044-36167a6a11b5" (UID: "67b65c5d-6767-4e9f-a044-36167a6a11b5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:35:55.071729 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.071634 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 18:35:55.086161 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.086128 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-xvbnz"] Jul 29 18:35:55.118417 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.118374 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/67b65c5d-6767-4e9f-a044-36167a6a11b5-image-registry-private-configuration\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:35:55.118417 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.118409 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-bound-sa-token\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:35:55.118641 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.118425 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/67b65c5d-6767-4e9f-a044-36167a6a11b5-ca-trust-extracted\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:35:55.118641 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.118441 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gz8ml\" (UniqueName: \"kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-kube-api-access-gz8ml\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:35:55.118641 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.118455 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67b65c5d-6767-4e9f-a044-36167a6a11b5-registry-tls\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:35:55.118641 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.118471 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/67b65c5d-6767-4e9f-a044-36167a6a11b5-registry-certificates\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:35:55.118641 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.118480 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/67b65c5d-6767-4e9f-a044-36167a6a11b5-installation-pull-secrets\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:35:55.118641 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.118488 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67b65c5d-6767-4e9f-a044-36167a6a11b5-trusted-ca\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:35:55.259808 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:35:55.259773 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e644921_b0ea_4a01_9cf2_75af74d2f7f4.slice/crio-0e9bbd1e875420f6fbf26587fcd4aaa131959b8a185f9ad47aa9495fe3dd6c48 WatchSource:0}: Error finding container 0e9bbd1e875420f6fbf26587fcd4aaa131959b8a185f9ad47aa9495fe3dd6c48: Status 404 returned error can't find the container with id 0e9bbd1e875420f6fbf26587fcd4aaa131959b8a185f9ad47aa9495fe3dd6c48 Jul 29 18:35:55.260473 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:35:55.260449 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedeff186_6274_4f3d_bbfd_20cad5259e75.slice/crio-fe0ca5a69b8b9f9bc807a70776b72e7f33082932a304938ba7361608b0195771 WatchSource:0}: Error finding container fe0ca5a69b8b9f9bc807a70776b72e7f33082932a304938ba7361608b0195771: Status 404 returned error can't find the container with id fe0ca5a69b8b9f9bc807a70776b72e7f33082932a304938ba7361608b0195771 Jul 29 18:35:55.273906 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.273880 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-759f55f9b4-9dfmk"] Jul 29 18:35:55.274316 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.274291 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67b65c5d-6767-4e9f-a044-36167a6a11b5" containerName="registry" Jul 29 18:35:55.274316 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.274314 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="67b65c5d-6767-4e9f-a044-36167a6a11b5" containerName="registry" Jul 29 18:35:55.274456 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.274403 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="67b65c5d-6767-4e9f-a044-36167a6a11b5" containerName="registry" Jul 29 18:35:55.280344 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.280328 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:35:55.288508 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.288483 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-759f55f9b4-9dfmk"] Jul 29 18:35:55.420724 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.420701 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d67ac03-e3ee-4078-982f-930243350f86-console-serving-cert\") pod \"console-759f55f9b4-9dfmk\" (UID: \"0d67ac03-e3ee-4078-982f-930243350f86\") " pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:35:55.420849 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.420751 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzj7m\" (UniqueName: \"kubernetes.io/projected/0d67ac03-e3ee-4078-982f-930243350f86-kube-api-access-pzj7m\") pod \"console-759f55f9b4-9dfmk\" (UID: \"0d67ac03-e3ee-4078-982f-930243350f86\") " pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:35:55.420914 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.420854 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d67ac03-e3ee-4078-982f-930243350f86-service-ca\") pod \"console-759f55f9b4-9dfmk\" (UID: \"0d67ac03-e3ee-4078-982f-930243350f86\") " pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:35:55.420914 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.420887 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d67ac03-e3ee-4078-982f-930243350f86-oauth-serving-cert\") pod \"console-759f55f9b4-9dfmk\" (UID: \"0d67ac03-e3ee-4078-982f-930243350f86\") " pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:35:55.421080 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.420946 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d67ac03-e3ee-4078-982f-930243350f86-trusted-ca-bundle\") pod \"console-759f55f9b4-9dfmk\" (UID: \"0d67ac03-e3ee-4078-982f-930243350f86\") " pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:35:55.421080 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.421015 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d67ac03-e3ee-4078-982f-930243350f86-console-config\") pod \"console-759f55f9b4-9dfmk\" (UID: \"0d67ac03-e3ee-4078-982f-930243350f86\") " pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:35:55.421080 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.421056 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d67ac03-e3ee-4078-982f-930243350f86-console-oauth-config\") pod \"console-759f55f9b4-9dfmk\" (UID: \"0d67ac03-e3ee-4078-982f-930243350f86\") " pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:35:55.522267 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.522240 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzj7m\" (UniqueName: \"kubernetes.io/projected/0d67ac03-e3ee-4078-982f-930243350f86-kube-api-access-pzj7m\") pod \"console-759f55f9b4-9dfmk\" (UID: \"0d67ac03-e3ee-4078-982f-930243350f86\") " pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:35:55.522402 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.522285 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d67ac03-e3ee-4078-982f-930243350f86-service-ca\") pod \"console-759f55f9b4-9dfmk\" (UID: \"0d67ac03-e3ee-4078-982f-930243350f86\") " pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:35:55.522402 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.522304 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d67ac03-e3ee-4078-982f-930243350f86-oauth-serving-cert\") pod \"console-759f55f9b4-9dfmk\" (UID: \"0d67ac03-e3ee-4078-982f-930243350f86\") " pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:35:55.522594 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.522414 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d67ac03-e3ee-4078-982f-930243350f86-trusted-ca-bundle\") pod \"console-759f55f9b4-9dfmk\" (UID: \"0d67ac03-e3ee-4078-982f-930243350f86\") " pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:35:55.522594 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.522486 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d67ac03-e3ee-4078-982f-930243350f86-console-config\") pod \"console-759f55f9b4-9dfmk\" (UID: \"0d67ac03-e3ee-4078-982f-930243350f86\") " pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:35:55.522594 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.522539 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d67ac03-e3ee-4078-982f-930243350f86-console-oauth-config\") pod \"console-759f55f9b4-9dfmk\" (UID: \"0d67ac03-e3ee-4078-982f-930243350f86\") " pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:35:55.522594 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.522586 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d67ac03-e3ee-4078-982f-930243350f86-console-serving-cert\") pod \"console-759f55f9b4-9dfmk\" (UID: \"0d67ac03-e3ee-4078-982f-930243350f86\") " pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:35:55.523014 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.522983 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d67ac03-e3ee-4078-982f-930243350f86-oauth-serving-cert\") pod \"console-759f55f9b4-9dfmk\" (UID: \"0d67ac03-e3ee-4078-982f-930243350f86\") " pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:35:55.523137 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.523113 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d67ac03-e3ee-4078-982f-930243350f86-console-config\") pod \"console-759f55f9b4-9dfmk\" (UID: \"0d67ac03-e3ee-4078-982f-930243350f86\") " pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:35:55.523207 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.523166 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d67ac03-e3ee-4078-982f-930243350f86-service-ca\") pod \"console-759f55f9b4-9dfmk\" (UID: \"0d67ac03-e3ee-4078-982f-930243350f86\") " pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:35:55.523207 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.523190 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d67ac03-e3ee-4078-982f-930243350f86-trusted-ca-bundle\") pod \"console-759f55f9b4-9dfmk\" (UID: \"0d67ac03-e3ee-4078-982f-930243350f86\") " pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:35:55.524727 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.524709 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d67ac03-e3ee-4078-982f-930243350f86-console-serving-cert\") pod \"console-759f55f9b4-9dfmk\" (UID: \"0d67ac03-e3ee-4078-982f-930243350f86\") " pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:35:55.524811 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.524787 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d67ac03-e3ee-4078-982f-930243350f86-console-oauth-config\") pod \"console-759f55f9b4-9dfmk\" (UID: \"0d67ac03-e3ee-4078-982f-930243350f86\") " pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:35:55.530019 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.530001 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzj7m\" (UniqueName: \"kubernetes.io/projected/0d67ac03-e3ee-4078-982f-930243350f86-kube-api-access-pzj7m\") pod \"console-759f55f9b4-9dfmk\" (UID: \"0d67ac03-e3ee-4078-982f-930243350f86\") " pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:35:55.590640 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.590578 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:35:55.705594 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.705568 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68df6d685c-2662d" Jul 29 18:35:55.742862 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.742830 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-759f55f9b4-9dfmk"] Jul 29 18:35:55.746234 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:35:55.746137 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d67ac03_e3ee_4078_982f_930243350f86.slice/crio-f6945afdc33de13148462f2cbd7ae138d6932bdd358af9f8a410f9161d0e6fb9 WatchSource:0}: Error finding container f6945afdc33de13148462f2cbd7ae138d6932bdd358af9f8a410f9161d0e6fb9: Status 404 returned error can't find the container with id f6945afdc33de13148462f2cbd7ae138d6932bdd358af9f8a410f9161d0e6fb9 Jul 29 18:35:55.814321 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.813878 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" event={"ID":"67b65c5d-6767-4e9f-a044-36167a6a11b5","Type":"ContainerDied","Data":"98c44fdcc6ee7cfe38acc095567d5e37dcf9cacdf6cfd23bdecc51fff857ddc2"} Jul 29 18:35:55.814321 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.813983 2562 scope.go:117] "RemoveContainer" containerID="2b011ba5004b860404be54bdc79a0bd8c90dedb9ab7050a689cae944db18e04d" Jul 29 18:35:55.814843 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.814498 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c75fd788d-7zq7r" Jul 29 18:35:55.821003 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.816009 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xvbnz" event={"ID":"0e644921-b0ea-4a01-9cf2-75af74d2f7f4","Type":"ContainerStarted","Data":"0e9bbd1e875420f6fbf26587fcd4aaa131959b8a185f9ad47aa9495fe3dd6c48"} Jul 29 18:35:55.821003 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.819695 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edeff186-6274-4f3d-bbfd-20cad5259e75","Type":"ContainerStarted","Data":"fe0ca5a69b8b9f9bc807a70776b72e7f33082932a304938ba7361608b0195771"} Jul 29 18:35:55.826742 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.825962 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9p9z9" event={"ID":"2a4adfc3-3297-4688-9122-4c8a6a588525","Type":"ContainerStarted","Data":"4ddd036c9d7ad6847b382b3e75a39ac34b2184ef773cc7fa0f69861a00ca469a"} Jul 29 18:35:55.831261 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.831232 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759f55f9b4-9dfmk" event={"ID":"0d67ac03-e3ee-4078-982f-930243350f86","Type":"ContainerStarted","Data":"f6945afdc33de13148462f2cbd7ae138d6932bdd358af9f8a410f9161d0e6fb9"} Jul 29 18:35:55.834898 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.834868 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-2njf9" event={"ID":"80336745-5e1f-4c2c-9901-d77c85536227","Type":"ContainerStarted","Data":"13422f4b17441eff4954f366a1473eb54c4762fcad8816ef3439ded7235d6324"} Jul 29 18:35:55.835121 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.835101 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-2njf9" Jul 29 18:35:55.837473 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.836900 2562 generic.go:356] "Generic (PLEG): container finished" podID="f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320" containerID="1cb0bf6ac2689f7383d83a6c8ee04a6bdbbf4cb4d86689a5037d4ab8b99b2c2a" exitCode=0 Jul 29 18:35:55.837585 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.837129 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tsw7n" event={"ID":"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320","Type":"ContainerDied","Data":"1cb0bf6ac2689f7383d83a6c8ee04a6bdbbf4cb4d86689a5037d4ab8b99b2c2a"} Jul 29 18:35:55.839368 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.839344 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f944f964b-gq77w" event={"ID":"c6f4a94c-52c5-4885-aa63-ec48453fba9a","Type":"ContainerStarted","Data":"bf71b67bc353e94fc75cf7461bdbbb154e1f52ea5d038bb1eae8947f3fb3debf"} Jul 29 18:35:55.846017 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.845960 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-2njf9" Jul 29 18:35:55.846213 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.846172 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c75fd788d-7zq7r"] Jul 29 18:35:55.855870 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.854999 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6c75fd788d-7zq7r"] Jul 29 18:35:55.858382 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.858334 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:55.901895 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.901469 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9p9z9" podStartSLOduration=1.3687799950000001 podStartE2EDuration="11.901445926s" totalImagesPullingTime="10.532665931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:35:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:35:55.879122243 +0000 UTC m=+97.121299398" watchObservedRunningTime="2026-07-29 18:35:55.901445926 +0000 UTC m=+97.143623083" Jul 29 18:35:55.918234 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.918182 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-2njf9" podStartSLOduration=6.714768818 podStartE2EDuration="27.917494772s" totalImagesPullingTime="21.202725954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:35:55.916593004 +0000 UTC m=+97.158770189" watchObservedRunningTime="2026-07-29 18:35:55.917494772 +0000 UTC m=+97.159671929" Jul 29 18:35:55.939069 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.939012 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f944f964b-gq77w" podStartSLOduration=1.911505407 podStartE2EDuration="11.938989749s" totalImagesPullingTime="10.027484342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:35:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:35:55.937650616 +0000 UTC m=+97.179827775" watchObservedRunningTime="2026-07-29 18:35:55.938989749 +0000 UTC m=+97.181166906" Jul 29 18:35:55.949625 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:55.949582 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:56.018221 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:56.018196 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:35:56.847760 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:56.847723 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759f55f9b4-9dfmk" event={"ID":"0d67ac03-e3ee-4078-982f-930243350f86","Type":"ContainerStarted","Data":"ea24b61bfdf5c6018d3ba1c925d1d4decef8fcebdd336044312b21b33f9ab6c6"} Jul 29 18:35:56.850280 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:56.850247 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tsw7n" event={"ID":"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320","Type":"ContainerStarted","Data":"d3f574d4411e489c3cec096a94899de47684bcd04bfc366dbe5c93e5c64d9d98"} Jul 29 18:35:56.850410 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:56.850300 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tsw7n" event={"ID":"f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320","Type":"ContainerStarted","Data":"90e7f1df45406df6985e201a3eb3b28ec464c8a8158adaf11b7a5b7a7f3cdbca"} Jul 29 18:35:56.865925 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:56.865880 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-759f55f9b4-9dfmk" podStartSLOduration=1.865863069 podStartE2EDuration="1.865863069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:35:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:35:56.864784904 +0000 UTC m=+98.106962059" watchObservedRunningTime="2026-07-29 18:35:56.865863069 +0000 UTC m=+98.108040228" Jul 29 18:35:56.883107 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:56.883045 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tsw7n" podStartSLOduration=2.048794244 podStartE2EDuration="12.883021234s" totalImagesPullingTime="10.766864752s" totalInitContainerRuntime="67.362238ms" isStatefulPod=true podCreationTimestamp="2026-07-29 18:35:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:35:56.882394892 +0000 UTC m=+98.124572049" watchObservedRunningTime="2026-07-29 18:35:56.883021234 +0000 UTC m=+98.125198405" Jul 29 18:35:57.350651 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:57.350611 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67b65c5d-6767-4e9f-a044-36167a6a11b5" path="/var/lib/kubelet/pods/67b65c5d-6767-4e9f-a044-36167a6a11b5/volumes" Jul 29 18:35:58.860278 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:58.860246 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xvbnz" event={"ID":"0e644921-b0ea-4a01-9cf2-75af74d2f7f4","Type":"ContainerStarted","Data":"99e6591c2b45f9c863ce533e31b742d251bf9c4d269b320a91571366a235ed79"} Jul 29 18:35:58.860793 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:58.860451 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xvbnz" Jul 29 18:35:58.862101 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:58.862075 2562 generic.go:356] "Generic (PLEG): container finished" podID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerID="100fdbccb1e36fa628e44183ef5bf56283c32d6fb655edaa8af3839ca673650b" exitCode=0 Jul 29 18:35:58.862224 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:58.862171 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edeff186-6274-4f3d-bbfd-20cad5259e75","Type":"ContainerDied","Data":"100fdbccb1e36fa628e44183ef5bf56283c32d6fb655edaa8af3839ca673650b"} Jul 29 18:35:58.872838 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:58.872794 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xvbnz" Jul 29 18:35:58.881028 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:35:58.880970 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xvbnz" podStartSLOduration=8.485169066 podStartE2EDuration="10.880920764s" totalImagesPullingTime="2.395751698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:35:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:35:58.879625985 +0000 UTC m=+100.121803142" watchObservedRunningTime="2026-07-29 18:35:58.880920764 +0000 UTC m=+100.123097921" Jul 29 18:36:01.879885 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:01.879838 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edeff186-6274-4f3d-bbfd-20cad5259e75","Type":"ContainerStarted","Data":"a09aa3311a306219feea9e56081e11df290d6053c5d207bf77f837d42dc8791d"} Jul 29 18:36:01.880363 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:01.879962 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edeff186-6274-4f3d-bbfd-20cad5259e75","Type":"ContainerStarted","Data":"84e8773f70eb61acc64251615d9314f6e7bfd8fb2da79e11239a115218dc1cd1"} Jul 29 18:36:01.880363 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:01.879992 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edeff186-6274-4f3d-bbfd-20cad5259e75","Type":"ContainerStarted","Data":"aca9a74b3124ee8ee65ee1e65bbfeedc307df2b3f746ffe985705bb5accf029a"} Jul 29 18:36:01.880363 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:01.880016 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edeff186-6274-4f3d-bbfd-20cad5259e75","Type":"ContainerStarted","Data":"ab76676688d68ae161aa5bba582b21b20a280ca6ae62ae589e39b7a7beb879cd"} Jul 29 18:36:01.880363 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:01.880039 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edeff186-6274-4f3d-bbfd-20cad5259e75","Type":"ContainerStarted","Data":"7994980923bf98221072ab2c0a044615788142fd4e9ce62884d0b1095b137876"} Jul 29 18:36:02.887835 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:02.887799 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edeff186-6274-4f3d-bbfd-20cad5259e75","Type":"ContainerStarted","Data":"976168ba00a5afa3434b8ce709c94a526d5a6224f6a604af58f9479d579685f1"} Jul 29 18:36:03.920437 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:03.920371 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=13.219037274 podStartE2EDuration="18.920348396s" totalImagesPullingTime="5.681220494s" totalInitContainerRuntime="20.090628ms" isStatefulPod=false podCreationTimestamp="2026-07-29 18:35:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:36:03.918574827 +0000 UTC m=+105.160752003" watchObservedRunningTime="2026-07-29 18:36:03.920348396 +0000 UTC m=+105.162525554" Jul 29 18:36:04.691344 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:04.691308 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f944f964b-gq77w" Jul 29 18:36:05.591396 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:05.591364 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:36:05.591838 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:05.591550 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:36:05.596378 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:05.596354 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:36:05.703009 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:05.702985 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xtdjk" Jul 29 18:36:05.904767 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:05.904697 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:36:06.069100 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:06.069060 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:36:06.169788 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:06.169689 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:36:06.290529 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:06.290480 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:36:06.385597 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:06.385559 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:36:07.206544 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:07.206499 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:36:07.306227 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:07.306195 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:36:16.815753 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:16.815713 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:36:20.806686 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:20.806645 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:36:20.868996 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:20.868958 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f944f964b-gq77w" podUID="c6f4a94c-52c5-4885-aa63-ec48453fba9a" containerName="console" containerID="cri-o://bf71b67bc353e94fc75cf7461bdbbb154e1f52ea5d038bb1eae8947f3fb3debf" gracePeriod=15 Jul 29 18:36:20.909944 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:20.909915 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:36:21.138473 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.138451 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f944f964b-gq77w" Jul 29 18:36:21.248989 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.248956 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6f4a94c-52c5-4885-aa63-ec48453fba9a-console-config\") pod \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\" (UID: \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\") " Jul 29 18:36:21.249167 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.249001 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6f4a94c-52c5-4885-aa63-ec48453fba9a-service-ca\") pod \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\" (UID: \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\") " Jul 29 18:36:21.249167 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.249019 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6f4a94c-52c5-4885-aa63-ec48453fba9a-trusted-ca-bundle\") pod \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\" (UID: \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\") " Jul 29 18:36:21.249167 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.249045 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6f4a94c-52c5-4885-aa63-ec48453fba9a-console-serving-cert\") pod \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\" (UID: \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\") " Jul 29 18:36:21.249336 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.249170 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sh76j\" (UniqueName: \"kubernetes.io/projected/c6f4a94c-52c5-4885-aa63-ec48453fba9a-kube-api-access-sh76j\") pod \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\" (UID: \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\") " Jul 29 18:36:21.249336 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.249206 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6f4a94c-52c5-4885-aa63-ec48453fba9a-console-oauth-config\") pod \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\" (UID: \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\") " Jul 29 18:36:21.249336 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.249318 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6f4a94c-52c5-4885-aa63-ec48453fba9a-oauth-serving-cert\") pod \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\" (UID: \"c6f4a94c-52c5-4885-aa63-ec48453fba9a\") " Jul 29 18:36:21.249476 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.249374 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6f4a94c-52c5-4885-aa63-ec48453fba9a-console-config" (OuterVolumeSpecName: "console-config") pod "c6f4a94c-52c5-4885-aa63-ec48453fba9a" (UID: "c6f4a94c-52c5-4885-aa63-ec48453fba9a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:36:21.249476 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.249439 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6f4a94c-52c5-4885-aa63-ec48453fba9a-service-ca" (OuterVolumeSpecName: "service-ca") pod "c6f4a94c-52c5-4885-aa63-ec48453fba9a" (UID: "c6f4a94c-52c5-4885-aa63-ec48453fba9a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:36:21.249588 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.249490 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6f4a94c-52c5-4885-aa63-ec48453fba9a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c6f4a94c-52c5-4885-aa63-ec48453fba9a" (UID: "c6f4a94c-52c5-4885-aa63-ec48453fba9a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:36:21.249754 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.249730 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6f4a94c-52c5-4885-aa63-ec48453fba9a-console-config\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:36:21.249865 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.249763 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6f4a94c-52c5-4885-aa63-ec48453fba9a-service-ca\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:36:21.249865 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.249761 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6f4a94c-52c5-4885-aa63-ec48453fba9a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c6f4a94c-52c5-4885-aa63-ec48453fba9a" (UID: "c6f4a94c-52c5-4885-aa63-ec48453fba9a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:36:21.249865 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.249776 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6f4a94c-52c5-4885-aa63-ec48453fba9a-trusted-ca-bundle\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:36:21.251399 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.251372 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6f4a94c-52c5-4885-aa63-ec48453fba9a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c6f4a94c-52c5-4885-aa63-ec48453fba9a" (UID: "c6f4a94c-52c5-4885-aa63-ec48453fba9a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:36:21.251399 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.251387 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6f4a94c-52c5-4885-aa63-ec48453fba9a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c6f4a94c-52c5-4885-aa63-ec48453fba9a" (UID: "c6f4a94c-52c5-4885-aa63-ec48453fba9a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:36:21.251399 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.251366 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6f4a94c-52c5-4885-aa63-ec48453fba9a-kube-api-access-sh76j" (OuterVolumeSpecName: "kube-api-access-sh76j") pod "c6f4a94c-52c5-4885-aa63-ec48453fba9a" (UID: "c6f4a94c-52c5-4885-aa63-ec48453fba9a"). InnerVolumeSpecName "kube-api-access-sh76j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 18:36:21.350891 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.350859 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6f4a94c-52c5-4885-aa63-ec48453fba9a-console-serving-cert\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:36:21.350891 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.350891 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sh76j\" (UniqueName: \"kubernetes.io/projected/c6f4a94c-52c5-4885-aa63-ec48453fba9a-kube-api-access-sh76j\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:36:21.351077 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.350906 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6f4a94c-52c5-4885-aa63-ec48453fba9a-console-oauth-config\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:36:21.351077 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.350922 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6f4a94c-52c5-4885-aa63-ec48453fba9a-oauth-serving-cert\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:36:21.962850 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.962815 2562 generic.go:356] "Generic (PLEG): container finished" podID="c6f4a94c-52c5-4885-aa63-ec48453fba9a" containerID="bf71b67bc353e94fc75cf7461bdbbb154e1f52ea5d038bb1eae8947f3fb3debf" exitCode=0 Jul 29 18:36:21.963359 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.962865 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f944f964b-gq77w" Jul 29 18:36:21.963359 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.962900 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f944f964b-gq77w" event={"ID":"c6f4a94c-52c5-4885-aa63-ec48453fba9a","Type":"ContainerDied","Data":"bf71b67bc353e94fc75cf7461bdbbb154e1f52ea5d038bb1eae8947f3fb3debf"} Jul 29 18:36:21.963359 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.962946 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f944f964b-gq77w" event={"ID":"c6f4a94c-52c5-4885-aa63-ec48453fba9a","Type":"ContainerDied","Data":"48d5ceb5bd3abe1acfb33360998b1cbda31b158d0dccc3a92ee06bf6c75c15ec"} Jul 29 18:36:21.963359 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.962966 2562 scope.go:117] "RemoveContainer" containerID="bf71b67bc353e94fc75cf7461bdbbb154e1f52ea5d038bb1eae8947f3fb3debf" Jul 29 18:36:21.972851 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.972836 2562 scope.go:117] "RemoveContainer" containerID="bf71b67bc353e94fc75cf7461bdbbb154e1f52ea5d038bb1eae8947f3fb3debf" Jul 29 18:36:21.973132 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:36:21.973111 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf71b67bc353e94fc75cf7461bdbbb154e1f52ea5d038bb1eae8947f3fb3debf\": container with ID starting with bf71b67bc353e94fc75cf7461bdbbb154e1f52ea5d038bb1eae8947f3fb3debf not found: ID does not exist" containerID="bf71b67bc353e94fc75cf7461bdbbb154e1f52ea5d038bb1eae8947f3fb3debf" Jul 29 18:36:21.973181 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.973140 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf71b67bc353e94fc75cf7461bdbbb154e1f52ea5d038bb1eae8947f3fb3debf"} err="failed to get container status \"bf71b67bc353e94fc75cf7461bdbbb154e1f52ea5d038bb1eae8947f3fb3debf\": rpc error: code = NotFound desc = could not find container \"bf71b67bc353e94fc75cf7461bdbbb154e1f52ea5d038bb1eae8947f3fb3debf\": container with ID starting with bf71b67bc353e94fc75cf7461bdbbb154e1f52ea5d038bb1eae8947f3fb3debf not found: ID does not exist" Jul 29 18:36:21.981581 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.981560 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f944f964b-gq77w"] Jul 29 18:36:21.985211 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:21.985189 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f944f964b-gq77w"] Jul 29 18:36:22.201917 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:22.201881 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:36:22.262470 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:22.262401 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:36:23.350496 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:23.350465 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6f4a94c-52c5-4885-aa63-ec48453fba9a" path="/var/lib/kubelet/pods/c6f4a94c-52c5-4885-aa63-ec48453fba9a/volumes" Jul 29 18:36:36.014824 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:36.014739 2562 generic.go:356] "Generic (PLEG): container finished" podID="de51fc41-4f39-4224-9f3d-13f3e113a694" containerID="c9e4eb9c876917ffd27b95fee30dae1b9e7b3d0b87c40a6745cbe3b3911756a6" exitCode=0 Jul 29 18:36:36.014824 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:36.014779 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-hlwzj" event={"ID":"de51fc41-4f39-4224-9f3d-13f3e113a694","Type":"ContainerDied","Data":"c9e4eb9c876917ffd27b95fee30dae1b9e7b3d0b87c40a6745cbe3b3911756a6"} Jul 29 18:36:36.015254 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:36.015113 2562 scope.go:117] "RemoveContainer" containerID="c9e4eb9c876917ffd27b95fee30dae1b9e7b3d0b87c40a6745cbe3b3911756a6" Jul 29 18:36:37.020693 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:36:37.020659 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-hlwzj" event={"ID":"de51fc41-4f39-4224-9f3d-13f3e113a694","Type":"ContainerStarted","Data":"078167a763aa985f8f1ceb4db2db2126ddec4fece54b51eb68eea5429c97c82a"} Jul 29 18:37:00.720719 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:00.720688 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:37:00.770800 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:00.770773 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:37:02.928015 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:02.927982 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:37:02.981899 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:02.981865 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:37:04.485500 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:04.485456 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 18:37:04.485902 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:04.485759 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerName="alertmanager" containerID="cri-o://7994980923bf98221072ab2c0a044615788142fd4e9ce62884d0b1095b137876" gracePeriod=120 Jul 29 18:37:04.485902 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:04.485837 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerName="kube-rbac-proxy-metric" containerID="cri-o://a09aa3311a306219feea9e56081e11df290d6053c5d207bf77f837d42dc8791d" gracePeriod=120 Jul 29 18:37:04.485902 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:04.485866 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerName="kube-rbac-proxy" containerID="cri-o://84e8773f70eb61acc64251615d9314f6e7bfd8fb2da79e11239a115218dc1cd1" gracePeriod=120 Jul 29 18:37:04.486067 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:04.485914 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerName="config-reloader" containerID="cri-o://ab76676688d68ae161aa5bba582b21b20a280ca6ae62ae589e39b7a7beb879cd" gracePeriod=120 Jul 29 18:37:04.486067 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:04.485837 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerName="kube-rbac-proxy-web" containerID="cri-o://aca9a74b3124ee8ee65ee1e65bbfeedc307df2b3f746ffe985705bb5accf029a" gracePeriod=120 Jul 29 18:37:04.486794 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:04.485909 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerName="prom-label-proxy" containerID="cri-o://976168ba00a5afa3434b8ce709c94a526d5a6224f6a604af58f9479d579685f1" gracePeriod=120 Jul 29 18:37:05.131614 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.131581 2562 generic.go:356] "Generic (PLEG): container finished" podID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerID="976168ba00a5afa3434b8ce709c94a526d5a6224f6a604af58f9479d579685f1" exitCode=0 Jul 29 18:37:05.131614 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.131603 2562 generic.go:356] "Generic (PLEG): container finished" podID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerID="a09aa3311a306219feea9e56081e11df290d6053c5d207bf77f837d42dc8791d" exitCode=0 Jul 29 18:37:05.131614 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.131609 2562 generic.go:356] "Generic (PLEG): container finished" podID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerID="84e8773f70eb61acc64251615d9314f6e7bfd8fb2da79e11239a115218dc1cd1" exitCode=0 Jul 29 18:37:05.131614 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.131615 2562 generic.go:356] "Generic (PLEG): container finished" podID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerID="ab76676688d68ae161aa5bba582b21b20a280ca6ae62ae589e39b7a7beb879cd" exitCode=0 Jul 29 18:37:05.131614 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.131621 2562 generic.go:356] "Generic (PLEG): container finished" podID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerID="7994980923bf98221072ab2c0a044615788142fd4e9ce62884d0b1095b137876" exitCode=0 Jul 29 18:37:05.131965 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.131654 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edeff186-6274-4f3d-bbfd-20cad5259e75","Type":"ContainerDied","Data":"976168ba00a5afa3434b8ce709c94a526d5a6224f6a604af58f9479d579685f1"} Jul 29 18:37:05.131965 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.131732 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edeff186-6274-4f3d-bbfd-20cad5259e75","Type":"ContainerDied","Data":"a09aa3311a306219feea9e56081e11df290d6053c5d207bf77f837d42dc8791d"} Jul 29 18:37:05.131965 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.131771 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edeff186-6274-4f3d-bbfd-20cad5259e75","Type":"ContainerDied","Data":"84e8773f70eb61acc64251615d9314f6e7bfd8fb2da79e11239a115218dc1cd1"} Jul 29 18:37:05.131965 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.131806 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edeff186-6274-4f3d-bbfd-20cad5259e75","Type":"ContainerDied","Data":"ab76676688d68ae161aa5bba582b21b20a280ca6ae62ae589e39b7a7beb879cd"} Jul 29 18:37:05.131965 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.131847 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edeff186-6274-4f3d-bbfd-20cad5259e75","Type":"ContainerDied","Data":"7994980923bf98221072ab2c0a044615788142fd4e9ce62884d0b1095b137876"} Jul 29 18:37:05.726043 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.726023 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:05.805791 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.805719 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-secret-alertmanager-kube-rbac-proxy-metric\") pod \"edeff186-6274-4f3d-bbfd-20cad5259e75\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " Jul 29 18:37:05.805791 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.805751 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-cluster-tls-config\") pod \"edeff186-6274-4f3d-bbfd-20cad5259e75\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " Jul 29 18:37:05.805791 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.805778 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-secret-alertmanager-kube-rbac-proxy-web\") pod \"edeff186-6274-4f3d-bbfd-20cad5259e75\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " Jul 29 18:37:05.806061 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.805851 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5gjg\" (UniqueName: \"kubernetes.io/projected/edeff186-6274-4f3d-bbfd-20cad5259e75-kube-api-access-t5gjg\") pod \"edeff186-6274-4f3d-bbfd-20cad5259e75\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " Jul 29 18:37:05.806061 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.805879 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/edeff186-6274-4f3d-bbfd-20cad5259e75-config-out\") pod \"edeff186-6274-4f3d-bbfd-20cad5259e75\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " Jul 29 18:37:05.806061 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.805908 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/edeff186-6274-4f3d-bbfd-20cad5259e75-alertmanager-main-db\") pod \"edeff186-6274-4f3d-bbfd-20cad5259e75\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " Jul 29 18:37:05.806061 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.805944 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-config-volume\") pod \"edeff186-6274-4f3d-bbfd-20cad5259e75\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " Jul 29 18:37:05.806061 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.805984 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-secret-alertmanager-main-tls\") pod \"edeff186-6274-4f3d-bbfd-20cad5259e75\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " Jul 29 18:37:05.806061 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.806014 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edeff186-6274-4f3d-bbfd-20cad5259e75-alertmanager-trusted-ca-bundle\") pod \"edeff186-6274-4f3d-bbfd-20cad5259e75\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " Jul 29 18:37:05.806061 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.806040 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-secret-alertmanager-kube-rbac-proxy\") pod \"edeff186-6274-4f3d-bbfd-20cad5259e75\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " Jul 29 18:37:05.806384 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.806076 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/edeff186-6274-4f3d-bbfd-20cad5259e75-tls-assets\") pod \"edeff186-6274-4f3d-bbfd-20cad5259e75\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " Jul 29 18:37:05.806384 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.806093 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/edeff186-6274-4f3d-bbfd-20cad5259e75-metrics-client-ca\") pod \"edeff186-6274-4f3d-bbfd-20cad5259e75\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " Jul 29 18:37:05.806384 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.806110 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-web-config\") pod \"edeff186-6274-4f3d-bbfd-20cad5259e75\" (UID: \"edeff186-6274-4f3d-bbfd-20cad5259e75\") " Jul 29 18:37:05.806977 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.806946 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edeff186-6274-4f3d-bbfd-20cad5259e75-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "edeff186-6274-4f3d-bbfd-20cad5259e75" (UID: "edeff186-6274-4f3d-bbfd-20cad5259e75"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:37:05.807093 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.806967 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edeff186-6274-4f3d-bbfd-20cad5259e75-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "edeff186-6274-4f3d-bbfd-20cad5259e75" (UID: "edeff186-6274-4f3d-bbfd-20cad5259e75"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 18:37:05.807158 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.807090 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edeff186-6274-4f3d-bbfd-20cad5259e75-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "edeff186-6274-4f3d-bbfd-20cad5259e75" (UID: "edeff186-6274-4f3d-bbfd-20cad5259e75"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:37:05.809530 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.809489 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edeff186-6274-4f3d-bbfd-20cad5259e75-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "edeff186-6274-4f3d-bbfd-20cad5259e75" (UID: "edeff186-6274-4f3d-bbfd-20cad5259e75"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 18:37:05.809641 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.809584 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edeff186-6274-4f3d-bbfd-20cad5259e75-kube-api-access-t5gjg" (OuterVolumeSpecName: "kube-api-access-t5gjg") pod "edeff186-6274-4f3d-bbfd-20cad5259e75" (UID: "edeff186-6274-4f3d-bbfd-20cad5259e75"). InnerVolumeSpecName "kube-api-access-t5gjg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 18:37:05.813004 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.812978 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "edeff186-6274-4f3d-bbfd-20cad5259e75" (UID: "edeff186-6274-4f3d-bbfd-20cad5259e75"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:37:05.813622 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.813537 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edeff186-6274-4f3d-bbfd-20cad5259e75-config-out" (OuterVolumeSpecName: "config-out") pod "edeff186-6274-4f3d-bbfd-20cad5259e75" (UID: "edeff186-6274-4f3d-bbfd-20cad5259e75"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 18:37:05.813622 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.813571 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-config-volume" (OuterVolumeSpecName: "config-volume") pod "edeff186-6274-4f3d-bbfd-20cad5259e75" (UID: "edeff186-6274-4f3d-bbfd-20cad5259e75"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:37:05.813622 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.813589 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "edeff186-6274-4f3d-bbfd-20cad5259e75" (UID: "edeff186-6274-4f3d-bbfd-20cad5259e75"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:37:05.813813 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.813614 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "edeff186-6274-4f3d-bbfd-20cad5259e75" (UID: "edeff186-6274-4f3d-bbfd-20cad5259e75"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:37:05.813813 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.813751 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "edeff186-6274-4f3d-bbfd-20cad5259e75" (UID: "edeff186-6274-4f3d-bbfd-20cad5259e75"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:37:05.815651 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.815507 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "edeff186-6274-4f3d-bbfd-20cad5259e75" (UID: "edeff186-6274-4f3d-bbfd-20cad5259e75"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:37:05.822274 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.822253 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-web-config" (OuterVolumeSpecName: "web-config") pod "edeff186-6274-4f3d-bbfd-20cad5259e75" (UID: "edeff186-6274-4f3d-bbfd-20cad5259e75"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:37:05.906772 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.906746 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/edeff186-6274-4f3d-bbfd-20cad5259e75-tls-assets\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:37:05.906772 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.906768 2562 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/edeff186-6274-4f3d-bbfd-20cad5259e75-metrics-client-ca\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:37:05.906772 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.906777 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-web-config\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:37:05.906972 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.906786 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:37:05.906972 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.906795 2562 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-cluster-tls-config\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:37:05.906972 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.906805 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:37:05.906972 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.906814 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5gjg\" (UniqueName: \"kubernetes.io/projected/edeff186-6274-4f3d-bbfd-20cad5259e75-kube-api-access-t5gjg\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:37:05.906972 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.906823 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/edeff186-6274-4f3d-bbfd-20cad5259e75-config-out\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:37:05.906972 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.906831 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/edeff186-6274-4f3d-bbfd-20cad5259e75-alertmanager-main-db\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:37:05.906972 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.906839 2562 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-config-volume\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:37:05.906972 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.906847 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-secret-alertmanager-main-tls\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:37:05.906972 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.906855 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edeff186-6274-4f3d-bbfd-20cad5259e75-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:37:05.906972 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:05.906863 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/edeff186-6274-4f3d-bbfd-20cad5259e75-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:37:06.138602 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.138574 2562 generic.go:356] "Generic (PLEG): container finished" podID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerID="aca9a74b3124ee8ee65ee1e65bbfeedc307df2b3f746ffe985705bb5accf029a" exitCode=0 Jul 29 18:37:06.138757 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.138647 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edeff186-6274-4f3d-bbfd-20cad5259e75","Type":"ContainerDied","Data":"aca9a74b3124ee8ee65ee1e65bbfeedc307df2b3f746ffe985705bb5accf029a"} Jul 29 18:37:06.138757 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.138653 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.138757 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.138703 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edeff186-6274-4f3d-bbfd-20cad5259e75","Type":"ContainerDied","Data":"fe0ca5a69b8b9f9bc807a70776b72e7f33082932a304938ba7361608b0195771"} Jul 29 18:37:06.138757 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.138736 2562 scope.go:117] "RemoveContainer" containerID="976168ba00a5afa3434b8ce709c94a526d5a6224f6a604af58f9479d579685f1" Jul 29 18:37:06.146420 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.146402 2562 scope.go:117] "RemoveContainer" containerID="a09aa3311a306219feea9e56081e11df290d6053c5d207bf77f837d42dc8791d" Jul 29 18:37:06.153163 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.153146 2562 scope.go:117] "RemoveContainer" containerID="84e8773f70eb61acc64251615d9314f6e7bfd8fb2da79e11239a115218dc1cd1" Jul 29 18:37:06.159639 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.159622 2562 scope.go:117] "RemoveContainer" containerID="aca9a74b3124ee8ee65ee1e65bbfeedc307df2b3f746ffe985705bb5accf029a" Jul 29 18:37:06.161244 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.161226 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 18:37:06.166251 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.166231 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 18:37:06.167379 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.167366 2562 scope.go:117] "RemoveContainer" containerID="ab76676688d68ae161aa5bba582b21b20a280ca6ae62ae589e39b7a7beb879cd" Jul 29 18:37:06.173866 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.173851 2562 scope.go:117] "RemoveContainer" containerID="7994980923bf98221072ab2c0a044615788142fd4e9ce62884d0b1095b137876" Jul 29 18:37:06.180203 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.180189 2562 scope.go:117] "RemoveContainer" containerID="100fdbccb1e36fa628e44183ef5bf56283c32d6fb655edaa8af3839ca673650b" Jul 29 18:37:06.186762 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.186749 2562 scope.go:117] "RemoveContainer" containerID="976168ba00a5afa3434b8ce709c94a526d5a6224f6a604af58f9479d579685f1" Jul 29 18:37:06.187020 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:37:06.187004 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"976168ba00a5afa3434b8ce709c94a526d5a6224f6a604af58f9479d579685f1\": container with ID starting with 976168ba00a5afa3434b8ce709c94a526d5a6224f6a604af58f9479d579685f1 not found: ID does not exist" containerID="976168ba00a5afa3434b8ce709c94a526d5a6224f6a604af58f9479d579685f1" Jul 29 18:37:06.187078 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.187027 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"976168ba00a5afa3434b8ce709c94a526d5a6224f6a604af58f9479d579685f1"} err="failed to get container status \"976168ba00a5afa3434b8ce709c94a526d5a6224f6a604af58f9479d579685f1\": rpc error: code = NotFound desc = could not find container \"976168ba00a5afa3434b8ce709c94a526d5a6224f6a604af58f9479d579685f1\": container with ID starting with 976168ba00a5afa3434b8ce709c94a526d5a6224f6a604af58f9479d579685f1 not found: ID does not exist" Jul 29 18:37:06.187078 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.187044 2562 scope.go:117] "RemoveContainer" containerID="a09aa3311a306219feea9e56081e11df290d6053c5d207bf77f837d42dc8791d" Jul 29 18:37:06.187284 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:37:06.187270 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a09aa3311a306219feea9e56081e11df290d6053c5d207bf77f837d42dc8791d\": container with ID starting with a09aa3311a306219feea9e56081e11df290d6053c5d207bf77f837d42dc8791d not found: ID does not exist" containerID="a09aa3311a306219feea9e56081e11df290d6053c5d207bf77f837d42dc8791d" Jul 29 18:37:06.187326 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.187290 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a09aa3311a306219feea9e56081e11df290d6053c5d207bf77f837d42dc8791d"} err="failed to get container status \"a09aa3311a306219feea9e56081e11df290d6053c5d207bf77f837d42dc8791d\": rpc error: code = NotFound desc = could not find container \"a09aa3311a306219feea9e56081e11df290d6053c5d207bf77f837d42dc8791d\": container with ID starting with a09aa3311a306219feea9e56081e11df290d6053c5d207bf77f837d42dc8791d not found: ID does not exist" Jul 29 18:37:06.187326 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.187302 2562 scope.go:117] "RemoveContainer" containerID="84e8773f70eb61acc64251615d9314f6e7bfd8fb2da79e11239a115218dc1cd1" Jul 29 18:37:06.187494 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:37:06.187479 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84e8773f70eb61acc64251615d9314f6e7bfd8fb2da79e11239a115218dc1cd1\": container with ID starting with 84e8773f70eb61acc64251615d9314f6e7bfd8fb2da79e11239a115218dc1cd1 not found: ID does not exist" containerID="84e8773f70eb61acc64251615d9314f6e7bfd8fb2da79e11239a115218dc1cd1" Jul 29 18:37:06.187547 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.187498 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84e8773f70eb61acc64251615d9314f6e7bfd8fb2da79e11239a115218dc1cd1"} err="failed to get container status \"84e8773f70eb61acc64251615d9314f6e7bfd8fb2da79e11239a115218dc1cd1\": rpc error: code = NotFound desc = could not find container \"84e8773f70eb61acc64251615d9314f6e7bfd8fb2da79e11239a115218dc1cd1\": container with ID starting with 84e8773f70eb61acc64251615d9314f6e7bfd8fb2da79e11239a115218dc1cd1 not found: ID does not exist" Jul 29 18:37:06.187547 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.187524 2562 scope.go:117] "RemoveContainer" containerID="aca9a74b3124ee8ee65ee1e65bbfeedc307df2b3f746ffe985705bb5accf029a" Jul 29 18:37:06.187742 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:37:06.187715 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aca9a74b3124ee8ee65ee1e65bbfeedc307df2b3f746ffe985705bb5accf029a\": container with ID starting with aca9a74b3124ee8ee65ee1e65bbfeedc307df2b3f746ffe985705bb5accf029a not found: ID does not exist" containerID="aca9a74b3124ee8ee65ee1e65bbfeedc307df2b3f746ffe985705bb5accf029a" Jul 29 18:37:06.187846 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.187744 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aca9a74b3124ee8ee65ee1e65bbfeedc307df2b3f746ffe985705bb5accf029a"} err="failed to get container status \"aca9a74b3124ee8ee65ee1e65bbfeedc307df2b3f746ffe985705bb5accf029a\": rpc error: code = NotFound desc = could not find container \"aca9a74b3124ee8ee65ee1e65bbfeedc307df2b3f746ffe985705bb5accf029a\": container with ID starting with aca9a74b3124ee8ee65ee1e65bbfeedc307df2b3f746ffe985705bb5accf029a not found: ID does not exist" Jul 29 18:37:06.187846 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.187755 2562 scope.go:117] "RemoveContainer" containerID="ab76676688d68ae161aa5bba582b21b20a280ca6ae62ae589e39b7a7beb879cd" Jul 29 18:37:06.187975 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:37:06.187960 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab76676688d68ae161aa5bba582b21b20a280ca6ae62ae589e39b7a7beb879cd\": container with ID starting with ab76676688d68ae161aa5bba582b21b20a280ca6ae62ae589e39b7a7beb879cd not found: ID does not exist" containerID="ab76676688d68ae161aa5bba582b21b20a280ca6ae62ae589e39b7a7beb879cd" Jul 29 18:37:06.188016 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.187977 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab76676688d68ae161aa5bba582b21b20a280ca6ae62ae589e39b7a7beb879cd"} err="failed to get container status \"ab76676688d68ae161aa5bba582b21b20a280ca6ae62ae589e39b7a7beb879cd\": rpc error: code = NotFound desc = could not find container \"ab76676688d68ae161aa5bba582b21b20a280ca6ae62ae589e39b7a7beb879cd\": container with ID starting with ab76676688d68ae161aa5bba582b21b20a280ca6ae62ae589e39b7a7beb879cd not found: ID does not exist" Jul 29 18:37:06.188016 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.187988 2562 scope.go:117] "RemoveContainer" containerID="7994980923bf98221072ab2c0a044615788142fd4e9ce62884d0b1095b137876" Jul 29 18:37:06.188179 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:37:06.188167 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7994980923bf98221072ab2c0a044615788142fd4e9ce62884d0b1095b137876\": container with ID starting with 7994980923bf98221072ab2c0a044615788142fd4e9ce62884d0b1095b137876 not found: ID does not exist" containerID="7994980923bf98221072ab2c0a044615788142fd4e9ce62884d0b1095b137876" Jul 29 18:37:06.188215 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.188183 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7994980923bf98221072ab2c0a044615788142fd4e9ce62884d0b1095b137876"} err="failed to get container status \"7994980923bf98221072ab2c0a044615788142fd4e9ce62884d0b1095b137876\": rpc error: code = NotFound desc = could not find container \"7994980923bf98221072ab2c0a044615788142fd4e9ce62884d0b1095b137876\": container with ID starting with 7994980923bf98221072ab2c0a044615788142fd4e9ce62884d0b1095b137876 not found: ID does not exist" Jul 29 18:37:06.188215 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.188196 2562 scope.go:117] "RemoveContainer" containerID="100fdbccb1e36fa628e44183ef5bf56283c32d6fb655edaa8af3839ca673650b" Jul 29 18:37:06.188400 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:37:06.188386 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"100fdbccb1e36fa628e44183ef5bf56283c32d6fb655edaa8af3839ca673650b\": container with ID starting with 100fdbccb1e36fa628e44183ef5bf56283c32d6fb655edaa8af3839ca673650b not found: ID does not exist" containerID="100fdbccb1e36fa628e44183ef5bf56283c32d6fb655edaa8af3839ca673650b" Jul 29 18:37:06.188439 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.188402 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"100fdbccb1e36fa628e44183ef5bf56283c32d6fb655edaa8af3839ca673650b"} err="failed to get container status \"100fdbccb1e36fa628e44183ef5bf56283c32d6fb655edaa8af3839ca673650b\": rpc error: code = NotFound desc = could not find container \"100fdbccb1e36fa628e44183ef5bf56283c32d6fb655edaa8af3839ca673650b\": container with ID starting with 100fdbccb1e36fa628e44183ef5bf56283c32d6fb655edaa8af3839ca673650b not found: ID does not exist" Jul 29 18:37:06.192251 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.192231 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 18:37:06.192497 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.192484 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerName="config-reloader" Jul 29 18:37:06.192581 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.192499 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerName="config-reloader" Jul 29 18:37:06.192616 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.192584 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerName="alertmanager" Jul 29 18:37:06.192616 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.192592 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerName="alertmanager" Jul 29 18:37:06.192616 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.192602 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerName="kube-rbac-proxy-metric" Jul 29 18:37:06.192616 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.192607 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerName="kube-rbac-proxy-metric" Jul 29 18:37:06.192616 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.192614 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6f4a94c-52c5-4885-aa63-ec48453fba9a" containerName="console" Jul 29 18:37:06.192752 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.192621 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6f4a94c-52c5-4885-aa63-ec48453fba9a" containerName="console" Jul 29 18:37:06.192752 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.192635 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerName="prom-label-proxy" Jul 29 18:37:06.192752 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.192641 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerName="prom-label-proxy" Jul 29 18:37:06.192752 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.192648 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerName="kube-rbac-proxy" Jul 29 18:37:06.192752 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.192653 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerName="kube-rbac-proxy" Jul 29 18:37:06.192752 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.192661 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerName="init-config-reloader" Jul 29 18:37:06.192752 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.192666 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerName="init-config-reloader" Jul 29 18:37:06.192752 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.192673 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerName="kube-rbac-proxy-web" Jul 29 18:37:06.192752 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.192677 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerName="kube-rbac-proxy-web" Jul 29 18:37:06.192752 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.192724 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerName="kube-rbac-proxy-web" Jul 29 18:37:06.192752 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.192731 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerName="kube-rbac-proxy-metric" Jul 29 18:37:06.192752 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.192737 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerName="kube-rbac-proxy" Jul 29 18:37:06.192752 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.192743 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6f4a94c-52c5-4885-aa63-ec48453fba9a" containerName="console" Jul 29 18:37:06.192752 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.192749 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerName="prom-label-proxy" Jul 29 18:37:06.192752 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.192756 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerName="alertmanager" Jul 29 18:37:06.193148 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.192761 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="edeff186-6274-4f3d-bbfd-20cad5259e75" containerName="config-reloader" Jul 29 18:37:06.196476 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.196460 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.200959 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.200944 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 29 18:37:06.201227 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.201212 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 29 18:37:06.201308 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.201285 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 29 18:37:06.201532 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.201495 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 29 18:37:06.201793 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.201633 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 29 18:37:06.201793 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.201641 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qldg9\"" Jul 29 18:37:06.201907 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.201877 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 29 18:37:06.201984 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.201966 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 29 18:37:06.202332 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.202312 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 29 18:37:06.209496 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.209473 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 29 18:37:06.211762 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.211733 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 18:37:06.310235 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.310200 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b88e03a-51a8-4750-b765-f5115214878d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.310391 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.310247 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5b88e03a-51a8-4750-b765-f5115214878d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.310391 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.310262 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5b88e03a-51a8-4750-b765-f5115214878d-config-out\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.310391 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.310280 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5b88e03a-51a8-4750-b765-f5115214878d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.310391 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.310342 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5b88e03a-51a8-4750-b765-f5115214878d-config-volume\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.310391 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.310377 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7bg4\" (UniqueName: \"kubernetes.io/projected/5b88e03a-51a8-4750-b765-f5115214878d-kube-api-access-d7bg4\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.310616 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.310404 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b88e03a-51a8-4750-b765-f5115214878d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.310616 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.310428 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b88e03a-51a8-4750-b765-f5115214878d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.310616 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.310447 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b88e03a-51a8-4750-b765-f5115214878d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.310616 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.310463 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5b88e03a-51a8-4750-b765-f5115214878d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.310616 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.310483 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5b88e03a-51a8-4750-b765-f5115214878d-web-config\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.310616 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.310504 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5b88e03a-51a8-4750-b765-f5115214878d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.310616 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.310539 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5b88e03a-51a8-4750-b765-f5115214878d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.411440 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.411365 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b88e03a-51a8-4750-b765-f5115214878d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.411440 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.411403 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b88e03a-51a8-4750-b765-f5115214878d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.411440 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.411426 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b88e03a-51a8-4750-b765-f5115214878d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.411706 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.411452 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5b88e03a-51a8-4750-b765-f5115214878d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.411706 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.411480 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5b88e03a-51a8-4750-b765-f5115214878d-web-config\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.411706 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.411533 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5b88e03a-51a8-4750-b765-f5115214878d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.411706 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.411559 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5b88e03a-51a8-4750-b765-f5115214878d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.411706 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.411594 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b88e03a-51a8-4750-b765-f5115214878d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.411706 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.411643 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5b88e03a-51a8-4750-b765-f5115214878d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.411706 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.411666 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5b88e03a-51a8-4750-b765-f5115214878d-config-out\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.411706 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.411693 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5b88e03a-51a8-4750-b765-f5115214878d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.412155 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.411720 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5b88e03a-51a8-4750-b765-f5115214878d-config-volume\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.412155 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.411758 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7bg4\" (UniqueName: \"kubernetes.io/projected/5b88e03a-51a8-4750-b765-f5115214878d-kube-api-access-d7bg4\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.412155 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.412124 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5b88e03a-51a8-4750-b765-f5115214878d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.412315 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.412190 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b88e03a-51a8-4750-b765-f5115214878d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.412560 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.412535 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b88e03a-51a8-4750-b765-f5115214878d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.414506 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.414478 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b88e03a-51a8-4750-b765-f5115214878d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.414697 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.414637 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5b88e03a-51a8-4750-b765-f5115214878d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.414697 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.414650 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5b88e03a-51a8-4750-b765-f5115214878d-config-out\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.414860 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.414839 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b88e03a-51a8-4750-b765-f5115214878d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.414915 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.414868 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5b88e03a-51a8-4750-b765-f5115214878d-web-config\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.414915 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.414885 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5b88e03a-51a8-4750-b765-f5115214878d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.415175 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.415154 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5b88e03a-51a8-4750-b765-f5115214878d-config-volume\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.415240 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.415225 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5b88e03a-51a8-4750-b765-f5115214878d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.416329 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.416312 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5b88e03a-51a8-4750-b765-f5115214878d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.419266 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.419247 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7bg4\" (UniqueName: \"kubernetes.io/projected/5b88e03a-51a8-4750-b765-f5115214878d-kube-api-access-d7bg4\") pod \"alertmanager-main-0\" (UID: \"5b88e03a-51a8-4750-b765-f5115214878d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.507727 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.507698 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:37:06.646851 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:06.646658 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 18:37:06.649370 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:37:06.649342 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b88e03a_51a8_4750_b765_f5115214878d.slice/crio-a11cf56a6941d5ea0ef5410e07d1708f7871c5619762e078d1d9aefd8f24eaef WatchSource:0}: Error finding container a11cf56a6941d5ea0ef5410e07d1708f7871c5619762e078d1d9aefd8f24eaef: Status 404 returned error can't find the container with id a11cf56a6941d5ea0ef5410e07d1708f7871c5619762e078d1d9aefd8f24eaef Jul 29 18:37:07.143666 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:07.143637 2562 generic.go:356] "Generic (PLEG): container finished" podID="5b88e03a-51a8-4750-b765-f5115214878d" containerID="3ebd9a5a2df6d72c400ce13e8c73769e9da7a9f7499380b073b3323845aa319f" exitCode=0 Jul 29 18:37:07.144097 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:07.143726 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b88e03a-51a8-4750-b765-f5115214878d","Type":"ContainerDied","Data":"3ebd9a5a2df6d72c400ce13e8c73769e9da7a9f7499380b073b3323845aa319f"} Jul 29 18:37:07.144097 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:07.143789 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b88e03a-51a8-4750-b765-f5115214878d","Type":"ContainerStarted","Data":"a11cf56a6941d5ea0ef5410e07d1708f7871c5619762e078d1d9aefd8f24eaef"} Jul 29 18:37:07.351126 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:07.351085 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edeff186-6274-4f3d-bbfd-20cad5259e75" path="/var/lib/kubelet/pods/edeff186-6274-4f3d-bbfd-20cad5259e75/volumes" Jul 29 18:37:08.152260 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:08.152223 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b88e03a-51a8-4750-b765-f5115214878d","Type":"ContainerStarted","Data":"1de97f9976b8d7fc15e29aa4c4b5fdfbc8bc1dfaf92d7397829f8807892027d7"} Jul 29 18:37:08.152668 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:08.152338 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b88e03a-51a8-4750-b765-f5115214878d","Type":"ContainerStarted","Data":"c8661d70d93ab5588e628876894a367911a300efc73511b719d5e0523b650925"} Jul 29 18:37:08.152668 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:08.152378 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b88e03a-51a8-4750-b765-f5115214878d","Type":"ContainerStarted","Data":"2f590d396bf61636f3d8734c2d7a5b6beac649a8a3be6fdc909f281f0d5a8bab"} Jul 29 18:37:08.152668 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:08.152420 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b88e03a-51a8-4750-b765-f5115214878d","Type":"ContainerStarted","Data":"c78da23e479bde171f86ccf86a1b082c2794a8bf3f738ffc73d55067657b65fb"} Jul 29 18:37:08.152668 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:08.152456 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b88e03a-51a8-4750-b765-f5115214878d","Type":"ContainerStarted","Data":"54781208abd06ac4a44ecc7aa85a1437aad8e9b9e2bb7f2fc6fc60fd538c1970"} Jul 29 18:37:08.152668 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:08.152492 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b88e03a-51a8-4750-b765-f5115214878d","Type":"ContainerStarted","Data":"9a20677456f5f9ab77886019431b9ae4df766445fedeb3f8331c07debbeb1651"} Jul 29 18:37:08.180207 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:08.180158 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.164471159 podStartE2EDuration="2.180143631s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.672472ms" isStatefulPod=false podCreationTimestamp="2026-07-29 18:37:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:37:08.17856207 +0000 UTC m=+169.420739228" watchObservedRunningTime="2026-07-29 18:37:08.180143631 +0000 UTC m=+169.422320787" Jul 29 18:37:12.226731 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:12.226645 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:37:12.328046 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:12.327996 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:37:13.934693 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:13.934660 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-759f55f9b4-9dfmk"] Jul 29 18:37:14.034960 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:14.034911 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:37:14.135847 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:14.135793 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:37:14.236704 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:14.236633 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:37:22.201669 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:22.201633 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:37:22.299653 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:22.299620 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:37:38.953453 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:38.953409 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-759f55f9b4-9dfmk" podUID="0d67ac03-e3ee-4078-982f-930243350f86" containerName="console" containerID="cri-o://ea24b61bfdf5c6018d3ba1c925d1d4decef8fcebdd336044312b21b33f9ab6c6" gracePeriod=15 Jul 29 18:37:39.189354 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.189326 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:37:39.268096 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.268020 2562 generic.go:356] "Generic (PLEG): container finished" podID="0d67ac03-e3ee-4078-982f-930243350f86" containerID="ea24b61bfdf5c6018d3ba1c925d1d4decef8fcebdd336044312b21b33f9ab6c6" exitCode=0 Jul 29 18:37:39.268096 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.268059 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759f55f9b4-9dfmk" Jul 29 18:37:39.268252 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.268061 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759f55f9b4-9dfmk" event={"ID":"0d67ac03-e3ee-4078-982f-930243350f86","Type":"ContainerDied","Data":"ea24b61bfdf5c6018d3ba1c925d1d4decef8fcebdd336044312b21b33f9ab6c6"} Jul 29 18:37:39.268252 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.268194 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759f55f9b4-9dfmk" event={"ID":"0d67ac03-e3ee-4078-982f-930243350f86","Type":"ContainerDied","Data":"f6945afdc33de13148462f2cbd7ae138d6932bdd358af9f8a410f9161d0e6fb9"} Jul 29 18:37:39.268252 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.268221 2562 scope.go:117] "RemoveContainer" containerID="ea24b61bfdf5c6018d3ba1c925d1d4decef8fcebdd336044312b21b33f9ab6c6" Jul 29 18:37:39.275770 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.275756 2562 scope.go:117] "RemoveContainer" containerID="ea24b61bfdf5c6018d3ba1c925d1d4decef8fcebdd336044312b21b33f9ab6c6" Jul 29 18:37:39.275994 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:37:39.275977 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea24b61bfdf5c6018d3ba1c925d1d4decef8fcebdd336044312b21b33f9ab6c6\": container with ID starting with ea24b61bfdf5c6018d3ba1c925d1d4decef8fcebdd336044312b21b33f9ab6c6 not found: ID does not exist" containerID="ea24b61bfdf5c6018d3ba1c925d1d4decef8fcebdd336044312b21b33f9ab6c6" Jul 29 18:37:39.276059 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.276002 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea24b61bfdf5c6018d3ba1c925d1d4decef8fcebdd336044312b21b33f9ab6c6"} err="failed to get container status \"ea24b61bfdf5c6018d3ba1c925d1d4decef8fcebdd336044312b21b33f9ab6c6\": rpc error: code = NotFound desc = could not find container \"ea24b61bfdf5c6018d3ba1c925d1d4decef8fcebdd336044312b21b33f9ab6c6\": container with ID starting with ea24b61bfdf5c6018d3ba1c925d1d4decef8fcebdd336044312b21b33f9ab6c6 not found: ID does not exist" Jul 29 18:37:39.284297 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.284279 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzj7m\" (UniqueName: \"kubernetes.io/projected/0d67ac03-e3ee-4078-982f-930243350f86-kube-api-access-pzj7m\") pod \"0d67ac03-e3ee-4078-982f-930243350f86\" (UID: \"0d67ac03-e3ee-4078-982f-930243350f86\") " Jul 29 18:37:39.284359 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.284308 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d67ac03-e3ee-4078-982f-930243350f86-oauth-serving-cert\") pod \"0d67ac03-e3ee-4078-982f-930243350f86\" (UID: \"0d67ac03-e3ee-4078-982f-930243350f86\") " Jul 29 18:37:39.284359 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.284324 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d67ac03-e3ee-4078-982f-930243350f86-trusted-ca-bundle\") pod \"0d67ac03-e3ee-4078-982f-930243350f86\" (UID: \"0d67ac03-e3ee-4078-982f-930243350f86\") " Jul 29 18:37:39.284451 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.284356 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d67ac03-e3ee-4078-982f-930243350f86-console-oauth-config\") pod \"0d67ac03-e3ee-4078-982f-930243350f86\" (UID: \"0d67ac03-e3ee-4078-982f-930243350f86\") " Jul 29 18:37:39.284451 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.284382 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d67ac03-e3ee-4078-982f-930243350f86-service-ca\") pod \"0d67ac03-e3ee-4078-982f-930243350f86\" (UID: \"0d67ac03-e3ee-4078-982f-930243350f86\") " Jul 29 18:37:39.284451 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.284419 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d67ac03-e3ee-4078-982f-930243350f86-console-serving-cert\") pod \"0d67ac03-e3ee-4078-982f-930243350f86\" (UID: \"0d67ac03-e3ee-4078-982f-930243350f86\") " Jul 29 18:37:39.284451 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.284442 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d67ac03-e3ee-4078-982f-930243350f86-console-config\") pod \"0d67ac03-e3ee-4078-982f-930243350f86\" (UID: \"0d67ac03-e3ee-4078-982f-930243350f86\") " Jul 29 18:37:39.284771 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.284748 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d67ac03-e3ee-4078-982f-930243350f86-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0d67ac03-e3ee-4078-982f-930243350f86" (UID: "0d67ac03-e3ee-4078-982f-930243350f86"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:37:39.285219 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.285194 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d67ac03-e3ee-4078-982f-930243350f86-service-ca" (OuterVolumeSpecName: "service-ca") pod "0d67ac03-e3ee-4078-982f-930243350f86" (UID: "0d67ac03-e3ee-4078-982f-930243350f86"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:37:39.285330 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.285225 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d67ac03-e3ee-4078-982f-930243350f86-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0d67ac03-e3ee-4078-982f-930243350f86" (UID: "0d67ac03-e3ee-4078-982f-930243350f86"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:37:39.285394 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.285352 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d67ac03-e3ee-4078-982f-930243350f86-console-config" (OuterVolumeSpecName: "console-config") pod "0d67ac03-e3ee-4078-982f-930243350f86" (UID: "0d67ac03-e3ee-4078-982f-930243350f86"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:37:39.289075 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.289024 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d67ac03-e3ee-4078-982f-930243350f86-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0d67ac03-e3ee-4078-982f-930243350f86" (UID: "0d67ac03-e3ee-4078-982f-930243350f86"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:37:39.291853 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.291828 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d67ac03-e3ee-4078-982f-930243350f86-kube-api-access-pzj7m" (OuterVolumeSpecName: "kube-api-access-pzj7m") pod "0d67ac03-e3ee-4078-982f-930243350f86" (UID: "0d67ac03-e3ee-4078-982f-930243350f86"). InnerVolumeSpecName "kube-api-access-pzj7m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 18:37:39.291945 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.291916 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d67ac03-e3ee-4078-982f-930243350f86-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0d67ac03-e3ee-4078-982f-930243350f86" (UID: "0d67ac03-e3ee-4078-982f-930243350f86"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:37:39.385122 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.385098 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzj7m\" (UniqueName: \"kubernetes.io/projected/0d67ac03-e3ee-4078-982f-930243350f86-kube-api-access-pzj7m\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:37:39.385122 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.385121 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d67ac03-e3ee-4078-982f-930243350f86-oauth-serving-cert\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:37:39.385275 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.385130 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d67ac03-e3ee-4078-982f-930243350f86-trusted-ca-bundle\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:37:39.385275 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.385138 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d67ac03-e3ee-4078-982f-930243350f86-console-oauth-config\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:37:39.385275 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.385146 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d67ac03-e3ee-4078-982f-930243350f86-service-ca\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:37:39.385275 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.385153 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d67ac03-e3ee-4078-982f-930243350f86-console-serving-cert\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:37:39.385275 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.385162 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d67ac03-e3ee-4078-982f-930243350f86-console-config\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:37:39.583298 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.583224 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-759f55f9b4-9dfmk"] Jul 29 18:37:39.589377 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:39.589352 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-759f55f9b4-9dfmk"] Jul 29 18:37:41.349373 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:41.349341 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d67ac03-e3ee-4078-982f-930243350f86" path="/var/lib/kubelet/pods/0d67ac03-e3ee-4078-982f-930243350f86/volumes" Jul 29 18:37:49.862792 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:49.862755 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:37:55.694940 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:55.694900 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:37:55.796071 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:37:55.796040 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:38:06.716817 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:38:06.716780 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:38:06.770091 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:38:06.770048 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:38:32.082508 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:38:32.082470 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:39:19.136141 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:19.136116 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8mjg_6bd12426-d81c-40eb-ab01-ee24cbd47be2/ovn-acl-logging/0.log" Jul 29 18:39:19.139551 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:19.139527 2562 kubelet.go:1648] "Image garbage collection succeeded" Jul 29 18:39:19.141531 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:19.141497 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8mjg_6bd12426-d81c-40eb-ab01-ee24cbd47be2/ovn-acl-logging/0.log" Jul 29 18:39:35.790930 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:35.790900 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:39:36.662241 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:36.662209 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk"] Jul 29 18:39:36.662499 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:36.662487 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d67ac03-e3ee-4078-982f-930243350f86" containerName="console" Jul 29 18:39:36.662564 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:36.662500 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d67ac03-e3ee-4078-982f-930243350f86" containerName="console" Jul 29 18:39:36.662564 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:36.662562 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d67ac03-e3ee-4078-982f-930243350f86" containerName="console" Jul 29 18:39:36.664186 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:36.664171 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk" Jul 29 18:39:36.666752 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:36.666734 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 29 18:39:36.667694 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:36.667673 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 29 18:39:36.667694 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:36.667691 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hgxhg\"" Jul 29 18:39:36.673382 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:36.673359 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk"] Jul 29 18:39:36.765603 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:36.765576 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk\" (UID: \"ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk" Jul 29 18:39:36.765603 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:36.765605 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfxpt\" (UniqueName: \"kubernetes.io/projected/ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5-kube-api-access-hfxpt\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk\" (UID: \"ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk" Jul 29 18:39:36.765837 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:36.765625 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk\" (UID: \"ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk" Jul 29 18:39:36.866364 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:36.866327 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk\" (UID: \"ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk" Jul 29 18:39:36.866364 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:36.866365 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfxpt\" (UniqueName: \"kubernetes.io/projected/ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5-kube-api-access-hfxpt\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk\" (UID: \"ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk" Jul 29 18:39:36.866787 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:36.866383 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk\" (UID: \"ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk" Jul 29 18:39:36.866787 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:36.866736 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk\" (UID: \"ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk" Jul 29 18:39:36.866857 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:36.866793 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk\" (UID: \"ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk" Jul 29 18:39:36.875303 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:36.875273 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfxpt\" (UniqueName: \"kubernetes.io/projected/ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5-kube-api-access-hfxpt\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk\" (UID: \"ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk" Jul 29 18:39:36.973965 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:36.973892 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk" Jul 29 18:39:37.096140 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:37.096118 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk"] Jul 29 18:39:37.099938 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:39:37.099910 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee006cd5_8fd7_45e7_aa6a_f167b6bdffd5.slice/crio-7909292de96a8d85ac338a8877f818c45431a9387fd5e1b02502112f15300b9e WatchSource:0}: Error finding container 7909292de96a8d85ac338a8877f818c45431a9387fd5e1b02502112f15300b9e: Status 404 returned error can't find the container with id 7909292de96a8d85ac338a8877f818c45431a9387fd5e1b02502112f15300b9e Jul 29 18:39:37.102151 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:37.102137 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 18:39:37.490937 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:37.490905 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:39:37.685793 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:37.685762 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk" event={"ID":"ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5","Type":"ContainerStarted","Data":"7909292de96a8d85ac338a8877f818c45431a9387fd5e1b02502112f15300b9e"} Jul 29 18:39:42.707565 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:42.707538 2562 generic.go:356] "Generic (PLEG): container finished" podID="ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5" containerID="a637cc8224464daa936fbc338eec92b1777ba67c814ea5318afaa85593c1fb3d" exitCode=0 Jul 29 18:39:42.707968 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:42.707617 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk" event={"ID":"ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5","Type":"ContainerDied","Data":"a637cc8224464daa936fbc338eec92b1777ba67c814ea5318afaa85593c1fb3d"} Jul 29 18:39:45.722914 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:45.722876 2562 generic.go:356] "Generic (PLEG): container finished" podID="ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5" containerID="94d6d068a202da39b0d164eeabf51d6ace32bca84173e1d0b78803aaea627f81" exitCode=0 Jul 29 18:39:45.723348 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:45.722958 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk" event={"ID":"ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5","Type":"ContainerDied","Data":"94d6d068a202da39b0d164eeabf51d6ace32bca84173e1d0b78803aaea627f81"} Jul 29 18:39:52.752744 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:52.752666 2562 generic.go:356] "Generic (PLEG): container finished" podID="ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5" containerID="e349422e5257a8dd17d8c474d27338e5217779c39d265770245dd39a3e15a764" exitCode=0 Jul 29 18:39:52.752744 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:52.752707 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk" event={"ID":"ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5","Type":"ContainerDied","Data":"e349422e5257a8dd17d8c474d27338e5217779c39d265770245dd39a3e15a764"} Jul 29 18:39:53.885596 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:53.885574 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk" Jul 29 18:39:53.899032 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:53.899014 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5-bundle\") pod \"ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5\" (UID: \"ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5\") " Jul 29 18:39:53.899094 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:53.899057 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfxpt\" (UniqueName: \"kubernetes.io/projected/ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5-kube-api-access-hfxpt\") pod \"ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5\" (UID: \"ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5\") " Jul 29 18:39:53.899094 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:53.899077 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5-util\") pod \"ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5\" (UID: \"ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5\") " Jul 29 18:39:53.899707 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:53.899685 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5-bundle" (OuterVolumeSpecName: "bundle") pod "ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5" (UID: "ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 18:39:53.901097 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:53.901075 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5-kube-api-access-hfxpt" (OuterVolumeSpecName: "kube-api-access-hfxpt") pod "ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5" (UID: "ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5"). InnerVolumeSpecName "kube-api-access-hfxpt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 18:39:53.903304 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:53.903279 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5-util" (OuterVolumeSpecName: "util") pod "ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5" (UID: "ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 18:39:54.000029 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:53.999995 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5-util\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:39:54.000029 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:54.000022 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5-bundle\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:39:54.000029 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:54.000032 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfxpt\" (UniqueName: \"kubernetes.io/projected/ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5-kube-api-access-hfxpt\") on node \"ip-10-0-135-190.ec2.internal\" DevicePath \"\"" Jul 29 18:39:54.761854 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:54.761816 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk" event={"ID":"ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5","Type":"ContainerDied","Data":"7909292de96a8d85ac338a8877f818c45431a9387fd5e1b02502112f15300b9e"} Jul 29 18:39:54.761854 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:54.761817 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gz8rk" Jul 29 18:39:54.762052 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:54.761870 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7909292de96a8d85ac338a8877f818c45431a9387fd5e1b02502112f15300b9e" Jul 29 18:39:56.074420 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:56.074388 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:39:58.016877 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:58.016818 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:39:58.117812 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:58.117776 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:39:59.440499 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:59.440472 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-n5hqv"] Jul 29 18:39:59.440855 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:59.440810 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5" containerName="util" Jul 29 18:39:59.440855 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:59.440822 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5" containerName="util" Jul 29 18:39:59.440855 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:59.440832 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5" containerName="pull" Jul 29 18:39:59.440855 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:59.440837 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5" containerName="pull" Jul 29 18:39:59.440855 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:59.440846 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5" containerName="extract" Jul 29 18:39:59.440855 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:59.440851 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5" containerName="extract" Jul 29 18:39:59.441046 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:59.440899 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee006cd5-8fd7-45e7-aa6a-f167b6bdffd5" containerName="extract" Jul 29 18:39:59.489596 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:59.489563 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-n5hqv"] Jul 29 18:39:59.489738 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:59.489653 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-n5hqv" Jul 29 18:39:59.495784 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:59.495755 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-tgk4z\"" Jul 29 18:39:59.495870 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:59.495821 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 29 18:39:59.496093 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:59.496074 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 29 18:39:59.499883 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:59.499864 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 29 18:39:59.533943 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:59.533914 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/87184eff-7e4f-429c-863d-bb70b1199e78-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-n5hqv\" (UID: \"87184eff-7e4f-429c-863d-bb70b1199e78\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-n5hqv" Jul 29 18:39:59.534072 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:59.534051 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxt7q\" (UniqueName: \"kubernetes.io/projected/87184eff-7e4f-429c-863d-bb70b1199e78-kube-api-access-lxt7q\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-n5hqv\" (UID: \"87184eff-7e4f-429c-863d-bb70b1199e78\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-n5hqv" Jul 29 18:39:59.634783 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:59.634755 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxt7q\" (UniqueName: \"kubernetes.io/projected/87184eff-7e4f-429c-863d-bb70b1199e78-kube-api-access-lxt7q\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-n5hqv\" (UID: \"87184eff-7e4f-429c-863d-bb70b1199e78\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-n5hqv" Jul 29 18:39:59.634909 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:59.634804 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/87184eff-7e4f-429c-863d-bb70b1199e78-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-n5hqv\" (UID: \"87184eff-7e4f-429c-863d-bb70b1199e78\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-n5hqv" Jul 29 18:39:59.637050 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:59.637018 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/87184eff-7e4f-429c-863d-bb70b1199e78-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-n5hqv\" (UID: \"87184eff-7e4f-429c-863d-bb70b1199e78\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-n5hqv" Jul 29 18:39:59.644357 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:59.644332 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxt7q\" (UniqueName: \"kubernetes.io/projected/87184eff-7e4f-429c-863d-bb70b1199e78-kube-api-access-lxt7q\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-n5hqv\" (UID: \"87184eff-7e4f-429c-863d-bb70b1199e78\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-n5hqv" Jul 29 18:39:59.799546 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:59.799456 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-n5hqv" Jul 29 18:39:59.958165 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:39:59.958135 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87184eff_7e4f_429c_863d_bb70b1199e78.slice/crio-d48e4f1f2ffaa4f516a9cd24590d1710546c808a08acd121ba02a3a21c616cc7 WatchSource:0}: Error finding container d48e4f1f2ffaa4f516a9cd24590d1710546c808a08acd121ba02a3a21c616cc7: Status 404 returned error can't find the container with id d48e4f1f2ffaa4f516a9cd24590d1710546c808a08acd121ba02a3a21c616cc7 Jul 29 18:39:59.959808 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:39:59.959786 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-n5hqv"] Jul 29 18:40:00.787284 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:00.787248 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-n5hqv" event={"ID":"87184eff-7e4f-429c-863d-bb70b1199e78","Type":"ContainerStarted","Data":"d48e4f1f2ffaa4f516a9cd24590d1710546c808a08acd121ba02a3a21c616cc7"} Jul 29 18:40:03.664427 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:03.664391 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:40:03.803334 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:03.803306 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-n5hqv" event={"ID":"87184eff-7e4f-429c-863d-bb70b1199e78","Type":"ContainerStarted","Data":"46cc6345969b32550ff482f3b47139769ce9a7178764fa2cc82efe5bd103f4ec"} Jul 29 18:40:03.803487 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:03.803374 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-n5hqv" Jul 29 18:40:03.826157 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:03.826106 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-n5hqv" podStartSLOduration=1.664082115 podStartE2EDuration="4.826090337s" totalImagesPullingTime="3.162008222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:40:03.824117281 +0000 UTC m=+345.066294435" watchObservedRunningTime="2026-07-29 18:40:03.826090337 +0000 UTC m=+345.068267492" Jul 29 18:40:03.937750 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:03.937683 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-77f648d694-sv6kl"] Jul 29 18:40:03.942100 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:03.942070 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:40:03.960004 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:03.959981 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-sv6kl"] Jul 29 18:40:03.960155 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:03.960106 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-sv6kl" Jul 29 18:40:03.962833 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:03.962757 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 29 18:40:03.963019 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:03.962993 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-sbfg2\"" Jul 29 18:40:03.963236 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:03.963198 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 29 18:40:03.967884 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:03.967863 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/f6f5d610-b665-46e5-98ef-5df7526fc9f2-cabundle0\") pod \"keda-operator-77f648d694-sv6kl\" (UID: \"f6f5d610-b665-46e5-98ef-5df7526fc9f2\") " pod="openshift-keda/keda-operator-77f648d694-sv6kl" Jul 29 18:40:03.968004 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:03.967896 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f6f5d610-b665-46e5-98ef-5df7526fc9f2-certificates\") pod \"keda-operator-77f648d694-sv6kl\" (UID: \"f6f5d610-b665-46e5-98ef-5df7526fc9f2\") " pod="openshift-keda/keda-operator-77f648d694-sv6kl" Jul 29 18:40:03.968004 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:03.967927 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsf6q\" (UniqueName: \"kubernetes.io/projected/f6f5d610-b665-46e5-98ef-5df7526fc9f2-kube-api-access-xsf6q\") pod \"keda-operator-77f648d694-sv6kl\" (UID: \"f6f5d610-b665-46e5-98ef-5df7526fc9f2\") " pod="openshift-keda/keda-operator-77f648d694-sv6kl" Jul 29 18:40:04.013084 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.013057 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:40:04.068905 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.068884 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/f6f5d610-b665-46e5-98ef-5df7526fc9f2-cabundle0\") pod \"keda-operator-77f648d694-sv6kl\" (UID: \"f6f5d610-b665-46e5-98ef-5df7526fc9f2\") " pod="openshift-keda/keda-operator-77f648d694-sv6kl" Jul 29 18:40:04.069045 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.068925 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f6f5d610-b665-46e5-98ef-5df7526fc9f2-certificates\") pod \"keda-operator-77f648d694-sv6kl\" (UID: \"f6f5d610-b665-46e5-98ef-5df7526fc9f2\") " pod="openshift-keda/keda-operator-77f648d694-sv6kl" Jul 29 18:40:04.069045 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.068969 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsf6q\" (UniqueName: \"kubernetes.io/projected/f6f5d610-b665-46e5-98ef-5df7526fc9f2-kube-api-access-xsf6q\") pod \"keda-operator-77f648d694-sv6kl\" (UID: \"f6f5d610-b665-46e5-98ef-5df7526fc9f2\") " pod="openshift-keda/keda-operator-77f648d694-sv6kl" Jul 29 18:40:04.069154 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:40:04.069050 2562 secret.go:281] references non-existent secret key: ca.crt Jul 29 18:40:04.069154 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:40:04.069069 2562 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 29 18:40:04.069154 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:40:04.069078 2562 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-sv6kl: references non-existent secret key: ca.crt Jul 29 18:40:04.069154 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:40:04.069137 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6f5d610-b665-46e5-98ef-5df7526fc9f2-certificates podName:f6f5d610-b665-46e5-98ef-5df7526fc9f2 nodeName:}" failed. No retries permitted until 2026-07-29 18:40:04.569120732 +0000 UTC m=+345.811297866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/f6f5d610-b665-46e5-98ef-5df7526fc9f2-certificates") pod "keda-operator-77f648d694-sv6kl" (UID: "f6f5d610-b665-46e5-98ef-5df7526fc9f2") : references non-existent secret key: ca.crt Jul 29 18:40:04.069652 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.069633 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/f6f5d610-b665-46e5-98ef-5df7526fc9f2-cabundle0\") pod \"keda-operator-77f648d694-sv6kl\" (UID: \"f6f5d610-b665-46e5-98ef-5df7526fc9f2\") " pod="openshift-keda/keda-operator-77f648d694-sv6kl" Jul 29 18:40:04.082682 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.082462 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsf6q\" (UniqueName: \"kubernetes.io/projected/f6f5d610-b665-46e5-98ef-5df7526fc9f2-kube-api-access-xsf6q\") pod \"keda-operator-77f648d694-sv6kl\" (UID: \"f6f5d610-b665-46e5-98ef-5df7526fc9f2\") " pod="openshift-keda/keda-operator-77f648d694-sv6kl" Jul 29 18:40:04.127424 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.127397 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:40:04.134348 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.134327 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-6prnf"] Jul 29 18:40:04.154289 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.154268 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-6prnf"] Jul 29 18:40:04.154407 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.154361 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-6prnf" Jul 29 18:40:04.157068 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.157047 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 29 18:40:04.170101 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.170084 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gstm\" (UniqueName: \"kubernetes.io/projected/c1a0fbe6-eaf0-426d-8dee-244277c01f5e-kube-api-access-4gstm\") pod \"keda-metrics-apiserver-55557df8c-6prnf\" (UID: \"c1a0fbe6-eaf0-426d-8dee-244277c01f5e\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-6prnf" Jul 29 18:40:04.170208 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.170114 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c1a0fbe6-eaf0-426d-8dee-244277c01f5e-certificates\") pod \"keda-metrics-apiserver-55557df8c-6prnf\" (UID: \"c1a0fbe6-eaf0-426d-8dee-244277c01f5e\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-6prnf" Jul 29 18:40:04.170208 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.170145 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/c1a0fbe6-eaf0-426d-8dee-244277c01f5e-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-6prnf\" (UID: \"c1a0fbe6-eaf0-426d-8dee-244277c01f5e\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-6prnf" Jul 29 18:40:04.251108 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.251043 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:40:04.271184 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.271166 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gstm\" (UniqueName: \"kubernetes.io/projected/c1a0fbe6-eaf0-426d-8dee-244277c01f5e-kube-api-access-4gstm\") pod \"keda-metrics-apiserver-55557df8c-6prnf\" (UID: \"c1a0fbe6-eaf0-426d-8dee-244277c01f5e\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-6prnf" Jul 29 18:40:04.271270 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.271199 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c1a0fbe6-eaf0-426d-8dee-244277c01f5e-certificates\") pod \"keda-metrics-apiserver-55557df8c-6prnf\" (UID: \"c1a0fbe6-eaf0-426d-8dee-244277c01f5e\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-6prnf" Jul 29 18:40:04.271270 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.271245 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/c1a0fbe6-eaf0-426d-8dee-244277c01f5e-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-6prnf\" (UID: \"c1a0fbe6-eaf0-426d-8dee-244277c01f5e\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-6prnf" Jul 29 18:40:04.271377 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:40:04.271364 2562 secret.go:281] references non-existent secret key: tls.crt Jul 29 18:40:04.271412 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:40:04.271382 2562 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Jul 29 18:40:04.271412 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:40:04.271396 2562 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-55557df8c-6prnf: references non-existent secret key: tls.crt Jul 29 18:40:04.271482 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:40:04.271447 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1a0fbe6-eaf0-426d-8dee-244277c01f5e-certificates podName:c1a0fbe6-eaf0-426d-8dee-244277c01f5e nodeName:}" failed. No retries permitted until 2026-07-29 18:40:04.771433172 +0000 UTC m=+346.013610306 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/c1a0fbe6-eaf0-426d-8dee-244277c01f5e-certificates") pod "keda-metrics-apiserver-55557df8c-6prnf" (UID: "c1a0fbe6-eaf0-426d-8dee-244277c01f5e") : references non-existent secret key: tls.crt Jul 29 18:40:04.271655 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.271639 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/c1a0fbe6-eaf0-426d-8dee-244277c01f5e-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-6prnf\" (UID: \"c1a0fbe6-eaf0-426d-8dee-244277c01f5e\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-6prnf" Jul 29 18:40:04.280215 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.280195 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gstm\" (UniqueName: \"kubernetes.io/projected/c1a0fbe6-eaf0-426d-8dee-244277c01f5e-kube-api-access-4gstm\") pod \"keda-metrics-apiserver-55557df8c-6prnf\" (UID: \"c1a0fbe6-eaf0-426d-8dee-244277c01f5e\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-6prnf" Jul 29 18:40:04.574424 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.574350 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f6f5d610-b665-46e5-98ef-5df7526fc9f2-certificates\") pod \"keda-operator-77f648d694-sv6kl\" (UID: \"f6f5d610-b665-46e5-98ef-5df7526fc9f2\") " pod="openshift-keda/keda-operator-77f648d694-sv6kl" Jul 29 18:40:04.574572 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:40:04.574453 2562 secret.go:281] references non-existent secret key: ca.crt Jul 29 18:40:04.574572 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:40:04.574464 2562 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 29 18:40:04.574572 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:40:04.574472 2562 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-sv6kl: references non-existent secret key: ca.crt Jul 29 18:40:04.574572 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:40:04.574536 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6f5d610-b665-46e5-98ef-5df7526fc9f2-certificates podName:f6f5d610-b665-46e5-98ef-5df7526fc9f2 nodeName:}" failed. No retries permitted until 2026-07-29 18:40:05.574503525 +0000 UTC m=+346.816680659 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/f6f5d610-b665-46e5-98ef-5df7526fc9f2-certificates") pod "keda-operator-77f648d694-sv6kl" (UID: "f6f5d610-b665-46e5-98ef-5df7526fc9f2") : references non-existent secret key: ca.crt Jul 29 18:40:04.727205 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.727166 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-shz44"] Jul 29 18:40:04.731199 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.731174 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:40:04.745474 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.745446 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-shz44"] Jul 29 18:40:04.745624 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.745580 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-shz44" Jul 29 18:40:04.748044 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.748024 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 29 18:40:04.775823 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.775801 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f67e5833-a65a-4b5e-abaa-13632407f6cb-certificates\") pod \"keda-admission-56f9798bb4-shz44\" (UID: \"f67e5833-a65a-4b5e-abaa-13632407f6cb\") " pod="openshift-keda/keda-admission-56f9798bb4-shz44" Jul 29 18:40:04.776078 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.775913 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c1a0fbe6-eaf0-426d-8dee-244277c01f5e-certificates\") pod \"keda-metrics-apiserver-55557df8c-6prnf\" (UID: \"c1a0fbe6-eaf0-426d-8dee-244277c01f5e\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-6prnf" Jul 29 18:40:04.776078 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.775944 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjjpx\" (UniqueName: \"kubernetes.io/projected/f67e5833-a65a-4b5e-abaa-13632407f6cb-kube-api-access-sjjpx\") pod \"keda-admission-56f9798bb4-shz44\" (UID: \"f67e5833-a65a-4b5e-abaa-13632407f6cb\") " pod="openshift-keda/keda-admission-56f9798bb4-shz44" Jul 29 18:40:04.779167 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.779141 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c1a0fbe6-eaf0-426d-8dee-244277c01f5e-certificates\") pod \"keda-metrics-apiserver-55557df8c-6prnf\" (UID: \"c1a0fbe6-eaf0-426d-8dee-244277c01f5e\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-6prnf" Jul 29 18:40:04.835357 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.835322 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:40:04.877060 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.877028 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjjpx\" (UniqueName: \"kubernetes.io/projected/f67e5833-a65a-4b5e-abaa-13632407f6cb-kube-api-access-sjjpx\") pod \"keda-admission-56f9798bb4-shz44\" (UID: \"f67e5833-a65a-4b5e-abaa-13632407f6cb\") " pod="openshift-keda/keda-admission-56f9798bb4-shz44" Jul 29 18:40:04.877216 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.877192 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f67e5833-a65a-4b5e-abaa-13632407f6cb-certificates\") pod \"keda-admission-56f9798bb4-shz44\" (UID: \"f67e5833-a65a-4b5e-abaa-13632407f6cb\") " pod="openshift-keda/keda-admission-56f9798bb4-shz44" Jul 29 18:40:04.879686 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.879659 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f67e5833-a65a-4b5e-abaa-13632407f6cb-certificates\") pod \"keda-admission-56f9798bb4-shz44\" (UID: \"f67e5833-a65a-4b5e-abaa-13632407f6cb\") " pod="openshift-keda/keda-admission-56f9798bb4-shz44" Jul 29 18:40:04.886392 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.886369 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjjpx\" (UniqueName: \"kubernetes.io/projected/f67e5833-a65a-4b5e-abaa-13632407f6cb-kube-api-access-sjjpx\") pod \"keda-admission-56f9798bb4-shz44\" (UID: \"f67e5833-a65a-4b5e-abaa-13632407f6cb\") " pod="openshift-keda/keda-admission-56f9798bb4-shz44" Jul 29 18:40:04.935411 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:04.935373 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:40:05.057611 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:05.057581 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-shz44" Jul 29 18:40:05.064888 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:05.064806 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-6prnf" Jul 29 18:40:05.239569 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:05.239272 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:40:05.241549 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:05.241237 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-shz44"] Jul 29 18:40:05.245211 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:40:05.245168 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf67e5833_a65a_4b5e_abaa_13632407f6cb.slice/crio-1a563930b3134e92112d9dc383fc981f160940e966a69ab501dd2e739d282e89 WatchSource:0}: Error finding container 1a563930b3134e92112d9dc383fc981f160940e966a69ab501dd2e739d282e89: Status 404 returned error can't find the container with id 1a563930b3134e92112d9dc383fc981f160940e966a69ab501dd2e739d282e89 Jul 29 18:40:05.259492 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:05.259469 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-6prnf"] Jul 29 18:40:05.262559 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:40:05.262534 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1a0fbe6_eaf0_426d_8dee_244277c01f5e.slice/crio-f27bb8e279c0b8b561d83eabf1bfd3d072a69979cc311b2c40f04b807b3147b4 WatchSource:0}: Error finding container f27bb8e279c0b8b561d83eabf1bfd3d072a69979cc311b2c40f04b807b3147b4: Status 404 returned error can't find the container with id f27bb8e279c0b8b561d83eabf1bfd3d072a69979cc311b2c40f04b807b3147b4 Jul 29 18:40:05.440296 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:05.440203 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:40:05.559693 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:05.559636 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:40:05.584292 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:05.584265 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f6f5d610-b665-46e5-98ef-5df7526fc9f2-certificates\") pod \"keda-operator-77f648d694-sv6kl\" (UID: \"f6f5d610-b665-46e5-98ef-5df7526fc9f2\") " pod="openshift-keda/keda-operator-77f648d694-sv6kl" Jul 29 18:40:05.586639 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:05.586613 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f6f5d610-b665-46e5-98ef-5df7526fc9f2-certificates\") pod \"keda-operator-77f648d694-sv6kl\" (UID: \"f6f5d610-b665-46e5-98ef-5df7526fc9f2\") " pod="openshift-keda/keda-operator-77f648d694-sv6kl" Jul 29 18:40:05.657452 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:05.657421 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:40:05.771206 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:05.771132 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-sv6kl" Jul 29 18:40:05.814505 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:05.814472 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-shz44" event={"ID":"f67e5833-a65a-4b5e-abaa-13632407f6cb","Type":"ContainerStarted","Data":"1a563930b3134e92112d9dc383fc981f160940e966a69ab501dd2e739d282e89"} Jul 29 18:40:05.816240 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:05.816185 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-6prnf" event={"ID":"c1a0fbe6-eaf0-426d-8dee-244277c01f5e","Type":"ContainerStarted","Data":"f27bb8e279c0b8b561d83eabf1bfd3d072a69979cc311b2c40f04b807b3147b4"} Jul 29 18:40:05.926020 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:05.925989 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-sv6kl"] Jul 29 18:40:05.927850 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:40:05.927825 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6f5d610_b665_46e5_98ef_5df7526fc9f2.slice/crio-fe8983b96f140bc37025d959cd4984e0422cfca5e6af7111bc3e7205bd33d3ec WatchSource:0}: Error finding container fe8983b96f140bc37025d959cd4984e0422cfca5e6af7111bc3e7205bd33d3ec: Status 404 returned error can't find the container with id fe8983b96f140bc37025d959cd4984e0422cfca5e6af7111bc3e7205bd33d3ec Jul 29 18:40:06.821768 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:06.821735 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-sv6kl" event={"ID":"f6f5d610-b665-46e5-98ef-5df7526fc9f2","Type":"ContainerStarted","Data":"fe8983b96f140bc37025d959cd4984e0422cfca5e6af7111bc3e7205bd33d3ec"} Jul 29 18:40:07.828365 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:07.828332 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-shz44" event={"ID":"f67e5833-a65a-4b5e-abaa-13632407f6cb","Type":"ContainerStarted","Data":"36c37d5e85ec6737fc95de3335fa65375667901d175e729b77069d31d0cf87e1"} Jul 29 18:40:07.828836 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:07.828396 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-56f9798bb4-shz44" Jul 29 18:40:07.829813 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:07.829786 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-6prnf" event={"ID":"c1a0fbe6-eaf0-426d-8dee-244277c01f5e","Type":"ContainerStarted","Data":"a097004bb2f0b2a91a634c682f77e30557711d12769b1de840e97772c6032f81"} Jul 29 18:40:07.829947 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:07.829900 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-6prnf" Jul 29 18:40:07.845715 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:07.845672 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-56f9798bb4-shz44" podStartSLOduration=1.345573714 podStartE2EDuration="3.845656486s" totalImagesPullingTime="2.500082772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:40:07.844305978 +0000 UTC m=+349.086483127" watchObservedRunningTime="2026-07-29 18:40:07.845656486 +0000 UTC m=+349.087833642" Jul 29 18:40:07.861680 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:07.861616 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-6prnf" podStartSLOduration=1.373763448 podStartE2EDuration="3.861600546s" totalImagesPullingTime="2.487837098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:40:07.861182065 +0000 UTC m=+349.103359224" watchObservedRunningTime="2026-07-29 18:40:07.861600546 +0000 UTC m=+349.103777703" Jul 29 18:40:10.845271 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:10.845235 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-sv6kl" event={"ID":"f6f5d610-b665-46e5-98ef-5df7526fc9f2","Type":"ContainerStarted","Data":"737f3338aeb53cde84e0a777886b0b4729a3463276cb73efec5b31cfe8b5bf01"} Jul 29 18:40:10.845700 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:10.845390 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-77f648d694-sv6kl" Jul 29 18:40:10.862080 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:10.862039 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-77f648d694-sv6kl" podStartSLOduration=3.689553896 podStartE2EDuration="7.86202609s" totalImagesPullingTime="4.172472194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:40:10.860887302 +0000 UTC m=+352.103064458" watchObservedRunningTime="2026-07-29 18:40:10.86202609 +0000 UTC m=+352.104203246" Jul 29 18:40:18.839856 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:18.839830 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-6prnf" Jul 29 18:40:20.049918 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:20.049884 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:40:24.810095 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:24.810061 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-n5hqv" Jul 29 18:40:28.837562 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:28.837523 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-56f9798bb4-shz44" Jul 29 18:40:31.851657 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:31.851630 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-77f648d694-sv6kl" Jul 29 18:40:57.701371 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:57.701291 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:40:57.758438 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:40:57.758408 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:41:00.443477 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:00.443445 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:41:11.393292 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.393258 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:41:11.461467 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.461432 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:41:11.462072 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.462053 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-6c559f7cd9-5sqcz"] Jul 29 18:41:11.464237 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.464219 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6c559f7cd9-5sqcz" Jul 29 18:41:11.466508 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.466486 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 29 18:41:11.466779 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.466760 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 29 18:41:11.467529 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.467494 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 29 18:41:11.467611 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.467600 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-49mk8\"" Jul 29 18:41:11.476188 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.476166 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6c559f7cd9-5sqcz"] Jul 29 18:41:11.502530 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.502497 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-8445dbf85d-skl7d"] Jul 29 18:41:11.504696 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.504679 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-8445dbf85d-skl7d" Jul 29 18:41:11.506929 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.506914 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 29 18:41:11.507022 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.506915 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-mc5n5\"" Jul 29 18:41:11.507079 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.507022 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhjkh\" (UniqueName: \"kubernetes.io/projected/53faeec6-14f7-46ec-a791-ecf398326ea5-kube-api-access-qhjkh\") pod \"kserve-controller-manager-6c559f7cd9-5sqcz\" (UID: \"53faeec6-14f7-46ec-a791-ecf398326ea5\") " pod="kserve/kserve-controller-manager-6c559f7cd9-5sqcz" Jul 29 18:41:11.507155 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.507138 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53faeec6-14f7-46ec-a791-ecf398326ea5-cert\") pod \"kserve-controller-manager-6c559f7cd9-5sqcz\" (UID: \"53faeec6-14f7-46ec-a791-ecf398326ea5\") " pod="kserve/kserve-controller-manager-6c559f7cd9-5sqcz" Jul 29 18:41:11.514117 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.514100 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-8445dbf85d-skl7d"] Jul 29 18:41:11.557800 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.557765 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:41:11.607591 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.607569 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhjkh\" (UniqueName: \"kubernetes.io/projected/53faeec6-14f7-46ec-a791-ecf398326ea5-kube-api-access-qhjkh\") pod \"kserve-controller-manager-6c559f7cd9-5sqcz\" (UID: \"53faeec6-14f7-46ec-a791-ecf398326ea5\") " pod="kserve/kserve-controller-manager-6c559f7cd9-5sqcz" Jul 29 18:41:11.607705 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.607597 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcbrr\" (UniqueName: \"kubernetes.io/projected/0a9fc6eb-22c9-4881-baf2-1215ceda6ad9-kube-api-access-vcbrr\") pod \"seaweedfs-8445dbf85d-skl7d\" (UID: \"0a9fc6eb-22c9-4881-baf2-1215ceda6ad9\") " pod="kserve/seaweedfs-8445dbf85d-skl7d" Jul 29 18:41:11.607770 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.607722 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0a9fc6eb-22c9-4881-baf2-1215ceda6ad9-data\") pod \"seaweedfs-8445dbf85d-skl7d\" (UID: \"0a9fc6eb-22c9-4881-baf2-1215ceda6ad9\") " pod="kserve/seaweedfs-8445dbf85d-skl7d" Jul 29 18:41:11.607827 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.607767 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53faeec6-14f7-46ec-a791-ecf398326ea5-cert\") pod \"kserve-controller-manager-6c559f7cd9-5sqcz\" (UID: \"53faeec6-14f7-46ec-a791-ecf398326ea5\") " pod="kserve/kserve-controller-manager-6c559f7cd9-5sqcz" Jul 29 18:41:11.607895 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:41:11.607874 2562 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 29 18:41:11.607948 ip-10-0-135-190 kubenswrapper[2562]: E0729 18:41:11.607942 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53faeec6-14f7-46ec-a791-ecf398326ea5-cert podName:53faeec6-14f7-46ec-a791-ecf398326ea5 nodeName:}" failed. No retries permitted until 2026-07-29 18:41:12.107925759 +0000 UTC m=+413.350102892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/53faeec6-14f7-46ec-a791-ecf398326ea5-cert") pod "kserve-controller-manager-6c559f7cd9-5sqcz" (UID: "53faeec6-14f7-46ec-a791-ecf398326ea5") : secret "kserve-webhook-server-cert" not found Jul 29 18:41:11.616111 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.616093 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhjkh\" (UniqueName: \"kubernetes.io/projected/53faeec6-14f7-46ec-a791-ecf398326ea5-kube-api-access-qhjkh\") pod \"kserve-controller-manager-6c559f7cd9-5sqcz\" (UID: \"53faeec6-14f7-46ec-a791-ecf398326ea5\") " pod="kserve/kserve-controller-manager-6c559f7cd9-5sqcz" Jul 29 18:41:11.699293 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.699232 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:41:11.708949 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.708927 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcbrr\" (UniqueName: \"kubernetes.io/projected/0a9fc6eb-22c9-4881-baf2-1215ceda6ad9-kube-api-access-vcbrr\") pod \"seaweedfs-8445dbf85d-skl7d\" (UID: \"0a9fc6eb-22c9-4881-baf2-1215ceda6ad9\") " pod="kserve/seaweedfs-8445dbf85d-skl7d" Jul 29 18:41:11.709046 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.708986 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0a9fc6eb-22c9-4881-baf2-1215ceda6ad9-data\") pod \"seaweedfs-8445dbf85d-skl7d\" (UID: \"0a9fc6eb-22c9-4881-baf2-1215ceda6ad9\") " pod="kserve/seaweedfs-8445dbf85d-skl7d" Jul 29 18:41:11.709312 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.709298 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0a9fc6eb-22c9-4881-baf2-1215ceda6ad9-data\") pod \"seaweedfs-8445dbf85d-skl7d\" (UID: \"0a9fc6eb-22c9-4881-baf2-1215ceda6ad9\") " pod="kserve/seaweedfs-8445dbf85d-skl7d" Jul 29 18:41:11.717024 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.717005 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcbrr\" (UniqueName: \"kubernetes.io/projected/0a9fc6eb-22c9-4881-baf2-1215ceda6ad9-kube-api-access-vcbrr\") pod \"seaweedfs-8445dbf85d-skl7d\" (UID: \"0a9fc6eb-22c9-4881-baf2-1215ceda6ad9\") " pod="kserve/seaweedfs-8445dbf85d-skl7d" Jul 29 18:41:11.799820 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.799786 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:41:11.813875 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.813848 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-8445dbf85d-skl7d" Jul 29 18:41:11.937023 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:11.937000 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-8445dbf85d-skl7d"] Jul 29 18:41:11.939221 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:41:11.939195 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a9fc6eb_22c9_4881_baf2_1215ceda6ad9.slice/crio-8269f308c64a2e2e15fe9d2f20f77a3d05406d08e9ede40c35f16f67be83fc9a WatchSource:0}: Error finding container 8269f308c64a2e2e15fe9d2f20f77a3d05406d08e9ede40c35f16f67be83fc9a: Status 404 returned error can't find the container with id 8269f308c64a2e2e15fe9d2f20f77a3d05406d08e9ede40c35f16f67be83fc9a Jul 29 18:41:12.056895 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:12.056805 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:41:12.100298 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:12.100268 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-8445dbf85d-skl7d" event={"ID":"0a9fc6eb-22c9-4881-baf2-1215ceda6ad9","Type":"ContainerStarted","Data":"8269f308c64a2e2e15fe9d2f20f77a3d05406d08e9ede40c35f16f67be83fc9a"} Jul 29 18:41:12.112814 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:12.112791 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53faeec6-14f7-46ec-a791-ecf398326ea5-cert\") pod \"kserve-controller-manager-6c559f7cd9-5sqcz\" (UID: \"53faeec6-14f7-46ec-a791-ecf398326ea5\") " pod="kserve/kserve-controller-manager-6c559f7cd9-5sqcz" Jul 29 18:41:12.115135 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:12.115114 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53faeec6-14f7-46ec-a791-ecf398326ea5-cert\") pod \"kserve-controller-manager-6c559f7cd9-5sqcz\" (UID: \"53faeec6-14f7-46ec-a791-ecf398326ea5\") " pod="kserve/kserve-controller-manager-6c559f7cd9-5sqcz" Jul 29 18:41:12.157262 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:12.157235 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:41:12.375190 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:12.375155 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6c559f7cd9-5sqcz" Jul 29 18:41:12.592883 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:12.592856 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6c559f7cd9-5sqcz"] Jul 29 18:41:12.594422 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:41:12.594396 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53faeec6_14f7_46ec_a791_ecf398326ea5.slice/crio-a2ff27979adf123cad163009801946cd74ac5d2a17ac54fd8af6830db8a03b92 WatchSource:0}: Error finding container a2ff27979adf123cad163009801946cd74ac5d2a17ac54fd8af6830db8a03b92: Status 404 returned error can't find the container with id a2ff27979adf123cad163009801946cd74ac5d2a17ac54fd8af6830db8a03b92 Jul 29 18:41:13.108083 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:13.108040 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6c559f7cd9-5sqcz" event={"ID":"53faeec6-14f7-46ec-a791-ecf398326ea5","Type":"ContainerStarted","Data":"a2ff27979adf123cad163009801946cd74ac5d2a17ac54fd8af6830db8a03b92"} Jul 29 18:41:16.123194 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:16.123165 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6c559f7cd9-5sqcz" event={"ID":"53faeec6-14f7-46ec-a791-ecf398326ea5","Type":"ContainerStarted","Data":"fc07d072c26391cf255bfbd130bd04e08150724f95ce3169a7eaed5ff13c3f11"} Jul 29 18:41:16.123618 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:16.123292 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-6c559f7cd9-5sqcz" Jul 29 18:41:16.124698 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:16.124674 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-8445dbf85d-skl7d" event={"ID":"0a9fc6eb-22c9-4881-baf2-1215ceda6ad9","Type":"ContainerStarted","Data":"143a1738c963bc94b938c036cd40b642b96da1f4dd35bee0815fdcb265063a5b"} Jul 29 18:41:16.124805 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:16.124727 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-8445dbf85d-skl7d" Jul 29 18:41:16.170669 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:16.170623 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-6c559f7cd9-5sqcz" podStartSLOduration=1.893988342 podStartE2EDuration="5.170609161s" totalImagesPullingTime="3.276620819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:41:16.168809646 +0000 UTC m=+417.410986801" watchObservedRunningTime="2026-07-29 18:41:16.170609161 +0000 UTC m=+417.412786317" Jul 29 18:41:16.196286 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:16.196240 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-8445dbf85d-skl7d" podStartSLOduration=1.198415333 podStartE2EDuration="5.196227392s" totalImagesPullingTime="3.997812059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:41:16.194039264 +0000 UTC m=+417.436216419" watchObservedRunningTime="2026-07-29 18:41:16.196227392 +0000 UTC m=+417.438404548" Jul 29 18:41:22.131185 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:22.131156 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-8445dbf85d-skl7d" Jul 29 18:41:29.082271 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:29.082239 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:41:29.184914 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:29.184882 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:41:29.284292 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:29.284253 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:41:29.818932 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:29.818901 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:41:29.877793 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:29.877758 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:41:39.922285 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:39.922236 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:41:39.983106 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:39.983076 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:41:40.039771 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:40.039745 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:41:47.134438 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:41:47.134362 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-6c559f7cd9-5sqcz" Jul 29 18:44:19.168309 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:44:19.168284 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8mjg_6bd12426-d81c-40eb-ab01-ee24cbd47be2/ovn-acl-logging/0.log" Jul 29 18:44:19.169320 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:44:19.169305 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8mjg_6bd12426-d81c-40eb-ab01-ee24cbd47be2/ovn-acl-logging/0.log" Jul 29 18:47:46.595312 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:47:46.595234 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:49:19.198812 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:49:19.198734 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8mjg_6bd12426-d81c-40eb-ab01-ee24cbd47be2/ovn-acl-logging/0.log" Jul 29 18:49:19.201212 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:49:19.201193 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8mjg_6bd12426-d81c-40eb-ab01-ee24cbd47be2/ovn-acl-logging/0.log" Jul 29 18:51:20.154156 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:20.154124 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:51:20.241049 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:20.241019 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:51:40.362346 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:40.362307 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:51:40.512456 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:40.512411 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:51:40.613304 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:40.613203 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:51:43.273883 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:43.273830 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8cc84_c1f1308a-865e-4a0f-ad80-7a8602155966/global-pull-secret-syncer/0.log" Jul 29 18:51:43.427033 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:43.426990 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" Jul 29 18:51:43.560568 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:43.560460 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-190.ec2.internal_305d6500b5831efe5fa1deaa8b353f63/haproxy/0.log" Jul 29 18:51:46.564534 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:46.564484 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:51:46.776627 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:46.776585 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dqf5_15ad40c9-68c8-4602-8911-603bd60f8de3/konnectivity-agent/0.log" limit=1024 Jul 29 18:51:47.545922 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:47.545886 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5b88e03a-51a8-4750-b765-f5115214878d/alertmanager/0.log" Jul 29 18:51:47.574235 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:47.574206 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5b88e03a-51a8-4750-b765-f5115214878d/config-reloader/0.log" Jul 29 18:51:47.606746 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:47.606715 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5b88e03a-51a8-4750-b765-f5115214878d/kube-rbac-proxy-web/0.log" Jul 29 18:51:47.638594 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:47.638575 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5b88e03a-51a8-4750-b765-f5115214878d/kube-rbac-proxy/0.log" Jul 29 18:51:47.681277 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:47.681226 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5b88e03a-51a8-4750-b765-f5115214878d/kube-rbac-proxy-metric/0.log" Jul 29 18:51:47.711056 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:47.711035 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5b88e03a-51a8-4750-b765-f5115214878d/prom-label-proxy/0.log" Jul 29 18:51:47.754315 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:47.754292 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5b88e03a-51a8-4750-b765-f5115214878d/init-config-reloader/0.log" Jul 29 18:51:47.823115 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:47.823051 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-2cfx4_c8190cca-b804-457d-8db5-1dc89fe61e1d/cluster-monitoring-operator/0.log" Jul 29 18:51:47.983144 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:47.983115 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-xvbnz_0e644921-b0ea-4a01-9cf2-75af74d2f7f4/monitoring-plugin/0.log" Jul 29 18:51:48.215859 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:48.215831 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tsw7n_f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320/node-exporter/0.log" Jul 29 18:51:48.246801 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:48.246777 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tsw7n_f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320/kube-rbac-proxy/0.log" Jul 29 18:51:48.275194 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:48.275172 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tsw7n_f8dcbf30-cb3d-4f00-9d8c-8cbff78b3320/init-textfile/0.log" Jul 29 18:51:48.303459 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:48.303438 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-9p9z9_2a4adfc3-3297-4688-9122-4c8a6a588525/kube-rbac-proxy-main/0.log" Jul 29 18:51:48.328105 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:48.328086 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-9p9z9_2a4adfc3-3297-4688-9122-4c8a6a588525/kube-rbac-proxy-self/0.log" Jul 29 18:51:48.354951 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:48.354927 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-9p9z9_2a4adfc3-3297-4688-9122-4c8a6a588525/openshift-state-metrics/0.log" Jul 29 18:51:48.618852 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:48.618823 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-bffgm_5e56bdea-f7cf-48f2-8497-c79950514e4c/prometheus-operator/0.log" Jul 29 18:51:48.641653 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:48.641629 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-bffgm_5e56bdea-f7cf-48f2-8497-c79950514e4c/kube-rbac-proxy/0.log" Jul 29 18:51:51.276432 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:51.276392 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-2njf9_80336745-5e1f-4c2c-9901-d77c85536227/download-server/0.log" Jul 29 18:51:51.555008 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:51.554932 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qnpmm/perf-node-gather-daemonset-lc579"] Jul 29 18:51:51.557017 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:51.557000 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qnpmm/perf-node-gather-daemonset-lc579" Jul 29 18:51:51.560962 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:51.560940 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qnpmm\"/\"default-dockercfg-sm7jc\"" Jul 29 18:51:51.561060 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:51.560952 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qnpmm\"/\"kube-root-ca.crt\"" Jul 29 18:51:51.561698 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:51.561685 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qnpmm\"/\"openshift-service-ca.crt\"" Jul 29 18:51:51.567537 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:51.567489 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qnpmm/perf-node-gather-daemonset-lc579"] Jul 29 18:51:51.618838 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:51.618809 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fae88ea2-8087-4fc0-8e50-3ca7330badbc-lib-modules\") pod \"perf-node-gather-daemonset-lc579\" (UID: \"fae88ea2-8087-4fc0-8e50-3ca7330badbc\") " pod="openshift-must-gather-qnpmm/perf-node-gather-daemonset-lc579" Jul 29 18:51:51.618838 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:51.618838 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fae88ea2-8087-4fc0-8e50-3ca7330badbc-podres\") pod \"perf-node-gather-daemonset-lc579\" (UID: \"fae88ea2-8087-4fc0-8e50-3ca7330badbc\") " pod="openshift-must-gather-qnpmm/perf-node-gather-daemonset-lc579" Jul 29 18:51:51.619026 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:51.618874 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fae88ea2-8087-4fc0-8e50-3ca7330badbc-proc\") pod \"perf-node-gather-daemonset-lc579\" (UID: \"fae88ea2-8087-4fc0-8e50-3ca7330badbc\") " pod="openshift-must-gather-qnpmm/perf-node-gather-daemonset-lc579" Jul 29 18:51:51.619026 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:51.618901 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7xlj\" (UniqueName: \"kubernetes.io/projected/fae88ea2-8087-4fc0-8e50-3ca7330badbc-kube-api-access-w7xlj\") pod \"perf-node-gather-daemonset-lc579\" (UID: \"fae88ea2-8087-4fc0-8e50-3ca7330badbc\") " pod="openshift-must-gather-qnpmm/perf-node-gather-daemonset-lc579" Jul 29 18:51:51.619026 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:51.618929 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fae88ea2-8087-4fc0-8e50-3ca7330badbc-sys\") pod \"perf-node-gather-daemonset-lc579\" (UID: \"fae88ea2-8087-4fc0-8e50-3ca7330badbc\") " pod="openshift-must-gather-qnpmm/perf-node-gather-daemonset-lc579" Jul 29 18:51:51.719599 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:51.719569 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fae88ea2-8087-4fc0-8e50-3ca7330badbc-sys\") pod \"perf-node-gather-daemonset-lc579\" (UID: \"fae88ea2-8087-4fc0-8e50-3ca7330badbc\") " pod="openshift-must-gather-qnpmm/perf-node-gather-daemonset-lc579" Jul 29 18:51:51.719773 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:51.719630 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fae88ea2-8087-4fc0-8e50-3ca7330badbc-lib-modules\") pod \"perf-node-gather-daemonset-lc579\" (UID: \"fae88ea2-8087-4fc0-8e50-3ca7330badbc\") " pod="openshift-must-gather-qnpmm/perf-node-gather-daemonset-lc579" Jul 29 18:51:51.719773 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:51.719647 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fae88ea2-8087-4fc0-8e50-3ca7330badbc-podres\") pod \"perf-node-gather-daemonset-lc579\" (UID: \"fae88ea2-8087-4fc0-8e50-3ca7330badbc\") " pod="openshift-must-gather-qnpmm/perf-node-gather-daemonset-lc579" Jul 29 18:51:51.719773 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:51.719656 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fae88ea2-8087-4fc0-8e50-3ca7330badbc-sys\") pod \"perf-node-gather-daemonset-lc579\" (UID: \"fae88ea2-8087-4fc0-8e50-3ca7330badbc\") " pod="openshift-must-gather-qnpmm/perf-node-gather-daemonset-lc579" Jul 29 18:51:51.719773 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:51.719672 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fae88ea2-8087-4fc0-8e50-3ca7330badbc-proc\") pod \"perf-node-gather-daemonset-lc579\" (UID: \"fae88ea2-8087-4fc0-8e50-3ca7330badbc\") " pod="openshift-must-gather-qnpmm/perf-node-gather-daemonset-lc579" Jul 29 18:51:51.719773 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:51.719722 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fae88ea2-8087-4fc0-8e50-3ca7330badbc-proc\") pod \"perf-node-gather-daemonset-lc579\" (UID: \"fae88ea2-8087-4fc0-8e50-3ca7330badbc\") " pod="openshift-must-gather-qnpmm/perf-node-gather-daemonset-lc579" Jul 29 18:51:51.719773 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:51.719744 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7xlj\" (UniqueName: \"kubernetes.io/projected/fae88ea2-8087-4fc0-8e50-3ca7330badbc-kube-api-access-w7xlj\") pod \"perf-node-gather-daemonset-lc579\" (UID: \"fae88ea2-8087-4fc0-8e50-3ca7330badbc\") " pod="openshift-must-gather-qnpmm/perf-node-gather-daemonset-lc579" Jul 29 18:51:51.719773 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:51.719747 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fae88ea2-8087-4fc0-8e50-3ca7330badbc-podres\") pod \"perf-node-gather-daemonset-lc579\" (UID: \"fae88ea2-8087-4fc0-8e50-3ca7330badbc\") " pod="openshift-must-gather-qnpmm/perf-node-gather-daemonset-lc579" Jul 29 18:51:51.720028 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:51.719788 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fae88ea2-8087-4fc0-8e50-3ca7330badbc-lib-modules\") pod \"perf-node-gather-daemonset-lc579\" (UID: \"fae88ea2-8087-4fc0-8e50-3ca7330badbc\") " pod="openshift-must-gather-qnpmm/perf-node-gather-daemonset-lc579" Jul 29 18:51:51.728677 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:51.728657 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7xlj\" (UniqueName: \"kubernetes.io/projected/fae88ea2-8087-4fc0-8e50-3ca7330badbc-kube-api-access-w7xlj\") pod \"perf-node-gather-daemonset-lc579\" (UID: \"fae88ea2-8087-4fc0-8e50-3ca7330badbc\") " pod="openshift-must-gather-qnpmm/perf-node-gather-daemonset-lc579" Jul 29 18:51:51.853027 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:51.853003 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-x96sp_64b54268-b3fd-4a74-9ed7-a57e6883cb70/volume-data-source-validator/0.log" Jul 29 18:51:51.867775 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:51.867759 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qnpmm/perf-node-gather-daemonset-lc579" Jul 29 18:51:51.994271 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:51.994250 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qnpmm/perf-node-gather-daemonset-lc579"] Jul 29 18:51:51.997060 ip-10-0-135-190 kubenswrapper[2562]: W0729 18:51:51.997035 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfae88ea2_8087_4fc0_8e50_3ca7330badbc.slice/crio-fce82992ebe3ba9b8cfc0f5f87b393698396982446a7f3a6451c7aa5c66ac6f2 WatchSource:0}: Error finding container fce82992ebe3ba9b8cfc0f5f87b393698396982446a7f3a6451c7aa5c66ac6f2: Status 404 returned error can't find the container with id fce82992ebe3ba9b8cfc0f5f87b393698396982446a7f3a6451c7aa5c66ac6f2 Jul 29 18:51:52.812431 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:52.812397 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qnpmm/perf-node-gather-daemonset-lc579" event={"ID":"fae88ea2-8087-4fc0-8e50-3ca7330badbc","Type":"ContainerStarted","Data":"71f6b13c41ec8fb6259d6e42cc6a1e2ae68afb7957476eab3ffdc1cdbfa1d600"} Jul 29 18:51:52.812907 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:52.812444 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qnpmm/perf-node-gather-daemonset-lc579" event={"ID":"fae88ea2-8087-4fc0-8e50-3ca7330badbc","Type":"ContainerStarted","Data":"fce82992ebe3ba9b8cfc0f5f87b393698396982446a7f3a6451c7aa5c66ac6f2"} Jul 29 18:51:52.812907 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:52.812475 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qnpmm/perf-node-gather-daemonset-lc579" Jul 29 18:51:52.830076 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:52.830025 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qnpmm/perf-node-gather-daemonset-lc579" podStartSLOduration=1.830010315 podStartE2EDuration="1.830010315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:51:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:51:52.828256752 +0000 UTC m=+1054.070433920" watchObservedRunningTime="2026-07-29 18:51:52.830010315 +0000 UTC m=+1054.072187518" Jul 29 18:51:52.918901 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:52.918879 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h8pgd_bbd0aa69-cc0c-4c79-9460-26e246d285f1/dns/0.log" Jul 29 18:51:52.944984 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:52.944963 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h8pgd_bbd0aa69-cc0c-4c79-9460-26e246d285f1/kube-rbac-proxy/0.log" Jul 29 18:51:52.971225 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:52.971202 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-skm5p_9e7c71e3-553b-4508-a7e3-1e823a72af11/dns-node-resolver/0.log" Jul 29 18:51:53.484624 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:53.484598 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-68df6d685c-2662d_81fb55a1-fc39-4fe2-9892-96639ea676cf/registry/0.log" Jul 29 18:51:53.506359 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:53.506335 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5ddbt_5d933486-a30c-4f85-83ff-e1a190e2f95b/node-ca/0.log" Jul 29 18:51:54.812057 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:54.812025 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2gvrs_2ed6ab3b-0c74-4957-be43-c96816a41d1a/serve-healthcheck-canary/0.log" Jul 29 18:51:55.251572 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:55.251543 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-hlwzj_de51fc41-4f39-4224-9f3d-13f3e113a694/insights-operator/1.log" Jul 29 18:51:55.251862 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:55.251843 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-hlwzj_de51fc41-4f39-4224-9f3d-13f3e113a694/insights-operator/0.log" Jul 29 18:51:55.356297 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:55.356277 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l5mk5_a34ff964-79be-4feb-9960-a027467c77e7/kube-rbac-proxy/0.log" Jul 29 18:51:55.380965 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:55.380945 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l5mk5_a34ff964-79be-4feb-9960-a027467c77e7/exporter/0.log" Jul 29 18:51:55.407244 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:55.407222 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l5mk5_a34ff964-79be-4feb-9960-a027467c77e7/extractor/0.log" Jul 29 18:51:57.513523 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:57.513485 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-6c559f7cd9-5sqcz_53faeec6-14f7-46ec-a791-ecf398326ea5/manager/0.log" Jul 29 18:51:57.567611 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:57.567589 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-8445dbf85d-skl7d_0a9fc6eb-22c9-4881-baf2-1215ceda6ad9/seaweedfs/0.log" Jul 29 18:51:58.826479 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:51:58.826454 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qnpmm/perf-node-gather-daemonset-lc579" Jul 29 18:52:03.278292 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:52:03.278263 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q72xw_4092d9a7-0970-48af-9e09-e0cd691fcc02/kube-multus-additional-cni-plugins/0.log" Jul 29 18:52:03.302216 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:52:03.302150 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q72xw_4092d9a7-0970-48af-9e09-e0cd691fcc02/egress-router-binary-copy/0.log" Jul 29 18:52:03.327554 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:52:03.327529 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q72xw_4092d9a7-0970-48af-9e09-e0cd691fcc02/cni-plugins/0.log" Jul 29 18:52:03.350942 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:52:03.350921 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q72xw_4092d9a7-0970-48af-9e09-e0cd691fcc02/bond-cni-plugin/0.log" Jul 29 18:52:03.377396 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:52:03.377375 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q72xw_4092d9a7-0970-48af-9e09-e0cd691fcc02/routeoverride-cni/0.log" Jul 29 18:52:03.404741 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:52:03.404719 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q72xw_4092d9a7-0970-48af-9e09-e0cd691fcc02/whereabouts-cni-bincopy/0.log" Jul 29 18:52:03.427400 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:52:03.427383 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q72xw_4092d9a7-0970-48af-9e09-e0cd691fcc02/whereabouts-cni/0.log" Jul 29 18:52:03.697624 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:52:03.697595 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tzwxd_0ba5d633-3365-42f2-9956-0409775e3fa2/kube-multus/0.log" Jul 29 18:52:03.823075 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:52:03.823042 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w69sl_95f0df74-cd8c-4c76-ac89-62b675ce368f/network-metrics-daemon/0.log" Jul 29 18:52:03.845741 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:52:03.845714 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w69sl_95f0df74-cd8c-4c76-ac89-62b675ce368f/kube-rbac-proxy/0.log" Jul 29 18:52:04.628440 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:52:04.628410 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8mjg_6bd12426-d81c-40eb-ab01-ee24cbd47be2/ovn-controller/0.log" Jul 29 18:52:04.650210 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:52:04.650175 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8mjg_6bd12426-d81c-40eb-ab01-ee24cbd47be2/ovn-acl-logging/0.log" Jul 29 18:52:04.650468 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:52:04.650428 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8mjg_6bd12426-d81c-40eb-ab01-ee24cbd47be2/ovn-acl-logging/1.log" Jul 29 18:52:04.670032 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:52:04.670013 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8mjg_6bd12426-d81c-40eb-ab01-ee24cbd47be2/kube-rbac-proxy-node/0.log" Jul 29 18:52:04.694072 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:52:04.694050 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8mjg_6bd12426-d81c-40eb-ab01-ee24cbd47be2/kube-rbac-proxy-ovn-metrics/0.log" Jul 29 18:52:04.716227 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:52:04.716208 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8mjg_6bd12426-d81c-40eb-ab01-ee24cbd47be2/northd/0.log" Jul 29 18:52:04.738631 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:52:04.738611 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8mjg_6bd12426-d81c-40eb-ab01-ee24cbd47be2/nbdb/0.log" Jul 29 18:52:04.762144 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:52:04.762122 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8mjg_6bd12426-d81c-40eb-ab01-ee24cbd47be2/sbdb/0.log" Jul 29 18:52:04.817858 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:52:04.817837 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8mjg_6bd12426-d81c-40eb-ab01-ee24cbd47be2/ovnkube-controller/0.log" Jul 29 18:52:06.393563 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:52:06.393525 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-xtdjk_7961d8da-66e2-4b1b-9f5a-37beefbd47eb/network-check-target-container/0.log" Jul 29 18:52:07.331214 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:52:07.331186 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-44lqv_f54f65a5-9d9b-4516-8bd7-dc90f5e3dad6/iptables-alerter/0.log" Jul 29 18:52:08.079638 ip-10-0-135-190 kubenswrapper[2562]: I0729 18:52:08.079607 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-qgmsv_fe3ec65e-1d9e-4ab3-9a1c-078bca4e78de/tuned/0.log"