Jul 18 03:48:15.641516 ip-10-0-138-224 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 18 03:48:15.641525 ip-10-0-138-224 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 18 03:48:15.641532 ip-10-0-138-224 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 18 03:48:15.641839 ip-10-0-138-224 systemd[1]: Failed to start Kubernetes Kubelet. Jul 18 03:48:25.646509 ip-10-0-138-224 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 18 03:48:25.646526 ip-10-0-138-224 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 122e29c86adf48bfbb5edbab57fed2b5 -- Jul 18 03:49:57.719342 ip-10-0-138-224 systemd[1]: Starting Kubernetes Kubelet... Jul 18 03:49:58.173522 ip-10-0-138-224 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 18 03:49:58.173522 ip-10-0-138-224 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 18 03:49:58.173522 ip-10-0-138-224 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 18 03:49:58.173522 ip-10-0-138-224 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 18 03:49:58.173522 ip-10-0-138-224 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 18 03:49:58.174453 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.174374 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 18 03:49:58.179910 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.179894 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 03:49:58.179910 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.179909 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 03:49:58.179975 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.179915 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 03:49:58.179975 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.179920 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 03:49:58.179975 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.179923 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 03:49:58.179975 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.179927 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 03:49:58.179975 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.179930 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 03:49:58.179975 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.179933 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 03:49:58.179975 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.179937 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 03:49:58.179975 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.179940 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 03:49:58.179975 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.179943 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 03:49:58.179975 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.179945 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 03:49:58.179975 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.179952 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 03:49:58.179975 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.179956 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 03:49:58.179975 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.179960 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 03:49:58.179975 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.179963 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 03:49:58.179975 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.179967 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 03:49:58.179975 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.179969 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 03:49:58.179975 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.179972 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 03:49:58.179975 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.179975 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 03:49:58.179975 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.179978 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 03:49:58.180430 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.179980 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 03:49:58.180430 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.179984 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 03:49:58.180430 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.179986 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 03:49:58.180430 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.179989 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 03:49:58.180430 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.179993 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 03:49:58.180430 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.179997 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 03:49:58.180430 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180000 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 03:49:58.180430 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180003 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 03:49:58.180430 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180006 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 03:49:58.180430 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180008 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 03:49:58.180430 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180011 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 03:49:58.180430 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180014 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 03:49:58.180430 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180016 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 03:49:58.180430 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180019 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 03:49:58.180430 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180022 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 03:49:58.180430 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180025 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 03:49:58.180430 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180028 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 03:49:58.180430 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180030 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 03:49:58.180430 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180033 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 03:49:58.180430 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180035 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 03:49:58.180948 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180038 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 03:49:58.180948 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180040 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 03:49:58.180948 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180043 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 03:49:58.180948 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180046 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 03:49:58.180948 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180048 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 03:49:58.180948 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180051 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 03:49:58.180948 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180053 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 03:49:58.180948 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180056 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 03:49:58.180948 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180058 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 03:49:58.180948 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180074 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 03:49:58.180948 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180077 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 03:49:58.180948 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180080 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 03:49:58.180948 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180084 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 03:49:58.180948 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180088 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 03:49:58.180948 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180091 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 03:49:58.180948 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180094 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 03:49:58.180948 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180097 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 03:49:58.180948 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180099 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 03:49:58.180948 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180104 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 03:49:58.180948 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180106 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 03:49:58.181444 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180109 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 03:49:58.181444 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180112 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 03:49:58.181444 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180114 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 03:49:58.181444 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180117 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 03:49:58.181444 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180119 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 03:49:58.181444 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180122 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 03:49:58.181444 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180124 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 03:49:58.181444 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180127 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 03:49:58.181444 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180130 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 03:49:58.181444 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180132 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 03:49:58.181444 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180135 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 03:49:58.181444 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180137 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 03:49:58.181444 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180140 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 03:49:58.181444 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180142 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 03:49:58.181444 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180145 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 03:49:58.181444 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180148 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 03:49:58.181444 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180150 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 18 03:49:58.181444 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180153 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 03:49:58.181444 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180156 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 03:49:58.181444 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180158 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 03:49:58.181910 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180161 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 03:49:58.181910 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180163 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 03:49:58.181910 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180166 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 03:49:58.181910 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180169 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 03:49:58.181910 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180171 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 03:49:58.181910 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180176 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 03:49:58.181910 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180179 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 03:49:58.181910 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180182 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 03:49:58.181910 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180184 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 03:49:58.181910 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180187 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 03:49:58.181910 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180190 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 03:49:58.181910 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180192 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 03:49:58.181910 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180195 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 03:49:58.181910 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180197 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 03:49:58.181910 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180200 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 03:49:58.181910 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180202 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 03:49:58.181910 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180205 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 03:49:58.181910 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180207 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 03:49:58.181910 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180909 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 03:49:58.182363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180915 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 03:49:58.182363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180918 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 03:49:58.182363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180920 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 03:49:58.182363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180923 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 03:49:58.182363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180926 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 03:49:58.182363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180928 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 03:49:58.182363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180931 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 03:49:58.182363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180934 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 03:49:58.182363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180939 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 03:49:58.182363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180941 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 03:49:58.182363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180944 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 03:49:58.182363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180946 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 03:49:58.182363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180949 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 03:49:58.182363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180952 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 03:49:58.182363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180954 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 03:49:58.182363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180957 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 03:49:58.182363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180960 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 03:49:58.182363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180963 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 03:49:58.182363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180965 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 03:49:58.182840 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180969 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 03:49:58.182840 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180971 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 03:49:58.182840 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180974 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 03:49:58.182840 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180977 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 03:49:58.182840 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180981 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 03:49:58.182840 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180986 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 03:49:58.182840 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180989 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 03:49:58.182840 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180991 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 03:49:58.182840 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180994 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 03:49:58.182840 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.180997 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 03:49:58.182840 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181000 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 18 03:49:58.182840 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181002 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 03:49:58.182840 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181005 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 03:49:58.182840 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181008 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 03:49:58.182840 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181010 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 03:49:58.182840 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181013 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 03:49:58.182840 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181016 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 03:49:58.182840 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181018 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 03:49:58.182840 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181021 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 03:49:58.182840 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181023 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 03:49:58.183337 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181026 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 03:49:58.183337 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181029 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 03:49:58.183337 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181032 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 03:49:58.183337 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181035 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 03:49:58.183337 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181037 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 03:49:58.183337 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181039 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 03:49:58.183337 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181042 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 03:49:58.183337 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181046 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 03:49:58.183337 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181050 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 03:49:58.183337 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181055 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 03:49:58.183337 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181058 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 03:49:58.183337 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181079 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 03:49:58.183337 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181082 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 03:49:58.183337 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181085 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 03:49:58.183337 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181089 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 03:49:58.183337 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181092 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 03:49:58.183337 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181095 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 03:49:58.183337 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181098 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 03:49:58.183337 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181101 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 03:49:58.183850 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181104 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 03:49:58.183850 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181107 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 03:49:58.183850 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181110 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 03:49:58.183850 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181113 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 03:49:58.183850 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181115 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 03:49:58.183850 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181118 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 03:49:58.183850 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181120 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 03:49:58.183850 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181123 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 03:49:58.183850 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181125 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 03:49:58.183850 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181128 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 03:49:58.183850 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181130 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 03:49:58.183850 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181133 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 03:49:58.183850 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181138 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 03:49:58.183850 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181141 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 03:49:58.183850 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181144 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 03:49:58.183850 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181146 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 03:49:58.183850 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181150 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 03:49:58.183850 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181152 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 03:49:58.183850 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181155 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 03:49:58.183850 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181157 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 03:49:58.184345 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181160 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 03:49:58.184345 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181162 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 03:49:58.184345 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181165 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 03:49:58.184345 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181167 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 03:49:58.184345 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181171 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 03:49:58.184345 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181173 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 03:49:58.184345 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181176 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 03:49:58.184345 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181178 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 03:49:58.184345 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181181 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 03:49:58.184345 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181183 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 03:49:58.184345 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181186 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 03:49:58.184345 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181188 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 03:49:58.184345 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181191 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 03:49:58.184345 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181193 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 03:49:58.184345 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181196 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 03:49:58.184345 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181200 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 03:49:58.184345 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181202 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 03:49:58.184345 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181205 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 03:49:58.184345 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181208 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 03:49:58.184345 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181211 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 03:49:58.184820 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181596 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 03:49:58.184820 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181601 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 03:49:58.184820 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181604 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 03:49:58.184820 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181606 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 03:49:58.184820 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181611 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 03:49:58.184820 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181614 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 03:49:58.184820 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181616 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 03:49:58.184820 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181619 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 03:49:58.184820 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181622 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 03:49:58.184820 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181625 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 03:49:58.184820 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181628 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 03:49:58.184820 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181630 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 03:49:58.184820 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181633 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 03:49:58.184820 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181635 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 03:49:58.184820 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181638 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 03:49:58.184820 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181641 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 03:49:58.184820 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181643 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 03:49:58.184820 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181646 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 03:49:58.184820 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181649 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 03:49:58.184820 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181652 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 03:49:58.185311 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181654 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 03:49:58.185311 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181657 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 03:49:58.185311 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181660 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 03:49:58.185311 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181662 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 03:49:58.185311 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181665 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 18 03:49:58.185311 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181668 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 03:49:58.185311 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181670 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 03:49:58.185311 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181673 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 03:49:58.185311 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181675 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 03:49:58.185311 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181678 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 03:49:58.185311 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181680 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 03:49:58.185311 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181683 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 03:49:58.185311 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181685 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 03:49:58.185311 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181688 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 03:49:58.185311 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181690 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 03:49:58.185311 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181693 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 03:49:58.185311 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181697 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 03:49:58.185311 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181699 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 03:49:58.185311 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181702 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 03:49:58.185311 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181705 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 03:49:58.185790 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181707 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 03:49:58.185790 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181713 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 03:49:58.185790 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181718 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 03:49:58.185790 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181721 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 03:49:58.185790 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181724 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 03:49:58.185790 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181728 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 03:49:58.185790 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181731 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 03:49:58.185790 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181734 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 03:49:58.185790 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181736 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 03:49:58.185790 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181739 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 03:49:58.185790 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181741 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 03:49:58.185790 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181744 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 03:49:58.185790 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181746 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 03:49:58.185790 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181749 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 03:49:58.185790 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181752 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 03:49:58.185790 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181754 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 03:49:58.185790 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181756 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 03:49:58.185790 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181759 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 03:49:58.185790 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181762 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 03:49:58.186262 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181764 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 03:49:58.186262 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181767 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 03:49:58.186262 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181771 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 03:49:58.186262 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181774 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 03:49:58.186262 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181777 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 03:49:58.186262 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181780 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 03:49:58.186262 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181783 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 03:49:58.186262 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181786 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 03:49:58.186262 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181789 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 03:49:58.186262 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181793 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 03:49:58.186262 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181795 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 03:49:58.186262 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181799 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 03:49:58.186262 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181802 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 03:49:58.186262 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181804 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 03:49:58.186262 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181807 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 03:49:58.186262 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181816 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 03:49:58.186262 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181819 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 03:49:58.186262 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181821 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 03:49:58.186262 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181824 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 03:49:58.186763 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181826 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 03:49:58.186763 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181828 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 03:49:58.186763 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181831 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 03:49:58.186763 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181833 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 03:49:58.186763 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181836 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 03:49:58.186763 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181838 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 03:49:58.186763 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181841 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 03:49:58.186763 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181843 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 03:49:58.186763 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181846 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 03:49:58.186763 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181848 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 03:49:58.186763 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181851 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 03:49:58.186763 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181854 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 03:49:58.186763 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181856 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 03:49:58.186763 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181859 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 03:49:58.186763 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181862 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 03:49:58.186763 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181865 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 03:49:58.186763 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181867 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 03:49:58.186763 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181870 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 03:49:58.186763 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181873 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 03:49:58.187237 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181875 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 03:49:58.187237 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.181878 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 03:49:58.187237 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.181948 2558 flags.go:64] FLAG: --address="0.0.0.0" Jul 18 03:49:58.187237 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.181956 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 18 03:49:58.187237 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.181971 2558 flags.go:64] FLAG: --anonymous-auth="true" Jul 18 03:49:58.187237 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.181978 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 18 03:49:58.187237 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.181983 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 18 03:49:58.187237 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.181986 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 18 03:49:58.187237 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.181990 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 18 03:49:58.187237 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.181995 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 18 03:49:58.187237 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182004 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 18 03:49:58.187237 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182007 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 18 03:49:58.187237 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182011 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 18 03:49:58.187237 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182014 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 18 03:49:58.187237 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182017 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 18 03:49:58.187237 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182021 2558 flags.go:64] FLAG: --cgroup-root="" Jul 18 03:49:58.187237 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182024 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 18 03:49:58.187237 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182027 2558 flags.go:64] FLAG: --client-ca-file="" Jul 18 03:49:58.187237 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182030 2558 flags.go:64] FLAG: --cloud-provider="external" Jul 18 03:49:58.187237 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182032 2558 flags.go:64] FLAG: --cluster-dns="[]" Jul 18 03:49:58.187237 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182039 2558 flags.go:64] FLAG: --cluster-domain="" Jul 18 03:49:58.187237 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182042 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 18 03:49:58.187237 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182045 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 18 03:49:58.187237 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182048 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 18 03:49:58.187815 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182051 2558 flags.go:64] FLAG: --container-log-max-files="5" Jul 18 03:49:58.187815 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182055 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 18 03:49:58.187815 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182058 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 18 03:49:58.187815 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182076 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 18 03:49:58.187815 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182080 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 18 03:49:58.187815 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182083 2558 flags.go:64] FLAG: --contention-profiling="false" Jul 18 03:49:58.187815 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182086 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 18 03:49:58.187815 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182089 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 18 03:49:58.187815 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182092 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 18 03:49:58.187815 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182095 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 18 03:49:58.187815 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182100 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 18 03:49:58.187815 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182103 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 18 03:49:58.187815 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182106 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 18 03:49:58.187815 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182110 2558 flags.go:64] FLAG: --enable-load-reader="false" Jul 18 03:49:58.187815 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182113 2558 flags.go:64] FLAG: --enable-server="true" Jul 18 03:49:58.187815 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182116 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 18 03:49:58.187815 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182125 2558 flags.go:64] FLAG: --event-burst="100" Jul 18 03:49:58.187815 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182128 2558 flags.go:64] FLAG: --event-qps="50" Jul 18 03:49:58.187815 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182131 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 18 03:49:58.187815 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182137 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 18 03:49:58.187815 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182141 2558 flags.go:64] FLAG: --eviction-hard="" Jul 18 03:49:58.187815 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182145 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 18 03:49:58.187815 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182147 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 18 03:49:58.187815 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182150 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 18 03:49:58.187815 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182153 2558 flags.go:64] FLAG: --eviction-soft="" Jul 18 03:49:58.188497 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182156 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 18 03:49:58.188497 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182159 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 18 03:49:58.188497 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182163 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 18 03:49:58.188497 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182165 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jul 18 03:49:58.188497 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182168 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 18 03:49:58.188497 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182171 2558 flags.go:64] FLAG: --fail-swap-on="true" Jul 18 03:49:58.188497 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182174 2558 flags.go:64] FLAG: --feature-gates="" Jul 18 03:49:58.188497 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182178 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jul 18 03:49:58.188497 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182181 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 18 03:49:58.188497 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182184 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 18 03:49:58.188497 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182187 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 18 03:49:58.188497 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182190 2558 flags.go:64] FLAG: --healthz-port="10248" Jul 18 03:49:58.188497 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182193 2558 flags.go:64] FLAG: --help="false" Jul 18 03:49:58.188497 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182196 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-138-224.ec2.internal" Jul 18 03:49:58.188497 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182199 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 18 03:49:58.188497 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182202 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jul 18 03:49:58.188497 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182205 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 18 03:49:58.188497 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182209 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 18 03:49:58.188497 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182212 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 18 03:49:58.188497 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182215 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 18 03:49:58.188497 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182219 2558 flags.go:64] FLAG: --image-service-endpoint="" Jul 18 03:49:58.188497 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182222 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 18 03:49:58.188497 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182225 2558 flags.go:64] FLAG: --kube-api-burst="100" Jul 18 03:49:58.189133 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182228 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 18 03:49:58.189133 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182231 2558 flags.go:64] FLAG: --kube-api-qps="50" Jul 18 03:49:58.189133 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182234 2558 flags.go:64] FLAG: --kube-reserved="" Jul 18 03:49:58.189133 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182237 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 18 03:49:58.189133 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182240 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 18 03:49:58.189133 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182244 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jul 18 03:49:58.189133 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182247 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 18 03:49:58.189133 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182249 2558 flags.go:64] FLAG: --lock-file="" Jul 18 03:49:58.189133 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182252 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 18 03:49:58.189133 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182255 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 18 03:49:58.189133 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182258 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 18 03:49:58.189133 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182264 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jul 18 03:49:58.189133 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182267 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 18 03:49:58.189133 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182270 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jul 18 03:49:58.189133 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182272 2558 flags.go:64] FLAG: --logging-format="text" Jul 18 03:49:58.189133 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182275 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 18 03:49:58.189133 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182279 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 18 03:49:58.189133 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182282 2558 flags.go:64] FLAG: --manifest-url="" Jul 18 03:49:58.189133 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182285 2558 flags.go:64] FLAG: --manifest-url-header="" Jul 18 03:49:58.189133 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182289 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 18 03:49:58.189133 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182292 2558 flags.go:64] FLAG: --max-open-files="1000000" Jul 18 03:49:58.189133 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182296 2558 flags.go:64] FLAG: --max-pods="110" Jul 18 03:49:58.189133 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182299 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 18 03:49:58.189133 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182302 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 18 03:49:58.189133 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182304 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jul 18 03:49:58.189740 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182307 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 18 03:49:58.189740 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182310 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 18 03:49:58.189740 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182313 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 18 03:49:58.189740 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182316 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 18 03:49:58.189740 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182324 2558 flags.go:64] FLAG: --node-status-max-images="50" Jul 18 03:49:58.189740 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182328 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 18 03:49:58.189740 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182331 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jul 18 03:49:58.189740 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182334 2558 flags.go:64] FLAG: --pod-cidr="" Jul 18 03:49:58.189740 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182337 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 18 03:49:58.189740 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182342 2558 flags.go:64] FLAG: --pod-manifest-path="" Jul 18 03:49:58.189740 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182345 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jul 18 03:49:58.189740 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182348 2558 flags.go:64] FLAG: --pods-per-core="0" Jul 18 03:49:58.189740 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182352 2558 flags.go:64] FLAG: --port="10250" Jul 18 03:49:58.189740 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182355 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 18 03:49:58.189740 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182358 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-025b1beca919c77f1" Jul 18 03:49:58.189740 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182361 2558 flags.go:64] FLAG: --qos-reserved="" Jul 18 03:49:58.189740 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182364 2558 flags.go:64] FLAG: --read-only-port="10255" Jul 18 03:49:58.189740 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182367 2558 flags.go:64] FLAG: --register-node="true" Jul 18 03:49:58.189740 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182370 2558 flags.go:64] FLAG: --register-with-taints="" Jul 18 03:49:58.189740 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182374 2558 flags.go:64] FLAG: --registry-burst="10" Jul 18 03:49:58.189740 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182377 2558 flags.go:64] FLAG: --registry-qps="5" Jul 18 03:49:58.189740 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182380 2558 flags.go:64] FLAG: --reserved-cpus="" Jul 18 03:49:58.189740 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182383 2558 flags.go:64] FLAG: --reserved-memory="" Jul 18 03:49:58.189740 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182386 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 18 03:49:58.189740 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182389 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 18 03:49:58.190354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182392 2558 flags.go:64] FLAG: --rotate-certificates="false" Jul 18 03:49:58.190354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182395 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 18 03:49:58.190354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182398 2558 flags.go:64] FLAG: --runonce="false" Jul 18 03:49:58.190354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182401 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 18 03:49:58.190354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182405 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 18 03:49:58.190354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182408 2558 flags.go:64] FLAG: --seccomp-default="false" Jul 18 03:49:58.190354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182411 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 18 03:49:58.190354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182414 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 18 03:49:58.190354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182417 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 18 03:49:58.190354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182421 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 18 03:49:58.190354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182425 2558 flags.go:64] FLAG: --storage-driver-password="root" Jul 18 03:49:58.190354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182428 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jul 18 03:49:58.190354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182432 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jul 18 03:49:58.190354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182435 2558 flags.go:64] FLAG: --storage-driver-user="root" Jul 18 03:49:58.190354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182438 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 18 03:49:58.190354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182442 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 18 03:49:58.190354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182445 2558 flags.go:64] FLAG: --system-cgroups="" Jul 18 03:49:58.190354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182448 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 18 03:49:58.190354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182453 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 18 03:49:58.190354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182456 2558 flags.go:64] FLAG: --tls-cert-file="" Jul 18 03:49:58.190354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182460 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 18 03:49:58.190354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182466 2558 flags.go:64] FLAG: --tls-min-version="" Jul 18 03:49:58.190354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182469 2558 flags.go:64] FLAG: --tls-private-key-file="" Jul 18 03:49:58.190354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182473 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jul 18 03:49:58.190354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182475 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 18 03:49:58.190949 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182478 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jul 18 03:49:58.190949 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182481 2558 flags.go:64] FLAG: --v="2" Jul 18 03:49:58.190949 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182485 2558 flags.go:64] FLAG: --version="false" Jul 18 03:49:58.190949 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182489 2558 flags.go:64] FLAG: --vmodule="" Jul 18 03:49:58.190949 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182498 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 18 03:49:58.190949 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182502 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 18 03:49:58.190949 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182622 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 03:49:58.190949 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182625 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 03:49:58.190949 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182629 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 03:49:58.190949 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182631 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 03:49:58.190949 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182634 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 03:49:58.190949 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182637 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 03:49:58.190949 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182639 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 03:49:58.190949 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182642 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 03:49:58.190949 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182644 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 03:49:58.190949 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182647 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 03:49:58.190949 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182652 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 03:49:58.190949 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182654 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 03:49:58.190949 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182657 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 03:49:58.190949 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182661 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 03:49:58.190949 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182664 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 03:49:58.191470 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182666 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 03:49:58.191470 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182669 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 03:49:58.191470 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182672 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 03:49:58.191470 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182674 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 03:49:58.191470 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182677 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 03:49:58.191470 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182680 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 03:49:58.191470 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182683 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 03:49:58.191470 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182686 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 03:49:58.191470 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182689 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 03:49:58.191470 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182691 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 03:49:58.191470 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182694 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 03:49:58.191470 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182697 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 03:49:58.191470 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182700 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 03:49:58.191470 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182703 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 03:49:58.191470 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182706 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 03:49:58.191470 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182708 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 03:49:58.191470 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182711 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 03:49:58.191470 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182713 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 03:49:58.191470 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182716 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 03:49:58.191929 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182718 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 03:49:58.191929 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182721 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 03:49:58.191929 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182724 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 03:49:58.191929 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182726 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 03:49:58.191929 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182729 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 03:49:58.191929 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182732 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 03:49:58.191929 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182734 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 03:49:58.191929 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182737 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 03:49:58.191929 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182741 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 03:49:58.191929 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182743 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 03:49:58.191929 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182746 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 03:49:58.191929 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182750 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 03:49:58.191929 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182753 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 03:49:58.191929 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182756 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 03:49:58.191929 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182758 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 03:49:58.191929 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182761 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 03:49:58.191929 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182765 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 03:49:58.191929 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182769 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 03:49:58.191929 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182771 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 03:49:58.192412 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182774 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 03:49:58.192412 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182777 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 03:49:58.192412 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182780 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 03:49:58.192412 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182782 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 03:49:58.192412 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182785 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 03:49:58.192412 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182788 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 03:49:58.192412 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182791 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 03:49:58.192412 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182793 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 03:49:58.192412 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182796 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 03:49:58.192412 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182798 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 03:49:58.192412 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182801 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 03:49:58.192412 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182803 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 03:49:58.192412 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182806 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 03:49:58.192412 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182809 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 03:49:58.192412 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182811 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 03:49:58.192412 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182814 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 03:49:58.192412 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182817 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 03:49:58.192412 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182821 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 03:49:58.192412 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182823 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 03:49:58.192412 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182826 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 18 03:49:58.192918 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182828 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 03:49:58.192918 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182833 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 03:49:58.192918 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182835 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 03:49:58.192918 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182838 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 03:49:58.192918 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182843 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 03:49:58.192918 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182847 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 03:49:58.192918 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182850 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 03:49:58.192918 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182853 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 03:49:58.192918 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182856 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 03:49:58.192918 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182859 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 03:49:58.192918 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182862 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 03:49:58.192918 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182865 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 03:49:58.192918 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182868 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 03:49:58.192918 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182870 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 03:49:58.192918 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182873 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 03:49:58.192918 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182876 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 03:49:58.192918 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182879 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 03:49:58.192918 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182881 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 03:49:58.192918 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182884 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 03:49:58.192918 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182886 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 03:49:58.193424 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182889 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 03:49:58.193424 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182892 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 03:49:58.193424 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182894 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 03:49:58.193424 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182897 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 03:49:58.193424 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182899 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 03:49:58.193424 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.182902 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 03:49:58.193424 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.182907 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 18 03:49:58.193424 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.189781 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 18 03:49:58.193424 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.189798 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 18 03:49:58.193424 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.189819 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 18 03:49:58.193424 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.189829 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 18 03:49:58.193424 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189884 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 03:49:58.193424 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189889 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 03:49:58.193424 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189893 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 03:49:58.193803 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189897 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 03:49:58.193803 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189901 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 03:49:58.193803 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189904 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 18 03:49:58.193803 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189907 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 03:49:58.193803 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189910 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 03:49:58.193803 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189913 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 03:49:58.193803 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189916 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 03:49:58.193803 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189918 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 03:49:58.193803 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189922 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 03:49:58.193803 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189924 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 03:49:58.193803 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189927 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 03:49:58.193803 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189930 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 03:49:58.193803 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189932 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 03:49:58.193803 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189935 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 03:49:58.193803 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189938 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 03:49:58.193803 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189941 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 03:49:58.193803 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189944 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 03:49:58.193803 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189947 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 03:49:58.193803 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189949 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 03:49:58.193803 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189952 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 03:49:58.194363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189954 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 03:49:58.194363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189957 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 03:49:58.194363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189960 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 03:49:58.194363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189963 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 03:49:58.194363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189966 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 03:49:58.194363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189969 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 03:49:58.194363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189973 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 03:49:58.194363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189975 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 03:49:58.194363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189978 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 03:49:58.194363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189981 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 03:49:58.194363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189983 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 03:49:58.194363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189986 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 03:49:58.194363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189988 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 03:49:58.194363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189991 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 03:49:58.194363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189994 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 03:49:58.194363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189996 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 03:49:58.194363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.189999 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 03:49:58.194363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190001 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 03:49:58.194363 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190004 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 03:49:58.194839 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190007 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 03:49:58.194839 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190009 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 03:49:58.194839 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190012 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 03:49:58.194839 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190014 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 03:49:58.194839 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190017 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 03:49:58.194839 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190019 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 03:49:58.194839 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190022 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 03:49:58.194839 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190025 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 03:49:58.194839 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190028 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 03:49:58.194839 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190031 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 03:49:58.194839 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190033 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 03:49:58.194839 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190036 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 03:49:58.194839 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190039 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 03:49:58.194839 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190041 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 03:49:58.194839 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190045 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 03:49:58.194839 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190048 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 03:49:58.194839 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190052 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 03:49:58.194839 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190056 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 03:49:58.194839 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190059 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 03:49:58.195329 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190079 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 03:49:58.195329 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190083 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 03:49:58.195329 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190086 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 03:49:58.195329 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190088 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 03:49:58.195329 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190091 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 03:49:58.195329 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190094 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 03:49:58.195329 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190097 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 03:49:58.195329 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190099 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 03:49:58.195329 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190102 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 03:49:58.195329 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190104 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 03:49:58.195329 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190107 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 03:49:58.195329 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190110 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 03:49:58.195329 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190113 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 03:49:58.195329 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190116 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 03:49:58.195329 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190118 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 03:49:58.195329 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190121 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 03:49:58.195329 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190123 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 03:49:58.195329 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190125 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 03:49:58.195329 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190128 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 03:49:58.195329 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190131 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 03:49:58.195830 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190134 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 03:49:58.195830 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190136 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 03:49:58.195830 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190139 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 03:49:58.195830 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190141 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 03:49:58.195830 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190144 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 03:49:58.195830 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190146 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 03:49:58.195830 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190149 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 03:49:58.195830 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190151 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 03:49:58.195830 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190154 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 03:49:58.195830 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190157 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 03:49:58.195830 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190160 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 03:49:58.195830 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190163 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 03:49:58.195830 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190165 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 03:49:58.195830 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190168 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 03:49:58.195830 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190172 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 03:49:58.195830 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190174 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 03:49:58.195830 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190177 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 03:49:58.195830 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190179 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 03:49:58.196330 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.190184 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 18 03:49:58.196330 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190309 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 03:49:58.196330 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190315 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 03:49:58.196330 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190318 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 03:49:58.196330 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190322 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 03:49:58.196330 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190325 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 03:49:58.196330 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190328 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 03:49:58.196330 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190331 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 03:49:58.196330 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190333 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 03:49:58.196330 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190336 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 03:49:58.196330 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190339 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 03:49:58.196330 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190341 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 03:49:58.196330 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190344 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 03:49:58.196330 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190347 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 03:49:58.196330 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190349 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 03:49:58.196699 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190352 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 03:49:58.196699 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190354 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 03:49:58.196699 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190357 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 03:49:58.196699 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190359 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 03:49:58.196699 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190362 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 03:49:58.196699 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190364 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 03:49:58.196699 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190367 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 03:49:58.196699 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190370 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 03:49:58.196699 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190373 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 03:49:58.196699 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190375 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 03:49:58.196699 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190377 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 03:49:58.196699 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190380 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 03:49:58.196699 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190383 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 03:49:58.196699 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190385 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 03:49:58.196699 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190389 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 03:49:58.196699 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190391 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 03:49:58.196699 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190394 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 03:49:58.196699 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190397 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 03:49:58.196699 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190401 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 03:49:58.197162 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190404 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 03:49:58.197162 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190407 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 03:49:58.197162 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190409 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 03:49:58.197162 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190412 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 03:49:58.197162 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190414 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 03:49:58.197162 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190418 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 03:49:58.197162 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190421 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 03:49:58.197162 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190425 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 03:49:58.197162 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190429 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 03:49:58.197162 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190432 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 03:49:58.197162 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190435 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 03:49:58.197162 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190439 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 03:49:58.197162 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190442 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 03:49:58.197162 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190445 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 03:49:58.197162 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190447 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 03:49:58.197162 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190450 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 03:49:58.197162 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190452 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 03:49:58.197162 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190455 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 03:49:58.197162 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190457 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 03:49:58.197706 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190460 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 03:49:58.197706 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190462 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 03:49:58.197706 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190465 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 03:49:58.197706 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190467 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 03:49:58.197706 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190470 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 03:49:58.197706 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190472 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 03:49:58.197706 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190475 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 03:49:58.197706 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190477 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 03:49:58.197706 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190480 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 03:49:58.197706 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190483 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 03:49:58.197706 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190485 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 03:49:58.197706 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190488 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 03:49:58.197706 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190490 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 03:49:58.197706 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190493 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 03:49:58.197706 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190495 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 03:49:58.197706 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190498 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 18 03:49:58.197706 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190500 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 03:49:58.197706 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190503 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 03:49:58.197706 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190505 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 03:49:58.197706 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190507 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 03:49:58.198488 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190510 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 03:49:58.198488 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190512 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 03:49:58.198488 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190515 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 03:49:58.198488 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190517 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 03:49:58.198488 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190520 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 03:49:58.198488 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190522 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 03:49:58.198488 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190525 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 03:49:58.198488 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190528 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 03:49:58.198488 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190530 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 03:49:58.198488 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190533 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 03:49:58.198488 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190535 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 03:49:58.198488 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190537 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 03:49:58.198488 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190540 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 03:49:58.198488 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190542 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 03:49:58.198488 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190545 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 03:49:58.198488 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190547 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 03:49:58.198488 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190550 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 03:49:58.198488 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190552 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 03:49:58.198488 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190555 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 03:49:58.198488 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190557 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 03:49:58.199114 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190560 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 03:49:58.199114 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190562 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 03:49:58.199114 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190565 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 03:49:58.199114 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190568 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 03:49:58.199114 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190571 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 03:49:58.199114 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190573 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 03:49:58.199114 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:49:58.190575 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 03:49:58.199114 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.190580 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 18 03:49:58.199114 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.190697 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jul 18 03:49:58.199114 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.193322 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 18 03:49:58.199114 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.194857 2558 server.go:1019] "Starting client certificate rotation" Jul 18 03:49:58.199114 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.194957 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 18 03:49:58.199114 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.194988 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 18 03:49:58.199552 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.199526 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 18 03:49:58.201415 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.201399 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 18 03:49:58.215358 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.215340 2558 log.go:25] "Validated CRI v1 runtime API" Jul 18 03:49:58.217859 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.217844 2558 log.go:25] "Validated CRI v1 image API" Jul 18 03:49:58.218710 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.218693 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 18 03:49:58.221346 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.221318 2558 fs.go:135] Filesystem UUIDs: map[0ccc1ed0-0291-4ddd-91fb-e192f66c7d6a:/dev/nvme0n1p4 16ce5aed-f941-447c-bcd7-fb49a3195bbd:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 18 03:49:58.221417 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.221345 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 18 03:49:58.224554 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.224522 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 18 03:49:58.225844 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.225730 2558 manager.go:216] Machine: {Timestamp:2026-07-18 03:49:58.225240552 +0000 UTC m=+0.374746670 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104411 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b68e5ca4ea36a2fdd78be214c543e SystemUUID:ec2b68e5-ca4e-a36a-2fdd-78be214c543e BootID:122e29c8-6adf-48bf-bb5e-dbab57fed2b5 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b1:ef:a0:5a:f9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b1:ef:a0:5a:f9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:ea:db:25:7d:d1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 18 03:49:58.225844 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.225836 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 18 03:49:58.226013 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.225996 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 18 03:49:58.229585 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.229556 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 18 03:49:58.229752 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.229589 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-224.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 18 03:49:58.230433 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.230421 2558 topology_manager.go:138] "Creating topology manager with none policy" Jul 18 03:49:58.230495 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.230439 2558 container_manager_linux.go:309] "Creating device plugin manager" Jul 18 03:49:58.230495 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.230450 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 18 03:49:58.231549 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.231531 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 18 03:49:58.233483 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.233471 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 18 03:49:58.238623 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.238608 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 18 03:49:58.238769 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.238757 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 18 03:49:58.238826 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.238801 2558 kubelet.go:486] "Attempting to sync node with API server" Jul 18 03:49:58.238826 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.238821 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 18 03:49:58.238912 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.238836 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 18 03:49:58.238912 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.238851 2558 kubelet.go:398] "Adding apiserver pod source" Jul 18 03:49:58.238912 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.238864 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 18 03:49:58.239359 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.239323 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 18 03:49:58.239437 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.239364 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 18 03:49:58.241880 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.241852 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 18 03:49:58.244389 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.244367 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 18 03:49:58.244472 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.244416 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 18 03:49:58.245333 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.245315 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 18 03:49:58.245409 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.245342 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 18 03:49:58.245409 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.245355 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 18 03:49:58.245409 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.245364 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 18 03:49:58.245409 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.245379 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 18 03:49:58.245409 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.245391 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 18 03:49:58.245409 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.245404 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 18 03:49:58.245652 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.245414 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 18 03:49:58.245652 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.245432 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 18 03:49:58.245652 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.245442 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 18 03:49:58.245652 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.245455 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 18 03:49:58.245652 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.245463 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 18 03:49:58.246440 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.246423 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 18 03:49:58.246518 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.246455 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 18 03:49:58.249395 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.249376 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-224.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 18 03:49:58.249477 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:49:58.249374 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 18 03:49:58.249519 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:49:58.249506 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-224.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 18 03:49:58.250290 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.250276 2558 server.go:1268] "Started kubelet" Jul 18 03:49:58.250357 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.250335 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 18 03:49:58.250428 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.250366 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 18 03:49:58.250486 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.250468 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 18 03:49:58.251142 ip-10-0-138-224 systemd[1]: Started Kubernetes Kubelet. Jul 18 03:49:58.251974 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.251929 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 18 03:49:58.252315 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.252299 2558 server.go:310] "Adding debug handlers to kubelet server" Jul 18 03:49:58.255247 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:49:58.255228 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 18 03:49:58.259732 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:49:58.258651 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-224.ec2.internal.18c345c6f8e1cec6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-224.ec2.internal,UID:ip-10-0-138-224.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-224.ec2.internal,},FirstTimestamp:2026-07-18 03:49:58.250237638 +0000 UTC m=+0.399743756,LastTimestamp:2026-07-18 03:49:58.250237638 +0000 UTC m=+0.399743756,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-224.ec2.internal,}" Jul 18 03:49:58.262145 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.262129 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 18 03:49:58.262221 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.262148 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 18 03:49:58.262273 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:49:58.262225 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-224.ec2.internal\" not found" Jul 18 03:49:58.262883 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.262863 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 18 03:49:58.262974 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.262895 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 18 03:49:58.263029 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.262969 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 18 03:49:58.263029 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.262975 2558 reconstruct.go:97] "Volume reconstruction finished" Jul 18 03:49:58.263029 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.262999 2558 reconciler.go:29] "Reconciler: start to sync state" Jul 18 03:49:58.263354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.263328 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 18 03:49:58.263354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.263346 2558 factory.go:55] Registering systemd factory Jul 18 03:49:58.263354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.263356 2558 factory.go:223] Registration of the systemd container factory successfully Jul 18 03:49:58.263585 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.263560 2558 factory.go:153] Registering CRI-O factory Jul 18 03:49:58.263585 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.263580 2558 factory.go:223] Registration of the crio container factory successfully Jul 18 03:49:58.263660 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.263605 2558 factory.go:103] Registering Raw factory Jul 18 03:49:58.263660 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.263621 2558 manager.go:1196] Started watching for new ooms in manager Jul 18 03:49:58.264023 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.264006 2558 manager.go:349] Starting recovery of all containers Jul 18 03:49:58.264777 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:49:58.264605 2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-224.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 18 03:49:58.264777 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:49:58.264721 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 18 03:49:58.269391 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.269361 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7z5rt" Jul 18 03:49:58.275789 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.275771 2558 manager.go:354] Recovery completed Jul 18 03:49:58.276546 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.276499 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7z5rt" Jul 18 03:49:58.280865 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.280849 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 03:49:58.282719 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.282701 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-224.ec2.internal" event="NodeHasSufficientMemory" Jul 18 03:49:58.282801 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.282735 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-224.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 03:49:58.282801 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.282749 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-224.ec2.internal" event="NodeHasSufficientPID" Jul 18 03:49:58.283302 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.283287 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 18 03:49:58.283302 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.283297 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 03:49:58.283302 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.283300 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 18 03:49:58.283451 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.283316 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 18 03:49:58.283986 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.283973 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-224.ec2.internal" event="NodeHasSufficientMemory" Jul 18 03:49:58.284030 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.284001 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-224.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 03:49:58.284030 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.284014 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-224.ec2.internal" event="NodeHasSufficientPID" Jul 18 03:49:58.284726 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:49:58.284659 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-224.ec2.internal.18c345c6fad16bc4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-224.ec2.internal,UID:ip-10-0-138-224.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-224.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-224.ec2.internal,},FirstTimestamp:2026-07-18 03:49:58.282718148 +0000 UTC m=+0.432224273,LastTimestamp:2026-07-18 03:49:58.282718148 +0000 UTC m=+0.432224273,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-224.ec2.internal,}" Jul 18 03:49:58.285261 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.285249 2558 policy_none.go:49] "None policy: Start" Jul 18 03:49:58.285300 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.285266 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 18 03:49:58.285300 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.285277 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 18 03:49:58.287244 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.287233 2558 policy_none.go:47] "Start" Jul 18 03:49:58.342703 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.328602 2558 manager.go:337] "Starting Device Plugin manager" Jul 18 03:49:58.342703 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:49:58.328836 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 18 03:49:58.342703 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.328850 2558 server.go:87] "Starting device plugin registration server" Jul 18 03:49:58.342703 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.329124 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 18 03:49:58.342703 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.329137 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 18 03:49:58.342703 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.329227 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 18 03:49:58.342703 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.329312 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 18 03:49:58.342703 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.329320 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 18 03:49:58.342703 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:49:58.329874 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 18 03:49:58.342703 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:49:58.329915 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-224.ec2.internal\" not found" Jul 18 03:49:58.370419 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.370392 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 18 03:49:58.371539 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.371520 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 18 03:49:58.371607 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.371580 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 18 03:49:58.371607 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.371605 2558 kubelet.go:2448] "Starting kubelet main sync loop" Jul 18 03:49:58.371691 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:49:58.371645 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 18 03:49:58.373787 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.373765 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 03:49:58.429693 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.429605 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 03:49:58.430574 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.430558 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-224.ec2.internal" event="NodeHasSufficientMemory" Jul 18 03:49:58.430660 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.430590 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-224.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 03:49:58.430660 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.430601 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-224.ec2.internal" event="NodeHasSufficientPID" Jul 18 03:49:58.430660 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.430626 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-224.ec2.internal" Jul 18 03:49:58.441438 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.441423 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-224.ec2.internal" Jul 18 03:49:58.441517 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:49:58.441444 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-224.ec2.internal\": node \"ip-10-0-138-224.ec2.internal\" not found" Jul 18 03:49:58.464697 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:49:58.464675 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-224.ec2.internal\" not found" Jul 18 03:49:58.472580 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.472547 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-224.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-224.ec2.internal"] Jul 18 03:49:58.472649 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.472617 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 03:49:58.473979 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.473960 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-224.ec2.internal" event="NodeHasSufficientMemory" Jul 18 03:49:58.474088 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.473989 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-224.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 03:49:58.474088 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.473999 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-224.ec2.internal" event="NodeHasSufficientPID" Jul 18 03:49:58.476174 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.476162 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 03:49:58.476276 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.476260 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-224.ec2.internal" Jul 18 03:49:58.476326 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.476292 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 03:49:58.476884 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.476870 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-224.ec2.internal" event="NodeHasSufficientMemory" Jul 18 03:49:58.476948 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.476892 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-224.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 03:49:58.476948 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.476903 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-224.ec2.internal" event="NodeHasSufficientPID" Jul 18 03:49:58.477011 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.476945 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-224.ec2.internal" event="NodeHasSufficientMemory" Jul 18 03:49:58.477011 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.476971 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-224.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 03:49:58.477011 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.476982 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-224.ec2.internal" event="NodeHasSufficientPID" Jul 18 03:49:58.479170 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.479153 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-224.ec2.internal" Jul 18 03:49:58.479239 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.479188 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 03:49:58.479889 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.479870 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-224.ec2.internal" event="NodeHasSufficientMemory" Jul 18 03:49:58.479986 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.479901 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-224.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 03:49:58.479986 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:49:58.479915 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-224.ec2.internal" event="NodeHasSufficientPID" Jul 18 03:49:58.490656 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:49:58.490638 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-224.ec2.internal\" not found" node="ip-10-0-138-224.ec2.internal" Jul 18 03:49:58.493963 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:49:58.493948 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-224.ec2.internal\" not found" node="ip-10-0-138-224.ec2.internal" Jul 18 03:49:59.953653 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:49:59.953635 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-224.ec2.internal\" not found" Jul 18 03:50:00.052061 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:00.052025 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/90a4a6eaac46277c0148bd75d4544ffb-config\") pod \"kube-apiserver-proxy-ip-10-0-138-224.ec2.internal\" (UID: \"90a4a6eaac46277c0148bd75d4544ffb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-224.ec2.internal" Jul 18 03:50:00.052170 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:00.052065 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c721835e4e909ab98512834ab0e67c6f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-224.ec2.internal\" (UID: \"c721835e4e909ab98512834ab0e67c6f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-224.ec2.internal" Jul 18 03:50:00.052170 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:00.052084 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c721835e4e909ab98512834ab0e67c6f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-224.ec2.internal\" (UID: \"c721835e4e909ab98512834ab0e67c6f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-224.ec2.internal" Jul 18 03:50:00.054079 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:00.054062 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-224.ec2.internal\" not found" Jul 18 03:50:00.152817 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:00.152748 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/90a4a6eaac46277c0148bd75d4544ffb-config\") pod \"kube-apiserver-proxy-ip-10-0-138-224.ec2.internal\" (UID: \"90a4a6eaac46277c0148bd75d4544ffb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-224.ec2.internal" Jul 18 03:50:00.152817 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:00.152791 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c721835e4e909ab98512834ab0e67c6f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-224.ec2.internal\" (UID: \"c721835e4e909ab98512834ab0e67c6f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-224.ec2.internal" Jul 18 03:50:00.152817 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:00.152808 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c721835e4e909ab98512834ab0e67c6f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-224.ec2.internal\" (UID: \"c721835e4e909ab98512834ab0e67c6f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-224.ec2.internal" Jul 18 03:50:00.152972 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:00.152850 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c721835e4e909ab98512834ab0e67c6f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-224.ec2.internal\" (UID: \"c721835e4e909ab98512834ab0e67c6f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-224.ec2.internal" Jul 18 03:50:00.152972 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:00.152859 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/90a4a6eaac46277c0148bd75d4544ffb-config\") pod \"kube-apiserver-proxy-ip-10-0-138-224.ec2.internal\" (UID: \"90a4a6eaac46277c0148bd75d4544ffb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-224.ec2.internal" Jul 18 03:50:00.152972 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:00.152868 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c721835e4e909ab98512834ab0e67c6f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-224.ec2.internal\" (UID: \"c721835e4e909ab98512834ab0e67c6f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-224.ec2.internal" Jul 18 03:50:00.154845 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:00.154824 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-224.ec2.internal\" not found" Jul 18 03:50:00.180042 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:00.180020 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-224.ec2.internal" Jul 18 03:50:00.184895 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:00.184638 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-224.ec2.internal" Jul 18 03:50:00.255363 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:00.255330 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-224.ec2.internal\" not found" Jul 18 03:50:00.355916 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:00.355884 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-224.ec2.internal\" not found" Jul 18 03:50:00.456474 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:00.456389 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-224.ec2.internal\" not found" Jul 18 03:50:00.556953 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:00.556915 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-224.ec2.internal\" not found" Jul 18 03:50:00.577214 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:00.577183 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 03:50:00.582092 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:00.582072 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 18 03:50:00.582217 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:00.582200 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 18 03:50:00.582253 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:00.582226 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 18 03:50:00.657254 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:00.657223 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-224.ec2.internal\" not found" Jul 18 03:50:00.671400 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:00.671366 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-17 03:44:59 +0000 UTC" deadline="2028-03-06 05:13:45.620068225 +0000 UTC" Jul 18 03:50:00.671400 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:00.671397 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14329h23m44.948674387s" Jul 18 03:50:00.758117 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:00.758055 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-224.ec2.internal\" not found" Jul 18 03:50:00.792894 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:50:00.792855 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90a4a6eaac46277c0148bd75d4544ffb.slice/crio-a51fc96645ca1f862a207928c43e1726be619648d362422ee2fee55521c5db3e WatchSource:0}: Error finding container a51fc96645ca1f862a207928c43e1726be619648d362422ee2fee55521c5db3e: Status 404 returned error can't find the container with id a51fc96645ca1f862a207928c43e1726be619648d362422ee2fee55521c5db3e Jul 18 03:50:00.798785 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:00.798768 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 03:50:00.804497 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:50:00.804467 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc721835e4e909ab98512834ab0e67c6f.slice/crio-64882da45146ef8a94c9fb34a55c23dbf2e1bfbc3ee38c8f5db74b0911a9e39c WatchSource:0}: Error finding container 64882da45146ef8a94c9fb34a55c23dbf2e1bfbc3ee38c8f5db74b0911a9e39c: Status 404 returned error can't find the container with id 64882da45146ef8a94c9fb34a55c23dbf2e1bfbc3ee38c8f5db74b0911a9e39c Jul 18 03:50:00.858880 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:00.858847 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-224.ec2.internal\" not found" Jul 18 03:50:00.884042 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:00.884013 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 03:50:00.908722 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:00.908701 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 03:50:00.950583 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:00.950553 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-224.ec2.internal" Jul 18 03:50:00.962228 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:00.962204 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 18 03:50:00.963301 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:00.963288 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-224.ec2.internal" Jul 18 03:50:00.968745 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:00.968732 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 18 03:50:01.627509 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.627457 2558 apiserver.go:52] "Watching apiserver" Jul 18 03:50:01.637739 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.637707 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 18 03:50:01.639665 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.639623 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-f8944","openshift-network-operator/iptables-alerter-l6ljv","kube-system/konnectivity-agent-74gks","kube-system/kube-apiserver-proxy-ip-10-0-138-224.ec2.internal","openshift-cluster-node-tuning-operator/tuned-hvkhb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-224.ec2.internal","openshift-multus/multus-f66jw","openshift-network-diagnostics/network-check-target-lb475","openshift-ovn-kubernetes/ovnkube-node-4f9kj","kube-system/global-pull-secret-syncer-7dx5n","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l","openshift-dns/node-resolver-l94vd","openshift-image-registry/node-ca-x92wq","openshift-multus/multus-additional-cni-plugins-4srql"] Jul 18 03:50:01.642593 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.642254 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:01.642593 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:01.642346 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8944" podUID="15496aee-38ed-4f76-b18f-b84cd34b2dc9" Jul 18 03:50:01.645071 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.645046 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4srql" Jul 18 03:50:01.647491 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.647468 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-74gks" Jul 18 03:50:01.647829 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.647808 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 18 03:50:01.647911 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.647876 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 18 03:50:01.648086 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.647812 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 18 03:50:01.648451 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.648182 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 18 03:50:01.648451 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.648263 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-t9xp2\"" Jul 18 03:50:01.648451 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.648362 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 18 03:50:01.649508 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.649490 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l" Jul 18 03:50:01.650066 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.650051 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 18 03:50:01.650583 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.650561 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 18 03:50:01.650697 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.650582 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rr4hc\"" Jul 18 03:50:01.650697 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.650679 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 18 03:50:01.651660 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.651599 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 18 03:50:01.651660 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.651605 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 18 03:50:01.651975 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.651882 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tzvx5\"" Jul 18 03:50:01.651975 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.651885 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 18 03:50:01.653264 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.653243 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.656027 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.655656 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.656027 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.655825 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 18 03:50:01.656169 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.656069 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 18 03:50:01.656481 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.656457 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rk5xs\"" Jul 18 03:50:01.656562 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.656491 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 18 03:50:01.656709 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.656696 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 18 03:50:01.656829 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.656809 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 18 03:50:01.656888 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.656809 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 18 03:50:01.657786 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.657767 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 18 03:50:01.658152 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.658134 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mxjgr\"" Jul 18 03:50:01.658554 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.658537 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:50:01.658719 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:01.658698 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lb475" podUID="533356c8-0188-468f-956b-f8fc72e64309" Jul 18 03:50:01.660816 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.660795 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-728jw\" (UniqueName: \"kubernetes.io/projected/15496aee-38ed-4f76-b18f-b84cd34b2dc9-kube-api-access-728jw\") pod \"network-metrics-daemon-f8944\" (UID: \"15496aee-38ed-4f76-b18f-b84cd34b2dc9\") " pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:01.660969 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.660851 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/712b3e8a-f5a5-4edf-9699-99d0eb835360-registration-dir\") pod \"aws-ebs-csi-driver-node-m245l\" (UID: \"712b3e8a-f5a5-4edf-9699-99d0eb835360\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l" Jul 18 03:50:01.660969 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.660881 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-host-kubelet\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.660969 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.660904 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-host-cni-netd\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.660969 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.660957 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6e77f13c-e59f-4453-b512-73bb702f5b6e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4srql\" (UID: \"6e77f13c-e59f-4453-b512-73bb702f5b6e\") " pod="openshift-multus/multus-additional-cni-plugins-4srql" Jul 18 03:50:01.661198 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.660995 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-run-systemd\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.661198 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661017 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8f0a789-ad90-4aee-9a37-c63373aaf151-ovn-node-metrics-cert\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.661198 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661045 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.661198 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661058 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e77f13c-e59f-4453-b512-73bb702f5b6e-system-cni-dir\") pod \"multus-additional-cni-plugins-4srql\" (UID: \"6e77f13c-e59f-4453-b512-73bb702f5b6e\") " pod="openshift-multus/multus-additional-cni-plugins-4srql" Jul 18 03:50:01.661198 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661082 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e77f13c-e59f-4453-b512-73bb702f5b6e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4srql\" (UID: \"6e77f13c-e59f-4453-b512-73bb702f5b6e\") " pod="openshift-multus/multus-additional-cni-plugins-4srql" Jul 18 03:50:01.661198 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661110 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0ee054bb-d92c-45b8-933e-2bebaf9aada6-agent-certs\") pod \"konnectivity-agent-74gks\" (UID: \"0ee054bb-d92c-45b8-933e-2bebaf9aada6\") " pod="kube-system/konnectivity-agent-74gks" Jul 18 03:50:01.661198 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661135 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-log-socket\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.661198 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661158 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-host-run-ovn-kubernetes\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.661198 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661190 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b8f0a789-ad90-4aee-9a37-c63373aaf151-env-overrides\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.661622 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661212 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/712b3e8a-f5a5-4edf-9699-99d0eb835360-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m245l\" (UID: \"712b3e8a-f5a5-4edf-9699-99d0eb835360\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l" Jul 18 03:50:01.661622 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661237 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/712b3e8a-f5a5-4edf-9699-99d0eb835360-sys-fs\") pod \"aws-ebs-csi-driver-node-m245l\" (UID: \"712b3e8a-f5a5-4edf-9699-99d0eb835360\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l" Jul 18 03:50:01.661622 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661278 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-var-lib-openvswitch\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.661622 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661300 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-run-openvswitch\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.661622 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661321 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-run-ovn\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.661622 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661365 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-host-run-netns\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.661622 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661394 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-host-cni-bin\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.661622 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661427 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-node-log\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.661622 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661512 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k8tg\" (UniqueName: \"kubernetes.io/projected/b8f0a789-ad90-4aee-9a37-c63373aaf151-kube-api-access-8k8tg\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.661622 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661548 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6e77f13c-e59f-4453-b512-73bb702f5b6e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4srql\" (UID: \"6e77f13c-e59f-4453-b512-73bb702f5b6e\") " pod="openshift-multus/multus-additional-cni-plugins-4srql" Jul 18 03:50:01.661622 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661578 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-host-slash\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.661622 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661617 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/712b3e8a-f5a5-4edf-9699-99d0eb835360-socket-dir\") pod \"aws-ebs-csi-driver-node-m245l\" (UID: \"712b3e8a-f5a5-4edf-9699-99d0eb835360\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l" Jul 18 03:50:01.662205 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661655 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mg44\" (UniqueName: \"kubernetes.io/projected/712b3e8a-f5a5-4edf-9699-99d0eb835360-kube-api-access-5mg44\") pod \"aws-ebs-csi-driver-node-m245l\" (UID: \"712b3e8a-f5a5-4edf-9699-99d0eb835360\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l" Jul 18 03:50:01.662205 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661683 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.662205 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661704 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e77f13c-e59f-4453-b512-73bb702f5b6e-cni-binary-copy\") pod \"multus-additional-cni-plugins-4srql\" (UID: \"6e77f13c-e59f-4453-b512-73bb702f5b6e\") " pod="openshift-multus/multus-additional-cni-plugins-4srql" Jul 18 03:50:01.662205 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661719 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9xmc\" (UniqueName: \"kubernetes.io/projected/6e77f13c-e59f-4453-b512-73bb702f5b6e-kube-api-access-p9xmc\") pod \"multus-additional-cni-plugins-4srql\" (UID: \"6e77f13c-e59f-4453-b512-73bb702f5b6e\") " pod="openshift-multus/multus-additional-cni-plugins-4srql" Jul 18 03:50:01.662205 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661752 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0ee054bb-d92c-45b8-933e-2bebaf9aada6-konnectivity-ca\") pod \"konnectivity-agent-74gks\" (UID: \"0ee054bb-d92c-45b8-933e-2bebaf9aada6\") " pod="kube-system/konnectivity-agent-74gks" Jul 18 03:50:01.662205 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661777 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/712b3e8a-f5a5-4edf-9699-99d0eb835360-device-dir\") pod \"aws-ebs-csi-driver-node-m245l\" (UID: \"712b3e8a-f5a5-4edf-9699-99d0eb835360\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l" Jul 18 03:50:01.662205 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661803 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b8f0a789-ad90-4aee-9a37-c63373aaf151-ovnkube-config\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.662205 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661820 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b8f0a789-ad90-4aee-9a37-c63373aaf151-ovnkube-script-lib\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.662205 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661852 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-systemd-units\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.662205 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661876 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/712b3e8a-f5a5-4edf-9699-99d0eb835360-etc-selinux\") pod \"aws-ebs-csi-driver-node-m245l\" (UID: \"712b3e8a-f5a5-4edf-9699-99d0eb835360\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l" Jul 18 03:50:01.662205 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661901 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs\") pod \"network-metrics-daemon-f8944\" (UID: \"15496aee-38ed-4f76-b18f-b84cd34b2dc9\") " pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:01.662205 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661924 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e77f13c-e59f-4453-b512-73bb702f5b6e-cnibin\") pod \"multus-additional-cni-plugins-4srql\" (UID: \"6e77f13c-e59f-4453-b512-73bb702f5b6e\") " pod="openshift-multus/multus-additional-cni-plugins-4srql" Jul 18 03:50:01.662205 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.661997 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e77f13c-e59f-4453-b512-73bb702f5b6e-os-release\") pod \"multus-additional-cni-plugins-4srql\" (UID: \"6e77f13c-e59f-4453-b512-73bb702f5b6e\") " pod="openshift-multus/multus-additional-cni-plugins-4srql" Jul 18 03:50:01.662205 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.662028 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-etc-openvswitch\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.663077 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.663041 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 18 03:50:01.663160 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.663096 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 18 03:50:01.663438 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.663388 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5b82r\"" Jul 18 03:50:01.663514 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.663448 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 18 03:50:01.663678 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.663663 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:01.663756 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:01.663734 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7dx5n" podUID="eadafdbc-08a4-43cb-8bf8-1afbf235bd6f" Jul 18 03:50:01.666212 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.666170 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l94vd" Jul 18 03:50:01.668566 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.668468 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x92wq" Jul 18 03:50:01.668669 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.668650 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 18 03:50:01.668732 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.668694 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 18 03:50:01.668915 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.668835 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tpzqv\"" Jul 18 03:50:01.670888 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.670672 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 18 03:50:01.670888 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.670809 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l6ljv" Jul 18 03:50:01.670888 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.670845 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9dq85\"" Jul 18 03:50:01.671100 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.671058 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 18 03:50:01.671288 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.671268 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 18 03:50:01.673054 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.673027 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-f9g24\"" Jul 18 03:50:01.673172 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.673153 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 18 03:50:01.673279 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.673260 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 18 03:50:01.673838 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.673818 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 18 03:50:01.683968 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.683912 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qdwdz" Jul 18 03:50:01.691190 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.691156 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qdwdz" Jul 18 03:50:01.752871 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.752836 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 18 03:50:01.762774 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.762742 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/712b3e8a-f5a5-4edf-9699-99d0eb835360-socket-dir\") pod \"aws-ebs-csi-driver-node-m245l\" (UID: \"712b3e8a-f5a5-4edf-9699-99d0eb835360\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l" Jul 18 03:50:01.762972 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.762787 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.762972 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.762815 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e77f13c-e59f-4453-b512-73bb702f5b6e-cni-binary-copy\") pod \"multus-additional-cni-plugins-4srql\" (UID: \"6e77f13c-e59f-4453-b512-73bb702f5b6e\") " pod="openshift-multus/multus-additional-cni-plugins-4srql" Jul 18 03:50:01.762972 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.762840 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9xmc\" (UniqueName: \"kubernetes.io/projected/6e77f13c-e59f-4453-b512-73bb702f5b6e-kube-api-access-p9xmc\") pod \"multus-additional-cni-plugins-4srql\" (UID: \"6e77f13c-e59f-4453-b512-73bb702f5b6e\") " pod="openshift-multus/multus-additional-cni-plugins-4srql" Jul 18 03:50:01.762972 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.762864 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0ee054bb-d92c-45b8-933e-2bebaf9aada6-konnectivity-ca\") pod \"konnectivity-agent-74gks\" (UID: \"0ee054bb-d92c-45b8-933e-2bebaf9aada6\") " pod="kube-system/konnectivity-agent-74gks" Jul 18 03:50:01.762972 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.762891 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-lib-modules\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.762972 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.762915 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/712b3e8a-f5a5-4edf-9699-99d0eb835360-device-dir\") pod \"aws-ebs-csi-driver-node-m245l\" (UID: \"712b3e8a-f5a5-4edf-9699-99d0eb835360\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l" Jul 18 03:50:01.762972 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.762954 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b8f0a789-ad90-4aee-9a37-c63373aaf151-ovnkube-script-lib\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.762972 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.762974 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-etc-kubernetes\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.763364 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.762995 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b30bacc8-75f3-48ba-8809-01e630ca256c-tmp\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.763364 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763018 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-system-cni-dir\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.763364 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763041 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-multus-conf-dir\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.763364 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763066 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-systemd-units\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.763364 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763092 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs\") pod \"network-metrics-daemon-f8944\" (UID: \"15496aee-38ed-4f76-b18f-b84cd34b2dc9\") " pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:01.763364 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763116 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e77f13c-e59f-4453-b512-73bb702f5b6e-cnibin\") pod \"multus-additional-cni-plugins-4srql\" (UID: \"6e77f13c-e59f-4453-b512-73bb702f5b6e\") " pod="openshift-multus/multus-additional-cni-plugins-4srql" Jul 18 03:50:01.763364 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763139 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e77f13c-e59f-4453-b512-73bb702f5b6e-os-release\") pod \"multus-additional-cni-plugins-4srql\" (UID: \"6e77f13c-e59f-4453-b512-73bb702f5b6e\") " pod="openshift-multus/multus-additional-cni-plugins-4srql" Jul 18 03:50:01.763364 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763162 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-host\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.763364 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763187 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k49r6\" (UniqueName: \"kubernetes.io/projected/8434d441-42df-4bd3-9f63-9d5a4d3f1521-kube-api-access-k49r6\") pod \"node-ca-x92wq\" (UID: \"8434d441-42df-4bd3-9f63-9d5a4d3f1521\") " pod="openshift-image-registry/node-ca-x92wq" Jul 18 03:50:01.763364 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763212 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-host-run-k8s-cni-cncf-io\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.763364 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763237 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-etc-openvswitch\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.763364 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763260 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-os-release\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.763364 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763285 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/712b3e8a-f5a5-4edf-9699-99d0eb835360-registration-dir\") pod \"aws-ebs-csi-driver-node-m245l\" (UID: \"712b3e8a-f5a5-4edf-9699-99d0eb835360\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l" Jul 18 03:50:01.763364 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763329 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-host-kubelet\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.763364 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763353 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-host-cni-netd\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.764161 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763384 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-dbus\") pod \"global-pull-secret-syncer-7dx5n\" (UID: \"eadafdbc-08a4-43cb-8bf8-1afbf235bd6f\") " pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:01.764161 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763409 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-etc-sysconfig\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.764161 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763439 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-etc-systemd\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.764161 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763463 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-var-lib-kubelet\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.764161 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763486 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-run-systemd\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.764161 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763510 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8f0a789-ad90-4aee-9a37-c63373aaf151-ovn-node-metrics-cert\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.764161 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763533 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e77f13c-e59f-4453-b512-73bb702f5b6e-system-cni-dir\") pod \"multus-additional-cni-plugins-4srql\" (UID: \"6e77f13c-e59f-4453-b512-73bb702f5b6e\") " pod="openshift-multus/multus-additional-cni-plugins-4srql" Jul 18 03:50:01.764161 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763556 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-original-pull-secret\") pod \"global-pull-secret-syncer-7dx5n\" (UID: \"eadafdbc-08a4-43cb-8bf8-1afbf235bd6f\") " pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:01.764161 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763579 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-cnibin\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.764161 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763600 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-host-run-netns\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.764161 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763607 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/712b3e8a-f5a5-4edf-9699-99d0eb835360-device-dir\") pod \"aws-ebs-csi-driver-node-m245l\" (UID: \"712b3e8a-f5a5-4edf-9699-99d0eb835360\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l" Jul 18 03:50:01.764161 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763630 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-run\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.764161 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:01.763611 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 03:50:01.764161 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763656 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-log-socket\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.764161 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763681 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-var-lib-openvswitch\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.764161 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763685 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e77f13c-e59f-4453-b512-73bb702f5b6e-cnibin\") pod \"multus-additional-cni-plugins-4srql\" (UID: \"6e77f13c-e59f-4453-b512-73bb702f5b6e\") " pod="openshift-multus/multus-additional-cni-plugins-4srql" Jul 18 03:50:01.764161 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763703 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-run-systemd\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.764906 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:01.763720 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs podName:15496aee-38ed-4f76-b18f-b84cd34b2dc9 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:02.26369531 +0000 UTC m=+3.025328944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs") pod "network-metrics-daemon-f8944" (UID: "15496aee-38ed-4f76-b18f-b84cd34b2dc9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 03:50:01.764906 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763724 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-systemd-units\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.764906 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763734 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-var-lib-openvswitch\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.764906 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763743 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-run-ovn\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.764906 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763774 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9jqb\" (UniqueName: \"kubernetes.io/projected/6f0209eb-dee6-49e8-85c5-55a211a0f069-kube-api-access-l9jqb\") pod \"node-resolver-l94vd\" (UID: \"6f0209eb-dee6-49e8-85c5-55a211a0f069\") " pod="openshift-dns/node-resolver-l94vd" Jul 18 03:50:01.764906 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763781 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e77f13c-e59f-4453-b512-73bb702f5b6e-system-cni-dir\") pod \"multus-additional-cni-plugins-4srql\" (UID: \"6e77f13c-e59f-4453-b512-73bb702f5b6e\") " pod="openshift-multus/multus-additional-cni-plugins-4srql" Jul 18 03:50:01.764906 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763835 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-log-socket\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.764906 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.763993 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e77f13c-e59f-4453-b512-73bb702f5b6e-os-release\") pod \"multus-additional-cni-plugins-4srql\" (UID: \"6e77f13c-e59f-4453-b512-73bb702f5b6e\") " pod="openshift-multus/multus-additional-cni-plugins-4srql" Jul 18 03:50:01.764906 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764035 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-run-ovn\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.764906 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764055 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-host-run-netns\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.764906 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764082 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.764906 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764084 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-host-cni-bin\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.764906 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764118 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-host-cni-bin\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.764906 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764161 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-etc-sysctl-d\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.764906 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764202 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-host-slash\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.764906 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764236 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mg44\" (UniqueName: \"kubernetes.io/projected/712b3e8a-f5a5-4edf-9699-99d0eb835360-kube-api-access-5mg44\") pod \"aws-ebs-csi-driver-node-m245l\" (UID: \"712b3e8a-f5a5-4edf-9699-99d0eb835360\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l" Jul 18 03:50:01.765590 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764267 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-etc-sysctl-conf\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.765590 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764287 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/712b3e8a-f5a5-4edf-9699-99d0eb835360-socket-dir\") pod \"aws-ebs-csi-driver-node-m245l\" (UID: \"712b3e8a-f5a5-4edf-9699-99d0eb835360\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l" Jul 18 03:50:01.765590 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764204 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-host-cni-netd\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.765590 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764303 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-etc-openvswitch\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.765590 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764339 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp49l\" (UniqueName: \"kubernetes.io/projected/b30bacc8-75f3-48ba-8809-01e630ca256c-kube-api-access-tp49l\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.765590 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764347 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-host-slash\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.765590 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764377 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-multus-cni-dir\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.765590 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764382 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 18 03:50:01.765590 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764397 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/712b3e8a-f5a5-4edf-9699-99d0eb835360-registration-dir\") pod \"aws-ebs-csi-driver-node-m245l\" (UID: \"712b3e8a-f5a5-4edf-9699-99d0eb835360\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l" Jul 18 03:50:01.765590 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764414 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-host-kubelet\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.765590 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764441 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-host-run-netns\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.765590 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764478 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64qlb\" (UniqueName: \"kubernetes.io/projected/2824c8d5-c431-4f95-9219-f9969dc5907a-kube-api-access-64qlb\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.765590 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764490 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0ee054bb-d92c-45b8-933e-2bebaf9aada6-konnectivity-ca\") pod \"konnectivity-agent-74gks\" (UID: \"0ee054bb-d92c-45b8-933e-2bebaf9aada6\") " pod="kube-system/konnectivity-agent-74gks" Jul 18 03:50:01.765590 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764496 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e77f13c-e59f-4453-b512-73bb702f5b6e-cni-binary-copy\") pod \"multus-additional-cni-plugins-4srql\" (UID: \"6e77f13c-e59f-4453-b512-73bb702f5b6e\") " pod="openshift-multus/multus-additional-cni-plugins-4srql" Jul 18 03:50:01.765590 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764498 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b8f0a789-ad90-4aee-9a37-c63373aaf151-ovnkube-script-lib\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.765590 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764512 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b8f0a789-ad90-4aee-9a37-c63373aaf151-ovnkube-config\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.765590 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764545 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-etc-modprobe-d\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.766283 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764579 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8434d441-42df-4bd3-9f63-9d5a4d3f1521-host\") pod \"node-ca-x92wq\" (UID: \"8434d441-42df-4bd3-9f63-9d5a4d3f1521\") " pod="openshift-image-registry/node-ca-x92wq" Jul 18 03:50:01.766283 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764613 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-host-var-lib-kubelet\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.766283 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764646 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/712b3e8a-f5a5-4edf-9699-99d0eb835360-etc-selinux\") pod \"aws-ebs-csi-driver-node-m245l\" (UID: \"712b3e8a-f5a5-4edf-9699-99d0eb835360\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l" Jul 18 03:50:01.766283 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764693 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8434d441-42df-4bd3-9f63-9d5a4d3f1521-serviceca\") pod \"node-ca-x92wq\" (UID: \"8434d441-42df-4bd3-9f63-9d5a4d3f1521\") " pod="openshift-image-registry/node-ca-x92wq" Jul 18 03:50:01.766283 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764733 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-host-var-lib-cni-multus\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.766283 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764766 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-728jw\" (UniqueName: \"kubernetes.io/projected/15496aee-38ed-4f76-b18f-b84cd34b2dc9-kube-api-access-728jw\") pod \"network-metrics-daemon-f8944\" (UID: \"15496aee-38ed-4f76-b18f-b84cd34b2dc9\") " pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:01.766283 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764782 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/712b3e8a-f5a5-4edf-9699-99d0eb835360-etc-selinux\") pod \"aws-ebs-csi-driver-node-m245l\" (UID: \"712b3e8a-f5a5-4edf-9699-99d0eb835360\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l" Jul 18 03:50:01.766283 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764791 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-sys\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.766283 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764816 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab166e2f-2606-4ec6-97a9-bb22e15f3a22-host-slash\") pod \"iptables-alerter-l6ljv\" (UID: \"ab166e2f-2606-4ec6-97a9-bb22e15f3a22\") " pod="openshift-network-operator/iptables-alerter-l6ljv" Jul 18 03:50:01.766283 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764847 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-host-run-multus-certs\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.766283 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764870 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-etc-kubernetes\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.766283 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764898 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6e77f13c-e59f-4453-b512-73bb702f5b6e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4srql\" (UID: \"6e77f13c-e59f-4453-b512-73bb702f5b6e\") " pod="openshift-multus/multus-additional-cni-plugins-4srql" Jul 18 03:50:01.766283 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.764971 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bskqp\" (UniqueName: \"kubernetes.io/projected/533356c8-0188-468f-956b-f8fc72e64309-kube-api-access-bskqp\") pod \"network-check-target-lb475\" (UID: \"533356c8-0188-468f-956b-f8fc72e64309\") " pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:50:01.766283 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765003 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b8f0a789-ad90-4aee-9a37-c63373aaf151-ovnkube-config\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.766283 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765018 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-kubelet-config\") pod \"global-pull-secret-syncer-7dx5n\" (UID: \"eadafdbc-08a4-43cb-8bf8-1afbf235bd6f\") " pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:01.766283 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765045 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b30bacc8-75f3-48ba-8809-01e630ca256c-etc-tuned\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.766283 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765069 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-hostroot\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.767107 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765129 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e77f13c-e59f-4453-b512-73bb702f5b6e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4srql\" (UID: \"6e77f13c-e59f-4453-b512-73bb702f5b6e\") " pod="openshift-multus/multus-additional-cni-plugins-4srql" Jul 18 03:50:01.767107 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765163 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0ee054bb-d92c-45b8-933e-2bebaf9aada6-agent-certs\") pod \"konnectivity-agent-74gks\" (UID: \"0ee054bb-d92c-45b8-933e-2bebaf9aada6\") " pod="kube-system/konnectivity-agent-74gks" Jul 18 03:50:01.767107 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765193 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr97t\" (UniqueName: \"kubernetes.io/projected/ab166e2f-2606-4ec6-97a9-bb22e15f3a22-kube-api-access-lr97t\") pod \"iptables-alerter-l6ljv\" (UID: \"ab166e2f-2606-4ec6-97a9-bb22e15f3a22\") " pod="openshift-network-operator/iptables-alerter-l6ljv" Jul 18 03:50:01.767107 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765223 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2824c8d5-c431-4f95-9219-f9969dc5907a-cni-binary-copy\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.767107 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765250 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-node-log\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.767107 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765269 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e77f13c-e59f-4453-b512-73bb702f5b6e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4srql\" (UID: \"6e77f13c-e59f-4453-b512-73bb702f5b6e\") " pod="openshift-multus/multus-additional-cni-plugins-4srql" Jul 18 03:50:01.767107 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765287 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-host-run-ovn-kubernetes\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.767107 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765313 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-node-log\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.767107 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765322 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b8f0a789-ad90-4aee-9a37-c63373aaf151-env-overrides\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.767107 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765358 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/712b3e8a-f5a5-4edf-9699-99d0eb835360-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m245l\" (UID: \"712b3e8a-f5a5-4edf-9699-99d0eb835360\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l" Jul 18 03:50:01.767107 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765368 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-host-run-ovn-kubernetes\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.767107 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765394 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6e77f13c-e59f-4453-b512-73bb702f5b6e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4srql\" (UID: \"6e77f13c-e59f-4453-b512-73bb702f5b6e\") " pod="openshift-multus/multus-additional-cni-plugins-4srql" Jul 18 03:50:01.767107 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765408 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/712b3e8a-f5a5-4edf-9699-99d0eb835360-sys-fs\") pod \"aws-ebs-csi-driver-node-m245l\" (UID: \"712b3e8a-f5a5-4edf-9699-99d0eb835360\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l" Jul 18 03:50:01.767107 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765453 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/712b3e8a-f5a5-4edf-9699-99d0eb835360-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m245l\" (UID: \"712b3e8a-f5a5-4edf-9699-99d0eb835360\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l" Jul 18 03:50:01.767107 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765489 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-run-openvswitch\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.767107 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765515 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f0209eb-dee6-49e8-85c5-55a211a0f069-tmp-dir\") pod \"node-resolver-l94vd\" (UID: \"6f0209eb-dee6-49e8-85c5-55a211a0f069\") " pod="openshift-dns/node-resolver-l94vd" Jul 18 03:50:01.767107 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765547 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ab166e2f-2606-4ec6-97a9-bb22e15f3a22-iptables-alerter-script\") pod \"iptables-alerter-l6ljv\" (UID: \"ab166e2f-2606-4ec6-97a9-bb22e15f3a22\") " pod="openshift-network-operator/iptables-alerter-l6ljv" Jul 18 03:50:01.767893 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765576 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k8tg\" (UniqueName: \"kubernetes.io/projected/b8f0a789-ad90-4aee-9a37-c63373aaf151-kube-api-access-8k8tg\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.767893 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765621 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/712b3e8a-f5a5-4edf-9699-99d0eb835360-sys-fs\") pod \"aws-ebs-csi-driver-node-m245l\" (UID: \"712b3e8a-f5a5-4edf-9699-99d0eb835360\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l" Jul 18 03:50:01.767893 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765661 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6e77f13c-e59f-4453-b512-73bb702f5b6e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4srql\" (UID: \"6e77f13c-e59f-4453-b512-73bb702f5b6e\") " pod="openshift-multus/multus-additional-cni-plugins-4srql" Jul 18 03:50:01.767893 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765686 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b8f0a789-ad90-4aee-9a37-c63373aaf151-env-overrides\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.767893 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765690 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6f0209eb-dee6-49e8-85c5-55a211a0f069-hosts-file\") pod \"node-resolver-l94vd\" (UID: \"6f0209eb-dee6-49e8-85c5-55a211a0f069\") " pod="openshift-dns/node-resolver-l94vd" Jul 18 03:50:01.767893 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765710 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8f0a789-ad90-4aee-9a37-c63373aaf151-run-openvswitch\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.767893 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765731 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-multus-socket-dir-parent\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.767893 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765776 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-host-var-lib-cni-bin\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.767893 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.765974 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2824c8d5-c431-4f95-9219-f9969dc5907a-multus-daemon-config\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.767893 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.766241 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6e77f13c-e59f-4453-b512-73bb702f5b6e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4srql\" (UID: \"6e77f13c-e59f-4453-b512-73bb702f5b6e\") " pod="openshift-multus/multus-additional-cni-plugins-4srql" Jul 18 03:50:01.767893 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.766358 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-224.ec2.internal" event={"ID":"c721835e4e909ab98512834ab0e67c6f","Type":"ContainerStarted","Data":"64882da45146ef8a94c9fb34a55c23dbf2e1bfbc3ee38c8f5db74b0911a9e39c"} Jul 18 03:50:01.768421 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.768125 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-224.ec2.internal" event={"ID":"90a4a6eaac46277c0148bd75d4544ffb","Type":"ContainerStarted","Data":"a51fc96645ca1f862a207928c43e1726be619648d362422ee2fee55521c5db3e"} Jul 18 03:50:01.768995 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.768967 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8f0a789-ad90-4aee-9a37-c63373aaf151-ovn-node-metrics-cert\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.769181 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.769155 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0ee054bb-d92c-45b8-933e-2bebaf9aada6-agent-certs\") pod \"konnectivity-agent-74gks\" (UID: \"0ee054bb-d92c-45b8-933e-2bebaf9aada6\") " pod="kube-system/konnectivity-agent-74gks" Jul 18 03:50:01.775743 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.775710 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9xmc\" (UniqueName: \"kubernetes.io/projected/6e77f13c-e59f-4453-b512-73bb702f5b6e-kube-api-access-p9xmc\") pod \"multus-additional-cni-plugins-4srql\" (UID: \"6e77f13c-e59f-4453-b512-73bb702f5b6e\") " pod="openshift-multus/multus-additional-cni-plugins-4srql" Jul 18 03:50:01.776401 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.776374 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k8tg\" (UniqueName: \"kubernetes.io/projected/b8f0a789-ad90-4aee-9a37-c63373aaf151-kube-api-access-8k8tg\") pod \"ovnkube-node-4f9kj\" (UID: \"b8f0a789-ad90-4aee-9a37-c63373aaf151\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.776853 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.776829 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mg44\" (UniqueName: \"kubernetes.io/projected/712b3e8a-f5a5-4edf-9699-99d0eb835360-kube-api-access-5mg44\") pod \"aws-ebs-csi-driver-node-m245l\" (UID: \"712b3e8a-f5a5-4edf-9699-99d0eb835360\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l" Jul 18 03:50:01.777680 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.777655 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-728jw\" (UniqueName: \"kubernetes.io/projected/15496aee-38ed-4f76-b18f-b84cd34b2dc9-kube-api-access-728jw\") pod \"network-metrics-daemon-f8944\" (UID: \"15496aee-38ed-4f76-b18f-b84cd34b2dc9\") " pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:01.866282 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866243 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8434d441-42df-4bd3-9f63-9d5a4d3f1521-serviceca\") pod \"node-ca-x92wq\" (UID: \"8434d441-42df-4bd3-9f63-9d5a4d3f1521\") " pod="openshift-image-registry/node-ca-x92wq" Jul 18 03:50:01.866282 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866282 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-host-var-lib-cni-multus\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.866514 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866302 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-sys\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.866514 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866325 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab166e2f-2606-4ec6-97a9-bb22e15f3a22-host-slash\") pod \"iptables-alerter-l6ljv\" (UID: \"ab166e2f-2606-4ec6-97a9-bb22e15f3a22\") " pod="openshift-network-operator/iptables-alerter-l6ljv" Jul 18 03:50:01.866514 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866351 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-host-run-multus-certs\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.866514 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866373 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-etc-kubernetes\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.866514 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866405 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-host-var-lib-cni-multus\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.866514 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866426 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bskqp\" (UniqueName: \"kubernetes.io/projected/533356c8-0188-468f-956b-f8fc72e64309-kube-api-access-bskqp\") pod \"network-check-target-lb475\" (UID: \"533356c8-0188-468f-956b-f8fc72e64309\") " pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:50:01.866514 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866429 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-host-run-multus-certs\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.866514 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866422 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-sys\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.866514 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866483 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-kubelet-config\") pod \"global-pull-secret-syncer-7dx5n\" (UID: \"eadafdbc-08a4-43cb-8bf8-1afbf235bd6f\") " pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:01.866514 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866480 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab166e2f-2606-4ec6-97a9-bb22e15f3a22-host-slash\") pod \"iptables-alerter-l6ljv\" (UID: \"ab166e2f-2606-4ec6-97a9-bb22e15f3a22\") " pod="openshift-network-operator/iptables-alerter-l6ljv" Jul 18 03:50:01.867011 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866547 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-etc-kubernetes\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.867011 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866596 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b30bacc8-75f3-48ba-8809-01e630ca256c-etc-tuned\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.867011 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866609 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-kubelet-config\") pod \"global-pull-secret-syncer-7dx5n\" (UID: \"eadafdbc-08a4-43cb-8bf8-1afbf235bd6f\") " pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:01.867011 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866654 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-hostroot\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.867011 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866680 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr97t\" (UniqueName: \"kubernetes.io/projected/ab166e2f-2606-4ec6-97a9-bb22e15f3a22-kube-api-access-lr97t\") pod \"iptables-alerter-l6ljv\" (UID: \"ab166e2f-2606-4ec6-97a9-bb22e15f3a22\") " pod="openshift-network-operator/iptables-alerter-l6ljv" Jul 18 03:50:01.867011 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866704 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2824c8d5-c431-4f95-9219-f9969dc5907a-cni-binary-copy\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.867011 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866730 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f0209eb-dee6-49e8-85c5-55a211a0f069-tmp-dir\") pod \"node-resolver-l94vd\" (UID: \"6f0209eb-dee6-49e8-85c5-55a211a0f069\") " pod="openshift-dns/node-resolver-l94vd" Jul 18 03:50:01.867011 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866756 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ab166e2f-2606-4ec6-97a9-bb22e15f3a22-iptables-alerter-script\") pod \"iptables-alerter-l6ljv\" (UID: \"ab166e2f-2606-4ec6-97a9-bb22e15f3a22\") " pod="openshift-network-operator/iptables-alerter-l6ljv" Jul 18 03:50:01.867011 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866785 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6f0209eb-dee6-49e8-85c5-55a211a0f069-hosts-file\") pod \"node-resolver-l94vd\" (UID: \"6f0209eb-dee6-49e8-85c5-55a211a0f069\") " pod="openshift-dns/node-resolver-l94vd" Jul 18 03:50:01.867011 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866801 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-multus-socket-dir-parent\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.867011 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866816 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-host-var-lib-cni-bin\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.867011 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866838 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2824c8d5-c431-4f95-9219-f9969dc5907a-multus-daemon-config\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.867011 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866895 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-hostroot\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.867011 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866895 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8434d441-42df-4bd3-9f63-9d5a4d3f1521-serviceca\") pod \"node-ca-x92wq\" (UID: \"8434d441-42df-4bd3-9f63-9d5a4d3f1521\") " pod="openshift-image-registry/node-ca-x92wq" Jul 18 03:50:01.867011 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866963 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-lib-modules\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.867011 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866974 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-multus-socket-dir-parent\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.867011 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.866997 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-etc-kubernetes\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.867011 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867022 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b30bacc8-75f3-48ba-8809-01e630ca256c-tmp\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.867838 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867040 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6f0209eb-dee6-49e8-85c5-55a211a0f069-hosts-file\") pod \"node-resolver-l94vd\" (UID: \"6f0209eb-dee6-49e8-85c5-55a211a0f069\") " pod="openshift-dns/node-resolver-l94vd" Jul 18 03:50:01.867838 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867042 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-system-cni-dir\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.867838 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867076 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-multus-conf-dir\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.867838 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867085 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-system-cni-dir\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.867838 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867119 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-host\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.867838 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867128 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-multus-conf-dir\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.867838 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867144 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k49r6\" (UniqueName: \"kubernetes.io/projected/8434d441-42df-4bd3-9f63-9d5a4d3f1521-kube-api-access-k49r6\") pod \"node-ca-x92wq\" (UID: \"8434d441-42df-4bd3-9f63-9d5a4d3f1521\") " pod="openshift-image-registry/node-ca-x92wq" Jul 18 03:50:01.867838 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867170 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-host-run-k8s-cni-cncf-io\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.867838 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867193 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-host\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.867838 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867145 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-host-var-lib-cni-bin\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.867838 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867246 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-host-run-k8s-cni-cncf-io\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.867838 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867196 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-os-release\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.867838 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867266 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-lib-modules\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.867838 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867280 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-dbus\") pod \"global-pull-secret-syncer-7dx5n\" (UID: \"eadafdbc-08a4-43cb-8bf8-1afbf235bd6f\") " pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:01.867838 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867306 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-etc-sysconfig\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.867838 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867315 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-etc-kubernetes\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.867838 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867322 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f0209eb-dee6-49e8-85c5-55a211a0f069-tmp-dir\") pod \"node-resolver-l94vd\" (UID: \"6f0209eb-dee6-49e8-85c5-55a211a0f069\") " pod="openshift-dns/node-resolver-l94vd" Jul 18 03:50:01.867838 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867329 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-etc-systemd\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.868569 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867357 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-var-lib-kubelet\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.868569 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867385 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-original-pull-secret\") pod \"global-pull-secret-syncer-7dx5n\" (UID: \"eadafdbc-08a4-43cb-8bf8-1afbf235bd6f\") " pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:01.868569 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867410 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-cnibin\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.868569 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867424 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-etc-sysconfig\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.868569 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867437 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2824c8d5-c431-4f95-9219-f9969dc5907a-multus-daemon-config\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.868569 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867448 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-dbus\") pod \"global-pull-secret-syncer-7dx5n\" (UID: \"eadafdbc-08a4-43cb-8bf8-1afbf235bd6f\") " pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:01.868569 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867452 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ab166e2f-2606-4ec6-97a9-bb22e15f3a22-iptables-alerter-script\") pod \"iptables-alerter-l6ljv\" (UID: \"ab166e2f-2606-4ec6-97a9-bb22e15f3a22\") " pod="openshift-network-operator/iptables-alerter-l6ljv" Jul 18 03:50:01.868569 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867440 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-host-run-netns\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.868569 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867478 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-var-lib-kubelet\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.868569 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867495 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-run\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.868569 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867515 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-host-run-netns\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.868569 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867538 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9jqb\" (UniqueName: \"kubernetes.io/projected/6f0209eb-dee6-49e8-85c5-55a211a0f069-kube-api-access-l9jqb\") pod \"node-resolver-l94vd\" (UID: \"6f0209eb-dee6-49e8-85c5-55a211a0f069\") " pod="openshift-dns/node-resolver-l94vd" Jul 18 03:50:01.868569 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:01.867557 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 03:50:01.868569 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867562 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-cnibin\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.868569 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867605 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-etc-sysctl-d\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.868569 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867656 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-etc-sysctl-conf\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.868569 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867679 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-os-release\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.868569 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867686 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp49l\" (UniqueName: \"kubernetes.io/projected/b30bacc8-75f3-48ba-8809-01e630ca256c-kube-api-access-tp49l\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.869280 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:01.867704 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-original-pull-secret podName:eadafdbc-08a4-43cb-8bf8-1afbf235bd6f nodeName:}" failed. No retries permitted until 2026-07-18 03:50:02.367683883 +0000 UTC m=+3.129317509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-original-pull-secret") pod "global-pull-secret-syncer-7dx5n" (UID: "eadafdbc-08a4-43cb-8bf8-1afbf235bd6f") : object "kube-system"/"original-pull-secret" not registered Jul 18 03:50:01.869280 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867791 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-etc-sysctl-d\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.869280 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867820 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2824c8d5-c431-4f95-9219-f9969dc5907a-cni-binary-copy\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.869280 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867840 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-multus-cni-dir\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.869280 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867853 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-etc-systemd\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.869280 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867867 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-run\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.869280 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867887 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64qlb\" (UniqueName: \"kubernetes.io/projected/2824c8d5-c431-4f95-9219-f9969dc5907a-kube-api-access-64qlb\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.869280 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867910 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-multus-cni-dir\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.869280 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867920 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-etc-modprobe-d\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.869280 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867960 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8434d441-42df-4bd3-9f63-9d5a4d3f1521-host\") pod \"node-ca-x92wq\" (UID: \"8434d441-42df-4bd3-9f63-9d5a4d3f1521\") " pod="openshift-image-registry/node-ca-x92wq" Jul 18 03:50:01.869280 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867973 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-etc-sysctl-conf\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.869280 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.867988 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-host-var-lib-kubelet\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.869280 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.868017 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8434d441-42df-4bd3-9f63-9d5a4d3f1521-host\") pod \"node-ca-x92wq\" (UID: \"8434d441-42df-4bd3-9f63-9d5a4d3f1521\") " pod="openshift-image-registry/node-ca-x92wq" Jul 18 03:50:01.869280 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.868097 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b30bacc8-75f3-48ba-8809-01e630ca256c-etc-modprobe-d\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.869280 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.868103 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2824c8d5-c431-4f95-9219-f9969dc5907a-host-var-lib-kubelet\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.869832 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.869737 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b30bacc8-75f3-48ba-8809-01e630ca256c-tmp\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.869908 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.869890 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b30bacc8-75f3-48ba-8809-01e630ca256c-etc-tuned\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.872292 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:01.872270 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 03:50:01.872292 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:01.872292 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 03:50:01.872475 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:01.872305 2558 projected.go:196] Error preparing data for projected volume kube-api-access-bskqp for pod openshift-network-diagnostics/network-check-target-lb475: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 03:50:01.872475 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:01.872410 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/533356c8-0188-468f-956b-f8fc72e64309-kube-api-access-bskqp podName:533356c8-0188-468f-956b-f8fc72e64309 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:02.372393601 +0000 UTC m=+3.134027215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bskqp" (UniqueName: "kubernetes.io/projected/533356c8-0188-468f-956b-f8fc72e64309-kube-api-access-bskqp") pod "network-check-target-lb475" (UID: "533356c8-0188-468f-956b-f8fc72e64309") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 03:50:01.874648 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.874625 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr97t\" (UniqueName: \"kubernetes.io/projected/ab166e2f-2606-4ec6-97a9-bb22e15f3a22-kube-api-access-lr97t\") pod \"iptables-alerter-l6ljv\" (UID: \"ab166e2f-2606-4ec6-97a9-bb22e15f3a22\") " pod="openshift-network-operator/iptables-alerter-l6ljv" Jul 18 03:50:01.875152 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.875123 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k49r6\" (UniqueName: \"kubernetes.io/projected/8434d441-42df-4bd3-9f63-9d5a4d3f1521-kube-api-access-k49r6\") pod \"node-ca-x92wq\" (UID: \"8434d441-42df-4bd3-9f63-9d5a4d3f1521\") " pod="openshift-image-registry/node-ca-x92wq" Jul 18 03:50:01.876185 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.876166 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64qlb\" (UniqueName: \"kubernetes.io/projected/2824c8d5-c431-4f95-9219-f9969dc5907a-kube-api-access-64qlb\") pod \"multus-f66jw\" (UID: \"2824c8d5-c431-4f95-9219-f9969dc5907a\") " pod="openshift-multus/multus-f66jw" Jul 18 03:50:01.876633 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.876613 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9jqb\" (UniqueName: \"kubernetes.io/projected/6f0209eb-dee6-49e8-85c5-55a211a0f069-kube-api-access-l9jqb\") pod \"node-resolver-l94vd\" (UID: \"6f0209eb-dee6-49e8-85c5-55a211a0f069\") " pod="openshift-dns/node-resolver-l94vd" Jul 18 03:50:01.876750 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.876724 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp49l\" (UniqueName: \"kubernetes.io/projected/b30bacc8-75f3-48ba-8809-01e630ca256c-kube-api-access-tp49l\") pod \"tuned-hvkhb\" (UID: \"b30bacc8-75f3-48ba-8809-01e630ca256c\") " pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:01.963709 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.963620 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4srql" Jul 18 03:50:01.971993 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.971970 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-74gks" Jul 18 03:50:01.983577 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.983546 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l" Jul 18 03:50:01.990415 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.990394 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:01.997118 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:01.997099 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f66jw" Jul 18 03:50:02.004791 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:02.004767 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" Jul 18 03:50:02.012546 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:02.012521 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l94vd" Jul 18 03:50:02.020299 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:02.020275 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x92wq" Jul 18 03:50:02.027865 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:02.027843 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l6ljv" Jul 18 03:50:02.093141 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:02.093108 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 03:50:02.271821 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:02.271741 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs\") pod \"network-metrics-daemon-f8944\" (UID: \"15496aee-38ed-4f76-b18f-b84cd34b2dc9\") " pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:02.272003 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:02.271874 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 03:50:02.272003 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:02.271952 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs podName:15496aee-38ed-4f76-b18f-b84cd34b2dc9 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:03.271920647 +0000 UTC m=+4.033554258 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs") pod "network-metrics-daemon-f8944" (UID: "15496aee-38ed-4f76-b18f-b84cd34b2dc9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 03:50:02.372523 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:02.372485 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bskqp\" (UniqueName: \"kubernetes.io/projected/533356c8-0188-468f-956b-f8fc72e64309-kube-api-access-bskqp\") pod \"network-check-target-lb475\" (UID: \"533356c8-0188-468f-956b-f8fc72e64309\") " pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:50:02.372723 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:02.372586 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-original-pull-secret\") pod \"global-pull-secret-syncer-7dx5n\" (UID: \"eadafdbc-08a4-43cb-8bf8-1afbf235bd6f\") " pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:02.372723 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:02.372668 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 03:50:02.372723 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:02.372697 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 03:50:02.372723 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:02.372714 2558 projected.go:196] Error preparing data for projected volume kube-api-access-bskqp for pod openshift-network-diagnostics/network-check-target-lb475: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 03:50:02.372723 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:02.372721 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 03:50:02.372917 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:02.372777 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/533356c8-0188-468f-956b-f8fc72e64309-kube-api-access-bskqp podName:533356c8-0188-468f-956b-f8fc72e64309 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:03.372761945 +0000 UTC m=+4.134395555 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bskqp" (UniqueName: "kubernetes.io/projected/533356c8-0188-468f-956b-f8fc72e64309-kube-api-access-bskqp") pod "network-check-target-lb475" (UID: "533356c8-0188-468f-956b-f8fc72e64309") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 03:50:02.372917 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:02.372794 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-original-pull-secret podName:eadafdbc-08a4-43cb-8bf8-1afbf235bd6f nodeName:}" failed. No retries permitted until 2026-07-18 03:50:03.372787687 +0000 UTC m=+4.134421297 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-original-pull-secret") pod "global-pull-secret-syncer-7dx5n" (UID: "eadafdbc-08a4-43cb-8bf8-1afbf235bd6f") : object "kube-system"/"original-pull-secret" not registered Jul 18 03:50:02.695008 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:02.694893 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 03:45:01 +0000 UTC" deadline="2028-02-09 08:24:08.193677877 +0000 UTC" Jul 18 03:50:02.695008 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:02.694949 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13708h34m5.498747832s" Jul 18 03:50:02.857563 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:50:02.857532 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2824c8d5_c431_4f95_9219_f9969dc5907a.slice/crio-9585b2e47246ec52b7fb6dc896d5cdcf869741544b497cf06fc13f7d1ef19bcc WatchSource:0}: Error finding container 9585b2e47246ec52b7fb6dc896d5cdcf869741544b497cf06fc13f7d1ef19bcc: Status 404 returned error can't find the container with id 9585b2e47246ec52b7fb6dc896d5cdcf869741544b497cf06fc13f7d1ef19bcc Jul 18 03:50:02.858930 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:50:02.858900 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e77f13c_e59f_4453_b512_73bb702f5b6e.slice/crio-c41e803201df77361fe17e9a55ff641473281f1c52a3338cc8e13948a44f2fa4 WatchSource:0}: Error finding container c41e803201df77361fe17e9a55ff641473281f1c52a3338cc8e13948a44f2fa4: Status 404 returned error can't find the container with id c41e803201df77361fe17e9a55ff641473281f1c52a3338cc8e13948a44f2fa4 Jul 18 03:50:02.860394 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:50:02.860344 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8f0a789_ad90_4aee_9a37_c63373aaf151.slice/crio-de3a83a5a63b620e40e97e62e12cb97af4734f72e1766d69372bd3099c1edea2 WatchSource:0}: Error finding container de3a83a5a63b620e40e97e62e12cb97af4734f72e1766d69372bd3099c1edea2: Status 404 returned error can't find the container with id de3a83a5a63b620e40e97e62e12cb97af4734f72e1766d69372bd3099c1edea2 Jul 18 03:50:02.861049 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:50:02.861023 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f0209eb_dee6_49e8_85c5_55a211a0f069.slice/crio-d5db042b19b854a097b478fff15358a8e3faae760114c6fcfc1b43962ea76ec3 WatchSource:0}: Error finding container d5db042b19b854a097b478fff15358a8e3faae760114c6fcfc1b43962ea76ec3: Status 404 returned error can't find the container with id d5db042b19b854a097b478fff15358a8e3faae760114c6fcfc1b43962ea76ec3 Jul 18 03:50:02.864478 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:50:02.864452 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab166e2f_2606_4ec6_97a9_bb22e15f3a22.slice/crio-cecb0cf4a405bda3eaf95638a4f247e1eec466562d01fd5ed5a3d23cad566e92 WatchSource:0}: Error finding container cecb0cf4a405bda3eaf95638a4f247e1eec466562d01fd5ed5a3d23cad566e92: Status 404 returned error can't find the container with id cecb0cf4a405bda3eaf95638a4f247e1eec466562d01fd5ed5a3d23cad566e92 Jul 18 03:50:02.865715 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:50:02.865697 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8434d441_42df_4bd3_9f63_9d5a4d3f1521.slice/crio-b13b974fdc8bdb847b7904562551e5189ae1def3b1a869be059c2fadc0f2022f WatchSource:0}: Error finding container b13b974fdc8bdb847b7904562551e5189ae1def3b1a869be059c2fadc0f2022f: Status 404 returned error can't find the container with id b13b974fdc8bdb847b7904562551e5189ae1def3b1a869be059c2fadc0f2022f Jul 18 03:50:02.867772 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:50:02.867645 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod712b3e8a_f5a5_4edf_9699_99d0eb835360.slice/crio-c1e921188df3ff427c863116d8cd525d077a77993c9f05362350ac39b621acf4 WatchSource:0}: Error finding container c1e921188df3ff427c863116d8cd525d077a77993c9f05362350ac39b621acf4: Status 404 returned error can't find the container with id c1e921188df3ff427c863116d8cd525d077a77993c9f05362350ac39b621acf4 Jul 18 03:50:02.869526 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:50:02.869506 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ee054bb_d92c_45b8_933e_2bebaf9aada6.slice/crio-0940a4b8e97f0f5b81f77f7d3e7c65b2ab1c240e675c1b525d24e5790f8bb265 WatchSource:0}: Error finding container 0940a4b8e97f0f5b81f77f7d3e7c65b2ab1c240e675c1b525d24e5790f8bb265: Status 404 returned error can't find the container with id 0940a4b8e97f0f5b81f77f7d3e7c65b2ab1c240e675c1b525d24e5790f8bb265 Jul 18 03:50:02.870843 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:50:02.870665 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb30bacc8_75f3_48ba_8809_01e630ca256c.slice/crio-ae141abab1275954a9eefd800558324661f5239975e86082df1ede3c568cbb84 WatchSource:0}: Error finding container ae141abab1275954a9eefd800558324661f5239975e86082df1ede3c568cbb84: Status 404 returned error can't find the container with id ae141abab1275954a9eefd800558324661f5239975e86082df1ede3c568cbb84 Jul 18 03:50:02.984334 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:02.984262 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 03:50:03.279657 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:03.279392 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs\") pod \"network-metrics-daemon-f8944\" (UID: \"15496aee-38ed-4f76-b18f-b84cd34b2dc9\") " pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:03.279657 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:03.279547 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 03:50:03.279835 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:03.279678 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs podName:15496aee-38ed-4f76-b18f-b84cd34b2dc9 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:05.279662663 +0000 UTC m=+6.041296273 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs") pod "network-metrics-daemon-f8944" (UID: "15496aee-38ed-4f76-b18f-b84cd34b2dc9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 03:50:03.380603 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:03.380565 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-original-pull-secret\") pod \"global-pull-secret-syncer-7dx5n\" (UID: \"eadafdbc-08a4-43cb-8bf8-1afbf235bd6f\") " pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:03.380777 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:03.380634 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bskqp\" (UniqueName: \"kubernetes.io/projected/533356c8-0188-468f-956b-f8fc72e64309-kube-api-access-bskqp\") pod \"network-check-target-lb475\" (UID: \"533356c8-0188-468f-956b-f8fc72e64309\") " pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:50:03.380838 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:03.380803 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 03:50:03.380838 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:03.380825 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 03:50:03.380919 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:03.380839 2558 projected.go:196] Error preparing data for projected volume kube-api-access-bskqp for pod openshift-network-diagnostics/network-check-target-lb475: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 03:50:03.380919 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:03.380901 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/533356c8-0188-468f-956b-f8fc72e64309-kube-api-access-bskqp podName:533356c8-0188-468f-956b-f8fc72e64309 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:05.380882399 +0000 UTC m=+6.142516013 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bskqp" (UniqueName: "kubernetes.io/projected/533356c8-0188-468f-956b-f8fc72e64309-kube-api-access-bskqp") pod "network-check-target-lb475" (UID: "533356c8-0188-468f-956b-f8fc72e64309") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 03:50:03.381423 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:03.381336 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 03:50:03.381423 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:03.381393 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-original-pull-secret podName:eadafdbc-08a4-43cb-8bf8-1afbf235bd6f nodeName:}" failed. No retries permitted until 2026-07-18 03:50:05.381377156 +0000 UTC m=+6.143010769 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-original-pull-secret") pod "global-pull-secret-syncer-7dx5n" (UID: "eadafdbc-08a4-43cb-8bf8-1afbf235bd6f") : object "kube-system"/"original-pull-secret" not registered Jul 18 03:50:03.696128 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:03.695998 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 03:45:01 +0000 UTC" deadline="2028-02-26 02:18:58.995402566 +0000 UTC" Jul 18 03:50:03.696128 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:03.696041 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14110h28m55.299366603s" Jul 18 03:50:03.768741 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:03.768705 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:50:03.768974 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:03.768909 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lb475" podUID="533356c8-0188-468f-956b-f8fc72e64309" Jul 18 03:50:03.769529 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:03.769489 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:03.769654 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:03.769634 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7dx5n" podUID="eadafdbc-08a4-43cb-8bf8-1afbf235bd6f" Jul 18 03:50:03.769746 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:03.769732 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:03.769898 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:03.769880 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8944" podUID="15496aee-38ed-4f76-b18f-b84cd34b2dc9" Jul 18 03:50:03.780778 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:03.780744 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4srql" event={"ID":"6e77f13c-e59f-4453-b512-73bb702f5b6e","Type":"ContainerStarted","Data":"c41e803201df77361fe17e9a55ff641473281f1c52a3338cc8e13948a44f2fa4"} Jul 18 03:50:03.787121 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:03.787091 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" event={"ID":"b8f0a789-ad90-4aee-9a37-c63373aaf151","Type":"ContainerStarted","Data":"de3a83a5a63b620e40e97e62e12cb97af4734f72e1766d69372bd3099c1edea2"} Jul 18 03:50:03.802477 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:03.802373 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f66jw" event={"ID":"2824c8d5-c431-4f95-9219-f9969dc5907a","Type":"ContainerStarted","Data":"9585b2e47246ec52b7fb6dc896d5cdcf869741544b497cf06fc13f7d1ef19bcc"} Jul 18 03:50:03.810792 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:03.810720 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-224.ec2.internal" event={"ID":"90a4a6eaac46277c0148bd75d4544ffb","Type":"ContainerStarted","Data":"28da3cfa2d0d3e5bdbda216881197a9e96cba461a18d6c067a7a9db315a256d7"} Jul 18 03:50:03.824890 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:03.824824 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-224.ec2.internal" podStartSLOduration=3.8248063119999998 podStartE2EDuration="3.824806312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:03.824793893 +0000 UTC m=+4.586427527" watchObservedRunningTime="2026-07-18 03:50:03.824806312 +0000 UTC m=+4.586439945" Jul 18 03:50:03.825506 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:03.825414 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-74gks" event={"ID":"0ee054bb-d92c-45b8-933e-2bebaf9aada6","Type":"ContainerStarted","Data":"0940a4b8e97f0f5b81f77f7d3e7c65b2ab1c240e675c1b525d24e5790f8bb265"} Jul 18 03:50:03.828630 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:03.828549 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l" event={"ID":"712b3e8a-f5a5-4edf-9699-99d0eb835360","Type":"ContainerStarted","Data":"c1e921188df3ff427c863116d8cd525d077a77993c9f05362350ac39b621acf4"} Jul 18 03:50:03.831334 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:03.831286 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l94vd" event={"ID":"6f0209eb-dee6-49e8-85c5-55a211a0f069","Type":"ContainerStarted","Data":"d5db042b19b854a097b478fff15358a8e3faae760114c6fcfc1b43962ea76ec3"} Jul 18 03:50:03.844027 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:03.843990 2558 generic.go:356] "Generic (PLEG): container finished" podID="c721835e4e909ab98512834ab0e67c6f" containerID="368229352db84b52923b16d753f260f7bff7fc20fe21817b2c93de192b721e7b" exitCode=0 Jul 18 03:50:03.844741 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:03.844714 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-224.ec2.internal" event={"ID":"c721835e4e909ab98512834ab0e67c6f","Type":"ContainerDied","Data":"368229352db84b52923b16d753f260f7bff7fc20fe21817b2c93de192b721e7b"} Jul 18 03:50:03.861628 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:03.861524 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" event={"ID":"b30bacc8-75f3-48ba-8809-01e630ca256c","Type":"ContainerStarted","Data":"ae141abab1275954a9eefd800558324661f5239975e86082df1ede3c568cbb84"} Jul 18 03:50:03.874850 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:03.874812 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x92wq" event={"ID":"8434d441-42df-4bd3-9f63-9d5a4d3f1521","Type":"ContainerStarted","Data":"b13b974fdc8bdb847b7904562551e5189ae1def3b1a869be059c2fadc0f2022f"} Jul 18 03:50:03.889814 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:03.889767 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l6ljv" event={"ID":"ab166e2f-2606-4ec6-97a9-bb22e15f3a22","Type":"ContainerStarted","Data":"cecb0cf4a405bda3eaf95638a4f247e1eec466562d01fd5ed5a3d23cad566e92"} Jul 18 03:50:04.922840 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:04.922568 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-224.ec2.internal" event={"ID":"c721835e4e909ab98512834ab0e67c6f","Type":"ContainerStarted","Data":"4272bdc0d35379e360ce07a16dc2254c18e5f62068970dcc5ce6200b3827ffa7"} Jul 18 03:50:05.297986 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:05.297883 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs\") pod \"network-metrics-daemon-f8944\" (UID: \"15496aee-38ed-4f76-b18f-b84cd34b2dc9\") " pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:05.298150 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:05.298138 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 03:50:05.298208 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:05.298200 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs podName:15496aee-38ed-4f76-b18f-b84cd34b2dc9 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:09.298182543 +0000 UTC m=+10.059816159 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs") pod "network-metrics-daemon-f8944" (UID: "15496aee-38ed-4f76-b18f-b84cd34b2dc9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 03:50:05.398885 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:05.398835 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-original-pull-secret\") pod \"global-pull-secret-syncer-7dx5n\" (UID: \"eadafdbc-08a4-43cb-8bf8-1afbf235bd6f\") " pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:05.399089 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:05.398899 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bskqp\" (UniqueName: \"kubernetes.io/projected/533356c8-0188-468f-956b-f8fc72e64309-kube-api-access-bskqp\") pod \"network-check-target-lb475\" (UID: \"533356c8-0188-468f-956b-f8fc72e64309\") " pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:50:05.399089 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:05.399085 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 03:50:05.399208 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:05.399105 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 03:50:05.399208 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:05.399118 2558 projected.go:196] Error preparing data for projected volume kube-api-access-bskqp for pod openshift-network-diagnostics/network-check-target-lb475: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 03:50:05.399208 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:05.399175 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/533356c8-0188-468f-956b-f8fc72e64309-kube-api-access-bskqp podName:533356c8-0188-468f-956b-f8fc72e64309 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:09.399157342 +0000 UTC m=+10.160790957 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bskqp" (UniqueName: "kubernetes.io/projected/533356c8-0188-468f-956b-f8fc72e64309-kube-api-access-bskqp") pod "network-check-target-lb475" (UID: "533356c8-0188-468f-956b-f8fc72e64309") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 03:50:05.399588 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:05.399566 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 03:50:05.399676 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:05.399623 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-original-pull-secret podName:eadafdbc-08a4-43cb-8bf8-1afbf235bd6f nodeName:}" failed. No retries permitted until 2026-07-18 03:50:09.399608808 +0000 UTC m=+10.161242420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-original-pull-secret") pod "global-pull-secret-syncer-7dx5n" (UID: "eadafdbc-08a4-43cb-8bf8-1afbf235bd6f") : object "kube-system"/"original-pull-secret" not registered Jul 18 03:50:05.762223 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:05.762139 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:05.762391 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:05.762291 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8944" podUID="15496aee-38ed-4f76-b18f-b84cd34b2dc9" Jul 18 03:50:05.762468 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:05.762443 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:50:05.762551 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:05.762527 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lb475" podUID="533356c8-0188-468f-956b-f8fc72e64309" Jul 18 03:50:05.762628 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:05.762583 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:05.762693 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:05.762651 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7dx5n" podUID="eadafdbc-08a4-43cb-8bf8-1afbf235bd6f" Jul 18 03:50:07.760554 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:07.760367 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:07.760554 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:07.760420 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:07.760554 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:07.760373 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:50:07.761152 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:07.760557 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8944" podUID="15496aee-38ed-4f76-b18f-b84cd34b2dc9" Jul 18 03:50:07.761152 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:07.760695 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lb475" podUID="533356c8-0188-468f-956b-f8fc72e64309" Jul 18 03:50:07.761152 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:07.760856 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7dx5n" podUID="eadafdbc-08a4-43cb-8bf8-1afbf235bd6f" Jul 18 03:50:09.334519 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:09.334474 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs\") pod \"network-metrics-daemon-f8944\" (UID: \"15496aee-38ed-4f76-b18f-b84cd34b2dc9\") " pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:09.335011 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:09.334623 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 03:50:09.335011 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:09.334689 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs podName:15496aee-38ed-4f76-b18f-b84cd34b2dc9 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:17.334669668 +0000 UTC m=+18.096303283 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs") pod "network-metrics-daemon-f8944" (UID: "15496aee-38ed-4f76-b18f-b84cd34b2dc9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 03:50:09.435605 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:09.435566 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-original-pull-secret\") pod \"global-pull-secret-syncer-7dx5n\" (UID: \"eadafdbc-08a4-43cb-8bf8-1afbf235bd6f\") " pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:09.435792 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:09.435636 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bskqp\" (UniqueName: \"kubernetes.io/projected/533356c8-0188-468f-956b-f8fc72e64309-kube-api-access-bskqp\") pod \"network-check-target-lb475\" (UID: \"533356c8-0188-468f-956b-f8fc72e64309\") " pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:50:09.435792 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:09.435738 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 03:50:09.435903 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:09.435791 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 03:50:09.435903 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:09.435809 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 03:50:09.435903 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:09.435813 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-original-pull-secret podName:eadafdbc-08a4-43cb-8bf8-1afbf235bd6f nodeName:}" failed. No retries permitted until 2026-07-18 03:50:17.435794446 +0000 UTC m=+18.197428055 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-original-pull-secret") pod "global-pull-secret-syncer-7dx5n" (UID: "eadafdbc-08a4-43cb-8bf8-1afbf235bd6f") : object "kube-system"/"original-pull-secret" not registered Jul 18 03:50:09.435903 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:09.435822 2558 projected.go:196] Error preparing data for projected volume kube-api-access-bskqp for pod openshift-network-diagnostics/network-check-target-lb475: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 03:50:09.435903 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:09.435873 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/533356c8-0188-468f-956b-f8fc72e64309-kube-api-access-bskqp podName:533356c8-0188-468f-956b-f8fc72e64309 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:17.435858756 +0000 UTC m=+18.197492372 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bskqp" (UniqueName: "kubernetes.io/projected/533356c8-0188-468f-956b-f8fc72e64309-kube-api-access-bskqp") pod "network-check-target-lb475" (UID: "533356c8-0188-468f-956b-f8fc72e64309") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 03:50:09.761631 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:09.761540 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:09.761789 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:09.761664 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8944" podUID="15496aee-38ed-4f76-b18f-b84cd34b2dc9" Jul 18 03:50:09.762121 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:09.761926 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:09.762121 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:09.762073 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7dx5n" podUID="eadafdbc-08a4-43cb-8bf8-1afbf235bd6f" Jul 18 03:50:09.762121 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:09.762113 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:50:09.762341 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:09.762208 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lb475" podUID="533356c8-0188-468f-956b-f8fc72e64309" Jul 18 03:50:11.760207 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:11.760176 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:11.760642 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:11.760308 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7dx5n" podUID="eadafdbc-08a4-43cb-8bf8-1afbf235bd6f" Jul 18 03:50:11.760642 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:11.760427 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:11.760642 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:11.760554 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8944" podUID="15496aee-38ed-4f76-b18f-b84cd34b2dc9" Jul 18 03:50:11.760642 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:11.760586 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:50:11.760872 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:11.760664 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lb475" podUID="533356c8-0188-468f-956b-f8fc72e64309" Jul 18 03:50:13.760345 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:13.760275 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:13.760861 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:13.760281 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:13.760861 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:13.760423 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7dx5n" podUID="eadafdbc-08a4-43cb-8bf8-1afbf235bd6f" Jul 18 03:50:13.760861 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:13.760275 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:50:13.760861 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:13.760514 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8944" podUID="15496aee-38ed-4f76-b18f-b84cd34b2dc9" Jul 18 03:50:13.760861 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:13.760548 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lb475" podUID="533356c8-0188-468f-956b-f8fc72e64309" Jul 18 03:50:15.760546 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:15.760478 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:15.760546 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:15.760519 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:50:15.761114 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:15.760489 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:15.761114 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:15.760621 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7dx5n" podUID="eadafdbc-08a4-43cb-8bf8-1afbf235bd6f" Jul 18 03:50:15.761114 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:15.760720 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8944" podUID="15496aee-38ed-4f76-b18f-b84cd34b2dc9" Jul 18 03:50:15.761114 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:15.760794 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lb475" podUID="533356c8-0188-468f-956b-f8fc72e64309" Jul 18 03:50:17.396086 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:17.396047 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs\") pod \"network-metrics-daemon-f8944\" (UID: \"15496aee-38ed-4f76-b18f-b84cd34b2dc9\") " pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:17.396476 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:17.396196 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 03:50:17.396476 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:17.396257 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs podName:15496aee-38ed-4f76-b18f-b84cd34b2dc9 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:33.396243097 +0000 UTC m=+34.157876709 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs") pod "network-metrics-daemon-f8944" (UID: "15496aee-38ed-4f76-b18f-b84cd34b2dc9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 03:50:17.496627 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:17.496534 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bskqp\" (UniqueName: \"kubernetes.io/projected/533356c8-0188-468f-956b-f8fc72e64309-kube-api-access-bskqp\") pod \"network-check-target-lb475\" (UID: \"533356c8-0188-468f-956b-f8fc72e64309\") " pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:50:17.496627 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:17.496625 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-original-pull-secret\") pod \"global-pull-secret-syncer-7dx5n\" (UID: \"eadafdbc-08a4-43cb-8bf8-1afbf235bd6f\") " pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:17.496845 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:17.496721 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 03:50:17.496845 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:17.496797 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-original-pull-secret podName:eadafdbc-08a4-43cb-8bf8-1afbf235bd6f nodeName:}" failed. No retries permitted until 2026-07-18 03:50:33.49677704 +0000 UTC m=+34.258410656 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-original-pull-secret") pod "global-pull-secret-syncer-7dx5n" (UID: "eadafdbc-08a4-43cb-8bf8-1afbf235bd6f") : object "kube-system"/"original-pull-secret" not registered Jul 18 03:50:17.496845 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:17.496724 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 03:50:17.496845 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:17.496840 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 03:50:17.497116 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:17.496856 2558 projected.go:196] Error preparing data for projected volume kube-api-access-bskqp for pod openshift-network-diagnostics/network-check-target-lb475: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 03:50:17.497116 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:17.496915 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/533356c8-0188-468f-956b-f8fc72e64309-kube-api-access-bskqp podName:533356c8-0188-468f-956b-f8fc72e64309 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:33.496898742 +0000 UTC m=+34.258532353 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bskqp" (UniqueName: "kubernetes.io/projected/533356c8-0188-468f-956b-f8fc72e64309-kube-api-access-bskqp") pod "network-check-target-lb475" (UID: "533356c8-0188-468f-956b-f8fc72e64309") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 03:50:17.760438 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:17.760358 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:17.760599 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:17.760358 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:50:17.760599 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:17.760490 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7dx5n" podUID="eadafdbc-08a4-43cb-8bf8-1afbf235bd6f" Jul 18 03:50:17.760599 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:17.760502 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:17.760599 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:17.760578 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lb475" podUID="533356c8-0188-468f-956b-f8fc72e64309" Jul 18 03:50:17.760788 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:17.760676 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8944" podUID="15496aee-38ed-4f76-b18f-b84cd34b2dc9" Jul 18 03:50:19.760906 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:19.760867 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:50:19.761402 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:19.761027 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:19.761402 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:19.761038 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lb475" podUID="533356c8-0188-468f-956b-f8fc72e64309" Jul 18 03:50:19.761402 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:19.761128 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8944" podUID="15496aee-38ed-4f76-b18f-b84cd34b2dc9" Jul 18 03:50:19.761402 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:19.761155 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:19.761402 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:19.761224 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7dx5n" podUID="eadafdbc-08a4-43cb-8bf8-1afbf235bd6f" Jul 18 03:50:21.760976 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:21.760775 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:50:21.762100 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:21.760775 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:21.762100 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:21.761094 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lb475" podUID="533356c8-0188-468f-956b-f8fc72e64309" Jul 18 03:50:21.762100 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:21.760918 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:21.762100 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:21.761228 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8944" podUID="15496aee-38ed-4f76-b18f-b84cd34b2dc9" Jul 18 03:50:21.762100 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:21.761264 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7dx5n" podUID="eadafdbc-08a4-43cb-8bf8-1afbf235bd6f" Jul 18 03:50:21.958831 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:21.958596 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" event={"ID":"b30bacc8-75f3-48ba-8809-01e630ca256c","Type":"ContainerStarted","Data":"d719c4aa9bcbb9d2881d096f26d5eef1799d98599a34af61409a666443197dee"} Jul 18 03:50:21.961152 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:21.960966 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x92wq" event={"ID":"8434d441-42df-4bd3-9f63-9d5a4d3f1521","Type":"ContainerStarted","Data":"031e6e20e84ef242860105bcd581ec45c27e0576e3321088379a9ed1e5841a69"} Jul 18 03:50:21.963259 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:21.963232 2558 generic.go:356] "Generic (PLEG): container finished" podID="6e77f13c-e59f-4453-b512-73bb702f5b6e" containerID="3151d73875eedb6e4bbc30a5b646cc024bc3666c8866d85d07e1bfe3f7708a2b" exitCode=0 Jul 18 03:50:21.963365 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:21.963307 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4srql" event={"ID":"6e77f13c-e59f-4453-b512-73bb702f5b6e","Type":"ContainerDied","Data":"3151d73875eedb6e4bbc30a5b646cc024bc3666c8866d85d07e1bfe3f7708a2b"} Jul 18 03:50:21.968263 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:21.968237 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" event={"ID":"b8f0a789-ad90-4aee-9a37-c63373aaf151","Type":"ContainerStarted","Data":"587ee894a6b9c087bf8e9159a593b5e40d69ba7a5811c346e1579b85623a7c53"} Jul 18 03:50:21.968355 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:21.968330 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" event={"ID":"b8f0a789-ad90-4aee-9a37-c63373aaf151","Type":"ContainerStarted","Data":"f1a77bc91576eb6f972f1386616e84d9706c2a67a13d892d9c15387d0e3720c3"} Jul 18 03:50:21.968406 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:21.968375 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" event={"ID":"b8f0a789-ad90-4aee-9a37-c63373aaf151","Type":"ContainerStarted","Data":"f93b0826e96bf44f09974ca5fa8ba3640eaa00db47e4612c8763f88fa4d720f9"} Jul 18 03:50:21.968450 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:21.968414 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" event={"ID":"b8f0a789-ad90-4aee-9a37-c63373aaf151","Type":"ContainerStarted","Data":"616e231f9e1cb02a9d200fd4b379d9c439d7559094c40f21453f9cd9cc194a21"} Jul 18 03:50:21.969611 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:21.969580 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f66jw" event={"ID":"2824c8d5-c431-4f95-9219-f9969dc5907a","Type":"ContainerStarted","Data":"1772ed6333d36e082b52e544a716e11d4890e2fcbcb1c95fd1669a4bebe408f2"} Jul 18 03:50:21.970995 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:21.970972 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-74gks" event={"ID":"0ee054bb-d92c-45b8-933e-2bebaf9aada6","Type":"ContainerStarted","Data":"7fa5dd1db72b6e80ebcf37aee3ed29bddde1b4d2ea36fbd76429ff2547948aa5"} Jul 18 03:50:21.972452 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:21.972433 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l" event={"ID":"712b3e8a-f5a5-4edf-9699-99d0eb835360","Type":"ContainerStarted","Data":"ffc53f3621bcf2bc8656995354520b68deae67ebdd669dc276cf5776a3155e21"} Jul 18 03:50:21.973634 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:21.973597 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hvkhb" podStartSLOduration=3.308900118 podStartE2EDuration="21.973586669s" totalImagesPullingTime="18.664686551s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:21.973279641 +0000 UTC m=+22.734913274" watchObservedRunningTime="2026-07-18 03:50:21.973586669 +0000 UTC m=+22.735220301" Jul 18 03:50:21.973756 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:21.973683 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-224.ec2.internal" podStartSLOduration=21.97368027 podStartE2EDuration="21.97368027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:04.938057413 +0000 UTC m=+5.699691050" watchObservedRunningTime="2026-07-18 03:50:21.97368027 +0000 UTC m=+22.735313903" Jul 18 03:50:21.973880 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:21.973862 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l94vd" event={"ID":"6f0209eb-dee6-49e8-85c5-55a211a0f069","Type":"ContainerStarted","Data":"e8f6cb8fbe3bf6921db76af4ebf6f1339e5cd4685fc06efab72be10dd231146a"} Jul 18 03:50:21.988861 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:21.988819 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-f66jw" podStartSLOduration=3.252421444 podStartE2EDuration="21.988800875s" totalImagesPullingTime="18.736379431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:21.988044206 +0000 UTC m=+22.749677837" watchObservedRunningTime="2026-07-18 03:50:21.988800875 +0000 UTC m=+22.750434507" Jul 18 03:50:22.005374 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:22.005332 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-x92wq" podStartSLOduration=7.702975696 podStartE2EDuration="22.005317689s" totalImagesPullingTime="14.302341993s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:22.005151233 +0000 UTC m=+22.766784866" watchObservedRunningTime="2026-07-18 03:50:22.005317689 +0000 UTC m=+22.766951321" Jul 18 03:50:22.048929 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:22.048881 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-74gks" podStartSLOduration=8.749771506 podStartE2EDuration="23.048865338s" totalImagesPullingTime="14.299093832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:49:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:22.048658082 +0000 UTC m=+22.810291714" watchObservedRunningTime="2026-07-18 03:50:22.048865338 +0000 UTC m=+22.810499016" Jul 18 03:50:22.065087 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:22.065040 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-l94vd" podStartSLOduration=3.429928213 podStartE2EDuration="22.065023414s" totalImagesPullingTime="18.635095201s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:22.064777565 +0000 UTC m=+22.826411200" watchObservedRunningTime="2026-07-18 03:50:22.065023414 +0000 UTC m=+22.826657045" Jul 18 03:50:22.978614 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:22.978578 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l6ljv" event={"ID":"ab166e2f-2606-4ec6-97a9-bb22e15f3a22","Type":"ContainerStarted","Data":"aeb0bba20225ec4dd4ff782254271c3560e9232ad710efc70c9a5ffccfc0d655"} Jul 18 03:50:22.982462 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:22.982436 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" event={"ID":"b8f0a789-ad90-4aee-9a37-c63373aaf151","Type":"ContainerStarted","Data":"5fa33909b60693a4d43144e3d7e71619c1f563c6c3bc621e4c06b5076477433e"} Jul 18 03:50:22.982597 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:22.982523 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" event={"ID":"b8f0a789-ad90-4aee-9a37-c63373aaf151","Type":"ContainerStarted","Data":"616fe77ad7f72adb387161527833258089733df6f392c56983f8a26c82114e4e"} Jul 18 03:50:22.992034 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:22.991985 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-l6ljv" podStartSLOduration=4.361106903 podStartE2EDuration="22.991966817s" totalImagesPullingTime="18.630859914s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:22.991505719 +0000 UTC m=+23.753139353" watchObservedRunningTime="2026-07-18 03:50:22.991966817 +0000 UTC m=+23.753600452" Jul 18 03:50:23.041015 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:23.040983 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 18 03:50:23.728887 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:23.728772 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-18T03:50:23.041007245Z","UUID":"c9efd3fc-d9fd-4d64-a1e2-e594867911bb","Handler":null,"Name":"","Endpoint":""} Jul 18 03:50:23.730929 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:23.730906 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 18 03:50:23.731072 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:23.730968 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 18 03:50:23.760290 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:23.760261 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:23.760452 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:23.760293 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:50:23.760452 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:23.760266 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:23.760452 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:23.760406 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7dx5n" podUID="eadafdbc-08a4-43cb-8bf8-1afbf235bd6f" Jul 18 03:50:23.760622 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:23.760514 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8944" podUID="15496aee-38ed-4f76-b18f-b84cd34b2dc9" Jul 18 03:50:23.760622 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:23.760594 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lb475" podUID="533356c8-0188-468f-956b-f8fc72e64309" Jul 18 03:50:23.987099 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:23.986956 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l" event={"ID":"712b3e8a-f5a5-4edf-9699-99d0eb835360","Type":"ContainerStarted","Data":"81e30a8294829fad8e499d2924487cdef4a3e5e3cf78baf256d534b10161a7c3"} Jul 18 03:50:24.658778 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:24.658744 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-74gks" Jul 18 03:50:24.659466 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:24.659445 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-74gks" Jul 18 03:50:24.993536 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:24.993458 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" event={"ID":"b8f0a789-ad90-4aee-9a37-c63373aaf151","Type":"ContainerStarted","Data":"73ec907095685f7822bcaf1a99858eb915080f6f473ba8abb691828ef4431828"} Jul 18 03:50:24.996002 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:24.995958 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l" event={"ID":"712b3e8a-f5a5-4edf-9699-99d0eb835360","Type":"ContainerStarted","Data":"6063baf1def76dca85fdab3651cd9050ae612ebc8e984eaa8aea448ce697ac5b"} Jul 18 03:50:24.996259 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:24.996200 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-74gks" Jul 18 03:50:24.996711 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:24.996680 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-74gks" Jul 18 03:50:25.011265 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:25.011218 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m245l" podStartSLOduration=4.952089506 podStartE2EDuration="26.011204751s" totalImagesPullingTime="21.059115245s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:49:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:25.010808849 +0000 UTC m=+25.772442482" watchObservedRunningTime="2026-07-18 03:50:25.011204751 +0000 UTC m=+25.772838408" Jul 18 03:50:25.760084 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:25.759846 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:50:25.760283 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:25.759859 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:25.760283 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:25.760192 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lb475" podUID="533356c8-0188-468f-956b-f8fc72e64309" Jul 18 03:50:25.760283 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:25.759913 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:25.760450 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:25.760285 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7dx5n" podUID="eadafdbc-08a4-43cb-8bf8-1afbf235bd6f" Jul 18 03:50:25.760450 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:25.760352 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8944" podUID="15496aee-38ed-4f76-b18f-b84cd34b2dc9" Jul 18 03:50:27.002494 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:27.002460 2558 generic.go:356] "Generic (PLEG): container finished" podID="6e77f13c-e59f-4453-b512-73bb702f5b6e" containerID="2c980b75798a0dfd0f29d2b19c1071865cdc54ac709b340c540c51ee4d77417c" exitCode=0 Jul 18 03:50:27.003348 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:27.002502 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4srql" event={"ID":"6e77f13c-e59f-4453-b512-73bb702f5b6e","Type":"ContainerDied","Data":"2c980b75798a0dfd0f29d2b19c1071865cdc54ac709b340c540c51ee4d77417c"} Jul 18 03:50:27.006321 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:27.006295 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" event={"ID":"b8f0a789-ad90-4aee-9a37-c63373aaf151","Type":"ContainerStarted","Data":"b9fd83e3525e643d3d0b0d0f9896e71c4a60bf0dfdad8b63ffe4d6f18f87f13f"} Jul 18 03:50:27.006782 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:27.006760 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:27.006868 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:27.006819 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:27.022073 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:27.021890 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:27.056135 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:27.056082 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" podStartSLOduration=9.317462057 podStartE2EDuration="28.056064937s" totalImagesPullingTime="18.73860288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:49:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:27.055823696 +0000 UTC m=+27.817457341" watchObservedRunningTime="2026-07-18 03:50:27.056064937 +0000 UTC m=+27.817698568" Jul 18 03:50:27.759993 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:27.759957 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:27.760200 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:27.759956 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:50:27.760200 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:27.760089 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:27.760200 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:27.760096 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8944" podUID="15496aee-38ed-4f76-b18f-b84cd34b2dc9" Jul 18 03:50:27.760200 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:27.760190 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lb475" podUID="533356c8-0188-468f-956b-f8fc72e64309" Jul 18 03:50:27.760395 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:27.760279 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7dx5n" podUID="eadafdbc-08a4-43cb-8bf8-1afbf235bd6f" Jul 18 03:50:28.008394 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:28.008365 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:28.023651 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:28.023590 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:50:28.623767 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:28.623730 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7dx5n"] Jul 18 03:50:28.623981 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:28.623872 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:28.624044 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:28.623979 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7dx5n" podUID="eadafdbc-08a4-43cb-8bf8-1afbf235bd6f" Jul 18 03:50:28.626745 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:28.626709 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f8944"] Jul 18 03:50:28.626877 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:28.626846 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:28.626999 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:28.626979 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8944" podUID="15496aee-38ed-4f76-b18f-b84cd34b2dc9" Jul 18 03:50:28.627328 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:28.627308 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lb475"] Jul 18 03:50:28.627415 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:28.627401 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:50:28.627491 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:28.627474 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lb475" podUID="533356c8-0188-468f-956b-f8fc72e64309" Jul 18 03:50:29.012262 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:29.012187 2558 generic.go:356] "Generic (PLEG): container finished" podID="6e77f13c-e59f-4453-b512-73bb702f5b6e" containerID="f8bfcf15e5a8daf1b4a8530e2f5d9094baa3a0618a22aade0cf8da63e37dd830" exitCode=0 Jul 18 03:50:29.012635 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:29.012274 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4srql" event={"ID":"6e77f13c-e59f-4453-b512-73bb702f5b6e","Type":"ContainerDied","Data":"f8bfcf15e5a8daf1b4a8530e2f5d9094baa3a0618a22aade0cf8da63e37dd830"} Jul 18 03:50:30.759846 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:30.759814 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:50:30.760282 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:30.759817 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:30.760282 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:30.759817 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:30.760282 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:30.759962 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lb475" podUID="533356c8-0188-468f-956b-f8fc72e64309" Jul 18 03:50:30.760282 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:30.760015 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7dx5n" podUID="eadafdbc-08a4-43cb-8bf8-1afbf235bd6f" Jul 18 03:50:30.760282 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:30.760088 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8944" podUID="15496aee-38ed-4f76-b18f-b84cd34b2dc9" Jul 18 03:50:31.019654 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:31.019622 2558 generic.go:356] "Generic (PLEG): container finished" podID="6e77f13c-e59f-4453-b512-73bb702f5b6e" containerID="bf477699316c20d355b52b70e3ec594e34dc9beccde902b0f8bfeb66050571ea" exitCode=0 Jul 18 03:50:31.019820 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:31.019672 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4srql" event={"ID":"6e77f13c-e59f-4453-b512-73bb702f5b6e","Type":"ContainerDied","Data":"bf477699316c20d355b52b70e3ec594e34dc9beccde902b0f8bfeb66050571ea"} Jul 18 03:50:32.760045 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:32.759826 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:32.760475 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:32.759866 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:50:32.760475 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:32.760135 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7dx5n" podUID="eadafdbc-08a4-43cb-8bf8-1afbf235bd6f" Jul 18 03:50:32.760475 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:32.759866 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:32.760475 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:32.760210 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lb475" podUID="533356c8-0188-468f-956b-f8fc72e64309" Jul 18 03:50:32.760475 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:32.760315 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8944" podUID="15496aee-38ed-4f76-b18f-b84cd34b2dc9" Jul 18 03:50:33.412896 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:33.412859 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs\") pod \"network-metrics-daemon-f8944\" (UID: \"15496aee-38ed-4f76-b18f-b84cd34b2dc9\") " pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:33.413077 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:33.413039 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 03:50:33.413133 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:33.413115 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs podName:15496aee-38ed-4f76-b18f-b84cd34b2dc9 nodeName:}" failed. No retries permitted until 2026-07-18 03:51:05.413093385 +0000 UTC m=+66.174726998 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs") pod "network-metrics-daemon-f8944" (UID: "15496aee-38ed-4f76-b18f-b84cd34b2dc9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 03:50:33.513582 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:33.513541 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bskqp\" (UniqueName: \"kubernetes.io/projected/533356c8-0188-468f-956b-f8fc72e64309-kube-api-access-bskqp\") pod \"network-check-target-lb475\" (UID: \"533356c8-0188-468f-956b-f8fc72e64309\") " pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:50:33.513779 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:33.513624 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-original-pull-secret\") pod \"global-pull-secret-syncer-7dx5n\" (UID: \"eadafdbc-08a4-43cb-8bf8-1afbf235bd6f\") " pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:33.513779 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:33.513730 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 03:50:33.513779 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:33.513745 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 03:50:33.513779 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:33.513751 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 03:50:33.513779 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:33.513766 2558 projected.go:196] Error preparing data for projected volume kube-api-access-bskqp for pod openshift-network-diagnostics/network-check-target-lb475: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 03:50:33.514010 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:33.513815 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-original-pull-secret podName:eadafdbc-08a4-43cb-8bf8-1afbf235bd6f nodeName:}" failed. No retries permitted until 2026-07-18 03:51:05.513795206 +0000 UTC m=+66.275428822 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-original-pull-secret") pod "global-pull-secret-syncer-7dx5n" (UID: "eadafdbc-08a4-43cb-8bf8-1afbf235bd6f") : object "kube-system"/"original-pull-secret" not registered Jul 18 03:50:33.514010 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:33.513838 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/533356c8-0188-468f-956b-f8fc72e64309-kube-api-access-bskqp podName:533356c8-0188-468f-956b-f8fc72e64309 nodeName:}" failed. No retries permitted until 2026-07-18 03:51:05.513826389 +0000 UTC m=+66.275460004 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bskqp" (UniqueName: "kubernetes.io/projected/533356c8-0188-468f-956b-f8fc72e64309-kube-api-access-bskqp") pod "network-check-target-lb475" (UID: "533356c8-0188-468f-956b-f8fc72e64309") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 03:50:34.530765 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.530728 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-224.ec2.internal" event="NodeReady" Jul 18 03:50:34.531373 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.530915 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 18 03:50:34.562887 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.562851 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-77mmr"] Jul 18 03:50:34.566919 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.566893 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67b88fc4d6-t5z9g"] Jul 18 03:50:34.567090 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.567032 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-77mmr" Jul 18 03:50:34.569390 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.569363 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 18 03:50:34.569567 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.569550 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-t9khv\"" Jul 18 03:50:34.569649 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.569624 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 18 03:50:34.569912 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.569888 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:34.572320 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.572301 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kp4b6\"" Jul 18 03:50:34.572320 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.572315 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 18 03:50:34.572467 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.572339 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 18 03:50:34.572467 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.572369 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 18 03:50:34.576497 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.576038 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-77mmr"] Jul 18 03:50:34.578388 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.578253 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 18 03:50:34.579127 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.579105 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-njlzd"] Jul 18 03:50:34.582635 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.582613 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67b88fc4d6-t5z9g"] Jul 18 03:50:34.582744 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.582723 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-njlzd" Jul 18 03:50:34.585728 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.585553 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9czfx"] Jul 18 03:50:34.585728 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.585665 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 18 03:50:34.585728 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.585696 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6rnqn\"" Jul 18 03:50:34.585927 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.585889 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 18 03:50:34.589210 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.589189 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9czfx" Jul 18 03:50:34.592034 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.591916 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 18 03:50:34.592034 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.591973 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nm4kf\"" Jul 18 03:50:34.592435 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.592244 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 18 03:50:34.592435 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.592251 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 18 03:50:34.593449 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.593428 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-njlzd"] Jul 18 03:50:34.597399 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.597374 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9czfx"] Jul 18 03:50:34.621139 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.621107 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-77mmr\" (UID: \"f2341662-76e0-4fcd-bd08-f9aa4128746b\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-77mmr" Jul 18 03:50:34.621324 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.621194 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f2341662-76e0-4fcd-bd08-f9aa4128746b-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-77mmr\" (UID: \"f2341662-76e0-4fcd-bd08-f9aa4128746b\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-77mmr" Jul 18 03:50:34.722114 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.722071 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-77mmr\" (UID: \"f2341662-76e0-4fcd-bd08-f9aa4128746b\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-77mmr" Jul 18 03:50:34.722269 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.722134 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46e600e7-76a1-49e4-bcd7-00c1caaaf2e0-cert\") pod \"ingress-canary-9czfx\" (UID: \"46e600e7-76a1-49e4-bcd7-00c1caaaf2e0\") " pod="openshift-ingress-canary/ingress-canary-9czfx" Jul 18 03:50:34.722269 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.722191 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b3eeda2e-c41b-41ac-9653-138d62736de0-installation-pull-secrets\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:34.722269 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:34.722222 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 18 03:50:34.722477 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:34.722302 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert podName:f2341662-76e0-4fcd-bd08-f9aa4128746b nodeName:}" failed. No retries permitted until 2026-07-18 03:50:35.222278716 +0000 UTC m=+35.983912328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-77mmr" (UID: "f2341662-76e0-4fcd-bd08-f9aa4128746b") : secret "networking-console-plugin-cert" not found Jul 18 03:50:34.722477 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.722223 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls\") pod \"dns-default-njlzd\" (UID: \"2ed19b61-20f5-4efa-b877-e3b733109b6f\") " pod="openshift-dns/dns-default-njlzd" Jul 18 03:50:34.722477 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.722342 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c9dh\" (UniqueName: \"kubernetes.io/projected/46e600e7-76a1-49e4-bcd7-00c1caaaf2e0-kube-api-access-9c9dh\") pod \"ingress-canary-9czfx\" (UID: \"46e600e7-76a1-49e4-bcd7-00c1caaaf2e0\") " pod="openshift-ingress-canary/ingress-canary-9czfx" Jul 18 03:50:34.722477 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.722376 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b3eeda2e-c41b-41ac-9653-138d62736de0-image-registry-private-configuration\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:34.722477 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.722398 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-certificates\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:34.722477 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.722421 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ed19b61-20f5-4efa-b877-e3b733109b6f-tmp-dir\") pod \"dns-default-njlzd\" (UID: \"2ed19b61-20f5-4efa-b877-e3b733109b6f\") " pod="openshift-dns/dns-default-njlzd" Jul 18 03:50:34.722477 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.722452 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgqqp\" (UniqueName: \"kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-kube-api-access-tgqqp\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:34.722477 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.722477 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2ed19b61-20f5-4efa-b877-e3b733109b6f-config-volume\") pod \"dns-default-njlzd\" (UID: \"2ed19b61-20f5-4efa-b877-e3b733109b6f\") " pod="openshift-dns/dns-default-njlzd" Jul 18 03:50:34.722850 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.722512 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f2341662-76e0-4fcd-bd08-f9aa4128746b-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-77mmr\" (UID: \"f2341662-76e0-4fcd-bd08-f9aa4128746b\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-77mmr" Jul 18 03:50:34.722850 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.722536 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b3eeda2e-c41b-41ac-9653-138d62736de0-ca-trust-extracted\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:34.722850 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.722559 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3eeda2e-c41b-41ac-9653-138d62736de0-trusted-ca\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:34.722850 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.722612 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-bound-sa-token\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:34.722850 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.722672 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:34.722850 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.722699 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77dnb\" (UniqueName: \"kubernetes.io/projected/2ed19b61-20f5-4efa-b877-e3b733109b6f-kube-api-access-77dnb\") pod \"dns-default-njlzd\" (UID: \"2ed19b61-20f5-4efa-b877-e3b733109b6f\") " pod="openshift-dns/dns-default-njlzd" Jul 18 03:50:34.723235 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.723212 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f2341662-76e0-4fcd-bd08-f9aa4128746b-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-77mmr\" (UID: \"f2341662-76e0-4fcd-bd08-f9aa4128746b\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-77mmr" Jul 18 03:50:34.760394 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.760354 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:50:34.760583 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.760483 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:50:34.760583 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.760520 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:50:34.762956 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.762888 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 18 03:50:34.762956 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.762914 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 18 03:50:34.763145 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.762987 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g4mng\"" Jul 18 03:50:34.763145 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.763118 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 18 03:50:34.763249 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.763199 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 18 03:50:34.763249 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.763227 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mc9fd\"" Jul 18 03:50:34.823538 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.823500 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b3eeda2e-c41b-41ac-9653-138d62736de0-ca-trust-extracted\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:34.823538 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.823546 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3eeda2e-c41b-41ac-9653-138d62736de0-trusted-ca\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:34.823783 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.823566 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-bound-sa-token\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:34.823783 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.823606 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:34.823783 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.823629 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77dnb\" (UniqueName: \"kubernetes.io/projected/2ed19b61-20f5-4efa-b877-e3b733109b6f-kube-api-access-77dnb\") pod \"dns-default-njlzd\" (UID: \"2ed19b61-20f5-4efa-b877-e3b733109b6f\") " pod="openshift-dns/dns-default-njlzd" Jul 18 03:50:34.823783 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.823701 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46e600e7-76a1-49e4-bcd7-00c1caaaf2e0-cert\") pod \"ingress-canary-9czfx\" (UID: \"46e600e7-76a1-49e4-bcd7-00c1caaaf2e0\") " pod="openshift-ingress-canary/ingress-canary-9czfx" Jul 18 03:50:34.823783 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.823739 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b3eeda2e-c41b-41ac-9653-138d62736de0-installation-pull-secrets\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:34.823783 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:34.823750 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 03:50:34.823783 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.823766 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls\") pod \"dns-default-njlzd\" (UID: \"2ed19b61-20f5-4efa-b877-e3b733109b6f\") " pod="openshift-dns/dns-default-njlzd" Jul 18 03:50:34.823783 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:34.823772 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67b88fc4d6-t5z9g: secret "image-registry-tls" not found Jul 18 03:50:34.824184 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.823794 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c9dh\" (UniqueName: \"kubernetes.io/projected/46e600e7-76a1-49e4-bcd7-00c1caaaf2e0-kube-api-access-9c9dh\") pod \"ingress-canary-9czfx\" (UID: \"46e600e7-76a1-49e4-bcd7-00c1caaaf2e0\") " pod="openshift-ingress-canary/ingress-canary-9czfx" Jul 18 03:50:34.824184 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:34.823828 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls podName:b3eeda2e-c41b-41ac-9653-138d62736de0 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:35.323808829 +0000 UTC m=+36.085442453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls") pod "image-registry-67b88fc4d6-t5z9g" (UID: "b3eeda2e-c41b-41ac-9653-138d62736de0") : secret "image-registry-tls" not found Jul 18 03:50:34.824184 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.823868 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b3eeda2e-c41b-41ac-9653-138d62736de0-image-registry-private-configuration\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:34.824184 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.823902 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-certificates\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:34.824184 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.823927 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ed19b61-20f5-4efa-b877-e3b733109b6f-tmp-dir\") pod \"dns-default-njlzd\" (UID: \"2ed19b61-20f5-4efa-b877-e3b733109b6f\") " pod="openshift-dns/dns-default-njlzd" Jul 18 03:50:34.824184 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.823970 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgqqp\" (UniqueName: \"kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-kube-api-access-tgqqp\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:34.824184 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.823986 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b3eeda2e-c41b-41ac-9653-138d62736de0-ca-trust-extracted\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:34.824184 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:34.824030 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 03:50:34.824184 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:34.824082 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls podName:2ed19b61-20f5-4efa-b877-e3b733109b6f nodeName:}" failed. No retries permitted until 2026-07-18 03:50:35.324065509 +0000 UTC m=+36.085699119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls") pod "dns-default-njlzd" (UID: "2ed19b61-20f5-4efa-b877-e3b733109b6f") : secret "dns-default-metrics-tls" not found Jul 18 03:50:34.824184 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.823994 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2ed19b61-20f5-4efa-b877-e3b733109b6f-config-volume\") pod \"dns-default-njlzd\" (UID: \"2ed19b61-20f5-4efa-b877-e3b733109b6f\") " pod="openshift-dns/dns-default-njlzd" Jul 18 03:50:34.824677 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.824491 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ed19b61-20f5-4efa-b877-e3b733109b6f-tmp-dir\") pod \"dns-default-njlzd\" (UID: \"2ed19b61-20f5-4efa-b877-e3b733109b6f\") " pod="openshift-dns/dns-default-njlzd" Jul 18 03:50:34.824677 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.824562 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3eeda2e-c41b-41ac-9653-138d62736de0-trusted-ca\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:34.824677 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.824573 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2ed19b61-20f5-4efa-b877-e3b733109b6f-config-volume\") pod \"dns-default-njlzd\" (UID: \"2ed19b61-20f5-4efa-b877-e3b733109b6f\") " pod="openshift-dns/dns-default-njlzd" Jul 18 03:50:34.825047 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.825015 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-certificates\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:34.828834 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.828810 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b3eeda2e-c41b-41ac-9653-138d62736de0-installation-pull-secrets\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:34.828834 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.828822 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46e600e7-76a1-49e4-bcd7-00c1caaaf2e0-cert\") pod \"ingress-canary-9czfx\" (UID: \"46e600e7-76a1-49e4-bcd7-00c1caaaf2e0\") " pod="openshift-ingress-canary/ingress-canary-9czfx" Jul 18 03:50:34.828993 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.828810 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b3eeda2e-c41b-41ac-9653-138d62736de0-image-registry-private-configuration\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:34.834919 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.834820 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgqqp\" (UniqueName: \"kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-kube-api-access-tgqqp\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:34.834919 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.834884 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77dnb\" (UniqueName: \"kubernetes.io/projected/2ed19b61-20f5-4efa-b877-e3b733109b6f-kube-api-access-77dnb\") pod \"dns-default-njlzd\" (UID: \"2ed19b61-20f5-4efa-b877-e3b733109b6f\") " pod="openshift-dns/dns-default-njlzd" Jul 18 03:50:34.834919 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.834894 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c9dh\" (UniqueName: \"kubernetes.io/projected/46e600e7-76a1-49e4-bcd7-00c1caaaf2e0-kube-api-access-9c9dh\") pod \"ingress-canary-9czfx\" (UID: \"46e600e7-76a1-49e4-bcd7-00c1caaaf2e0\") " pod="openshift-ingress-canary/ingress-canary-9czfx" Jul 18 03:50:34.835207 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.835033 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-bound-sa-token\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:34.904453 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:34.904416 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9czfx" Jul 18 03:50:35.227640 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:35.227606 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-77mmr\" (UID: \"f2341662-76e0-4fcd-bd08-f9aa4128746b\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-77mmr" Jul 18 03:50:35.227800 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:35.227754 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 18 03:50:35.227863 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:35.227836 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert podName:f2341662-76e0-4fcd-bd08-f9aa4128746b nodeName:}" failed. No retries permitted until 2026-07-18 03:50:36.227814464 +0000 UTC m=+36.989448093 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-77mmr" (UID: "f2341662-76e0-4fcd-bd08-f9aa4128746b") : secret "networking-console-plugin-cert" not found Jul 18 03:50:35.328444 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:35.328412 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:35.328596 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:35.328510 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls\") pod \"dns-default-njlzd\" (UID: \"2ed19b61-20f5-4efa-b877-e3b733109b6f\") " pod="openshift-dns/dns-default-njlzd" Jul 18 03:50:35.328596 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:35.328556 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 03:50:35.328596 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:35.328582 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67b88fc4d6-t5z9g: secret "image-registry-tls" not found Jul 18 03:50:35.328727 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:35.328664 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 03:50:35.328727 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:35.328685 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls podName:b3eeda2e-c41b-41ac-9653-138d62736de0 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:36.328661572 +0000 UTC m=+37.090295199 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls") pod "image-registry-67b88fc4d6-t5z9g" (UID: "b3eeda2e-c41b-41ac-9653-138d62736de0") : secret "image-registry-tls" not found Jul 18 03:50:35.328727 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:35.328719 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls podName:2ed19b61-20f5-4efa-b877-e3b733109b6f nodeName:}" failed. No retries permitted until 2026-07-18 03:50:36.328701478 +0000 UTC m=+37.090335102 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls") pod "dns-default-njlzd" (UID: "2ed19b61-20f5-4efa-b877-e3b733109b6f") : secret "dns-default-metrics-tls" not found Jul 18 03:50:35.353110 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:35.353080 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9czfx"] Jul 18 03:50:35.362996 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:50:35.362914 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46e600e7_76a1_49e4_bcd7_00c1caaaf2e0.slice/crio-e14001a6c58a7bddff4b455142c355d1729360fb4ad5e255d028d8f3c45b2f4c WatchSource:0}: Error finding container e14001a6c58a7bddff4b455142c355d1729360fb4ad5e255d028d8f3c45b2f4c: Status 404 returned error can't find the container with id e14001a6c58a7bddff4b455142c355d1729360fb4ad5e255d028d8f3c45b2f4c Jul 18 03:50:36.034691 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:36.034648 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9czfx" event={"ID":"46e600e7-76a1-49e4-bcd7-00c1caaaf2e0","Type":"ContainerStarted","Data":"e14001a6c58a7bddff4b455142c355d1729360fb4ad5e255d028d8f3c45b2f4c"} Jul 18 03:50:36.037954 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:36.037912 2558 generic.go:356] "Generic (PLEG): container finished" podID="6e77f13c-e59f-4453-b512-73bb702f5b6e" containerID="bcbcb87f2f29180068dea17657807d7d5aeaed0615697a0c64a556ce99c929ef" exitCode=0 Jul 18 03:50:36.038090 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:36.037974 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4srql" event={"ID":"6e77f13c-e59f-4453-b512-73bb702f5b6e","Type":"ContainerDied","Data":"bcbcb87f2f29180068dea17657807d7d5aeaed0615697a0c64a556ce99c929ef"} Jul 18 03:50:36.236318 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:36.236280 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-77mmr\" (UID: \"f2341662-76e0-4fcd-bd08-f9aa4128746b\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-77mmr" Jul 18 03:50:36.236505 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:36.236460 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 18 03:50:36.236556 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:36.236540 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert podName:f2341662-76e0-4fcd-bd08-f9aa4128746b nodeName:}" failed. No retries permitted until 2026-07-18 03:50:38.236519322 +0000 UTC m=+38.998152933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-77mmr" (UID: "f2341662-76e0-4fcd-bd08-f9aa4128746b") : secret "networking-console-plugin-cert" not found Jul 18 03:50:36.336870 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:36.336833 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:36.337079 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:36.336921 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls\") pod \"dns-default-njlzd\" (UID: \"2ed19b61-20f5-4efa-b877-e3b733109b6f\") " pod="openshift-dns/dns-default-njlzd" Jul 18 03:50:36.337079 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:36.337027 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 03:50:36.337079 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:36.337047 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67b88fc4d6-t5z9g: secret "image-registry-tls" not found Jul 18 03:50:36.337079 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:36.337064 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 03:50:36.337301 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:36.337109 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls podName:2ed19b61-20f5-4efa-b877-e3b733109b6f nodeName:}" failed. No retries permitted until 2026-07-18 03:50:38.337094849 +0000 UTC m=+39.098728459 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls") pod "dns-default-njlzd" (UID: "2ed19b61-20f5-4efa-b877-e3b733109b6f") : secret "dns-default-metrics-tls" not found Jul 18 03:50:36.337301 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:36.337127 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls podName:b3eeda2e-c41b-41ac-9653-138d62736de0 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:38.33711801 +0000 UTC m=+39.098751625 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls") pod "image-registry-67b88fc4d6-t5z9g" (UID: "b3eeda2e-c41b-41ac-9653-138d62736de0") : secret "image-registry-tls" not found Jul 18 03:50:37.044555 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:37.044518 2558 generic.go:356] "Generic (PLEG): container finished" podID="6e77f13c-e59f-4453-b512-73bb702f5b6e" containerID="4ed0b886d8ee6102c39b3d9d5d579d4731071dcfdb44e1ba1b8e4c25f58d8c93" exitCode=0 Jul 18 03:50:37.045073 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:37.044581 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4srql" event={"ID":"6e77f13c-e59f-4453-b512-73bb702f5b6e","Type":"ContainerDied","Data":"4ed0b886d8ee6102c39b3d9d5d579d4731071dcfdb44e1ba1b8e4c25f58d8c93"} Jul 18 03:50:38.050362 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:38.050318 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4srql" event={"ID":"6e77f13c-e59f-4453-b512-73bb702f5b6e","Type":"ContainerStarted","Data":"f072ff2bfb53506137d7f25cf3042236ca79271804c0bcf656007510dbe2dfff"} Jul 18 03:50:38.051711 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:38.051685 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9czfx" event={"ID":"46e600e7-76a1-49e4-bcd7-00c1caaaf2e0","Type":"ContainerStarted","Data":"963448dc13a88577b5c6efe3dca49c2a20d2cd7d065ae350f86f2d3e9d77371c"} Jul 18 03:50:38.071375 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:38.070735 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4srql" podStartSLOduration=9.171044065 podStartE2EDuration="39.070716486s" totalImagesPullingTime="29.899672421s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:49:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:38.068812857 +0000 UTC m=+38.830446490" watchObservedRunningTime="2026-07-18 03:50:38.070716486 +0000 UTC m=+38.832350118" Jul 18 03:50:38.082848 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:38.082803 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9czfx" podStartSLOduration=1.79439752 podStartE2EDuration="4.082789065s" totalImagesPullingTime="2.288391545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:38.08190305 +0000 UTC m=+38.843536704" watchObservedRunningTime="2026-07-18 03:50:38.082789065 +0000 UTC m=+38.844422695" Jul 18 03:50:38.220017 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:38.219977 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:50:38.253920 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:38.253874 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-77mmr\" (UID: \"f2341662-76e0-4fcd-bd08-f9aa4128746b\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-77mmr" Jul 18 03:50:38.254145 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:38.254066 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 18 03:50:38.254206 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:38.254147 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert podName:f2341662-76e0-4fcd-bd08-f9aa4128746b nodeName:}" failed. No retries permitted until 2026-07-18 03:50:42.254126889 +0000 UTC m=+43.015760516 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-77mmr" (UID: "f2341662-76e0-4fcd-bd08-f9aa4128746b") : secret "networking-console-plugin-cert" not found Jul 18 03:50:38.301122 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:38.301030 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:50:38.355039 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:38.355007 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:38.355148 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:38.355074 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls\") pod \"dns-default-njlzd\" (UID: \"2ed19b61-20f5-4efa-b877-e3b733109b6f\") " pod="openshift-dns/dns-default-njlzd" Jul 18 03:50:38.355224 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:38.355168 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 03:50:38.355224 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:38.355179 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 03:50:38.355224 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:38.355201 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67b88fc4d6-t5z9g: secret "image-registry-tls" not found Jul 18 03:50:38.355224 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:38.355221 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls podName:2ed19b61-20f5-4efa-b877-e3b733109b6f nodeName:}" failed. No retries permitted until 2026-07-18 03:50:42.35520872 +0000 UTC m=+43.116842329 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls") pod "dns-default-njlzd" (UID: "2ed19b61-20f5-4efa-b877-e3b733109b6f") : secret "dns-default-metrics-tls" not found Jul 18 03:50:38.355370 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:38.355257 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls podName:b3eeda2e-c41b-41ac-9653-138d62736de0 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:42.355238876 +0000 UTC m=+43.116872505 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls") pod "image-registry-67b88fc4d6-t5z9g" (UID: "b3eeda2e-c41b-41ac-9653-138d62736de0") : secret "image-registry-tls" not found Jul 18 03:50:38.823998 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:38.823963 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:50:38.874008 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:38.873962 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:50:40.368207 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:40.368169 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:50:40.469402 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:40.469359 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:50:41.013228 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:41.013193 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:50:41.068470 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:41.068429 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:50:42.120948 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:42.120913 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:50:42.171911 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:42.171877 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:50:42.286551 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:42.286506 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-77mmr\" (UID: \"f2341662-76e0-4fcd-bd08-f9aa4128746b\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-77mmr" Jul 18 03:50:42.286705 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:42.286650 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 18 03:50:42.286785 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:42.286714 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert podName:f2341662-76e0-4fcd-bd08-f9aa4128746b nodeName:}" failed. No retries permitted until 2026-07-18 03:50:50.286697281 +0000 UTC m=+51.048330890 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-77mmr" (UID: "f2341662-76e0-4fcd-bd08-f9aa4128746b") : secret "networking-console-plugin-cert" not found Jul 18 03:50:42.387223 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:42.387122 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls\") pod \"dns-default-njlzd\" (UID: \"2ed19b61-20f5-4efa-b877-e3b733109b6f\") " pod="openshift-dns/dns-default-njlzd" Jul 18 03:50:42.387363 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:42.387273 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 03:50:42.387363 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:42.387304 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:42.387363 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:42.387332 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls podName:2ed19b61-20f5-4efa-b877-e3b733109b6f nodeName:}" failed. No retries permitted until 2026-07-18 03:50:50.387316674 +0000 UTC m=+51.148950284 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls") pod "dns-default-njlzd" (UID: "2ed19b61-20f5-4efa-b877-e3b733109b6f") : secret "dns-default-metrics-tls" not found Jul 18 03:50:42.387525 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:42.387387 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 03:50:42.387525 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:42.387399 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67b88fc4d6-t5z9g: secret "image-registry-tls" not found Jul 18 03:50:42.387525 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:42.387443 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls podName:b3eeda2e-c41b-41ac-9653-138d62736de0 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:50.387432059 +0000 UTC m=+51.149065669 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls") pod "image-registry-67b88fc4d6-t5z9g" (UID: "b3eeda2e-c41b-41ac-9653-138d62736de0") : secret "image-registry-tls" not found Jul 18 03:50:42.486797 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:42.486756 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:50:42.543254 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:42.543208 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:50:47.833997 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:47.833957 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:50:47.883322 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:47.883293 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:50:50.356501 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:50.356466 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-77mmr\" (UID: \"f2341662-76e0-4fcd-bd08-f9aa4128746b\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-77mmr" Jul 18 03:50:50.356886 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:50.356618 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 18 03:50:50.356886 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:50.356681 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert podName:f2341662-76e0-4fcd-bd08-f9aa4128746b nodeName:}" failed. No retries permitted until 2026-07-18 03:51:06.356665275 +0000 UTC m=+67.118298886 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-77mmr" (UID: "f2341662-76e0-4fcd-bd08-f9aa4128746b") : secret "networking-console-plugin-cert" not found Jul 18 03:50:50.457886 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:50.457850 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls\") pod \"dns-default-njlzd\" (UID: \"2ed19b61-20f5-4efa-b877-e3b733109b6f\") " pod="openshift-dns/dns-default-njlzd" Jul 18 03:50:50.458073 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:50:50.457916 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:50:50.458073 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:50.458049 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 03:50:50.458073 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:50.458068 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67b88fc4d6-t5z9g: secret "image-registry-tls" not found Jul 18 03:50:50.458193 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:50.458114 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 03:50:50.458193 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:50.458126 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls podName:b3eeda2e-c41b-41ac-9653-138d62736de0 nodeName:}" failed. No retries permitted until 2026-07-18 03:51:06.45811095 +0000 UTC m=+67.219744559 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls") pod "image-registry-67b88fc4d6-t5z9g" (UID: "b3eeda2e-c41b-41ac-9653-138d62736de0") : secret "image-registry-tls" not found Jul 18 03:50:50.458193 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:50:50.458174 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls podName:2ed19b61-20f5-4efa-b877-e3b733109b6f nodeName:}" failed. No retries permitted until 2026-07-18 03:51:06.458161028 +0000 UTC m=+67.219794638 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls") pod "dns-default-njlzd" (UID: "2ed19b61-20f5-4efa-b877-e3b733109b6f") : secret "dns-default-metrics-tls" not found Jul 18 03:51:00.029952 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:00.029900 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4f9kj" Jul 18 03:51:00.175639 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:00.175600 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:51:00.276991 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:00.276956 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:51:02.360873 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:02.360838 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:51:02.406923 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:02.406883 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:51:04.059421 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:04.059375 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:51:04.111548 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:04.111510 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:51:04.158597 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:04.158561 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:51:05.465463 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:05.465426 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs\") pod \"network-metrics-daemon-f8944\" (UID: \"15496aee-38ed-4f76-b18f-b84cd34b2dc9\") " pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:51:05.467831 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:05.467811 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 18 03:51:05.476597 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:51:05.476581 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 18 03:51:05.476667 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:51:05.476636 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs podName:15496aee-38ed-4f76-b18f-b84cd34b2dc9 nodeName:}" failed. No retries permitted until 2026-07-18 03:52:09.47661945 +0000 UTC m=+130.238253060 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs") pod "network-metrics-daemon-f8944" (UID: "15496aee-38ed-4f76-b18f-b84cd34b2dc9") : secret "metrics-daemon-secret" not found Jul 18 03:51:05.566412 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:05.566366 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bskqp\" (UniqueName: \"kubernetes.io/projected/533356c8-0188-468f-956b-f8fc72e64309-kube-api-access-bskqp\") pod \"network-check-target-lb475\" (UID: \"533356c8-0188-468f-956b-f8fc72e64309\") " pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:51:05.566583 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:05.566476 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-original-pull-secret\") pod \"global-pull-secret-syncer-7dx5n\" (UID: \"eadafdbc-08a4-43cb-8bf8-1afbf235bd6f\") " pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:51:05.568931 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:05.568908 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 18 03:51:05.569063 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:05.568908 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 18 03:51:05.578925 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:05.578903 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 18 03:51:05.580618 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:05.580595 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eadafdbc-08a4-43cb-8bf8-1afbf235bd6f-original-pull-secret\") pod \"global-pull-secret-syncer-7dx5n\" (UID: \"eadafdbc-08a4-43cb-8bf8-1afbf235bd6f\") " pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:51:05.589693 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:05.589667 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bskqp\" (UniqueName: \"kubernetes.io/projected/533356c8-0188-468f-956b-f8fc72e64309-kube-api-access-bskqp\") pod \"network-check-target-lb475\" (UID: \"533356c8-0188-468f-956b-f8fc72e64309\") " pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:51:05.671827 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:05.671792 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7dx5n" Jul 18 03:51:05.686387 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:05.686360 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mc9fd\"" Jul 18 03:51:05.695240 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:05.695216 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:51:05.824749 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:05.824720 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7dx5n"] Jul 18 03:51:05.827822 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:51:05.827798 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeadafdbc_08a4_43cb_8bf8_1afbf235bd6f.slice/crio-a27beb0e12fbbcb587b11d70f1aa31bde75a084d176abf6a72380b0bc5fb6f6d WatchSource:0}: Error finding container a27beb0e12fbbcb587b11d70f1aa31bde75a084d176abf6a72380b0bc5fb6f6d: Status 404 returned error can't find the container with id a27beb0e12fbbcb587b11d70f1aa31bde75a084d176abf6a72380b0bc5fb6f6d Jul 18 03:51:05.840800 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:05.840773 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lb475"] Jul 18 03:51:05.844009 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:51:05.843981 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod533356c8_0188_468f_956b_f8fc72e64309.slice/crio-bb6d0e826015a8ded8326bd546c2e6701e4ea00952c15869f8ae71366ff30a48 WatchSource:0}: Error finding container bb6d0e826015a8ded8326bd546c2e6701e4ea00952c15869f8ae71366ff30a48: Status 404 returned error can't find the container with id bb6d0e826015a8ded8326bd546c2e6701e4ea00952c15869f8ae71366ff30a48 Jul 18 03:51:06.116714 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:06.116629 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lb475" event={"ID":"533356c8-0188-468f-956b-f8fc72e64309","Type":"ContainerStarted","Data":"bb6d0e826015a8ded8326bd546c2e6701e4ea00952c15869f8ae71366ff30a48"} Jul 18 03:51:06.117688 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:06.117668 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7dx5n" event={"ID":"eadafdbc-08a4-43cb-8bf8-1afbf235bd6f","Type":"ContainerStarted","Data":"a27beb0e12fbbcb587b11d70f1aa31bde75a084d176abf6a72380b0bc5fb6f6d"} Jul 18 03:51:06.373058 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:06.373022 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-77mmr\" (UID: \"f2341662-76e0-4fcd-bd08-f9aa4128746b\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-77mmr" Jul 18 03:51:06.373209 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:51:06.373159 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 18 03:51:06.373250 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:51:06.373224 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert podName:f2341662-76e0-4fcd-bd08-f9aa4128746b nodeName:}" failed. No retries permitted until 2026-07-18 03:51:38.373208529 +0000 UTC m=+99.134842139 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-77mmr" (UID: "f2341662-76e0-4fcd-bd08-f9aa4128746b") : secret "networking-console-plugin-cert" not found Jul 18 03:51:06.473746 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:06.473707 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls\") pod \"dns-default-njlzd\" (UID: \"2ed19b61-20f5-4efa-b877-e3b733109b6f\") " pod="openshift-dns/dns-default-njlzd" Jul 18 03:51:06.474219 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:06.473804 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:51:06.474219 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:51:06.473884 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 03:51:06.474219 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:51:06.473954 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 03:51:06.474219 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:51:06.473974 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67b88fc4d6-t5z9g: secret "image-registry-tls" not found Jul 18 03:51:06.474219 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:51:06.473984 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls podName:2ed19b61-20f5-4efa-b877-e3b733109b6f nodeName:}" failed. No retries permitted until 2026-07-18 03:51:38.47395968 +0000 UTC m=+99.235593297 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls") pod "dns-default-njlzd" (UID: "2ed19b61-20f5-4efa-b877-e3b733109b6f") : secret "dns-default-metrics-tls" not found Jul 18 03:51:06.474219 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:51:06.474023 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls podName:b3eeda2e-c41b-41ac-9653-138d62736de0 nodeName:}" failed. No retries permitted until 2026-07-18 03:51:38.474008397 +0000 UTC m=+99.235642007 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls") pod "image-registry-67b88fc4d6-t5z9g" (UID: "b3eeda2e-c41b-41ac-9653-138d62736de0") : secret "image-registry-tls" not found Jul 18 03:51:11.132740 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:11.132705 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lb475" event={"ID":"533356c8-0188-468f-956b-f8fc72e64309","Type":"ContainerStarted","Data":"4428a57e8cb6b28182e110e93d9284262a195216c8632a8ba2716daa77c3c326"} Jul 18 03:51:11.133244 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:11.132871 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:51:11.134209 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:11.134187 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7dx5n" event={"ID":"eadafdbc-08a4-43cb-8bf8-1afbf235bd6f","Type":"ContainerStarted","Data":"9b7bdd15c1fbc2baa98deb28ba1c6cd30fec0fc5e6b7de9e71a8af27f3783a59"} Jul 18 03:51:11.146907 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:11.146863 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lb475" podStartSLOduration=66.29013295 podStartE2EDuration="1m11.146851509s" totalImagesPullingTime="4.856718559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:51:11.146030719 +0000 UTC m=+71.907664344" watchObservedRunningTime="2026-07-18 03:51:11.146851509 +0000 UTC m=+71.908485141" Jul 18 03:51:11.159255 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:11.159222 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7dx5n" podStartSLOduration=66.283127011 podStartE2EDuration="1m11.159205523s" totalImagesPullingTime="4.876078512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:51:11.158993523 +0000 UTC m=+71.920627158" watchObservedRunningTime="2026-07-18 03:51:11.159205523 +0000 UTC m=+71.920839156" Jul 18 03:51:14.738414 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:14.738361 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:51:14.786601 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:14.786548 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:51:37.353471 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:37.353349 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:51:37.453860 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:37.453824 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:51:38.402061 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:38.402013 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-77mmr\" (UID: \"f2341662-76e0-4fcd-bd08-f9aa4128746b\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-77mmr" Jul 18 03:51:38.402413 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:51:38.402168 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 18 03:51:38.402413 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:51:38.402246 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert podName:f2341662-76e0-4fcd-bd08-f9aa4128746b nodeName:}" failed. No retries permitted until 2026-07-18 03:52:42.402229487 +0000 UTC m=+163.163863098 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-77mmr" (UID: "f2341662-76e0-4fcd-bd08-f9aa4128746b") : secret "networking-console-plugin-cert" not found Jul 18 03:51:38.502892 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:38.502816 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:51:38.502892 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:38.502894 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls\") pod \"dns-default-njlzd\" (UID: \"2ed19b61-20f5-4efa-b877-e3b733109b6f\") " pod="openshift-dns/dns-default-njlzd" Jul 18 03:51:38.503015 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:51:38.502989 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 03:51:38.503015 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:51:38.503009 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67b88fc4d6-t5z9g: secret "image-registry-tls" not found Jul 18 03:51:38.503075 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:51:38.503023 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 03:51:38.503107 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:51:38.503076 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls podName:2ed19b61-20f5-4efa-b877-e3b733109b6f nodeName:}" failed. No retries permitted until 2026-07-18 03:52:42.503061374 +0000 UTC m=+163.264694983 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls") pod "dns-default-njlzd" (UID: "2ed19b61-20f5-4efa-b877-e3b733109b6f") : secret "dns-default-metrics-tls" not found Jul 18 03:51:38.503107 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:51:38.503090 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls podName:b3eeda2e-c41b-41ac-9653-138d62736de0 nodeName:}" failed. No retries permitted until 2026-07-18 03:52:42.503084362 +0000 UTC m=+163.264717972 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls") pod "image-registry-67b88fc4d6-t5z9g" (UID: "b3eeda2e-c41b-41ac-9653-138d62736de0") : secret "image-registry-tls" not found Jul 18 03:51:42.139001 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:51:42.138974 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lb475" Jul 18 03:52:09.524042 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:52:09.523988 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs\") pod \"network-metrics-daemon-f8944\" (UID: \"15496aee-38ed-4f76-b18f-b84cd34b2dc9\") " pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:52:09.524560 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:52:09.524145 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 18 03:52:09.524560 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:52:09.524212 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs podName:15496aee-38ed-4f76-b18f-b84cd34b2dc9 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:11.524193107 +0000 UTC m=+252.285826730 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs") pod "network-metrics-daemon-f8944" (UID: "15496aee-38ed-4f76-b18f-b84cd34b2dc9") : secret "metrics-daemon-secret" not found Jul 18 03:52:37.581353 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:52:37.581311 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-77mmr" podUID="f2341662-76e0-4fcd-bd08-f9aa4128746b" Jul 18 03:52:37.590634 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:52:37.590605 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" podUID="b3eeda2e-c41b-41ac-9653-138d62736de0" Jul 18 03:52:37.598685 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:52:37.598666 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-njlzd" podUID="2ed19b61-20f5-4efa-b877-e3b733109b6f" Jul 18 03:52:37.778597 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:52:37.778559 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-f8944" podUID="15496aee-38ed-4f76-b18f-b84cd34b2dc9" Jul 18 03:52:38.333289 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:52:38.333260 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-njlzd" Jul 18 03:52:38.333444 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:52:38.333260 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-77mmr" Jul 18 03:52:38.333444 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:52:38.333264 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:52:42.458218 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:52:42.458173 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-77mmr\" (UID: \"f2341662-76e0-4fcd-bd08-f9aa4128746b\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-77mmr" Jul 18 03:52:42.458607 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:52:42.458321 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 18 03:52:42.458607 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:52:42.458393 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert podName:f2341662-76e0-4fcd-bd08-f9aa4128746b nodeName:}" failed. No retries permitted until 2026-07-18 03:54:44.458372797 +0000 UTC m=+285.220006420 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-77mmr" (UID: "f2341662-76e0-4fcd-bd08-f9aa4128746b") : secret "networking-console-plugin-cert" not found Jul 18 03:52:42.559319 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:52:42.559285 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:52:42.559409 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:52:42.559353 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls\") pod \"dns-default-njlzd\" (UID: \"2ed19b61-20f5-4efa-b877-e3b733109b6f\") " pod="openshift-dns/dns-default-njlzd" Jul 18 03:52:42.559453 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:52:42.559432 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 03:52:42.559492 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:52:42.559460 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67b88fc4d6-t5z9g: secret "image-registry-tls" not found Jul 18 03:52:42.559532 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:52:42.559527 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls podName:b3eeda2e-c41b-41ac-9653-138d62736de0 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:44.55950993 +0000 UTC m=+285.321143541 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls") pod "image-registry-67b88fc4d6-t5z9g" (UID: "b3eeda2e-c41b-41ac-9653-138d62736de0") : secret "image-registry-tls" not found Jul 18 03:52:42.559572 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:52:42.559445 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 03:52:42.559600 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:52:42.559590 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls podName:2ed19b61-20f5-4efa-b877-e3b733109b6f nodeName:}" failed. No retries permitted until 2026-07-18 03:54:44.559576152 +0000 UTC m=+285.321209783 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls") pod "dns-default-njlzd" (UID: "2ed19b61-20f5-4efa-b877-e3b733109b6f") : secret "dns-default-metrics-tls" not found Jul 18 03:52:48.760487 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:52:48.760442 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:54:00.824108 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.824068 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-kfkfb"] Jul 18 03:54:00.827010 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.826988 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9hqct"] Jul 18 03:54:00.827136 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.827110 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-kfkfb" Jul 18 03:54:00.829162 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.829144 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 18 03:54:00.829273 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.829149 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 18 03:54:00.829330 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.829271 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 18 03:54:00.829567 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.829549 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 18 03:54:00.829679 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.829630 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-twx6r\"" Jul 18 03:54:00.830436 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.830418 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-hcwqn"] Jul 18 03:54:00.830551 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.830537 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9hqct" Jul 18 03:54:00.833082 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.833060 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hcwqn" Jul 18 03:54:00.833564 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.833548 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 18 03:54:00.835053 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.835032 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 18 03:54:00.841926 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.841727 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 18 03:54:00.841926 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.841857 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ktvgj\"" Jul 18 03:54:00.841926 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.841870 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-rlg5h\"" Jul 18 03:54:00.842506 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.842487 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 18 03:54:00.842914 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.842862 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-hcwqn"] Jul 18 03:54:00.844020 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.843999 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9hqct"] Jul 18 03:54:00.847232 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.847212 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-kfkfb"] Jul 18 03:54:00.917697 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.917668 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9sclg"] Jul 18 03:54:00.920544 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.920529 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9sclg" Jul 18 03:54:00.922908 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.922872 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 18 03:54:00.923049 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.922930 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 18 03:54:00.923049 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.923002 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 18 03:54:00.923176 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.923082 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7gngv"] Jul 18 03:54:00.923228 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.923211 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 18 03:54:00.923278 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.923250 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-4wl9r\"" Jul 18 03:54:00.925840 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.925821 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jgfd4"] Jul 18 03:54:00.925964 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.925919 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7gngv" Jul 18 03:54:00.927889 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.927869 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-dzb79\"" Jul 18 03:54:00.928063 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.928038 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 18 03:54:00.928509 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.928487 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 18 03:54:00.928632 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.928601 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jgfd4" Jul 18 03:54:00.929562 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.929543 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9sclg"] Jul 18 03:54:00.932134 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.932106 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 18 03:54:00.932134 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.932123 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 18 03:54:00.932289 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.932136 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4jmfh\"" Jul 18 03:54:00.932289 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.932198 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 18 03:54:00.932289 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.932115 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 18 03:54:00.936060 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.936037 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7gngv"] Jul 18 03:54:00.939386 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:00.939365 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jgfd4"] Jul 18 03:54:01.000844 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.000808 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9ab82b85-02c2-4fa0-9a5a-2bced519bf92-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-9sclg\" (UID: \"9ab82b85-02c2-4fa0-9a5a-2bced519bf92\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9sclg" Jul 18 03:54:01.001050 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.000853 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/77a41d30-764b-40f0-9e8d-35b4f6f87009-serving-cert\") pod \"console-operator-565b7b569d-kfkfb\" (UID: \"77a41d30-764b-40f0-9e8d-35b4f6f87009\") " pod="openshift-console-operator/console-operator-565b7b569d-kfkfb" Jul 18 03:54:01.001050 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.000912 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm52g\" (UniqueName: \"kubernetes.io/projected/4a25d1b7-9150-447d-86b1-7674052f44e2-kube-api-access-vm52g\") pod \"network-check-source-7bc5b6bf85-hcwqn\" (UID: \"4a25d1b7-9150-447d-86b1-7674052f44e2\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hcwqn" Jul 18 03:54:01.001050 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.001020 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9ab82b85-02c2-4fa0-9a5a-2bced519bf92-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-9sclg\" (UID: \"9ab82b85-02c2-4fa0-9a5a-2bced519bf92\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9sclg" Jul 18 03:54:01.001221 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.001059 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gvw2\" (UniqueName: \"kubernetes.io/projected/d0e33e99-e3f9-42dd-b442-83a57365d4a6-kube-api-access-6gvw2\") pod \"cluster-samples-operator-79b7c55f87-9hqct\" (UID: \"d0e33e99-e3f9-42dd-b442-83a57365d4a6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9hqct" Jul 18 03:54:01.001221 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.001083 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmspx\" (UniqueName: \"kubernetes.io/projected/77a41d30-764b-40f0-9e8d-35b4f6f87009-kube-api-access-qmspx\") pod \"console-operator-565b7b569d-kfkfb\" (UID: \"77a41d30-764b-40f0-9e8d-35b4f6f87009\") " pod="openshift-console-operator/console-operator-565b7b569d-kfkfb" Jul 18 03:54:01.001221 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.001130 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8qlg\" (UniqueName: \"kubernetes.io/projected/9ab82b85-02c2-4fa0-9a5a-2bced519bf92-kube-api-access-p8qlg\") pod \"kube-storage-version-migrator-operator-7658d9b749-9sclg\" (UID: \"9ab82b85-02c2-4fa0-9a5a-2bced519bf92\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9sclg" Jul 18 03:54:01.001221 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.001165 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/77a41d30-764b-40f0-9e8d-35b4f6f87009-config\") pod \"console-operator-565b7b569d-kfkfb\" (UID: \"77a41d30-764b-40f0-9e8d-35b4f6f87009\") " pod="openshift-console-operator/console-operator-565b7b569d-kfkfb" Jul 18 03:54:01.001221 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.001187 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/77a41d30-764b-40f0-9e8d-35b4f6f87009-trusted-ca\") pod \"console-operator-565b7b569d-kfkfb\" (UID: \"77a41d30-764b-40f0-9e8d-35b4f6f87009\") " pod="openshift-console-operator/console-operator-565b7b569d-kfkfb" Jul 18 03:54:01.001371 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.001240 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d0e33e99-e3f9-42dd-b442-83a57365d4a6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-9hqct\" (UID: \"d0e33e99-e3f9-42dd-b442-83a57365d4a6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9hqct" Jul 18 03:54:01.069004 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.068972 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:01.101747 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.101672 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng5k7\" (UniqueName: \"kubernetes.io/projected/4689e3a1-9fac-4e73-86c9-5c3a73ef7eb4-kube-api-access-ng5k7\") pod \"volume-data-source-validator-78cf4c6f6-7gngv\" (UID: \"4689e3a1-9fac-4e73-86c9-5c3a73ef7eb4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7gngv" Jul 18 03:54:01.101747 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.101724 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm52g\" (UniqueName: \"kubernetes.io/projected/4a25d1b7-9150-447d-86b1-7674052f44e2-kube-api-access-vm52g\") pod \"network-check-source-7bc5b6bf85-hcwqn\" (UID: \"4a25d1b7-9150-447d-86b1-7674052f44e2\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hcwqn" Jul 18 03:54:01.101747 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.101749 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/77a41d30-764b-40f0-9e8d-35b4f6f87009-serving-cert\") pod \"console-operator-565b7b569d-kfkfb\" (UID: \"77a41d30-764b-40f0-9e8d-35b4f6f87009\") " pod="openshift-console-operator/console-operator-565b7b569d-kfkfb" Jul 18 03:54:01.101986 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.101800 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a6be9298-a8db-40bf-ad68-451199795a99-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-jgfd4\" (UID: \"a6be9298-a8db-40bf-ad68-451199795a99\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jgfd4" Jul 18 03:54:01.101986 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.101856 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gvw2\" (UniqueName: \"kubernetes.io/projected/d0e33e99-e3f9-42dd-b442-83a57365d4a6-kube-api-access-6gvw2\") pod \"cluster-samples-operator-79b7c55f87-9hqct\" (UID: \"d0e33e99-e3f9-42dd-b442-83a57365d4a6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9hqct" Jul 18 03:54:01.101986 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.101879 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/77a41d30-764b-40f0-9e8d-35b4f6f87009-config\") pod \"console-operator-565b7b569d-kfkfb\" (UID: \"77a41d30-764b-40f0-9e8d-35b4f6f87009\") " pod="openshift-console-operator/console-operator-565b7b569d-kfkfb" Jul 18 03:54:01.101986 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.101898 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/77a41d30-764b-40f0-9e8d-35b4f6f87009-trusted-ca\") pod \"console-operator-565b7b569d-kfkfb\" (UID: \"77a41d30-764b-40f0-9e8d-35b4f6f87009\") " pod="openshift-console-operator/console-operator-565b7b569d-kfkfb" Jul 18 03:54:01.101986 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.101917 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8qlg\" (UniqueName: \"kubernetes.io/projected/9ab82b85-02c2-4fa0-9a5a-2bced519bf92-kube-api-access-p8qlg\") pod \"kube-storage-version-migrator-operator-7658d9b749-9sclg\" (UID: \"9ab82b85-02c2-4fa0-9a5a-2bced519bf92\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9sclg" Jul 18 03:54:01.101986 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.101964 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52bvn\" (UniqueName: \"kubernetes.io/projected/a6be9298-a8db-40bf-ad68-451199795a99-kube-api-access-52bvn\") pod \"cluster-monitoring-operator-76cf8966f8-jgfd4\" (UID: \"a6be9298-a8db-40bf-ad68-451199795a99\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jgfd4" Jul 18 03:54:01.102354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.101997 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d0e33e99-e3f9-42dd-b442-83a57365d4a6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-9hqct\" (UID: \"d0e33e99-e3f9-42dd-b442-83a57365d4a6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9hqct" Jul 18 03:54:01.102354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.102036 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9ab82b85-02c2-4fa0-9a5a-2bced519bf92-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-9sclg\" (UID: \"9ab82b85-02c2-4fa0-9a5a-2bced519bf92\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9sclg" Jul 18 03:54:01.102354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.102075 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6be9298-a8db-40bf-ad68-451199795a99-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jgfd4\" (UID: \"a6be9298-a8db-40bf-ad68-451199795a99\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jgfd4" Jul 18 03:54:01.102354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.102123 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9ab82b85-02c2-4fa0-9a5a-2bced519bf92-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-9sclg\" (UID: \"9ab82b85-02c2-4fa0-9a5a-2bced519bf92\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9sclg" Jul 18 03:54:01.102354 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.102145 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmspx\" (UniqueName: \"kubernetes.io/projected/77a41d30-764b-40f0-9e8d-35b4f6f87009-kube-api-access-qmspx\") pod \"console-operator-565b7b569d-kfkfb\" (UID: \"77a41d30-764b-40f0-9e8d-35b4f6f87009\") " pod="openshift-console-operator/console-operator-565b7b569d-kfkfb" Jul 18 03:54:01.102354 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:01.102162 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 18 03:54:01.102354 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:01.102330 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0e33e99-e3f9-42dd-b442-83a57365d4a6-samples-operator-tls podName:d0e33e99-e3f9-42dd-b442-83a57365d4a6 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:01.602307944 +0000 UTC m=+242.363941555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d0e33e99-e3f9-42dd-b442-83a57365d4a6-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-9hqct" (UID: "d0e33e99-e3f9-42dd-b442-83a57365d4a6") : secret "samples-operator-tls" not found Jul 18 03:54:01.102699 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.102647 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/77a41d30-764b-40f0-9e8d-35b4f6f87009-config\") pod \"console-operator-565b7b569d-kfkfb\" (UID: \"77a41d30-764b-40f0-9e8d-35b4f6f87009\") " pod="openshift-console-operator/console-operator-565b7b569d-kfkfb" Jul 18 03:54:01.102797 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.102775 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9ab82b85-02c2-4fa0-9a5a-2bced519bf92-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-9sclg\" (UID: \"9ab82b85-02c2-4fa0-9a5a-2bced519bf92\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9sclg" Jul 18 03:54:01.103087 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.103067 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/77a41d30-764b-40f0-9e8d-35b4f6f87009-trusted-ca\") pod \"console-operator-565b7b569d-kfkfb\" (UID: \"77a41d30-764b-40f0-9e8d-35b4f6f87009\") " pod="openshift-console-operator/console-operator-565b7b569d-kfkfb" Jul 18 03:54:01.104196 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.104179 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/77a41d30-764b-40f0-9e8d-35b4f6f87009-serving-cert\") pod \"console-operator-565b7b569d-kfkfb\" (UID: \"77a41d30-764b-40f0-9e8d-35b4f6f87009\") " pod="openshift-console-operator/console-operator-565b7b569d-kfkfb" Jul 18 03:54:01.104401 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.104382 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9ab82b85-02c2-4fa0-9a5a-2bced519bf92-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-9sclg\" (UID: \"9ab82b85-02c2-4fa0-9a5a-2bced519bf92\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9sclg" Jul 18 03:54:01.110797 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.110776 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm52g\" (UniqueName: \"kubernetes.io/projected/4a25d1b7-9150-447d-86b1-7674052f44e2-kube-api-access-vm52g\") pod \"network-check-source-7bc5b6bf85-hcwqn\" (UID: \"4a25d1b7-9150-447d-86b1-7674052f44e2\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hcwqn" Jul 18 03:54:01.111196 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.111167 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8qlg\" (UniqueName: \"kubernetes.io/projected/9ab82b85-02c2-4fa0-9a5a-2bced519bf92-kube-api-access-p8qlg\") pod \"kube-storage-version-migrator-operator-7658d9b749-9sclg\" (UID: \"9ab82b85-02c2-4fa0-9a5a-2bced519bf92\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9sclg" Jul 18 03:54:01.111715 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.111694 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gvw2\" (UniqueName: \"kubernetes.io/projected/d0e33e99-e3f9-42dd-b442-83a57365d4a6-kube-api-access-6gvw2\") pod \"cluster-samples-operator-79b7c55f87-9hqct\" (UID: \"d0e33e99-e3f9-42dd-b442-83a57365d4a6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9hqct" Jul 18 03:54:01.111769 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.111736 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmspx\" (UniqueName: \"kubernetes.io/projected/77a41d30-764b-40f0-9e8d-35b4f6f87009-kube-api-access-qmspx\") pod \"console-operator-565b7b569d-kfkfb\" (UID: \"77a41d30-764b-40f0-9e8d-35b4f6f87009\") " pod="openshift-console-operator/console-operator-565b7b569d-kfkfb" Jul 18 03:54:01.137791 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.137762 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-kfkfb" Jul 18 03:54:01.150227 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.150207 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hcwqn" Jul 18 03:54:01.157830 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.157747 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:01.204238 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.202824 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52bvn\" (UniqueName: \"kubernetes.io/projected/a6be9298-a8db-40bf-ad68-451199795a99-kube-api-access-52bvn\") pod \"cluster-monitoring-operator-76cf8966f8-jgfd4\" (UID: \"a6be9298-a8db-40bf-ad68-451199795a99\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jgfd4" Jul 18 03:54:01.204238 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.202914 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6be9298-a8db-40bf-ad68-451199795a99-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jgfd4\" (UID: \"a6be9298-a8db-40bf-ad68-451199795a99\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jgfd4" Jul 18 03:54:01.204238 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.203017 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng5k7\" (UniqueName: \"kubernetes.io/projected/4689e3a1-9fac-4e73-86c9-5c3a73ef7eb4-kube-api-access-ng5k7\") pod \"volume-data-source-validator-78cf4c6f6-7gngv\" (UID: \"4689e3a1-9fac-4e73-86c9-5c3a73ef7eb4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7gngv" Jul 18 03:54:01.204238 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.203068 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a6be9298-a8db-40bf-ad68-451199795a99-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-jgfd4\" (UID: \"a6be9298-a8db-40bf-ad68-451199795a99\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jgfd4" Jul 18 03:54:01.204238 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:01.203957 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 18 03:54:01.204238 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:01.204028 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6be9298-a8db-40bf-ad68-451199795a99-cluster-monitoring-operator-tls podName:a6be9298-a8db-40bf-ad68-451199795a99 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:01.704008264 +0000 UTC m=+242.465641876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a6be9298-a8db-40bf-ad68-451199795a99-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-jgfd4" (UID: "a6be9298-a8db-40bf-ad68-451199795a99") : secret "cluster-monitoring-operator-tls" not found Jul 18 03:54:01.204648 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.204436 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a6be9298-a8db-40bf-ad68-451199795a99-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-jgfd4\" (UID: \"a6be9298-a8db-40bf-ad68-451199795a99\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jgfd4" Jul 18 03:54:01.212625 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.212597 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52bvn\" (UniqueName: \"kubernetes.io/projected/a6be9298-a8db-40bf-ad68-451199795a99-kube-api-access-52bvn\") pod \"cluster-monitoring-operator-76cf8966f8-jgfd4\" (UID: \"a6be9298-a8db-40bf-ad68-451199795a99\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jgfd4" Jul 18 03:54:01.212625 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.212618 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng5k7\" (UniqueName: \"kubernetes.io/projected/4689e3a1-9fac-4e73-86c9-5c3a73ef7eb4-kube-api-access-ng5k7\") pod \"volume-data-source-validator-78cf4c6f6-7gngv\" (UID: \"4689e3a1-9fac-4e73-86c9-5c3a73ef7eb4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7gngv" Jul 18 03:54:01.232022 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.231989 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9sclg" Jul 18 03:54:01.239833 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.239695 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7gngv" Jul 18 03:54:01.273879 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.273823 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-kfkfb"] Jul 18 03:54:01.276887 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:54:01.276832 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77a41d30_764b_40f0_9e8d_35b4f6f87009.slice/crio-078fe7562d5e5db6c3353e6c28082dfdbd066e66f58e96b3ea548088c43e00d1 WatchSource:0}: Error finding container 078fe7562d5e5db6c3353e6c28082dfdbd066e66f58e96b3ea548088c43e00d1: Status 404 returned error can't find the container with id 078fe7562d5e5db6c3353e6c28082dfdbd066e66f58e96b3ea548088c43e00d1 Jul 18 03:54:01.298773 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.298708 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-hcwqn"] Jul 18 03:54:01.300378 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:54:01.300309 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a25d1b7_9150_447d_86b1_7674052f44e2.slice/crio-227e7523875baa98368ac21b00ee9a268c09b1d1f1f43e86fe2c95b4d8281d8f WatchSource:0}: Error finding container 227e7523875baa98368ac21b00ee9a268c09b1d1f1f43e86fe2c95b4d8281d8f: Status 404 returned error can't find the container with id 227e7523875baa98368ac21b00ee9a268c09b1d1f1f43e86fe2c95b4d8281d8f Jul 18 03:54:01.382763 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.382727 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9sclg"] Jul 18 03:54:01.386187 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:54:01.386158 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ab82b85_02c2_4fa0_9a5a_2bced519bf92.slice/crio-89b8a3c3bbc8694fde96b69448de1dbc93d93caee1391bdd418728db2edc30df WatchSource:0}: Error finding container 89b8a3c3bbc8694fde96b69448de1dbc93d93caee1391bdd418728db2edc30df: Status 404 returned error can't find the container with id 89b8a3c3bbc8694fde96b69448de1dbc93d93caee1391bdd418728db2edc30df Jul 18 03:54:01.396877 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.396851 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7gngv"] Jul 18 03:54:01.399737 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:54:01.399713 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4689e3a1_9fac_4e73_86c9_5c3a73ef7eb4.slice/crio-65accf8710fccbed7d83dac9ab509b97d86bb8fe337bce699094782c3647184f WatchSource:0}: Error finding container 65accf8710fccbed7d83dac9ab509b97d86bb8fe337bce699094782c3647184f: Status 404 returned error can't find the container with id 65accf8710fccbed7d83dac9ab509b97d86bb8fe337bce699094782c3647184f Jul 18 03:54:01.527094 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.527053 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9sclg" event={"ID":"9ab82b85-02c2-4fa0-9a5a-2bced519bf92","Type":"ContainerStarted","Data":"89b8a3c3bbc8694fde96b69448de1dbc93d93caee1391bdd418728db2edc30df"} Jul 18 03:54:01.528567 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.528544 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hcwqn" event={"ID":"4a25d1b7-9150-447d-86b1-7674052f44e2","Type":"ContainerStarted","Data":"bf0c4f3b917bf89aaa19d1f49c24988cd24fd28ce3d45459cabbf4bd61a90a57"} Jul 18 03:54:01.528699 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.528585 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hcwqn" event={"ID":"4a25d1b7-9150-447d-86b1-7674052f44e2","Type":"ContainerStarted","Data":"227e7523875baa98368ac21b00ee9a268c09b1d1f1f43e86fe2c95b4d8281d8f"} Jul 18 03:54:01.529716 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.529693 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7gngv" event={"ID":"4689e3a1-9fac-4e73-86c9-5c3a73ef7eb4","Type":"ContainerStarted","Data":"65accf8710fccbed7d83dac9ab509b97d86bb8fe337bce699094782c3647184f"} Jul 18 03:54:01.530666 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.530647 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-kfkfb" event={"ID":"77a41d30-764b-40f0-9e8d-35b4f6f87009","Type":"ContainerStarted","Data":"078fe7562d5e5db6c3353e6c28082dfdbd066e66f58e96b3ea548088c43e00d1"} Jul 18 03:54:01.541931 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.541893 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hcwqn" podStartSLOduration=1.541880237 podStartE2EDuration="1.541880237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:54:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:01.541344563 +0000 UTC m=+242.302978216" watchObservedRunningTime="2026-07-18 03:54:01.541880237 +0000 UTC m=+242.303513868" Jul 18 03:54:01.606563 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.606532 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d0e33e99-e3f9-42dd-b442-83a57365d4a6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-9hqct\" (UID: \"d0e33e99-e3f9-42dd-b442-83a57365d4a6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9hqct" Jul 18 03:54:01.606712 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:01.606689 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 18 03:54:01.606790 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:01.606758 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0e33e99-e3f9-42dd-b442-83a57365d4a6-samples-operator-tls podName:d0e33e99-e3f9-42dd-b442-83a57365d4a6 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:02.606740396 +0000 UTC m=+243.368374011 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d0e33e99-e3f9-42dd-b442-83a57365d4a6-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-9hqct" (UID: "d0e33e99-e3f9-42dd-b442-83a57365d4a6") : secret "samples-operator-tls" not found Jul 18 03:54:01.707927 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:01.707886 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6be9298-a8db-40bf-ad68-451199795a99-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jgfd4\" (UID: \"a6be9298-a8db-40bf-ad68-451199795a99\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jgfd4" Jul 18 03:54:01.708115 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:01.708052 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 18 03:54:01.708178 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:01.708131 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6be9298-a8db-40bf-ad68-451199795a99-cluster-monitoring-operator-tls podName:a6be9298-a8db-40bf-ad68-451199795a99 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:02.708112181 +0000 UTC m=+243.469745805 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a6be9298-a8db-40bf-ad68-451199795a99-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-jgfd4" (UID: "a6be9298-a8db-40bf-ad68-451199795a99") : secret "cluster-monitoring-operator-tls" not found Jul 18 03:54:02.628312 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:02.628179 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d0e33e99-e3f9-42dd-b442-83a57365d4a6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-9hqct\" (UID: \"d0e33e99-e3f9-42dd-b442-83a57365d4a6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9hqct" Jul 18 03:54:02.628755 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:02.628284 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 18 03:54:02.628755 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:02.628482 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0e33e99-e3f9-42dd-b442-83a57365d4a6-samples-operator-tls podName:d0e33e99-e3f9-42dd-b442-83a57365d4a6 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:04.628456141 +0000 UTC m=+245.390089758 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d0e33e99-e3f9-42dd-b442-83a57365d4a6-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-9hqct" (UID: "d0e33e99-e3f9-42dd-b442-83a57365d4a6") : secret "samples-operator-tls" not found Jul 18 03:54:02.729056 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:02.729020 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6be9298-a8db-40bf-ad68-451199795a99-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jgfd4\" (UID: \"a6be9298-a8db-40bf-ad68-451199795a99\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jgfd4" Jul 18 03:54:02.729222 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:02.729185 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 18 03:54:02.729267 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:02.729256 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6be9298-a8db-40bf-ad68-451199795a99-cluster-monitoring-operator-tls podName:a6be9298-a8db-40bf-ad68-451199795a99 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:04.729237781 +0000 UTC m=+245.490871392 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a6be9298-a8db-40bf-ad68-451199795a99-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-jgfd4" (UID: "a6be9298-a8db-40bf-ad68-451199795a99") : secret "cluster-monitoring-operator-tls" not found Jul 18 03:54:04.542839 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:04.542796 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7gngv" event={"ID":"4689e3a1-9fac-4e73-86c9-5c3a73ef7eb4","Type":"ContainerStarted","Data":"be39ddfc7dcd49465708e85aa8355c4f11fc330ff1fda5b129e942075ff4cd67"} Jul 18 03:54:04.544451 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:04.544432 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kfkfb_77a41d30-764b-40f0-9e8d-35b4f6f87009/console-operator/0.log" Jul 18 03:54:04.544575 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:04.544467 2558 generic.go:356] "Generic (PLEG): container finished" podID="77a41d30-764b-40f0-9e8d-35b4f6f87009" containerID="cdcd698e30d14bf2eb44dc3c9e5fffe8d0c06b05275a7fc685ae2cb1845630f4" exitCode=255 Jul 18 03:54:04.544575 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:04.544539 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-kfkfb" event={"ID":"77a41d30-764b-40f0-9e8d-35b4f6f87009","Type":"ContainerDied","Data":"cdcd698e30d14bf2eb44dc3c9e5fffe8d0c06b05275a7fc685ae2cb1845630f4"} Jul 18 03:54:04.544766 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:04.544743 2558 scope.go:117] "RemoveContainer" containerID="cdcd698e30d14bf2eb44dc3c9e5fffe8d0c06b05275a7fc685ae2cb1845630f4" Jul 18 03:54:04.546082 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:04.546063 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9sclg" event={"ID":"9ab82b85-02c2-4fa0-9a5a-2bced519bf92","Type":"ContainerStarted","Data":"4dee0128ae459629ba41a257e40ec40f70e4dde75836353d9cc9580180a9d114"} Jul 18 03:54:04.557092 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:04.557052 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7gngv" podStartSLOduration=2.229314738 podStartE2EDuration="4.557032848s" totalImagesPullingTime="2.32771811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:54:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:04.55607047 +0000 UTC m=+245.317704104" watchObservedRunningTime="2026-07-18 03:54:04.557032848 +0000 UTC m=+245.318666462" Jul 18 03:54:04.586298 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:04.586236 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9sclg" podStartSLOduration=2.234287531 podStartE2EDuration="4.586218306s" totalImagesPullingTime="2.351930775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:54:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:04.58573631 +0000 UTC m=+245.347369944" watchObservedRunningTime="2026-07-18 03:54:04.586218306 +0000 UTC m=+245.347851939" Jul 18 03:54:04.632612 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:04.632567 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:04.645333 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:04.645302 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d0e33e99-e3f9-42dd-b442-83a57365d4a6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-9hqct\" (UID: \"d0e33e99-e3f9-42dd-b442-83a57365d4a6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9hqct" Jul 18 03:54:04.645559 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:04.645535 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 18 03:54:04.645629 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:04.645611 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0e33e99-e3f9-42dd-b442-83a57365d4a6-samples-operator-tls podName:d0e33e99-e3f9-42dd-b442-83a57365d4a6 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:08.645590988 +0000 UTC m=+249.407224600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d0e33e99-e3f9-42dd-b442-83a57365d4a6-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-9hqct" (UID: "d0e33e99-e3f9-42dd-b442-83a57365d4a6") : secret "samples-operator-tls" not found Jul 18 03:54:04.732190 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:04.732153 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:04.746376 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:04.746342 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6be9298-a8db-40bf-ad68-451199795a99-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jgfd4\" (UID: \"a6be9298-a8db-40bf-ad68-451199795a99\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jgfd4" Jul 18 03:54:04.746516 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:04.746495 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 18 03:54:04.746578 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:04.746565 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6be9298-a8db-40bf-ad68-451199795a99-cluster-monitoring-operator-tls podName:a6be9298-a8db-40bf-ad68-451199795a99 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:08.746547109 +0000 UTC m=+249.508180719 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a6be9298-a8db-40bf-ad68-451199795a99-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-jgfd4" (UID: "a6be9298-a8db-40bf-ad68-451199795a99") : secret "cluster-monitoring-operator-tls" not found Jul 18 03:54:05.099981 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.099931 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lcwxm"] Jul 18 03:54:05.103089 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.103070 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lcwxm" Jul 18 03:54:05.105682 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.105644 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wqk9w\"" Jul 18 03:54:05.105682 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.105674 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 18 03:54:05.105839 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.105761 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 18 03:54:05.106071 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.106057 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 18 03:54:05.107642 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.107626 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 18 03:54:05.121008 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.120985 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lcwxm"] Jul 18 03:54:05.145019 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.144990 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:05.198352 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.198325 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:05.250542 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.250512 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp7jm\" (UniqueName: \"kubernetes.io/projected/b495171b-e4dc-4857-91cd-ef47ece9e51d-kube-api-access-dp7jm\") pod \"insights-runtime-extractor-lcwxm\" (UID: \"b495171b-e4dc-4857-91cd-ef47ece9e51d\") " pod="openshift-insights/insights-runtime-extractor-lcwxm" Jul 18 03:54:05.250661 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.250555 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b495171b-e4dc-4857-91cd-ef47ece9e51d-crio-socket\") pod \"insights-runtime-extractor-lcwxm\" (UID: \"b495171b-e4dc-4857-91cd-ef47ece9e51d\") " pod="openshift-insights/insights-runtime-extractor-lcwxm" Jul 18 03:54:05.250661 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.250571 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b495171b-e4dc-4857-91cd-ef47ece9e51d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lcwxm\" (UID: \"b495171b-e4dc-4857-91cd-ef47ece9e51d\") " pod="openshift-insights/insights-runtime-extractor-lcwxm" Jul 18 03:54:05.250726 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.250710 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b495171b-e4dc-4857-91cd-ef47ece9e51d-data-volume\") pod \"insights-runtime-extractor-lcwxm\" (UID: \"b495171b-e4dc-4857-91cd-ef47ece9e51d\") " pod="openshift-insights/insights-runtime-extractor-lcwxm" Jul 18 03:54:05.250756 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.250739 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b495171b-e4dc-4857-91cd-ef47ece9e51d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lcwxm\" (UID: \"b495171b-e4dc-4857-91cd-ef47ece9e51d\") " pod="openshift-insights/insights-runtime-extractor-lcwxm" Jul 18 03:54:05.351534 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.351459 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b495171b-e4dc-4857-91cd-ef47ece9e51d-data-volume\") pod \"insights-runtime-extractor-lcwxm\" (UID: \"b495171b-e4dc-4857-91cd-ef47ece9e51d\") " pod="openshift-insights/insights-runtime-extractor-lcwxm" Jul 18 03:54:05.351534 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.351513 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b495171b-e4dc-4857-91cd-ef47ece9e51d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lcwxm\" (UID: \"b495171b-e4dc-4857-91cd-ef47ece9e51d\") " pod="openshift-insights/insights-runtime-extractor-lcwxm" Jul 18 03:54:05.351696 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.351575 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp7jm\" (UniqueName: \"kubernetes.io/projected/b495171b-e4dc-4857-91cd-ef47ece9e51d-kube-api-access-dp7jm\") pod \"insights-runtime-extractor-lcwxm\" (UID: \"b495171b-e4dc-4857-91cd-ef47ece9e51d\") " pod="openshift-insights/insights-runtime-extractor-lcwxm" Jul 18 03:54:05.351746 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:05.351687 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 03:54:05.351746 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.351707 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b495171b-e4dc-4857-91cd-ef47ece9e51d-crio-socket\") pod \"insights-runtime-extractor-lcwxm\" (UID: \"b495171b-e4dc-4857-91cd-ef47ece9e51d\") " pod="openshift-insights/insights-runtime-extractor-lcwxm" Jul 18 03:54:05.351844 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.351747 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b495171b-e4dc-4857-91cd-ef47ece9e51d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lcwxm\" (UID: \"b495171b-e4dc-4857-91cd-ef47ece9e51d\") " pod="openshift-insights/insights-runtime-extractor-lcwxm" Jul 18 03:54:05.351844 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:05.351811 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b495171b-e4dc-4857-91cd-ef47ece9e51d-insights-runtime-extractor-tls podName:b495171b-e4dc-4857-91cd-ef47ece9e51d nodeName:}" failed. No retries permitted until 2026-07-18 03:54:05.851789062 +0000 UTC m=+246.613422672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b495171b-e4dc-4857-91cd-ef47ece9e51d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lcwxm" (UID: "b495171b-e4dc-4857-91cd-ef47ece9e51d") : secret "insights-runtime-extractor-tls" not found Jul 18 03:54:05.351844 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.351827 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b495171b-e4dc-4857-91cd-ef47ece9e51d-crio-socket\") pod \"insights-runtime-extractor-lcwxm\" (UID: \"b495171b-e4dc-4857-91cd-ef47ece9e51d\") " pod="openshift-insights/insights-runtime-extractor-lcwxm" Jul 18 03:54:05.351961 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:05.351846 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 03:54:05.351961 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.351830 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b495171b-e4dc-4857-91cd-ef47ece9e51d-data-volume\") pod \"insights-runtime-extractor-lcwxm\" (UID: \"b495171b-e4dc-4857-91cd-ef47ece9e51d\") " pod="openshift-insights/insights-runtime-extractor-lcwxm" Jul 18 03:54:05.351961 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:05.351919 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b495171b-e4dc-4857-91cd-ef47ece9e51d-kube-rbac-proxy-cm podName:b495171b-e4dc-4857-91cd-ef47ece9e51d nodeName:}" failed. No retries permitted until 2026-07-18 03:54:05.851900959 +0000 UTC m=+246.613534586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b495171b-e4dc-4857-91cd-ef47ece9e51d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lcwxm" (UID: "b495171b-e4dc-4857-91cd-ef47ece9e51d") : configmap "kube-rbac-proxy" not found Jul 18 03:54:05.363185 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.363161 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp7jm\" (UniqueName: \"kubernetes.io/projected/b495171b-e4dc-4857-91cd-ef47ece9e51d-kube-api-access-dp7jm\") pod \"insights-runtime-extractor-lcwxm\" (UID: \"b495171b-e4dc-4857-91cd-ef47ece9e51d\") " pod="openshift-insights/insights-runtime-extractor-lcwxm" Jul 18 03:54:05.400540 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.400514 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:05.500616 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.500582 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:05.550649 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.550630 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kfkfb_77a41d30-764b-40f0-9e8d-35b4f6f87009/console-operator/1.log" Jul 18 03:54:05.551085 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.551071 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kfkfb_77a41d30-764b-40f0-9e8d-35b4f6f87009/console-operator/0.log" Jul 18 03:54:05.551144 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.551103 2558 generic.go:356] "Generic (PLEG): container finished" podID="77a41d30-764b-40f0-9e8d-35b4f6f87009" containerID="f9420a2ffa90161f13b92c6175b545622b47149b00d19207c7f7f1686644ee20" exitCode=255 Jul 18 03:54:05.551192 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.551135 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-kfkfb" event={"ID":"77a41d30-764b-40f0-9e8d-35b4f6f87009","Type":"ContainerDied","Data":"f9420a2ffa90161f13b92c6175b545622b47149b00d19207c7f7f1686644ee20"} Jul 18 03:54:05.551227 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.551209 2558 scope.go:117] "RemoveContainer" containerID="cdcd698e30d14bf2eb44dc3c9e5fffe8d0c06b05275a7fc685ae2cb1845630f4" Jul 18 03:54:05.551704 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.551686 2558 scope.go:117] "RemoveContainer" containerID="f9420a2ffa90161f13b92c6175b545622b47149b00d19207c7f7f1686644ee20" Jul 18 03:54:05.551853 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:05.551834 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-kfkfb_openshift-console-operator(77a41d30-764b-40f0-9e8d-35b4f6f87009)\"" pod="openshift-console-operator/console-operator-565b7b569d-kfkfb" podUID="77a41d30-764b-40f0-9e8d-35b4f6f87009" Jul 18 03:54:05.855737 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.855703 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b495171b-e4dc-4857-91cd-ef47ece9e51d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lcwxm\" (UID: \"b495171b-e4dc-4857-91cd-ef47ece9e51d\") " pod="openshift-insights/insights-runtime-extractor-lcwxm" Jul 18 03:54:05.855914 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.855757 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b495171b-e4dc-4857-91cd-ef47ece9e51d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lcwxm\" (UID: \"b495171b-e4dc-4857-91cd-ef47ece9e51d\") " pod="openshift-insights/insights-runtime-extractor-lcwxm" Jul 18 03:54:05.855914 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:05.855818 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 03:54:05.855914 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:05.855847 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 03:54:05.855914 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:05.855868 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b495171b-e4dc-4857-91cd-ef47ece9e51d-kube-rbac-proxy-cm podName:b495171b-e4dc-4857-91cd-ef47ece9e51d nodeName:}" failed. No retries permitted until 2026-07-18 03:54:06.855853964 +0000 UTC m=+247.617487575 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b495171b-e4dc-4857-91cd-ef47ece9e51d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lcwxm" (UID: "b495171b-e4dc-4857-91cd-ef47ece9e51d") : configmap "kube-rbac-proxy" not found Jul 18 03:54:05.855914 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:05.855896 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b495171b-e4dc-4857-91cd-ef47ece9e51d-insights-runtime-extractor-tls podName:b495171b-e4dc-4857-91cd-ef47ece9e51d nodeName:}" failed. No retries permitted until 2026-07-18 03:54:06.855882297 +0000 UTC m=+247.617515906 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b495171b-e4dc-4857-91cd-ef47ece9e51d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lcwxm" (UID: "b495171b-e4dc-4857-91cd-ef47ece9e51d") : secret "insights-runtime-extractor-tls" not found Jul 18 03:54:05.892715 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.892687 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:05.993202 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:05.993161 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:06.381261 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:06.381228 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-n2b9n"] Jul 18 03:54:06.385619 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:06.385596 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-n2b9n" Jul 18 03:54:06.387979 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:06.387961 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 18 03:54:06.388919 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:06.388898 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 18 03:54:06.389036 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:06.388978 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-d9mwj\"" Jul 18 03:54:06.390859 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:06.390833 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-n2b9n"] Jul 18 03:54:06.417576 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:06.417547 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:06.466326 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:06.466293 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:06.555572 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:06.555546 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kfkfb_77a41d30-764b-40f0-9e8d-35b4f6f87009/console-operator/1.log" Jul 18 03:54:06.555917 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:06.555850 2558 scope.go:117] "RemoveContainer" containerID="f9420a2ffa90161f13b92c6175b545622b47149b00d19207c7f7f1686644ee20" Jul 18 03:54:06.556022 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:06.556002 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-kfkfb_openshift-console-operator(77a41d30-764b-40f0-9e8d-35b4f6f87009)\"" pod="openshift-console-operator/console-operator-565b7b569d-kfkfb" podUID="77a41d30-764b-40f0-9e8d-35b4f6f87009" Jul 18 03:54:06.561857 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:06.561839 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjlqb\" (UniqueName: \"kubernetes.io/projected/3cdbb382-6147-4cc7-887d-96a4650fe81c-kube-api-access-tjlqb\") pod \"migrator-7cc9c7ffd7-n2b9n\" (UID: \"3cdbb382-6147-4cc7-887d-96a4650fe81c\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-n2b9n" Jul 18 03:54:06.662552 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:06.662451 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjlqb\" (UniqueName: \"kubernetes.io/projected/3cdbb382-6147-4cc7-887d-96a4650fe81c-kube-api-access-tjlqb\") pod \"migrator-7cc9c7ffd7-n2b9n\" (UID: \"3cdbb382-6147-4cc7-887d-96a4650fe81c\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-n2b9n" Jul 18 03:54:06.669762 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:06.669733 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjlqb\" (UniqueName: \"kubernetes.io/projected/3cdbb382-6147-4cc7-887d-96a4650fe81c-kube-api-access-tjlqb\") pod \"migrator-7cc9c7ffd7-n2b9n\" (UID: \"3cdbb382-6147-4cc7-887d-96a4650fe81c\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-n2b9n" Jul 18 03:54:06.695610 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:06.695586 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-n2b9n" Jul 18 03:54:06.817969 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:06.817791 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-n2b9n"] Jul 18 03:54:06.822004 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:54:06.821970 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cdbb382_6147_4cc7_887d_96a4650fe81c.slice/crio-f2fa8447f687c5d22f6d9e72873ee790b0e7a21c914a0174413c82abb62bf222 WatchSource:0}: Error finding container f2fa8447f687c5d22f6d9e72873ee790b0e7a21c914a0174413c82abb62bf222: Status 404 returned error can't find the container with id f2fa8447f687c5d22f6d9e72873ee790b0e7a21c914a0174413c82abb62bf222 Jul 18 03:54:06.864573 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:06.864535 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b495171b-e4dc-4857-91cd-ef47ece9e51d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lcwxm\" (UID: \"b495171b-e4dc-4857-91cd-ef47ece9e51d\") " pod="openshift-insights/insights-runtime-extractor-lcwxm" Jul 18 03:54:06.864725 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:06.864630 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b495171b-e4dc-4857-91cd-ef47ece9e51d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lcwxm\" (UID: \"b495171b-e4dc-4857-91cd-ef47ece9e51d\") " pod="openshift-insights/insights-runtime-extractor-lcwxm" Jul 18 03:54:06.864725 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:06.864666 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 03:54:06.864796 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:06.864731 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 03:54:06.864796 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:06.864734 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b495171b-e4dc-4857-91cd-ef47ece9e51d-kube-rbac-proxy-cm podName:b495171b-e4dc-4857-91cd-ef47ece9e51d nodeName:}" failed. No retries permitted until 2026-07-18 03:54:08.864716987 +0000 UTC m=+249.626350597 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b495171b-e4dc-4857-91cd-ef47ece9e51d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lcwxm" (UID: "b495171b-e4dc-4857-91cd-ef47ece9e51d") : configmap "kube-rbac-proxy" not found Jul 18 03:54:06.864796 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:06.864777 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b495171b-e4dc-4857-91cd-ef47ece9e51d-insights-runtime-extractor-tls podName:b495171b-e4dc-4857-91cd-ef47ece9e51d nodeName:}" failed. No retries permitted until 2026-07-18 03:54:08.864766112 +0000 UTC m=+249.626399721 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b495171b-e4dc-4857-91cd-ef47ece9e51d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lcwxm" (UID: "b495171b-e4dc-4857-91cd-ef47ece9e51d") : secret "insights-runtime-extractor-tls" not found Jul 18 03:54:07.088732 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:07.088651 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l94vd_6f0209eb-dee6-49e8-85c5-55a211a0f069/dns-node-resolver/0.log" Jul 18 03:54:07.487600 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:07.487569 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-nzvtk"] Jul 18 03:54:07.490626 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:07.490606 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-nzvtk" Jul 18 03:54:07.492784 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:07.492763 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 18 03:54:07.492921 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:07.492904 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 18 03:54:07.493716 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:07.493699 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-h25d2\"" Jul 18 03:54:07.493786 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:07.493699 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 18 03:54:07.493786 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:07.493753 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 18 03:54:07.497563 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:07.497542 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-nzvtk"] Jul 18 03:54:07.515744 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:07.515723 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:07.566493 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:07.566452 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:07.566921 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:07.566662 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-n2b9n" event={"ID":"3cdbb382-6147-4cc7-887d-96a4650fe81c","Type":"ContainerStarted","Data":"f2fa8447f687c5d22f6d9e72873ee790b0e7a21c914a0174413c82abb62bf222"} Jul 18 03:54:07.571243 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:07.571209 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq5w2\" (UniqueName: \"kubernetes.io/projected/bddecf18-6831-4b29-9d5b-c541353ce79e-kube-api-access-dq5w2\") pod \"service-ca-58598695f7-nzvtk\" (UID: \"bddecf18-6831-4b29-9d5b-c541353ce79e\") " pod="openshift-service-ca/service-ca-58598695f7-nzvtk" Jul 18 03:54:07.571361 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:07.571261 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bddecf18-6831-4b29-9d5b-c541353ce79e-signing-key\") pod \"service-ca-58598695f7-nzvtk\" (UID: \"bddecf18-6831-4b29-9d5b-c541353ce79e\") " pod="openshift-service-ca/service-ca-58598695f7-nzvtk" Jul 18 03:54:07.571361 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:07.571327 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bddecf18-6831-4b29-9d5b-c541353ce79e-signing-cabundle\") pod \"service-ca-58598695f7-nzvtk\" (UID: \"bddecf18-6831-4b29-9d5b-c541353ce79e\") " pod="openshift-service-ca/service-ca-58598695f7-nzvtk" Jul 18 03:54:07.672694 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:07.672661 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq5w2\" (UniqueName: \"kubernetes.io/projected/bddecf18-6831-4b29-9d5b-c541353ce79e-kube-api-access-dq5w2\") pod \"service-ca-58598695f7-nzvtk\" (UID: \"bddecf18-6831-4b29-9d5b-c541353ce79e\") " pod="openshift-service-ca/service-ca-58598695f7-nzvtk" Jul 18 03:54:07.672860 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:07.672715 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bddecf18-6831-4b29-9d5b-c541353ce79e-signing-key\") pod \"service-ca-58598695f7-nzvtk\" (UID: \"bddecf18-6831-4b29-9d5b-c541353ce79e\") " pod="openshift-service-ca/service-ca-58598695f7-nzvtk" Jul 18 03:54:07.672860 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:07.672780 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bddecf18-6831-4b29-9d5b-c541353ce79e-signing-cabundle\") pod \"service-ca-58598695f7-nzvtk\" (UID: \"bddecf18-6831-4b29-9d5b-c541353ce79e\") " pod="openshift-service-ca/service-ca-58598695f7-nzvtk" Jul 18 03:54:07.673645 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:07.673613 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bddecf18-6831-4b29-9d5b-c541353ce79e-signing-cabundle\") pod \"service-ca-58598695f7-nzvtk\" (UID: \"bddecf18-6831-4b29-9d5b-c541353ce79e\") " pod="openshift-service-ca/service-ca-58598695f7-nzvtk" Jul 18 03:54:07.675977 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:07.675949 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bddecf18-6831-4b29-9d5b-c541353ce79e-signing-key\") pod \"service-ca-58598695f7-nzvtk\" (UID: \"bddecf18-6831-4b29-9d5b-c541353ce79e\") " pod="openshift-service-ca/service-ca-58598695f7-nzvtk" Jul 18 03:54:07.680565 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:07.680533 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq5w2\" (UniqueName: \"kubernetes.io/projected/bddecf18-6831-4b29-9d5b-c541353ce79e-kube-api-access-dq5w2\") pod \"service-ca-58598695f7-nzvtk\" (UID: \"bddecf18-6831-4b29-9d5b-c541353ce79e\") " pod="openshift-service-ca/service-ca-58598695f7-nzvtk" Jul 18 03:54:07.800758 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:07.800665 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-nzvtk" Jul 18 03:54:08.059106 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:08.059081 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-nzvtk"] Jul 18 03:54:08.062677 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:54:08.062653 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbddecf18_6831_4b29_9d5b_c541353ce79e.slice/crio-a37fb508d4669bd403ce82d8e10e40ba41b04fa2ab13ef233346dc561ad135b2 WatchSource:0}: Error finding container a37fb508d4669bd403ce82d8e10e40ba41b04fa2ab13ef233346dc561ad135b2: Status 404 returned error can't find the container with id a37fb508d4669bd403ce82d8e10e40ba41b04fa2ab13ef233346dc561ad135b2 Jul 18 03:54:08.288811 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:08.288780 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x92wq_8434d441-42df-4bd3-9f63-9d5a4d3f1521/node-ca/0.log" Jul 18 03:54:08.356525 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:08.356442 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:08.572304 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:08.572264 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-n2b9n" event={"ID":"3cdbb382-6147-4cc7-887d-96a4650fe81c","Type":"ContainerStarted","Data":"e2543c5b80c35fda66c53610bc40122a98efd0bb39d21f0613ddfa526d4bf706"} Jul 18 03:54:08.572747 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:08.572337 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-n2b9n" event={"ID":"3cdbb382-6147-4cc7-887d-96a4650fe81c","Type":"ContainerStarted","Data":"eae3b49b7429faeac7a3538f710c5db1b7540a6fc79a64cf729900909ea44d1b"} Jul 18 03:54:08.573603 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:08.573553 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-nzvtk" event={"ID":"bddecf18-6831-4b29-9d5b-c541353ce79e","Type":"ContainerStarted","Data":"a37fb508d4669bd403ce82d8e10e40ba41b04fa2ab13ef233346dc561ad135b2"} Jul 18 03:54:08.588622 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:08.588572 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-n2b9n" podStartSLOduration=1.430435654 podStartE2EDuration="2.588554062s" totalImagesPullingTime="1.158118408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:54:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:08.587656266 +0000 UTC m=+249.349289900" watchObservedRunningTime="2026-07-18 03:54:08.588554062 +0000 UTC m=+249.350187698" Jul 18 03:54:08.682302 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:08.682261 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d0e33e99-e3f9-42dd-b442-83a57365d4a6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-9hqct\" (UID: \"d0e33e99-e3f9-42dd-b442-83a57365d4a6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9hqct" Jul 18 03:54:08.682465 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:08.682386 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 18 03:54:08.682465 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:08.682456 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0e33e99-e3f9-42dd-b442-83a57365d4a6-samples-operator-tls podName:d0e33e99-e3f9-42dd-b442-83a57365d4a6 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:16.682436629 +0000 UTC m=+257.444070254 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d0e33e99-e3f9-42dd-b442-83a57365d4a6-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-9hqct" (UID: "d0e33e99-e3f9-42dd-b442-83a57365d4a6") : secret "samples-operator-tls" not found Jul 18 03:54:08.691155 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:08.691123 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9czfx_46e600e7-76a1-49e4-bcd7-00c1caaaf2e0/serve-healthcheck-canary/0.log" Jul 18 03:54:08.783026 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:08.782992 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6be9298-a8db-40bf-ad68-451199795a99-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jgfd4\" (UID: \"a6be9298-a8db-40bf-ad68-451199795a99\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jgfd4" Jul 18 03:54:08.783245 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:08.783224 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 18 03:54:08.783362 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:08.783341 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6be9298-a8db-40bf-ad68-451199795a99-cluster-monitoring-operator-tls podName:a6be9298-a8db-40bf-ad68-451199795a99 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:16.783317904 +0000 UTC m=+257.544951529 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a6be9298-a8db-40bf-ad68-451199795a99-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-jgfd4" (UID: "a6be9298-a8db-40bf-ad68-451199795a99") : secret "cluster-monitoring-operator-tls" not found Jul 18 03:54:08.883734 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:08.883702 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b495171b-e4dc-4857-91cd-ef47ece9e51d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lcwxm\" (UID: \"b495171b-e4dc-4857-91cd-ef47ece9e51d\") " pod="openshift-insights/insights-runtime-extractor-lcwxm" Jul 18 03:54:08.883931 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:08.883766 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b495171b-e4dc-4857-91cd-ef47ece9e51d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lcwxm\" (UID: \"b495171b-e4dc-4857-91cd-ef47ece9e51d\") " pod="openshift-insights/insights-runtime-extractor-lcwxm" Jul 18 03:54:08.883931 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:08.883870 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 03:54:08.883931 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:08.883912 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 03:54:08.883931 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:08.883964 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b495171b-e4dc-4857-91cd-ef47ece9e51d-insights-runtime-extractor-tls podName:b495171b-e4dc-4857-91cd-ef47ece9e51d nodeName:}" failed. No retries permitted until 2026-07-18 03:54:12.883929817 +0000 UTC m=+253.645563432 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b495171b-e4dc-4857-91cd-ef47ece9e51d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lcwxm" (UID: "b495171b-e4dc-4857-91cd-ef47ece9e51d") : secret "insights-runtime-extractor-tls" not found Jul 18 03:54:08.884189 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:08.884000 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b495171b-e4dc-4857-91cd-ef47ece9e51d-kube-rbac-proxy-cm podName:b495171b-e4dc-4857-91cd-ef47ece9e51d nodeName:}" failed. No retries permitted until 2026-07-18 03:54:12.883975088 +0000 UTC m=+253.645608702 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b495171b-e4dc-4857-91cd-ef47ece9e51d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lcwxm" (UID: "b495171b-e4dc-4857-91cd-ef47ece9e51d") : configmap "kube-rbac-proxy" not found Jul 18 03:54:10.469765 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:10.469727 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:10.520656 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:10.520617 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:10.582265 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:10.582225 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-nzvtk" event={"ID":"bddecf18-6831-4b29-9d5b-c541353ce79e","Type":"ContainerStarted","Data":"8e21bf74efb55ab89f89b55699c505de30dcd2f66cf3726e1d52d7f237f190b1"} Jul 18 03:54:10.638004 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:10.637913 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:10.742244 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:10.742155 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:10.896947 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:10.896900 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:10.991406 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:10.991373 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:11.122499 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:11.122457 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:11.138399 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:11.138370 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-kfkfb" Jul 18 03:54:11.138536 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:11.138415 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-kfkfb" Jul 18 03:54:11.138785 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:11.138767 2558 scope.go:117] "RemoveContainer" containerID="f9420a2ffa90161f13b92c6175b545622b47149b00d19207c7f7f1686644ee20" Jul 18 03:54:11.138981 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:11.138960 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-kfkfb_openshift-console-operator(77a41d30-764b-40f0-9e8d-35b4f6f87009)\"" pod="openshift-console-operator/console-operator-565b7b569d-kfkfb" podUID="77a41d30-764b-40f0-9e8d-35b4f6f87009" Jul 18 03:54:11.378326 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:11.378247 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:11.584614 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:11.584578 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:11.610841 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:11.610811 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs\") pod \"network-metrics-daemon-f8944\" (UID: \"15496aee-38ed-4f76-b18f-b84cd34b2dc9\") " pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:54:11.610995 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:11.610978 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 18 03:54:11.611083 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:11.611046 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs podName:15496aee-38ed-4f76-b18f-b84cd34b2dc9 nodeName:}" failed. No retries permitted until 2026-07-18 03:56:13.61102637 +0000 UTC m=+374.372659981 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs") pod "network-metrics-daemon-f8944" (UID: "15496aee-38ed-4f76-b18f-b84cd34b2dc9") : secret "metrics-daemon-secret" not found Jul 18 03:54:12.376253 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:12.376215 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:12.922364 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:12.922332 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b495171b-e4dc-4857-91cd-ef47ece9e51d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lcwxm\" (UID: \"b495171b-e4dc-4857-91cd-ef47ece9e51d\") " pod="openshift-insights/insights-runtime-extractor-lcwxm" Jul 18 03:54:12.922781 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:12.922423 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b495171b-e4dc-4857-91cd-ef47ece9e51d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lcwxm\" (UID: \"b495171b-e4dc-4857-91cd-ef47ece9e51d\") " pod="openshift-insights/insights-runtime-extractor-lcwxm" Jul 18 03:54:12.922781 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:12.922477 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 03:54:12.922781 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:12.922518 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 03:54:12.922781 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:12.922562 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b495171b-e4dc-4857-91cd-ef47ece9e51d-kube-rbac-proxy-cm podName:b495171b-e4dc-4857-91cd-ef47ece9e51d nodeName:}" failed. No retries permitted until 2026-07-18 03:54:20.922539811 +0000 UTC m=+261.684173422 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b495171b-e4dc-4857-91cd-ef47ece9e51d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lcwxm" (UID: "b495171b-e4dc-4857-91cd-ef47ece9e51d") : configmap "kube-rbac-proxy" not found Jul 18 03:54:12.922781 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:12.922585 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b495171b-e4dc-4857-91cd-ef47ece9e51d-insights-runtime-extractor-tls podName:b495171b-e4dc-4857-91cd-ef47ece9e51d nodeName:}" failed. No retries permitted until 2026-07-18 03:54:20.922574251 +0000 UTC m=+261.684207862 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b495171b-e4dc-4857-91cd-ef47ece9e51d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lcwxm" (UID: "b495171b-e4dc-4857-91cd-ef47ece9e51d") : secret "insights-runtime-extractor-tls" not found Jul 18 03:54:12.977752 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:12.977704 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:13.174154 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:13.174067 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:13.377208 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:13.377173 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:13.477766 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:13.477652 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:13.771609 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:13.771515 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:14.374729 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:14.374693 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:14.424702 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:14.424675 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:14.575328 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:14.575303 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:14.778590 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:14.778503 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:14.973633 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:14.973605 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:15.075295 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:15.075212 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:15.175772 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:15.175736 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:15.376267 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:15.376235 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:15.773127 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:15.773022 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:16.404704 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:16.404655 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:16.753075 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:16.752999 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d0e33e99-e3f9-42dd-b442-83a57365d4a6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-9hqct\" (UID: \"d0e33e99-e3f9-42dd-b442-83a57365d4a6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9hqct" Jul 18 03:54:16.755430 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:16.755412 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d0e33e99-e3f9-42dd-b442-83a57365d4a6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-9hqct\" (UID: \"d0e33e99-e3f9-42dd-b442-83a57365d4a6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9hqct" Jul 18 03:54:16.853640 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:16.853604 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6be9298-a8db-40bf-ad68-451199795a99-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jgfd4\" (UID: \"a6be9298-a8db-40bf-ad68-451199795a99\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jgfd4" Jul 18 03:54:16.853775 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:16.853724 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 18 03:54:16.853813 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:16.853778 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6be9298-a8db-40bf-ad68-451199795a99-cluster-monitoring-operator-tls podName:a6be9298-a8db-40bf-ad68-451199795a99 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:32.853764545 +0000 UTC m=+273.615398155 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a6be9298-a8db-40bf-ad68-451199795a99-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-jgfd4" (UID: "a6be9298-a8db-40bf-ad68-451199795a99") : secret "cluster-monitoring-operator-tls" not found Jul 18 03:54:16.982055 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:16.982005 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:17.044974 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:17.044868 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9hqct" Jul 18 03:54:17.081196 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:17.081161 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:17.174657 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:17.174603 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-nzvtk" podStartSLOduration=8.478953861 podStartE2EDuration="10.17458729s" totalImagesPullingTime="1.695633429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:54:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:10.597437279 +0000 UTC m=+251.359070911" watchObservedRunningTime="2026-07-18 03:54:17.17458729 +0000 UTC m=+257.936220942" Jul 18 03:54:17.175837 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:17.175816 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9hqct"] Jul 18 03:54:17.178176 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:17.178148 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:17.377547 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:17.377510 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:17.603468 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:17.603436 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9hqct" event={"ID":"d0e33e99-e3f9-42dd-b442-83a57365d4a6","Type":"ContainerStarted","Data":"5737f44273d9494ba414bea1eb9ed04175ef2095c038c7ca2891ec3f61a422c8"} Jul 18 03:54:17.775678 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:17.775601 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:18.380330 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:18.380294 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:18.431153 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:18.431115 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:18.773986 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:18.773876 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:18.976590 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:18.976556 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:19.382498 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:19.382458 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:19.611594 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:19.611562 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9hqct" event={"ID":"d0e33e99-e3f9-42dd-b442-83a57365d4a6","Type":"ContainerStarted","Data":"811e250e0fd35479c972d737b2bf8f7ba6f68412c0887a02b9335a4a593171b6"} Jul 18 03:54:19.611787 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:19.611612 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9hqct" event={"ID":"d0e33e99-e3f9-42dd-b442-83a57365d4a6","Type":"ContainerStarted","Data":"ecff2194c72818b66c4c554f4ed0ba3b4c5a6c7dba672a080e8031d6d7694d7d"} Jul 18 03:54:19.629483 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:19.629431 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9hqct" podStartSLOduration=17.934761226 podStartE2EDuration="19.629418156s" totalImagesPullingTime="1.69465693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:54:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:19.627649112 +0000 UTC m=+260.389282742" watchObservedRunningTime="2026-07-18 03:54:19.629418156 +0000 UTC m=+260.391051787" Jul 18 03:54:19.972412 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:19.972378 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:20.574718 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:20.574679 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:20.772836 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:20.772802 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:20.970635 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:20.970599 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:20.991698 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:20.991668 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b495171b-e4dc-4857-91cd-ef47ece9e51d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lcwxm\" (UID: \"b495171b-e4dc-4857-91cd-ef47ece9e51d\") " pod="openshift-insights/insights-runtime-extractor-lcwxm" Jul 18 03:54:20.992020 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:20.991727 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b495171b-e4dc-4857-91cd-ef47ece9e51d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lcwxm\" (UID: \"b495171b-e4dc-4857-91cd-ef47ece9e51d\") " pod="openshift-insights/insights-runtime-extractor-lcwxm" Jul 18 03:54:20.992203 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:20.992179 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b495171b-e4dc-4857-91cd-ef47ece9e51d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lcwxm\" (UID: \"b495171b-e4dc-4857-91cd-ef47ece9e51d\") " pod="openshift-insights/insights-runtime-extractor-lcwxm" Jul 18 03:54:20.993901 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:20.993884 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b495171b-e4dc-4857-91cd-ef47ece9e51d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lcwxm\" (UID: \"b495171b-e4dc-4857-91cd-ef47ece9e51d\") " pod="openshift-insights/insights-runtime-extractor-lcwxm" Jul 18 03:54:21.013889 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:21.013860 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lcwxm" Jul 18 03:54:21.137858 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:21.137813 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lcwxm"] Jul 18 03:54:21.141957 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:54:21.141920 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb495171b_e4dc_4857_91cd_ef47ece9e51d.slice/crio-fe290be9b7546cb6b645a83d7eec50bcd83b603861b521cf033a13d7d1edff6f WatchSource:0}: Error finding container fe290be9b7546cb6b645a83d7eec50bcd83b603861b521cf033a13d7d1edff6f: Status 404 returned error can't find the container with id fe290be9b7546cb6b645a83d7eec50bcd83b603861b521cf033a13d7d1edff6f Jul 18 03:54:21.181598 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:21.181568 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:21.621709 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:21.621452 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lcwxm" event={"ID":"b495171b-e4dc-4857-91cd-ef47ece9e51d","Type":"ContainerStarted","Data":"fe290be9b7546cb6b645a83d7eec50bcd83b603861b521cf033a13d7d1edff6f"} Jul 18 03:54:22.760221 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:22.760188 2558 scope.go:117] "RemoveContainer" containerID="f9420a2ffa90161f13b92c6175b545622b47149b00d19207c7f7f1686644ee20" Jul 18 03:54:23.632663 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:23.632629 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kfkfb_77a41d30-764b-40f0-9e8d-35b4f6f87009/console-operator/1.log" Jul 18 03:54:23.632841 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:23.632712 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-kfkfb" event={"ID":"77a41d30-764b-40f0-9e8d-35b4f6f87009","Type":"ContainerStarted","Data":"8e9a9124c9c763b31def687c384d35868e9a700d10bd0f7c55b4097f3c5a6d17"} Jul 18 03:54:23.633040 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:23.633011 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-kfkfb" Jul 18 03:54:23.638832 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:23.638802 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-kfkfb" Jul 18 03:54:23.650478 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:23.650380 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-kfkfb" podStartSLOduration=21.193553668 podStartE2EDuration="23.650360205s" totalImagesPullingTime="2.456806537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:54:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:23.647310327 +0000 UTC m=+264.408943972" watchObservedRunningTime="2026-07-18 03:54:23.650360205 +0000 UTC m=+264.411993837" Jul 18 03:54:23.703118 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:23.703073 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:23.800776 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:23.800733 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:23.993744 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:23.993648 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:24.175352 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:24.175311 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:24.276600 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:24.276517 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:24.602983 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:24.602875 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:24.704560 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:24.704517 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:24.999180 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:24.999144 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:25.100399 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:25.100353 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:25.585574 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:25.585537 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:25.788443 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:25.788404 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:25.889520 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:25.889475 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:26.645874 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:26.645834 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lcwxm" event={"ID":"b495171b-e4dc-4857-91cd-ef47ece9e51d","Type":"ContainerStarted","Data":"6dc621d2d0a6a26aa29ae8387fcf66be9e1a06b9c2287cebdff3b5e09eaf09e1"} Jul 18 03:54:27.016846 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:27.016741 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:28.868301 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:28.868264 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:28.966497 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:28.966443 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:29.658260 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:29.658225 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lcwxm" event={"ID":"b495171b-e4dc-4857-91cd-ef47ece9e51d","Type":"ContainerStarted","Data":"4a82df4508d6055d84b7512b2e520db8878db24b159d11f4121ae934f57523f1"} Jul 18 03:54:32.836511 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:32.836477 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:32.895232 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:32.895208 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6be9298-a8db-40bf-ad68-451199795a99-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jgfd4\" (UID: \"a6be9298-a8db-40bf-ad68-451199795a99\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jgfd4" Jul 18 03:54:32.897549 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:32.897521 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6be9298-a8db-40bf-ad68-451199795a99-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jgfd4\" (UID: \"a6be9298-a8db-40bf-ad68-451199795a99\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jgfd4" Jul 18 03:54:32.937649 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:32.937620 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:33.045919 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:33.045885 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jgfd4" Jul 18 03:54:33.196571 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:33.196538 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jgfd4"] Jul 18 03:54:33.200661 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:54:33.200630 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6be9298_a8db_40bf_ad68_451199795a99.slice/crio-e0473898cbfa822e762cf63f34e47736b9ca0db8e35a70eabb12df0d4a2584bb WatchSource:0}: Error finding container e0473898cbfa822e762cf63f34e47736b9ca0db8e35a70eabb12df0d4a2584bb: Status 404 returned error can't find the container with id e0473898cbfa822e762cf63f34e47736b9ca0db8e35a70eabb12df0d4a2584bb Jul 18 03:54:33.673368 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:33.673328 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lcwxm" event={"ID":"b495171b-e4dc-4857-91cd-ef47ece9e51d","Type":"ContainerStarted","Data":"f009b3a89bb582d82de8a6fab7da93c16b9cae02dc646d09dd977701f3746545"} Jul 18 03:54:33.674325 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:33.674296 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jgfd4" event={"ID":"a6be9298-a8db-40bf-ad68-451199795a99","Type":"ContainerStarted","Data":"e0473898cbfa822e762cf63f34e47736b9ca0db8e35a70eabb12df0d4a2584bb"} Jul 18 03:54:33.689379 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:33.689334 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lcwxm" podStartSLOduration=17.096642637 podStartE2EDuration="28.689319774s" totalImagesPullingTime="11.592677137s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:54:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:33.688432885 +0000 UTC m=+274.450066535" watchObservedRunningTime="2026-07-18 03:54:33.689319774 +0000 UTC m=+274.450953407" Jul 18 03:54:34.415237 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.415198 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9946d7cf7-ccpqj"] Jul 18 03:54:34.420004 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.419979 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9946d7cf7-ccpqj" Jul 18 03:54:34.422668 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.422635 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 18 03:54:34.422668 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.422662 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 18 03:54:34.422837 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.422731 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 18 03:54:34.423280 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.423258 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 18 03:54:34.423280 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.423271 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 18 03:54:34.423454 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.423271 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-94tc7\"" Jul 18 03:54:34.423615 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.423580 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 18 03:54:34.423710 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.423579 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 18 03:54:34.426701 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.426678 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9946d7cf7-ccpqj"] Jul 18 03:54:34.510001 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.509960 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltn6b\" (UniqueName: \"kubernetes.io/projected/cd826334-05bb-4633-b9ab-1f02db519ef7-kube-api-access-ltn6b\") pod \"console-9946d7cf7-ccpqj\" (UID: \"cd826334-05bb-4633-b9ab-1f02db519ef7\") " pod="openshift-console/console-9946d7cf7-ccpqj" Jul 18 03:54:34.510171 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.510012 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd826334-05bb-4633-b9ab-1f02db519ef7-console-serving-cert\") pod \"console-9946d7cf7-ccpqj\" (UID: \"cd826334-05bb-4633-b9ab-1f02db519ef7\") " pod="openshift-console/console-9946d7cf7-ccpqj" Jul 18 03:54:34.510171 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.510037 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd826334-05bb-4633-b9ab-1f02db519ef7-console-oauth-config\") pod \"console-9946d7cf7-ccpqj\" (UID: \"cd826334-05bb-4633-b9ab-1f02db519ef7\") " pod="openshift-console/console-9946d7cf7-ccpqj" Jul 18 03:54:34.510171 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.510056 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd826334-05bb-4633-b9ab-1f02db519ef7-service-ca\") pod \"console-9946d7cf7-ccpqj\" (UID: \"cd826334-05bb-4633-b9ab-1f02db519ef7\") " pod="openshift-console/console-9946d7cf7-ccpqj" Jul 18 03:54:34.510171 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.510153 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd826334-05bb-4633-b9ab-1f02db519ef7-console-config\") pod \"console-9946d7cf7-ccpqj\" (UID: \"cd826334-05bb-4633-b9ab-1f02db519ef7\") " pod="openshift-console/console-9946d7cf7-ccpqj" Jul 18 03:54:34.510358 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.510207 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd826334-05bb-4633-b9ab-1f02db519ef7-oauth-serving-cert\") pod \"console-9946d7cf7-ccpqj\" (UID: \"cd826334-05bb-4633-b9ab-1f02db519ef7\") " pod="openshift-console/console-9946d7cf7-ccpqj" Jul 18 03:54:34.611571 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.611532 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd826334-05bb-4633-b9ab-1f02db519ef7-console-serving-cert\") pod \"console-9946d7cf7-ccpqj\" (UID: \"cd826334-05bb-4633-b9ab-1f02db519ef7\") " pod="openshift-console/console-9946d7cf7-ccpqj" Jul 18 03:54:34.611571 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.611573 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd826334-05bb-4633-b9ab-1f02db519ef7-console-oauth-config\") pod \"console-9946d7cf7-ccpqj\" (UID: \"cd826334-05bb-4633-b9ab-1f02db519ef7\") " pod="openshift-console/console-9946d7cf7-ccpqj" Jul 18 03:54:34.611794 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.611598 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd826334-05bb-4633-b9ab-1f02db519ef7-service-ca\") pod \"console-9946d7cf7-ccpqj\" (UID: \"cd826334-05bb-4633-b9ab-1f02db519ef7\") " pod="openshift-console/console-9946d7cf7-ccpqj" Jul 18 03:54:34.611907 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.611884 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd826334-05bb-4633-b9ab-1f02db519ef7-console-config\") pod \"console-9946d7cf7-ccpqj\" (UID: \"cd826334-05bb-4633-b9ab-1f02db519ef7\") " pod="openshift-console/console-9946d7cf7-ccpqj" Jul 18 03:54:34.612163 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.611923 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd826334-05bb-4633-b9ab-1f02db519ef7-oauth-serving-cert\") pod \"console-9946d7cf7-ccpqj\" (UID: \"cd826334-05bb-4633-b9ab-1f02db519ef7\") " pod="openshift-console/console-9946d7cf7-ccpqj" Jul 18 03:54:34.612163 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.612086 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltn6b\" (UniqueName: \"kubernetes.io/projected/cd826334-05bb-4633-b9ab-1f02db519ef7-kube-api-access-ltn6b\") pod \"console-9946d7cf7-ccpqj\" (UID: \"cd826334-05bb-4633-b9ab-1f02db519ef7\") " pod="openshift-console/console-9946d7cf7-ccpqj" Jul 18 03:54:34.612460 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.612400 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd826334-05bb-4633-b9ab-1f02db519ef7-service-ca\") pod \"console-9946d7cf7-ccpqj\" (UID: \"cd826334-05bb-4633-b9ab-1f02db519ef7\") " pod="openshift-console/console-9946d7cf7-ccpqj" Jul 18 03:54:34.612643 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.612613 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd826334-05bb-4633-b9ab-1f02db519ef7-console-config\") pod \"console-9946d7cf7-ccpqj\" (UID: \"cd826334-05bb-4633-b9ab-1f02db519ef7\") " pod="openshift-console/console-9946d7cf7-ccpqj" Jul 18 03:54:34.612743 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.612688 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd826334-05bb-4633-b9ab-1f02db519ef7-oauth-serving-cert\") pod \"console-9946d7cf7-ccpqj\" (UID: \"cd826334-05bb-4633-b9ab-1f02db519ef7\") " pod="openshift-console/console-9946d7cf7-ccpqj" Jul 18 03:54:34.614512 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.614489 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd826334-05bb-4633-b9ab-1f02db519ef7-console-oauth-config\") pod \"console-9946d7cf7-ccpqj\" (UID: \"cd826334-05bb-4633-b9ab-1f02db519ef7\") " pod="openshift-console/console-9946d7cf7-ccpqj" Jul 18 03:54:34.614720 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.614689 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd826334-05bb-4633-b9ab-1f02db519ef7-console-serving-cert\") pod \"console-9946d7cf7-ccpqj\" (UID: \"cd826334-05bb-4633-b9ab-1f02db519ef7\") " pod="openshift-console/console-9946d7cf7-ccpqj" Jul 18 03:54:34.620305 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.620280 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltn6b\" (UniqueName: \"kubernetes.io/projected/cd826334-05bb-4633-b9ab-1f02db519ef7-kube-api-access-ltn6b\") pod \"console-9946d7cf7-ccpqj\" (UID: \"cd826334-05bb-4633-b9ab-1f02db519ef7\") " pod="openshift-console/console-9946d7cf7-ccpqj" Jul 18 03:54:34.731960 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.731859 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9946d7cf7-ccpqj" Jul 18 03:54:34.933362 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:34.933336 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9946d7cf7-ccpqj"] Jul 18 03:54:34.936297 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:54:34.936272 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd826334_05bb_4633_b9ab_1f02db519ef7.slice/crio-364f2d897cb38be947174ccc7ec04f515cc1a139ad8fc0f8867e73d2f4a4cec3 WatchSource:0}: Error finding container 364f2d897cb38be947174ccc7ec04f515cc1a139ad8fc0f8867e73d2f4a4cec3: Status 404 returned error can't find the container with id 364f2d897cb38be947174ccc7ec04f515cc1a139ad8fc0f8867e73d2f4a4cec3 Jul 18 03:54:35.191642 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:35.191601 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:35.353101 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:35.353067 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:35.480769 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:35.480673 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:35.682781 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:35.682744 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jgfd4" event={"ID":"a6be9298-a8db-40bf-ad68-451199795a99","Type":"ContainerStarted","Data":"f8d654831c1afe73eb85376cecd5623f74c01f4a37c45965448fa90d8b2a68a1"} Jul 18 03:54:35.684059 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:35.684029 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9946d7cf7-ccpqj" event={"ID":"cd826334-05bb-4633-b9ab-1f02db519ef7","Type":"ContainerStarted","Data":"364f2d897cb38be947174ccc7ec04f515cc1a139ad8fc0f8867e73d2f4a4cec3"} Jul 18 03:54:35.697539 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:35.697494 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jgfd4" podStartSLOduration=34.034542343 podStartE2EDuration="35.697481547s" totalImagesPullingTime="1.662939204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:54:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:35.696208167 +0000 UTC m=+276.457841798" watchObservedRunningTime="2026-07-18 03:54:35.697481547 +0000 UTC m=+276.459115179" Jul 18 03:54:38.373821 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:38.373784 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:38.431229 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:38.431197 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:38.605397 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:38.605364 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:38.696479 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:38.696383 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9946d7cf7-ccpqj" event={"ID":"cd826334-05bb-4633-b9ab-1f02db519ef7","Type":"ContainerStarted","Data":"e5de4b93d26dadd2c9d94d1e68571bcd5580f3f1fcdc7e460bc4acedf92a604b"} Jul 18 03:54:38.711642 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:38.711578 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9946d7cf7-ccpqj" podStartSLOduration=1.282010236 podStartE2EDuration="4.711559687s" totalImagesPullingTime="3.429549451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:54:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:38.710916087 +0000 UTC m=+279.472549719" watchObservedRunningTime="2026-07-18 03:54:38.711559687 +0000 UTC m=+279.473193321" Jul 18 03:54:40.403868 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:40.403830 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:40.452862 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:40.452806 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:41.334472 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:41.334411 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-77mmr" podUID="f2341662-76e0-4fcd-bd08-f9aa4128746b" Jul 18 03:54:41.334472 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:41.334430 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" podUID="b3eeda2e-c41b-41ac-9653-138d62736de0" Jul 18 03:54:41.334472 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:41.334430 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-njlzd" podUID="2ed19b61-20f5-4efa-b877-e3b733109b6f" Jul 18 03:54:41.706021 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:41.705992 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-77mmr" Jul 18 03:54:41.706466 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:41.705992 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-njlzd" Jul 18 03:54:41.706466 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:41.705995 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:54:42.507627 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.507576 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:42.715122 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.715086 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:42.777681 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.777585 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4skkm"] Jul 18 03:54:42.780832 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.780811 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:42.783120 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.783058 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 18 03:54:42.783306 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.783290 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-np8nl\"" Jul 18 03:54:42.783403 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.783320 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 18 03:54:42.784413 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.784221 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 18 03:54:42.784413 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.784232 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 18 03:54:42.802782 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.802742 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:42.867721 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.867680 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:42.888753 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.888725 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f67ef240-2ef0-4c46-8265-4ba4de3d2319-node-exporter-accelerators-collector-config\") pod \"node-exporter-4skkm\" (UID: \"f67ef240-2ef0-4c46-8265-4ba4de3d2319\") " pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:42.888877 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.888786 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f67ef240-2ef0-4c46-8265-4ba4de3d2319-sys\") pod \"node-exporter-4skkm\" (UID: \"f67ef240-2ef0-4c46-8265-4ba4de3d2319\") " pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:42.888877 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.888839 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f67ef240-2ef0-4c46-8265-4ba4de3d2319-node-exporter-tls\") pod \"node-exporter-4skkm\" (UID: \"f67ef240-2ef0-4c46-8265-4ba4de3d2319\") " pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:42.889007 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.888909 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f67ef240-2ef0-4c46-8265-4ba4de3d2319-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4skkm\" (UID: \"f67ef240-2ef0-4c46-8265-4ba4de3d2319\") " pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:42.889007 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.888962 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f67ef240-2ef0-4c46-8265-4ba4de3d2319-node-exporter-wtmp\") pod \"node-exporter-4skkm\" (UID: \"f67ef240-2ef0-4c46-8265-4ba4de3d2319\") " pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:42.889007 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.888996 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f67ef240-2ef0-4c46-8265-4ba4de3d2319-metrics-client-ca\") pod \"node-exporter-4skkm\" (UID: \"f67ef240-2ef0-4c46-8265-4ba4de3d2319\") " pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:42.889162 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.889039 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f67ef240-2ef0-4c46-8265-4ba4de3d2319-root\") pod \"node-exporter-4skkm\" (UID: \"f67ef240-2ef0-4c46-8265-4ba4de3d2319\") " pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:42.889162 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.889081 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgxfc\" (UniqueName: \"kubernetes.io/projected/f67ef240-2ef0-4c46-8265-4ba4de3d2319-kube-api-access-wgxfc\") pod \"node-exporter-4skkm\" (UID: \"f67ef240-2ef0-4c46-8265-4ba4de3d2319\") " pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:42.889162 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.889131 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f67ef240-2ef0-4c46-8265-4ba4de3d2319-node-exporter-textfile\") pod \"node-exporter-4skkm\" (UID: \"f67ef240-2ef0-4c46-8265-4ba4de3d2319\") " pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:42.966159 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.966124 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:42.990521 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.990487 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f67ef240-2ef0-4c46-8265-4ba4de3d2319-node-exporter-wtmp\") pod \"node-exporter-4skkm\" (UID: \"f67ef240-2ef0-4c46-8265-4ba4de3d2319\") " pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:42.990521 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.990520 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f67ef240-2ef0-4c46-8265-4ba4de3d2319-metrics-client-ca\") pod \"node-exporter-4skkm\" (UID: \"f67ef240-2ef0-4c46-8265-4ba4de3d2319\") " pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:42.990734 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.990562 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f67ef240-2ef0-4c46-8265-4ba4de3d2319-root\") pod \"node-exporter-4skkm\" (UID: \"f67ef240-2ef0-4c46-8265-4ba4de3d2319\") " pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:42.990734 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.990607 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgxfc\" (UniqueName: \"kubernetes.io/projected/f67ef240-2ef0-4c46-8265-4ba4de3d2319-kube-api-access-wgxfc\") pod \"node-exporter-4skkm\" (UID: \"f67ef240-2ef0-4c46-8265-4ba4de3d2319\") " pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:42.990734 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.990666 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f67ef240-2ef0-4c46-8265-4ba4de3d2319-node-exporter-wtmp\") pod \"node-exporter-4skkm\" (UID: \"f67ef240-2ef0-4c46-8265-4ba4de3d2319\") " pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:42.990734 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.990661 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f67ef240-2ef0-4c46-8265-4ba4de3d2319-node-exporter-textfile\") pod \"node-exporter-4skkm\" (UID: \"f67ef240-2ef0-4c46-8265-4ba4de3d2319\") " pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:42.990734 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.990692 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f67ef240-2ef0-4c46-8265-4ba4de3d2319-root\") pod \"node-exporter-4skkm\" (UID: \"f67ef240-2ef0-4c46-8265-4ba4de3d2319\") " pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:42.990734 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.990722 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f67ef240-2ef0-4c46-8265-4ba4de3d2319-node-exporter-accelerators-collector-config\") pod \"node-exporter-4skkm\" (UID: \"f67ef240-2ef0-4c46-8265-4ba4de3d2319\") " pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:42.991056 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.990767 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f67ef240-2ef0-4c46-8265-4ba4de3d2319-sys\") pod \"node-exporter-4skkm\" (UID: \"f67ef240-2ef0-4c46-8265-4ba4de3d2319\") " pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:42.991056 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.990795 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f67ef240-2ef0-4c46-8265-4ba4de3d2319-node-exporter-tls\") pod \"node-exporter-4skkm\" (UID: \"f67ef240-2ef0-4c46-8265-4ba4de3d2319\") " pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:42.991056 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.990860 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f67ef240-2ef0-4c46-8265-4ba4de3d2319-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4skkm\" (UID: \"f67ef240-2ef0-4c46-8265-4ba4de3d2319\") " pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:42.991056 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.990959 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f67ef240-2ef0-4c46-8265-4ba4de3d2319-sys\") pod \"node-exporter-4skkm\" (UID: \"f67ef240-2ef0-4c46-8265-4ba4de3d2319\") " pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:42.991056 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.991018 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f67ef240-2ef0-4c46-8265-4ba4de3d2319-node-exporter-textfile\") pod \"node-exporter-4skkm\" (UID: \"f67ef240-2ef0-4c46-8265-4ba4de3d2319\") " pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:42.991477 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.991453 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f67ef240-2ef0-4c46-8265-4ba4de3d2319-metrics-client-ca\") pod \"node-exporter-4skkm\" (UID: \"f67ef240-2ef0-4c46-8265-4ba4de3d2319\") " pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:42.991614 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.991488 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f67ef240-2ef0-4c46-8265-4ba4de3d2319-node-exporter-accelerators-collector-config\") pod \"node-exporter-4skkm\" (UID: \"f67ef240-2ef0-4c46-8265-4ba4de3d2319\") " pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:42.993635 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.993606 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f67ef240-2ef0-4c46-8265-4ba4de3d2319-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4skkm\" (UID: \"f67ef240-2ef0-4c46-8265-4ba4de3d2319\") " pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:42.993754 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.993736 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f67ef240-2ef0-4c46-8265-4ba4de3d2319-node-exporter-tls\") pod \"node-exporter-4skkm\" (UID: \"f67ef240-2ef0-4c46-8265-4ba4de3d2319\") " pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:42.998686 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:42.998666 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgxfc\" (UniqueName: \"kubernetes.io/projected/f67ef240-2ef0-4c46-8265-4ba4de3d2319-kube-api-access-wgxfc\") pod \"node-exporter-4skkm\" (UID: \"f67ef240-2ef0-4c46-8265-4ba4de3d2319\") " pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:43.066206 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.066123 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:43.091179 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.091154 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4skkm" Jul 18 03:54:43.100533 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:54:43.100509 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf67ef240_2ef0_4c46_8265_4ba4de3d2319.slice/crio-111b451af55c01dee5d0af75015f0a78f4b2ac87eff4c6d15609b66f7b08a5da WatchSource:0}: Error finding container 111b451af55c01dee5d0af75015f0a78f4b2ac87eff4c6d15609b66f7b08a5da: Status 404 returned error can't find the container with id 111b451af55c01dee5d0af75015f0a78f4b2ac87eff4c6d15609b66f7b08a5da Jul 18 03:54:43.290858 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.290815 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:43.391154 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.391122 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:43.715643 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.715526 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4skkm" event={"ID":"f67ef240-2ef0-4c46-8265-4ba4de3d2319","Type":"ContainerStarted","Data":"111b451af55c01dee5d0af75015f0a78f4b2ac87eff4c6d15609b66f7b08a5da"} Jul 18 03:54:43.728357 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.728321 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:43.807388 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.807355 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:43.811710 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.811685 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 18 03:54:43.814696 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.814674 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:43.816862 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.816830 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 18 03:54:43.817135 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.817116 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-stsd6\"" Jul 18 03:54:43.817338 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.817206 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 18 03:54:43.817808 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.817505 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 18 03:54:43.817808 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.817552 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 18 03:54:43.817808 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.817583 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 18 03:54:43.817808 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.817602 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 18 03:54:43.817808 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.817705 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 18 03:54:43.817808 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.817727 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 18 03:54:43.818334 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.818281 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 18 03:54:43.828425 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.828345 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 18 03:54:43.999048 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.998918 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:43.999048 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.999033 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:43.999243 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.999073 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:43.999243 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.999097 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:43.999243 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.999115 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz8pk\" (UniqueName: \"kubernetes.io/projected/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-kube-api-access-tz8pk\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:43.999243 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.999135 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-web-config\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:43.999243 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.999208 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:43.999475 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.999306 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:43.999475 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.999368 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-config-out\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:43.999475 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.999407 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:43.999475 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.999444 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:43.999664 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.999485 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:43.999664 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:43.999531 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-config-volume\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:44.008547 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.005914 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5996b68d9c-4f6js"] Jul 18 03:54:44.010298 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.010274 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5996b68d9c-4f6js" Jul 18 03:54:44.019231 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.016134 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5996b68d9c-4f6js"] Jul 18 03:54:44.019231 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.018047 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 18 03:54:44.100843 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.100821 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:44.100919 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.100879 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-config-out\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:44.100919 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.100913 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:44.101012 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.100971 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:44.101012 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.101000 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:44.101087 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.101034 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-config-volume\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:44.101087 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.101080 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:44.101155 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.101106 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:44.101155 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.101128 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:44.101222 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.101156 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:44.101222 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.101179 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz8pk\" (UniqueName: \"kubernetes.io/projected/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-kube-api-access-tz8pk\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:44.101222 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.101205 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-web-config\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:44.101358 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.101247 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:44.101358 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.101270 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:44.101847 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:44.101607 2558 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 18 03:54:44.101847 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:44.101677 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-secret-alertmanager-main-tls podName:2763ec4f-c61f-41cc-80ce-ba7159ef68e9 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:44.601657782 +0000 UTC m=+285.363291393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "2763ec4f-c61f-41cc-80ce-ba7159ef68e9") : secret "alertmanager-main-tls" not found Jul 18 03:54:44.102629 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.102414 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:44.102629 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.102609 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:44.104774 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.104719 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:44.104774 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.104760 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:44.105189 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.105163 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-config-volume\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:44.106287 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.106183 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:44.106287 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.106215 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:44.106287 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.106210 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:44.107327 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.107304 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-config-out\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:44.107679 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.107637 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-web-config\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:44.108974 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.108952 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz8pk\" (UniqueName: \"kubernetes.io/projected/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-kube-api-access-tz8pk\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:44.202119 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.202090 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bpbk\" (UniqueName: \"kubernetes.io/projected/78f4628f-2511-4b81-abac-703f4cb46379-kube-api-access-7bpbk\") pod \"console-5996b68d9c-4f6js\" (UID: \"78f4628f-2511-4b81-abac-703f4cb46379\") " pod="openshift-console/console-5996b68d9c-4f6js" Jul 18 03:54:44.202266 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.202129 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78f4628f-2511-4b81-abac-703f4cb46379-oauth-serving-cert\") pod \"console-5996b68d9c-4f6js\" (UID: \"78f4628f-2511-4b81-abac-703f4cb46379\") " pod="openshift-console/console-5996b68d9c-4f6js" Jul 18 03:54:44.202266 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.202256 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78f4628f-2511-4b81-abac-703f4cb46379-console-config\") pod \"console-5996b68d9c-4f6js\" (UID: \"78f4628f-2511-4b81-abac-703f4cb46379\") " pod="openshift-console/console-5996b68d9c-4f6js" Jul 18 03:54:44.202374 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.202280 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78f4628f-2511-4b81-abac-703f4cb46379-service-ca\") pod \"console-5996b68d9c-4f6js\" (UID: \"78f4628f-2511-4b81-abac-703f4cb46379\") " pod="openshift-console/console-5996b68d9c-4f6js" Jul 18 03:54:44.202374 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.202314 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78f4628f-2511-4b81-abac-703f4cb46379-console-serving-cert\") pod \"console-5996b68d9c-4f6js\" (UID: \"78f4628f-2511-4b81-abac-703f4cb46379\") " pod="openshift-console/console-5996b68d9c-4f6js" Jul 18 03:54:44.202374 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.202343 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78f4628f-2511-4b81-abac-703f4cb46379-console-oauth-config\") pod \"console-5996b68d9c-4f6js\" (UID: \"78f4628f-2511-4b81-abac-703f4cb46379\") " pod="openshift-console/console-5996b68d9c-4f6js" Jul 18 03:54:44.202526 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.202386 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78f4628f-2511-4b81-abac-703f4cb46379-trusted-ca-bundle\") pod \"console-5996b68d9c-4f6js\" (UID: \"78f4628f-2511-4b81-abac-703f4cb46379\") " pod="openshift-console/console-5996b68d9c-4f6js" Jul 18 03:54:44.303193 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.303114 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78f4628f-2511-4b81-abac-703f4cb46379-console-config\") pod \"console-5996b68d9c-4f6js\" (UID: \"78f4628f-2511-4b81-abac-703f4cb46379\") " pod="openshift-console/console-5996b68d9c-4f6js" Jul 18 03:54:44.303193 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.303148 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78f4628f-2511-4b81-abac-703f4cb46379-service-ca\") pod \"console-5996b68d9c-4f6js\" (UID: \"78f4628f-2511-4b81-abac-703f4cb46379\") " pod="openshift-console/console-5996b68d9c-4f6js" Jul 18 03:54:44.303193 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.303176 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78f4628f-2511-4b81-abac-703f4cb46379-console-serving-cert\") pod \"console-5996b68d9c-4f6js\" (UID: \"78f4628f-2511-4b81-abac-703f4cb46379\") " pod="openshift-console/console-5996b68d9c-4f6js" Jul 18 03:54:44.303422 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.303200 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78f4628f-2511-4b81-abac-703f4cb46379-console-oauth-config\") pod \"console-5996b68d9c-4f6js\" (UID: \"78f4628f-2511-4b81-abac-703f4cb46379\") " pod="openshift-console/console-5996b68d9c-4f6js" Jul 18 03:54:44.303422 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.303235 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78f4628f-2511-4b81-abac-703f4cb46379-trusted-ca-bundle\") pod \"console-5996b68d9c-4f6js\" (UID: \"78f4628f-2511-4b81-abac-703f4cb46379\") " pod="openshift-console/console-5996b68d9c-4f6js" Jul 18 03:54:44.303422 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.303276 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bpbk\" (UniqueName: \"kubernetes.io/projected/78f4628f-2511-4b81-abac-703f4cb46379-kube-api-access-7bpbk\") pod \"console-5996b68d9c-4f6js\" (UID: \"78f4628f-2511-4b81-abac-703f4cb46379\") " pod="openshift-console/console-5996b68d9c-4f6js" Jul 18 03:54:44.303422 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.303311 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78f4628f-2511-4b81-abac-703f4cb46379-oauth-serving-cert\") pod \"console-5996b68d9c-4f6js\" (UID: \"78f4628f-2511-4b81-abac-703f4cb46379\") " pod="openshift-console/console-5996b68d9c-4f6js" Jul 18 03:54:44.304004 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.303928 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78f4628f-2511-4b81-abac-703f4cb46379-service-ca\") pod \"console-5996b68d9c-4f6js\" (UID: \"78f4628f-2511-4b81-abac-703f4cb46379\") " pod="openshift-console/console-5996b68d9c-4f6js" Jul 18 03:54:44.304124 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.303995 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78f4628f-2511-4b81-abac-703f4cb46379-console-config\") pod \"console-5996b68d9c-4f6js\" (UID: \"78f4628f-2511-4b81-abac-703f4cb46379\") " pod="openshift-console/console-5996b68d9c-4f6js" Jul 18 03:54:44.304188 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.304116 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78f4628f-2511-4b81-abac-703f4cb46379-oauth-serving-cert\") pod \"console-5996b68d9c-4f6js\" (UID: \"78f4628f-2511-4b81-abac-703f4cb46379\") " pod="openshift-console/console-5996b68d9c-4f6js" Jul 18 03:54:44.304530 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.304512 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78f4628f-2511-4b81-abac-703f4cb46379-trusted-ca-bundle\") pod \"console-5996b68d9c-4f6js\" (UID: \"78f4628f-2511-4b81-abac-703f4cb46379\") " pod="openshift-console/console-5996b68d9c-4f6js" Jul 18 03:54:44.305675 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.305651 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78f4628f-2511-4b81-abac-703f4cb46379-console-serving-cert\") pod \"console-5996b68d9c-4f6js\" (UID: \"78f4628f-2511-4b81-abac-703f4cb46379\") " pod="openshift-console/console-5996b68d9c-4f6js" Jul 18 03:54:44.305915 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.305894 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78f4628f-2511-4b81-abac-703f4cb46379-console-oauth-config\") pod \"console-5996b68d9c-4f6js\" (UID: \"78f4628f-2511-4b81-abac-703f4cb46379\") " pod="openshift-console/console-5996b68d9c-4f6js" Jul 18 03:54:44.311469 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.311283 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bpbk\" (UniqueName: \"kubernetes.io/projected/78f4628f-2511-4b81-abac-703f4cb46379-kube-api-access-7bpbk\") pod \"console-5996b68d9c-4f6js\" (UID: \"78f4628f-2511-4b81-abac-703f4cb46379\") " pod="openshift-console/console-5996b68d9c-4f6js" Jul 18 03:54:44.323083 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.323055 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5996b68d9c-4f6js" Jul 18 03:54:44.452532 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.452494 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5996b68d9c-4f6js"] Jul 18 03:54:44.456175 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:54:44.456145 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78f4628f_2511_4b81_abac_703f4cb46379.slice/crio-6f4f71dcd5f0fb70fb3089f959ea7ee4206e36e97d13d42fd58942e04f7c4886 WatchSource:0}: Error finding container 6f4f71dcd5f0fb70fb3089f959ea7ee4206e36e97d13d42fd58942e04f7c4886: Status 404 returned error can't find the container with id 6f4f71dcd5f0fb70fb3089f959ea7ee4206e36e97d13d42fd58942e04f7c4886 Jul 18 03:54:44.505233 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.505205 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-77mmr\" (UID: \"f2341662-76e0-4fcd-bd08-f9aa4128746b\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-77mmr" Jul 18 03:54:44.507738 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.507716 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f2341662-76e0-4fcd-bd08-f9aa4128746b-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-77mmr\" (UID: \"f2341662-76e0-4fcd-bd08-f9aa4128746b\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-77mmr" Jul 18 03:54:44.606466 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.606386 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:54:44.606466 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.606433 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:44.606678 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.606486 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls\") pod \"dns-default-njlzd\" (UID: \"2ed19b61-20f5-4efa-b877-e3b733109b6f\") " pod="openshift-dns/dns-default-njlzd" Jul 18 03:54:44.606678 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:44.606640 2558 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 18 03:54:44.606768 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:44.606720 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-secret-alertmanager-main-tls podName:2763ec4f-c61f-41cc-80ce-ba7159ef68e9 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:45.606703606 +0000 UTC m=+286.368337217 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "2763ec4f-c61f-41cc-80ce-ba7159ef68e9") : secret "alertmanager-main-tls" not found Jul 18 03:54:44.608811 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.608790 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ed19b61-20f5-4efa-b877-e3b733109b6f-metrics-tls\") pod \"dns-default-njlzd\" (UID: \"2ed19b61-20f5-4efa-b877-e3b733109b6f\") " pod="openshift-dns/dns-default-njlzd" Jul 18 03:54:44.609301 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.609282 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls\") pod \"image-registry-67b88fc4d6-t5z9g\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:54:44.708841 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.708814 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-t9khv\"" Jul 18 03:54:44.708841 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.708817 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kp4b6\"" Jul 18 03:54:44.709053 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.708862 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6rnqn\"" Jul 18 03:54:44.716711 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.716686 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-77mmr" Jul 18 03:54:44.717077 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.716722 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-njlzd" Jul 18 03:54:44.717077 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.716795 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:54:44.720696 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.720676 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5996b68d9c-4f6js" event={"ID":"78f4628f-2511-4b81-abac-703f4cb46379","Type":"ContainerStarted","Data":"319a9b54645e711f2f371cdbb2fa7decd65dbc649aab44032afd1345d4bf2101"} Jul 18 03:54:44.720780 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.720723 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5996b68d9c-4f6js" event={"ID":"78f4628f-2511-4b81-abac-703f4cb46379","Type":"ContainerStarted","Data":"6f4f71dcd5f0fb70fb3089f959ea7ee4206e36e97d13d42fd58942e04f7c4886"} Jul 18 03:54:44.722401 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.722381 2558 generic.go:356] "Generic (PLEG): container finished" podID="f67ef240-2ef0-4c46-8265-4ba4de3d2319" containerID="18d08e330114bba2ff5137698ccd3ef140ba5a388fc4a0974f33963879f87c0d" exitCode=0 Jul 18 03:54:44.722484 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.722415 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4skkm" event={"ID":"f67ef240-2ef0-4c46-8265-4ba4de3d2319","Type":"ContainerDied","Data":"18d08e330114bba2ff5137698ccd3ef140ba5a388fc4a0974f33963879f87c0d"} Jul 18 03:54:44.732372 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.732340 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9946d7cf7-ccpqj" Jul 18 03:54:44.732517 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.732390 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9946d7cf7-ccpqj" Jul 18 03:54:44.734244 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.734217 2558 patch_prober.go:28] interesting pod/console-9946d7cf7-ccpqj container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" start-of-body= Jul 18 03:54:44.734367 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.734263 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-9946d7cf7-ccpqj" podUID="cd826334-05bb-4633-b9ab-1f02db519ef7" containerName="console" probeResult="failure" output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" Jul 18 03:54:44.736491 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.736432 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5996b68d9c-4f6js" podStartSLOduration=1.736414083 podStartE2EDuration="1.736414083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:54:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:44.735227024 +0000 UTC m=+285.496860692" watchObservedRunningTime="2026-07-18 03:54:44.736414083 +0000 UTC m=+285.498047806" Jul 18 03:54:44.741319 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.741219 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:44.880625 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:44.880433 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-77mmr"] Jul 18 03:54:44.884302 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:54:44.884270 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2341662_76e0_4fcd_bd08_f9aa4128746b.slice/crio-2136fd1905207e750dc2aaa202b38de89c313860dd4c0f1bacac5cea2a2ec4f4 WatchSource:0}: Error finding container 2136fd1905207e750dc2aaa202b38de89c313860dd4c0f1bacac5cea2a2ec4f4: Status 404 returned error can't find the container with id 2136fd1905207e750dc2aaa202b38de89c313860dd4c0f1bacac5cea2a2ec4f4 Jul 18 03:54:45.009465 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.009430 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:45.109699 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.109626 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-njlzd"] Jul 18 03:54:45.112820 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:54:45.112791 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ed19b61_20f5_4efa_b877_e3b733109b6f.slice/crio-d5fa989d0bc1cae9c75b0d4fa380d8b4e4057b1abc9789d746d24b81fe8df154 WatchSource:0}: Error finding container d5fa989d0bc1cae9c75b0d4fa380d8b4e4057b1abc9789d746d24b81fe8df154: Status 404 returned error can't find the container with id d5fa989d0bc1cae9c75b0d4fa380d8b4e4057b1abc9789d746d24b81fe8df154 Jul 18 03:54:45.113325 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.113304 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67b88fc4d6-t5z9g"] Jul 18 03:54:45.117074 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:54:45.116966 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3eeda2e_c41b_41ac_9653_138d62736de0.slice/crio-802ef657aa9647c73bace7b8ae4e48334abe58830d38a9e7839e46002b5f00d2 WatchSource:0}: Error finding container 802ef657aa9647c73bace7b8ae4e48334abe58830d38a9e7839e46002b5f00d2: Status 404 returned error can't find the container with id 802ef657aa9647c73bace7b8ae4e48334abe58830d38a9e7839e46002b5f00d2 Jul 18 03:54:45.617333 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.617295 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:45.620875 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.620674 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2763ec4f-c61f-41cc-80ce-ba7159ef68e9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2763ec4f-c61f-41cc-80ce-ba7159ef68e9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:45.630160 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.628731 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 18 03:54:45.659141 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.659081 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:45.730722 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.730657 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-njlzd" event={"ID":"2ed19b61-20f5-4efa-b877-e3b733109b6f","Type":"ContainerStarted","Data":"d5fa989d0bc1cae9c75b0d4fa380d8b4e4057b1abc9789d746d24b81fe8df154"} Jul 18 03:54:45.732338 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.732310 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:45.733669 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.733633 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7546445765-kf497"] Jul 18 03:54:45.741864 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.740499 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4skkm" event={"ID":"f67ef240-2ef0-4c46-8265-4ba4de3d2319","Type":"ContainerStarted","Data":"eb7c00c5599e147b8b1eb6aecb95a1a6de072d78c21bf05d124fcf685ed36895"} Jul 18 03:54:45.741864 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.740538 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4skkm" event={"ID":"f67ef240-2ef0-4c46-8265-4ba4de3d2319","Type":"ContainerStarted","Data":"d9078f8ceec475d071ff4ec39b7c3249a67abb1aeb90994b9c2704498f1b6f1d"} Jul 18 03:54:45.741864 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.740563 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-77mmr" event={"ID":"f2341662-76e0-4fcd-bd08-f9aa4128746b","Type":"ContainerStarted","Data":"2136fd1905207e750dc2aaa202b38de89c313860dd4c0f1bacac5cea2a2ec4f4"} Jul 18 03:54:45.741864 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.740583 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" event={"ID":"b3eeda2e-c41b-41ac-9653-138d62736de0","Type":"ContainerStarted","Data":"f070010096b3c531c43a09d273bc9262b361ddf20b56752ea4c71f8b2d774696"} Jul 18 03:54:45.741864 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.740603 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" event={"ID":"b3eeda2e-c41b-41ac-9653-138d62736de0","Type":"ContainerStarted","Data":"802ef657aa9647c73bace7b8ae4e48334abe58830d38a9e7839e46002b5f00d2"} Jul 18 03:54:45.741864 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.740699 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7546445765-kf497" Jul 18 03:54:45.741864 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.741483 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:54:45.744449 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.743615 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 18 03:54:45.744449 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.743820 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 18 03:54:45.744449 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.744087 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 18 03:54:45.744449 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.744292 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 18 03:54:45.748704 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.745495 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 18 03:54:45.748704 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.745716 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4fdcp\"" Jul 18 03:54:45.748704 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.748217 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-72ad1100qf1es\"" Jul 18 03:54:45.748704 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.748495 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7546445765-kf497"] Jul 18 03:54:45.756032 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.753805 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4skkm" podStartSLOduration=2.692313541 podStartE2EDuration="3.753793112s" totalImagesPullingTime="991.299994ms" totalInitContainerRuntime="70.179577ms" isStatefulPod=true podCreationTimestamp="2026-07-18 03:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:45.753470397 +0000 UTC m=+286.515104030" watchObservedRunningTime="2026-07-18 03:54:45.753793112 +0000 UTC m=+286.515426744" Jul 18 03:54:45.797906 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.797750 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" podStartSLOduration=285.797727331 podStartE2EDuration="4m45.797727331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:50:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:45.796756441 +0000 UTC m=+286.558390078" watchObservedRunningTime="2026-07-18 03:54:45.797727331 +0000 UTC m=+286.559360945" Jul 18 03:54:45.838513 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.838480 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 18 03:54:45.921257 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.921174 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/061bee92-c378-4bb6-9a27-0ce8a9a16795-metrics-client-ca\") pod \"thanos-querier-7546445765-kf497\" (UID: \"061bee92-c378-4bb6-9a27-0ce8a9a16795\") " pod="openshift-monitoring/thanos-querier-7546445765-kf497" Jul 18 03:54:45.921424 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.921312 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/061bee92-c378-4bb6-9a27-0ce8a9a16795-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7546445765-kf497\" (UID: \"061bee92-c378-4bb6-9a27-0ce8a9a16795\") " pod="openshift-monitoring/thanos-querier-7546445765-kf497" Jul 18 03:54:45.921573 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.921547 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/061bee92-c378-4bb6-9a27-0ce8a9a16795-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7546445765-kf497\" (UID: \"061bee92-c378-4bb6-9a27-0ce8a9a16795\") " pod="openshift-monitoring/thanos-querier-7546445765-kf497" Jul 18 03:54:45.921667 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.921647 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/061bee92-c378-4bb6-9a27-0ce8a9a16795-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7546445765-kf497\" (UID: \"061bee92-c378-4bb6-9a27-0ce8a9a16795\") " pod="openshift-monitoring/thanos-querier-7546445765-kf497" Jul 18 03:54:45.922086 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.922012 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx8dq\" (UniqueName: \"kubernetes.io/projected/061bee92-c378-4bb6-9a27-0ce8a9a16795-kube-api-access-rx8dq\") pod \"thanos-querier-7546445765-kf497\" (UID: \"061bee92-c378-4bb6-9a27-0ce8a9a16795\") " pod="openshift-monitoring/thanos-querier-7546445765-kf497" Jul 18 03:54:45.922086 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.922054 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/061bee92-c378-4bb6-9a27-0ce8a9a16795-secret-thanos-querier-tls\") pod \"thanos-querier-7546445765-kf497\" (UID: \"061bee92-c378-4bb6-9a27-0ce8a9a16795\") " pod="openshift-monitoring/thanos-querier-7546445765-kf497" Jul 18 03:54:45.922277 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.922197 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/061bee92-c378-4bb6-9a27-0ce8a9a16795-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7546445765-kf497\" (UID: \"061bee92-c378-4bb6-9a27-0ce8a9a16795\") " pod="openshift-monitoring/thanos-querier-7546445765-kf497" Jul 18 03:54:45.922277 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.922244 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/061bee92-c378-4bb6-9a27-0ce8a9a16795-secret-grpc-tls\") pod \"thanos-querier-7546445765-kf497\" (UID: \"061bee92-c378-4bb6-9a27-0ce8a9a16795\") " pod="openshift-monitoring/thanos-querier-7546445765-kf497" Jul 18 03:54:45.924882 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:45.924794 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:46.023239 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:46.023195 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/061bee92-c378-4bb6-9a27-0ce8a9a16795-metrics-client-ca\") pod \"thanos-querier-7546445765-kf497\" (UID: \"061bee92-c378-4bb6-9a27-0ce8a9a16795\") " pod="openshift-monitoring/thanos-querier-7546445765-kf497" Jul 18 03:54:46.023424 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:46.023248 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/061bee92-c378-4bb6-9a27-0ce8a9a16795-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7546445765-kf497\" (UID: \"061bee92-c378-4bb6-9a27-0ce8a9a16795\") " pod="openshift-monitoring/thanos-querier-7546445765-kf497" Jul 18 03:54:46.023424 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:46.023345 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/061bee92-c378-4bb6-9a27-0ce8a9a16795-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7546445765-kf497\" (UID: \"061bee92-c378-4bb6-9a27-0ce8a9a16795\") " pod="openshift-monitoring/thanos-querier-7546445765-kf497" Jul 18 03:54:46.023424 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:46.023369 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/061bee92-c378-4bb6-9a27-0ce8a9a16795-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7546445765-kf497\" (UID: \"061bee92-c378-4bb6-9a27-0ce8a9a16795\") " pod="openshift-monitoring/thanos-querier-7546445765-kf497" Jul 18 03:54:46.023424 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:46.023393 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx8dq\" (UniqueName: \"kubernetes.io/projected/061bee92-c378-4bb6-9a27-0ce8a9a16795-kube-api-access-rx8dq\") pod \"thanos-querier-7546445765-kf497\" (UID: \"061bee92-c378-4bb6-9a27-0ce8a9a16795\") " pod="openshift-monitoring/thanos-querier-7546445765-kf497" Jul 18 03:54:46.023424 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:46.023418 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/061bee92-c378-4bb6-9a27-0ce8a9a16795-secret-thanos-querier-tls\") pod \"thanos-querier-7546445765-kf497\" (UID: \"061bee92-c378-4bb6-9a27-0ce8a9a16795\") " pod="openshift-monitoring/thanos-querier-7546445765-kf497" Jul 18 03:54:46.023689 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:46.023445 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/061bee92-c378-4bb6-9a27-0ce8a9a16795-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7546445765-kf497\" (UID: \"061bee92-c378-4bb6-9a27-0ce8a9a16795\") " pod="openshift-monitoring/thanos-querier-7546445765-kf497" Jul 18 03:54:46.023689 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:46.023471 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/061bee92-c378-4bb6-9a27-0ce8a9a16795-secret-grpc-tls\") pod \"thanos-querier-7546445765-kf497\" (UID: \"061bee92-c378-4bb6-9a27-0ce8a9a16795\") " pod="openshift-monitoring/thanos-querier-7546445765-kf497" Jul 18 03:54:46.024118 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:46.024065 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/061bee92-c378-4bb6-9a27-0ce8a9a16795-metrics-client-ca\") pod \"thanos-querier-7546445765-kf497\" (UID: \"061bee92-c378-4bb6-9a27-0ce8a9a16795\") " pod="openshift-monitoring/thanos-querier-7546445765-kf497" Jul 18 03:54:46.026839 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:46.026811 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/061bee92-c378-4bb6-9a27-0ce8a9a16795-secret-grpc-tls\") pod \"thanos-querier-7546445765-kf497\" (UID: \"061bee92-c378-4bb6-9a27-0ce8a9a16795\") " pod="openshift-monitoring/thanos-querier-7546445765-kf497" Jul 18 03:54:46.027143 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:46.027118 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/061bee92-c378-4bb6-9a27-0ce8a9a16795-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7546445765-kf497\" (UID: \"061bee92-c378-4bb6-9a27-0ce8a9a16795\") " pod="openshift-monitoring/thanos-querier-7546445765-kf497" Jul 18 03:54:46.027294 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:46.027266 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/061bee92-c378-4bb6-9a27-0ce8a9a16795-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7546445765-kf497\" (UID: \"061bee92-c378-4bb6-9a27-0ce8a9a16795\") " pod="openshift-monitoring/thanos-querier-7546445765-kf497" Jul 18 03:54:46.027487 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:46.027469 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/061bee92-c378-4bb6-9a27-0ce8a9a16795-secret-thanos-querier-tls\") pod \"thanos-querier-7546445765-kf497\" (UID: \"061bee92-c378-4bb6-9a27-0ce8a9a16795\") " pod="openshift-monitoring/thanos-querier-7546445765-kf497" Jul 18 03:54:46.027714 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:46.027691 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/061bee92-c378-4bb6-9a27-0ce8a9a16795-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7546445765-kf497\" (UID: \"061bee92-c378-4bb6-9a27-0ce8a9a16795\") " pod="openshift-monitoring/thanos-querier-7546445765-kf497" Jul 18 03:54:46.027893 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:46.027876 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/061bee92-c378-4bb6-9a27-0ce8a9a16795-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7546445765-kf497\" (UID: \"061bee92-c378-4bb6-9a27-0ce8a9a16795\") " pod="openshift-monitoring/thanos-querier-7546445765-kf497" Jul 18 03:54:46.031744 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:46.031716 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx8dq\" (UniqueName: \"kubernetes.io/projected/061bee92-c378-4bb6-9a27-0ce8a9a16795-kube-api-access-rx8dq\") pod \"thanos-querier-7546445765-kf497\" (UID: \"061bee92-c378-4bb6-9a27-0ce8a9a16795\") " pod="openshift-monitoring/thanos-querier-7546445765-kf497" Jul 18 03:54:46.061436 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:46.061392 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7546445765-kf497" Jul 18 03:54:46.062921 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:46.062875 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:46.124343 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:54:46.124304 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2763ec4f_c61f_41cc_80ce_ba7159ef68e9.slice/crio-8fe4f63e70e0ec6200944a3db8eb92bf7d56cebdb7f1edd776ac7dbbd2ff8d2f WatchSource:0}: Error finding container 8fe4f63e70e0ec6200944a3db8eb92bf7d56cebdb7f1edd776ac7dbbd2ff8d2f: Status 404 returned error can't find the container with id 8fe4f63e70e0ec6200944a3db8eb92bf7d56cebdb7f1edd776ac7dbbd2ff8d2f Jul 18 03:54:46.279825 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:46.279801 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7546445765-kf497"] Jul 18 03:54:46.281844 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:54:46.281816 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod061bee92_c378_4bb6_9a27_0ce8a9a16795.slice/crio-170f273e2eafa9ff961bc8135fa4e0fc25dc2822f3168df90acd50f396741894 WatchSource:0}: Error finding container 170f273e2eafa9ff961bc8135fa4e0fc25dc2822f3168df90acd50f396741894: Status 404 returned error can't find the container with id 170f273e2eafa9ff961bc8135fa4e0fc25dc2822f3168df90acd50f396741894 Jul 18 03:54:46.746232 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:46.746194 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-77mmr" event={"ID":"f2341662-76e0-4fcd-bd08-f9aa4128746b","Type":"ContainerStarted","Data":"da4b8de89b18076172a45822fd736e706e5d80ec6a3293bbba246c1f32e9d132"} Jul 18 03:54:46.747640 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:46.747612 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2763ec4f-c61f-41cc-80ce-ba7159ef68e9","Type":"ContainerStarted","Data":"8fe4f63e70e0ec6200944a3db8eb92bf7d56cebdb7f1edd776ac7dbbd2ff8d2f"} Jul 18 03:54:46.748977 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:46.748951 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7546445765-kf497" event={"ID":"061bee92-c378-4bb6-9a27-0ce8a9a16795","Type":"ContainerStarted","Data":"170f273e2eafa9ff961bc8135fa4e0fc25dc2822f3168df90acd50f396741894"} Jul 18 03:54:46.764008 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:46.763960 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-77mmr" podStartSLOduration=282.478458111 podStartE2EDuration="4m43.763921798s" totalImagesPullingTime="1.285463687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:50:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:46.763434668 +0000 UTC m=+287.525068302" watchObservedRunningTime="2026-07-18 03:54:46.763921798 +0000 UTC m=+287.525555431" Jul 18 03:54:46.850896 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:46.850855 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:46.900274 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:46.900242 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:47.530252 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:47.530102 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:47.539750 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:47.539719 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hd2dk"] Jul 18 03:54:47.544361 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:47.544340 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hd2dk" Jul 18 03:54:47.546606 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:47.546543 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 18 03:54:47.546606 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:47.546562 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hqvzm\"" Jul 18 03:54:47.553749 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:47.553645 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hd2dk"] Jul 18 03:54:47.588872 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:47.588796 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:47.639205 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:47.639166 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/23c5acf2-3fd9-4a50-a895-78d223c74651-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-hd2dk\" (UID: \"23c5acf2-3fd9-4a50-a895-78d223c74651\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hd2dk" Jul 18 03:54:47.639384 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:47.639286 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pght2\" (UniqueName: \"kubernetes.io/projected/23c5acf2-3fd9-4a50-a895-78d223c74651-kube-api-access-pght2\") pod \"monitoring-plugin-7b7b7bc8bf-hd2dk\" (UID: \"23c5acf2-3fd9-4a50-a895-78d223c74651\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hd2dk" Jul 18 03:54:47.683908 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:47.683848 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:47.740256 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:47.740226 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/23c5acf2-3fd9-4a50-a895-78d223c74651-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-hd2dk\" (UID: \"23c5acf2-3fd9-4a50-a895-78d223c74651\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hd2dk" Jul 18 03:54:47.740390 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:47.740303 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pght2\" (UniqueName: \"kubernetes.io/projected/23c5acf2-3fd9-4a50-a895-78d223c74651-kube-api-access-pght2\") pod \"monitoring-plugin-7b7b7bc8bf-hd2dk\" (UID: \"23c5acf2-3fd9-4a50-a895-78d223c74651\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hd2dk" Jul 18 03:54:47.742877 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:47.742848 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/23c5acf2-3fd9-4a50-a895-78d223c74651-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-hd2dk\" (UID: \"23c5acf2-3fd9-4a50-a895-78d223c74651\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hd2dk" Jul 18 03:54:47.747321 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:47.747298 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pght2\" (UniqueName: \"kubernetes.io/projected/23c5acf2-3fd9-4a50-a895-78d223c74651-kube-api-access-pght2\") pod \"monitoring-plugin-7b7b7bc8bf-hd2dk\" (UID: \"23c5acf2-3fd9-4a50-a895-78d223c74651\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hd2dk" Jul 18 03:54:47.755862 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:47.755762 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-njlzd" event={"ID":"2ed19b61-20f5-4efa-b877-e3b733109b6f","Type":"ContainerStarted","Data":"bc60ffbee3343747959ae458d82547630e28c41b79a26c1cf9b7542953f4b3d9"} Jul 18 03:54:47.755862 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:47.755820 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-njlzd" event={"ID":"2ed19b61-20f5-4efa-b877-e3b733109b6f","Type":"ContainerStarted","Data":"9325c3da983a30d930a2d7c256e0e413d1791e9afb577a5acf06bfbadc92390c"} Jul 18 03:54:47.771883 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:47.771833 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-njlzd" podStartSLOduration=251.950106648 podStartE2EDuration="4m13.771815204s" totalImagesPullingTime="1.821708556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:47.771414056 +0000 UTC m=+288.533047691" watchObservedRunningTime="2026-07-18 03:54:47.771815204 +0000 UTC m=+288.533448815" Jul 18 03:54:47.858330 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:47.858293 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hd2dk" Jul 18 03:54:48.004423 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:48.004328 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hd2dk"] Jul 18 03:54:48.096639 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:48.096542 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:48.147415 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:48.147373 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:48.433545 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:54:48.433510 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23c5acf2_3fd9_4a50_a895_78d223c74651.slice/crio-3f658a13383e65ff390e354c529cac28c0a198dc5fecc30d8687b59741ac6b69 WatchSource:0}: Error finding container 3f658a13383e65ff390e354c529cac28c0a198dc5fecc30d8687b59741ac6b69: Status 404 returned error can't find the container with id 3f658a13383e65ff390e354c529cac28c0a198dc5fecc30d8687b59741ac6b69 Jul 18 03:54:48.761180 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:48.761102 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hd2dk" event={"ID":"23c5acf2-3fd9-4a50-a895-78d223c74651","Type":"ContainerStarted","Data":"3f658a13383e65ff390e354c529cac28c0a198dc5fecc30d8687b59741ac6b69"} Jul 18 03:54:48.762573 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:48.762547 2558 generic.go:356] "Generic (PLEG): container finished" podID="2763ec4f-c61f-41cc-80ce-ba7159ef68e9" containerID="3c0382baafbd1be2226fb2b0b1812b6e92e9c96eb6be043bf307f1d61f8c9e70" exitCode=0 Jul 18 03:54:48.762686 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:48.762622 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2763ec4f-c61f-41cc-80ce-ba7159ef68e9","Type":"ContainerDied","Data":"3c0382baafbd1be2226fb2b0b1812b6e92e9c96eb6be043bf307f1d61f8c9e70"} Jul 18 03:54:48.764913 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:48.764893 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7546445765-kf497" event={"ID":"061bee92-c378-4bb6-9a27-0ce8a9a16795","Type":"ContainerStarted","Data":"a570ee881ba81c6f32ac02095df46c497451adec68034cb568139faf395f30d0"} Jul 18 03:54:48.765018 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:48.764971 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7546445765-kf497" event={"ID":"061bee92-c378-4bb6-9a27-0ce8a9a16795","Type":"ContainerStarted","Data":"f6a716d3d5d14488771ecc36a39ff826451220a75e91f9adbecb0e544453b137"} Jul 18 03:54:48.765083 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:48.765015 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7546445765-kf497" event={"ID":"061bee92-c378-4bb6-9a27-0ce8a9a16795","Type":"ContainerStarted","Data":"35d5b9e8da261d17f1f9c1c23fd42f0ad2d437adb1a7f15483c7eaa83b646d08"} Jul 18 03:54:48.765156 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:48.765139 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-njlzd" Jul 18 03:54:48.911236 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:48.911198 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:49.219669 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:49.219631 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:49.233058 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:49.233029 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9946d7cf7-ccpqj"] Jul 18 03:54:49.303178 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:49.303144 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:54:50.779824 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:50.779787 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2763ec4f-c61f-41cc-80ce-ba7159ef68e9","Type":"ContainerStarted","Data":"81b6bb46fd7414a2e25c8c2ed152f41da9e61be86b4229be3cbeb3e28e6eedce"} Jul 18 03:54:50.780247 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:50.779871 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2763ec4f-c61f-41cc-80ce-ba7159ef68e9","Type":"ContainerStarted","Data":"ac981fdf72678ac4badaff1ad8594589af765031da83d8fe77cc754c0d19708b"} Jul 18 03:54:50.780247 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:50.779916 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2763ec4f-c61f-41cc-80ce-ba7159ef68e9","Type":"ContainerStarted","Data":"3a87250fe6c7e6f0ad3cf730cc48c0528cb8990045543793eb1a3966e3a9f445"} Jul 18 03:54:50.780247 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:50.779980 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2763ec4f-c61f-41cc-80ce-ba7159ef68e9","Type":"ContainerStarted","Data":"868ee860ae15162b8b5d165b728968a7e02c7a7ce0619fbe2eee85fc36e55363"} Jul 18 03:54:50.780247 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:50.780020 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2763ec4f-c61f-41cc-80ce-ba7159ef68e9","Type":"ContainerStarted","Data":"5716a40d252ae3ec252bd7b25aa441b7bbe670e8f024082abe82010619289d89"} Jul 18 03:54:50.783755 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:50.783093 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7546445765-kf497" event={"ID":"061bee92-c378-4bb6-9a27-0ce8a9a16795","Type":"ContainerStarted","Data":"cb7ce8f1d4d5b9db30aa5a31a0cef97e9b8f5247a5a5ecb7930e469ae6ca8999"} Jul 18 03:54:50.783755 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:50.783168 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7546445765-kf497" event={"ID":"061bee92-c378-4bb6-9a27-0ce8a9a16795","Type":"ContainerStarted","Data":"8f9b8604e45bf5c4094afec54e73e5ed11eb1e5fb4adc4de75aee5c662748388"} Jul 18 03:54:50.783755 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:50.783210 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7546445765-kf497" event={"ID":"061bee92-c378-4bb6-9a27-0ce8a9a16795","Type":"ContainerStarted","Data":"d641a884adb1178a7c0145f89199000da3c47723749a85c27a0c227ddf8cd4f8"} Jul 18 03:54:50.783755 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:50.783366 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7546445765-kf497" Jul 18 03:54:50.785816 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:50.785767 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hd2dk" event={"ID":"23c5acf2-3fd9-4a50-a895-78d223c74651","Type":"ContainerStarted","Data":"e11dc3ff3d7d37edd715fc23c2be83f71fdc3d23a80535e0975ac41f5be17106"} Jul 18 03:54:50.785992 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:50.785974 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hd2dk" Jul 18 03:54:50.791738 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:50.791718 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hd2dk" Jul 18 03:54:50.804386 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:50.804342 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7546445765-kf497" podStartSLOduration=1.876923098 podStartE2EDuration="5.804327397s" totalImagesPullingTime="3.927404299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:54:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:50.802764802 +0000 UTC m=+291.564398430" watchObservedRunningTime="2026-07-18 03:54:50.804327397 +0000 UTC m=+291.565961029" Jul 18 03:54:50.816128 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:50.816088 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hd2dk" podStartSLOduration=1.853170698 podStartE2EDuration="3.816073105s" totalImagesPullingTime="1.962902407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:54:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:50.815645295 +0000 UTC m=+291.577278928" watchObservedRunningTime="2026-07-18 03:54:50.816073105 +0000 UTC m=+291.577706736" Jul 18 03:54:51.761811 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:54:51.761772 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-f8944" podUID="15496aee-38ed-4f76-b18f-b84cd34b2dc9" Jul 18 03:54:51.792410 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:51.792374 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2763ec4f-c61f-41cc-80ce-ba7159ef68e9","Type":"ContainerStarted","Data":"ae53a933ec0906863bfdbbf24b7d8d9418db4689fcfdc2d2f9d1c60e9d1fc154"} Jul 18 03:54:51.818629 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:51.818577 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.573048362 podStartE2EDuration="8.818562124s" totalImagesPullingTime="3.229995834s" totalInitContainerRuntime="15.517928ms" isStatefulPod=false podCreationTimestamp="2026-07-18 03:54:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:51.81735524 +0000 UTC m=+292.578988874" watchObservedRunningTime="2026-07-18 03:54:51.818562124 +0000 UTC m=+292.580195755" Jul 18 03:54:53.834386 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:53.834354 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5996b68d9c-4f6js"] Jul 18 03:54:53.883039 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:53.882998 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-676c77dc67-wqr2c"] Jul 18 03:54:53.886552 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:53.886532 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:54:53.903553 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:53.903518 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-676c77dc67-wqr2c"] Jul 18 03:54:53.999444 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:53.999393 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50576047-d8e8-4a53-9a3b-9e6221343712-trusted-ca-bundle\") pod \"console-676c77dc67-wqr2c\" (UID: \"50576047-d8e8-4a53-9a3b-9e6221343712\") " pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:54:53.999444 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:53.999453 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50576047-d8e8-4a53-9a3b-9e6221343712-console-config\") pod \"console-676c77dc67-wqr2c\" (UID: \"50576047-d8e8-4a53-9a3b-9e6221343712\") " pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:54:53.999672 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:53.999472 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50576047-d8e8-4a53-9a3b-9e6221343712-service-ca\") pod \"console-676c77dc67-wqr2c\" (UID: \"50576047-d8e8-4a53-9a3b-9e6221343712\") " pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:54:53.999672 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:53.999489 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50576047-d8e8-4a53-9a3b-9e6221343712-oauth-serving-cert\") pod \"console-676c77dc67-wqr2c\" (UID: \"50576047-d8e8-4a53-9a3b-9e6221343712\") " pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:54:53.999672 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:53.999583 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v85bx\" (UniqueName: \"kubernetes.io/projected/50576047-d8e8-4a53-9a3b-9e6221343712-kube-api-access-v85bx\") pod \"console-676c77dc67-wqr2c\" (UID: \"50576047-d8e8-4a53-9a3b-9e6221343712\") " pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:54:53.999672 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:53.999643 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50576047-d8e8-4a53-9a3b-9e6221343712-console-serving-cert\") pod \"console-676c77dc67-wqr2c\" (UID: \"50576047-d8e8-4a53-9a3b-9e6221343712\") " pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:54:53.999672 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:53.999661 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50576047-d8e8-4a53-9a3b-9e6221343712-console-oauth-config\") pod \"console-676c77dc67-wqr2c\" (UID: \"50576047-d8e8-4a53-9a3b-9e6221343712\") " pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:54:54.100530 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:54.100443 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50576047-d8e8-4a53-9a3b-9e6221343712-console-serving-cert\") pod \"console-676c77dc67-wqr2c\" (UID: \"50576047-d8e8-4a53-9a3b-9e6221343712\") " pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:54:54.100530 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:54.100483 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50576047-d8e8-4a53-9a3b-9e6221343712-console-oauth-config\") pod \"console-676c77dc67-wqr2c\" (UID: \"50576047-d8e8-4a53-9a3b-9e6221343712\") " pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:54:54.100530 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:54.100524 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50576047-d8e8-4a53-9a3b-9e6221343712-trusted-ca-bundle\") pod \"console-676c77dc67-wqr2c\" (UID: \"50576047-d8e8-4a53-9a3b-9e6221343712\") " pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:54:54.100812 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:54.100566 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50576047-d8e8-4a53-9a3b-9e6221343712-console-config\") pod \"console-676c77dc67-wqr2c\" (UID: \"50576047-d8e8-4a53-9a3b-9e6221343712\") " pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:54:54.100812 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:54.100597 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50576047-d8e8-4a53-9a3b-9e6221343712-service-ca\") pod \"console-676c77dc67-wqr2c\" (UID: \"50576047-d8e8-4a53-9a3b-9e6221343712\") " pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:54:54.100812 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:54.100620 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50576047-d8e8-4a53-9a3b-9e6221343712-oauth-serving-cert\") pod \"console-676c77dc67-wqr2c\" (UID: \"50576047-d8e8-4a53-9a3b-9e6221343712\") " pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:54:54.100812 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:54.100707 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v85bx\" (UniqueName: \"kubernetes.io/projected/50576047-d8e8-4a53-9a3b-9e6221343712-kube-api-access-v85bx\") pod \"console-676c77dc67-wqr2c\" (UID: \"50576047-d8e8-4a53-9a3b-9e6221343712\") " pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:54:54.101452 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:54.101427 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50576047-d8e8-4a53-9a3b-9e6221343712-trusted-ca-bundle\") pod \"console-676c77dc67-wqr2c\" (UID: \"50576047-d8e8-4a53-9a3b-9e6221343712\") " pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:54:54.101601 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:54.101537 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50576047-d8e8-4a53-9a3b-9e6221343712-service-ca\") pod \"console-676c77dc67-wqr2c\" (UID: \"50576047-d8e8-4a53-9a3b-9e6221343712\") " pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:54:54.101601 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:54.101536 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50576047-d8e8-4a53-9a3b-9e6221343712-oauth-serving-cert\") pod \"console-676c77dc67-wqr2c\" (UID: \"50576047-d8e8-4a53-9a3b-9e6221343712\") " pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:54:54.101787 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:54.101652 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50576047-d8e8-4a53-9a3b-9e6221343712-console-config\") pod \"console-676c77dc67-wqr2c\" (UID: \"50576047-d8e8-4a53-9a3b-9e6221343712\") " pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:54:54.104509 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:54.104461 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50576047-d8e8-4a53-9a3b-9e6221343712-console-serving-cert\") pod \"console-676c77dc67-wqr2c\" (UID: \"50576047-d8e8-4a53-9a3b-9e6221343712\") " pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:54:54.104636 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:54.104611 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50576047-d8e8-4a53-9a3b-9e6221343712-console-oauth-config\") pod \"console-676c77dc67-wqr2c\" (UID: \"50576047-d8e8-4a53-9a3b-9e6221343712\") " pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:54:54.108742 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:54.108720 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v85bx\" (UniqueName: \"kubernetes.io/projected/50576047-d8e8-4a53-9a3b-9e6221343712-kube-api-access-v85bx\") pod \"console-676c77dc67-wqr2c\" (UID: \"50576047-d8e8-4a53-9a3b-9e6221343712\") " pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:54:54.196059 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:54.196016 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:54:54.323498 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:54.323394 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5996b68d9c-4f6js" Jul 18 03:54:54.325730 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:54.325698 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-676c77dc67-wqr2c"] Jul 18 03:54:54.328885 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:54:54.328856 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50576047_d8e8_4a53_9a3b_9e6221343712.slice/crio-4af4adb7b1099d0fb5a404f02b13d4668b1410efc75eeb7ebe3cb32b43c47ccf WatchSource:0}: Error finding container 4af4adb7b1099d0fb5a404f02b13d4668b1410efc75eeb7ebe3cb32b43c47ccf: Status 404 returned error can't find the container with id 4af4adb7b1099d0fb5a404f02b13d4668b1410efc75eeb7ebe3cb32b43c47ccf Jul 18 03:54:54.805979 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:54.805921 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-676c77dc67-wqr2c" event={"ID":"50576047-d8e8-4a53-9a3b-9e6221343712","Type":"ContainerStarted","Data":"a6bf45ff3e4d9d684b69ca89942e8c36a357f14e54fcaccd80383496bd40224a"} Jul 18 03:54:54.806141 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:54.805994 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-676c77dc67-wqr2c" event={"ID":"50576047-d8e8-4a53-9a3b-9e6221343712","Type":"ContainerStarted","Data":"4af4adb7b1099d0fb5a404f02b13d4668b1410efc75eeb7ebe3cb32b43c47ccf"} Jul 18 03:54:54.822332 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:54.822282 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-676c77dc67-wqr2c" podStartSLOduration=1.822266948 podStartE2EDuration="1.822266948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:54:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:54.820422505 +0000 UTC m=+295.582056141" watchObservedRunningTime="2026-07-18 03:54:54.822266948 +0000 UTC m=+295.583900579" Jul 18 03:54:56.798485 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:56.798458 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7546445765-kf497" Jul 18 03:54:58.772343 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:58.772309 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-njlzd" Jul 18 03:54:59.672656 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:59.672627 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kfkfb_77a41d30-764b-40f0-9e8d-35b4f6f87009/console-operator/1.log" Jul 18 03:54:59.673339 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:59.673310 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kfkfb_77a41d30-764b-40f0-9e8d-35b4f6f87009/console-operator/1.log" Jul 18 03:54:59.684056 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:54:59.684034 2558 kubelet.go:1648] "Image garbage collection succeeded" Jul 18 03:55:01.669779 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:01.669743 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67b88fc4d6-t5z9g"] Jul 18 03:55:01.674087 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:01.674058 2558 patch_prober.go:28] interesting pod/image-registry-67b88fc4d6-t5z9g container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 18 03:55:01.674234 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:01.674117 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" podUID="b3eeda2e-c41b-41ac-9653-138d62736de0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 18 03:55:01.739305 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:01.739260 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:55:02.917290 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:02.917251 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:55:03.018465 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:03.018431 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:55:03.068856 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:03.068820 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:55:04.196839 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:04.196792 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:55:04.197293 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:04.196865 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:55:04.201662 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:04.201632 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:55:04.849612 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:04.849581 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:55:04.985145 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:04.985102 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:55:05.086568 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:05.086525 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:55:05.187814 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:05.187778 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:55:05.340037 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:05.339988 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:55:05.440181 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:05.440107 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:55:05.760764 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:05.760685 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:55:07.885872 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:07.885831 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:55:07.988680 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:07.988641 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:55:11.354693 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:11.354645 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:55:11.406996 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:11.406960 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:55:11.675021 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:11.674994 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:55:14.257193 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.257122 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-9946d7cf7-ccpqj" podUID="cd826334-05bb-4633-b9ab-1f02db519ef7" containerName="console" containerID="cri-o://e5de4b93d26dadd2c9d94d1e68571bcd5580f3f1fcdc7e460bc4acedf92a604b" gracePeriod=15 Jul 18 03:55:14.503588 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.503562 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9946d7cf7-ccpqj" Jul 18 03:55:14.588651 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.588564 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltn6b\" (UniqueName: \"kubernetes.io/projected/cd826334-05bb-4633-b9ab-1f02db519ef7-kube-api-access-ltn6b\") pod \"cd826334-05bb-4633-b9ab-1f02db519ef7\" (UID: \"cd826334-05bb-4633-b9ab-1f02db519ef7\") " Jul 18 03:55:14.588651 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.588603 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd826334-05bb-4633-b9ab-1f02db519ef7-service-ca\") pod \"cd826334-05bb-4633-b9ab-1f02db519ef7\" (UID: \"cd826334-05bb-4633-b9ab-1f02db519ef7\") " Jul 18 03:55:14.588913 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.588658 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd826334-05bb-4633-b9ab-1f02db519ef7-console-oauth-config\") pod \"cd826334-05bb-4633-b9ab-1f02db519ef7\" (UID: \"cd826334-05bb-4633-b9ab-1f02db519ef7\") " Jul 18 03:55:14.588913 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.588684 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd826334-05bb-4633-b9ab-1f02db519ef7-console-config\") pod \"cd826334-05bb-4633-b9ab-1f02db519ef7\" (UID: \"cd826334-05bb-4633-b9ab-1f02db519ef7\") " Jul 18 03:55:14.588913 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.588715 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd826334-05bb-4633-b9ab-1f02db519ef7-oauth-serving-cert\") pod \"cd826334-05bb-4633-b9ab-1f02db519ef7\" (UID: \"cd826334-05bb-4633-b9ab-1f02db519ef7\") " Jul 18 03:55:14.588913 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.588785 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd826334-05bb-4633-b9ab-1f02db519ef7-console-serving-cert\") pod \"cd826334-05bb-4633-b9ab-1f02db519ef7\" (UID: \"cd826334-05bb-4633-b9ab-1f02db519ef7\") " Jul 18 03:55:14.589190 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.589157 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd826334-05bb-4633-b9ab-1f02db519ef7-service-ca" (OuterVolumeSpecName: "service-ca") pod "cd826334-05bb-4633-b9ab-1f02db519ef7" (UID: "cd826334-05bb-4633-b9ab-1f02db519ef7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 03:55:14.589254 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.589187 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd826334-05bb-4633-b9ab-1f02db519ef7-console-config" (OuterVolumeSpecName: "console-config") pod "cd826334-05bb-4633-b9ab-1f02db519ef7" (UID: "cd826334-05bb-4633-b9ab-1f02db519ef7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 03:55:14.589313 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.589263 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd826334-05bb-4633-b9ab-1f02db519ef7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cd826334-05bb-4633-b9ab-1f02db519ef7" (UID: "cd826334-05bb-4633-b9ab-1f02db519ef7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 03:55:14.591102 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.591065 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd826334-05bb-4633-b9ab-1f02db519ef7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cd826334-05bb-4633-b9ab-1f02db519ef7" (UID: "cd826334-05bb-4633-b9ab-1f02db519ef7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 03:55:14.591212 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.591122 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd826334-05bb-4633-b9ab-1f02db519ef7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cd826334-05bb-4633-b9ab-1f02db519ef7" (UID: "cd826334-05bb-4633-b9ab-1f02db519ef7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 03:55:14.591212 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.591133 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd826334-05bb-4633-b9ab-1f02db519ef7-kube-api-access-ltn6b" (OuterVolumeSpecName: "kube-api-access-ltn6b") pod "cd826334-05bb-4633-b9ab-1f02db519ef7" (UID: "cd826334-05bb-4633-b9ab-1f02db519ef7"). InnerVolumeSpecName "kube-api-access-ltn6b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 03:55:14.690039 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.689997 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd826334-05bb-4633-b9ab-1f02db519ef7-console-oauth-config\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:55:14.690039 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.690030 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd826334-05bb-4633-b9ab-1f02db519ef7-console-config\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:55:14.690039 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.690039 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd826334-05bb-4633-b9ab-1f02db519ef7-oauth-serving-cert\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:55:14.690039 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.690048 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd826334-05bb-4633-b9ab-1f02db519ef7-console-serving-cert\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:55:14.690291 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.690058 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltn6b\" (UniqueName: \"kubernetes.io/projected/cd826334-05bb-4633-b9ab-1f02db519ef7-kube-api-access-ltn6b\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:55:14.690291 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.690068 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd826334-05bb-4633-b9ab-1f02db519ef7-service-ca\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:55:14.886826 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.886785 2558 generic.go:356] "Generic (PLEG): container finished" podID="cd826334-05bb-4633-b9ab-1f02db519ef7" containerID="e5de4b93d26dadd2c9d94d1e68571bcd5580f3f1fcdc7e460bc4acedf92a604b" exitCode=0 Jul 18 03:55:14.887019 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.886832 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9946d7cf7-ccpqj" Jul 18 03:55:14.887019 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.886835 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9946d7cf7-ccpqj" event={"ID":"cd826334-05bb-4633-b9ab-1f02db519ef7","Type":"ContainerDied","Data":"e5de4b93d26dadd2c9d94d1e68571bcd5580f3f1fcdc7e460bc4acedf92a604b"} Jul 18 03:55:14.887019 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.886888 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9946d7cf7-ccpqj" event={"ID":"cd826334-05bb-4633-b9ab-1f02db519ef7","Type":"ContainerDied","Data":"364f2d897cb38be947174ccc7ec04f515cc1a139ad8fc0f8867e73d2f4a4cec3"} Jul 18 03:55:14.887019 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.886917 2558 scope.go:117] "RemoveContainer" containerID="e5de4b93d26dadd2c9d94d1e68571bcd5580f3f1fcdc7e460bc4acedf92a604b" Jul 18 03:55:14.895798 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.895776 2558 scope.go:117] "RemoveContainer" containerID="e5de4b93d26dadd2c9d94d1e68571bcd5580f3f1fcdc7e460bc4acedf92a604b" Jul 18 03:55:14.896125 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:55:14.896102 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5de4b93d26dadd2c9d94d1e68571bcd5580f3f1fcdc7e460bc4acedf92a604b\": container with ID starting with e5de4b93d26dadd2c9d94d1e68571bcd5580f3f1fcdc7e460bc4acedf92a604b not found: ID does not exist" containerID="e5de4b93d26dadd2c9d94d1e68571bcd5580f3f1fcdc7e460bc4acedf92a604b" Jul 18 03:55:14.896205 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.896135 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5de4b93d26dadd2c9d94d1e68571bcd5580f3f1fcdc7e460bc4acedf92a604b"} err="failed to get container status \"e5de4b93d26dadd2c9d94d1e68571bcd5580f3f1fcdc7e460bc4acedf92a604b\": rpc error: code = NotFound desc = could not find container \"e5de4b93d26dadd2c9d94d1e68571bcd5580f3f1fcdc7e460bc4acedf92a604b\": container with ID starting with e5de4b93d26dadd2c9d94d1e68571bcd5580f3f1fcdc7e460bc4acedf92a604b not found: ID does not exist" Jul 18 03:55:14.907237 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.907204 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9946d7cf7-ccpqj"] Jul 18 03:55:14.910997 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:14.910964 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9946d7cf7-ccpqj"] Jul 18 03:55:15.765654 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:15.765619 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd826334-05bb-4633-b9ab-1f02db519ef7" path="/var/lib/kubelet/pods/cd826334-05bb-4633-b9ab-1f02db519ef7/volumes" Jul 18 03:55:16.934647 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:16.934612 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:55:17.901125 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:17.901091 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:55:17.953931 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:17.953893 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:55:18.854370 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:18.854324 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5996b68d9c-4f6js" podUID="78f4628f-2511-4b81-abac-703f4cb46379" containerName="console" containerID="cri-o://319a9b54645e711f2f371cdbb2fa7decd65dbc649aab44032afd1345d4bf2101" gracePeriod=15 Jul 18 03:55:19.098573 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.098545 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5996b68d9c-4f6js" Jul 18 03:55:19.232033 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.231998 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78f4628f-2511-4b81-abac-703f4cb46379-service-ca\") pod \"78f4628f-2511-4b81-abac-703f4cb46379\" (UID: \"78f4628f-2511-4b81-abac-703f4cb46379\") " Jul 18 03:55:19.232033 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.232039 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78f4628f-2511-4b81-abac-703f4cb46379-console-serving-cert\") pod \"78f4628f-2511-4b81-abac-703f4cb46379\" (UID: \"78f4628f-2511-4b81-abac-703f4cb46379\") " Jul 18 03:55:19.232252 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.232064 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78f4628f-2511-4b81-abac-703f4cb46379-trusted-ca-bundle\") pod \"78f4628f-2511-4b81-abac-703f4cb46379\" (UID: \"78f4628f-2511-4b81-abac-703f4cb46379\") " Jul 18 03:55:19.232252 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.232095 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78f4628f-2511-4b81-abac-703f4cb46379-console-config\") pod \"78f4628f-2511-4b81-abac-703f4cb46379\" (UID: \"78f4628f-2511-4b81-abac-703f4cb46379\") " Jul 18 03:55:19.232252 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.232134 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78f4628f-2511-4b81-abac-703f4cb46379-oauth-serving-cert\") pod \"78f4628f-2511-4b81-abac-703f4cb46379\" (UID: \"78f4628f-2511-4b81-abac-703f4cb46379\") " Jul 18 03:55:19.232252 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.232157 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78f4628f-2511-4b81-abac-703f4cb46379-console-oauth-config\") pod \"78f4628f-2511-4b81-abac-703f4cb46379\" (UID: \"78f4628f-2511-4b81-abac-703f4cb46379\") " Jul 18 03:55:19.232252 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.232194 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bpbk\" (UniqueName: \"kubernetes.io/projected/78f4628f-2511-4b81-abac-703f4cb46379-kube-api-access-7bpbk\") pod \"78f4628f-2511-4b81-abac-703f4cb46379\" (UID: \"78f4628f-2511-4b81-abac-703f4cb46379\") " Jul 18 03:55:19.232508 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.232353 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78f4628f-2511-4b81-abac-703f4cb46379-service-ca" (OuterVolumeSpecName: "service-ca") pod "78f4628f-2511-4b81-abac-703f4cb46379" (UID: "78f4628f-2511-4b81-abac-703f4cb46379"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 03:55:19.232508 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.232437 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78f4628f-2511-4b81-abac-703f4cb46379-service-ca\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:55:19.232595 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.232512 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78f4628f-2511-4b81-abac-703f4cb46379-console-config" (OuterVolumeSpecName: "console-config") pod "78f4628f-2511-4b81-abac-703f4cb46379" (UID: "78f4628f-2511-4b81-abac-703f4cb46379"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 03:55:19.232595 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.232572 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78f4628f-2511-4b81-abac-703f4cb46379-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "78f4628f-2511-4b81-abac-703f4cb46379" (UID: "78f4628f-2511-4b81-abac-703f4cb46379"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 03:55:19.232695 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.232595 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78f4628f-2511-4b81-abac-703f4cb46379-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "78f4628f-2511-4b81-abac-703f4cb46379" (UID: "78f4628f-2511-4b81-abac-703f4cb46379"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 03:55:19.234357 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.234329 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78f4628f-2511-4b81-abac-703f4cb46379-kube-api-access-7bpbk" (OuterVolumeSpecName: "kube-api-access-7bpbk") pod "78f4628f-2511-4b81-abac-703f4cb46379" (UID: "78f4628f-2511-4b81-abac-703f4cb46379"). InnerVolumeSpecName "kube-api-access-7bpbk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 03:55:19.234472 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.234367 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78f4628f-2511-4b81-abac-703f4cb46379-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "78f4628f-2511-4b81-abac-703f4cb46379" (UID: "78f4628f-2511-4b81-abac-703f4cb46379"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 03:55:19.234472 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.234418 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78f4628f-2511-4b81-abac-703f4cb46379-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "78f4628f-2511-4b81-abac-703f4cb46379" (UID: "78f4628f-2511-4b81-abac-703f4cb46379"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 03:55:19.333263 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.333227 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bpbk\" (UniqueName: \"kubernetes.io/projected/78f4628f-2511-4b81-abac-703f4cb46379-kube-api-access-7bpbk\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:55:19.333263 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.333259 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78f4628f-2511-4b81-abac-703f4cb46379-console-serving-cert\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:55:19.333263 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.333270 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78f4628f-2511-4b81-abac-703f4cb46379-trusted-ca-bundle\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:55:19.333479 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.333280 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78f4628f-2511-4b81-abac-703f4cb46379-console-config\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:55:19.333479 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.333289 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78f4628f-2511-4b81-abac-703f4cb46379-oauth-serving-cert\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:55:19.333479 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.333298 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78f4628f-2511-4b81-abac-703f4cb46379-console-oauth-config\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:55:19.908826 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.908792 2558 generic.go:356] "Generic (PLEG): container finished" podID="78f4628f-2511-4b81-abac-703f4cb46379" containerID="319a9b54645e711f2f371cdbb2fa7decd65dbc649aab44032afd1345d4bf2101" exitCode=0 Jul 18 03:55:19.909016 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.908838 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5996b68d9c-4f6js" Jul 18 03:55:19.909016 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.908861 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5996b68d9c-4f6js" event={"ID":"78f4628f-2511-4b81-abac-703f4cb46379","Type":"ContainerDied","Data":"319a9b54645e711f2f371cdbb2fa7decd65dbc649aab44032afd1345d4bf2101"} Jul 18 03:55:19.909016 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.908900 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5996b68d9c-4f6js" event={"ID":"78f4628f-2511-4b81-abac-703f4cb46379","Type":"ContainerDied","Data":"6f4f71dcd5f0fb70fb3089f959ea7ee4206e36e97d13d42fd58942e04f7c4886"} Jul 18 03:55:19.909016 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.908919 2558 scope.go:117] "RemoveContainer" containerID="319a9b54645e711f2f371cdbb2fa7decd65dbc649aab44032afd1345d4bf2101" Jul 18 03:55:19.917133 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.917103 2558 scope.go:117] "RemoveContainer" containerID="319a9b54645e711f2f371cdbb2fa7decd65dbc649aab44032afd1345d4bf2101" Jul 18 03:55:19.917393 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:55:19.917372 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"319a9b54645e711f2f371cdbb2fa7decd65dbc649aab44032afd1345d4bf2101\": container with ID starting with 319a9b54645e711f2f371cdbb2fa7decd65dbc649aab44032afd1345d4bf2101 not found: ID does not exist" containerID="319a9b54645e711f2f371cdbb2fa7decd65dbc649aab44032afd1345d4bf2101" Jul 18 03:55:19.917483 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.917406 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"319a9b54645e711f2f371cdbb2fa7decd65dbc649aab44032afd1345d4bf2101"} err="failed to get container status \"319a9b54645e711f2f371cdbb2fa7decd65dbc649aab44032afd1345d4bf2101\": rpc error: code = NotFound desc = could not find container \"319a9b54645e711f2f371cdbb2fa7decd65dbc649aab44032afd1345d4bf2101\": container with ID starting with 319a9b54645e711f2f371cdbb2fa7decd65dbc649aab44032afd1345d4bf2101 not found: ID does not exist" Jul 18 03:55:19.923560 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.923526 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5996b68d9c-4f6js"] Jul 18 03:55:19.926744 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:19.926723 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5996b68d9c-4f6js"] Jul 18 03:55:20.913863 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:20.913826 2558 generic.go:356] "Generic (PLEG): container finished" podID="9ab82b85-02c2-4fa0-9a5a-2bced519bf92" containerID="4dee0128ae459629ba41a257e40ec40f70e4dde75836353d9cc9580180a9d114" exitCode=0 Jul 18 03:55:20.914296 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:20.913895 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9sclg" event={"ID":"9ab82b85-02c2-4fa0-9a5a-2bced519bf92","Type":"ContainerDied","Data":"4dee0128ae459629ba41a257e40ec40f70e4dde75836353d9cc9580180a9d114"} Jul 18 03:55:20.914374 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:20.914329 2558 scope.go:117] "RemoveContainer" containerID="4dee0128ae459629ba41a257e40ec40f70e4dde75836353d9cc9580180a9d114" Jul 18 03:55:21.766070 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:21.766038 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78f4628f-2511-4b81-abac-703f4cb46379" path="/var/lib/kubelet/pods/78f4628f-2511-4b81-abac-703f4cb46379/volumes" Jul 18 03:55:21.920660 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:21.920627 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9sclg" event={"ID":"9ab82b85-02c2-4fa0-9a5a-2bced519bf92","Type":"ContainerStarted","Data":"97010cfe8eb9afed22b4236b285018a5b4da595e3e3ec07455ab1e1a80f2254d"} Jul 18 03:55:26.690142 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:26.690076 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" podUID="b3eeda2e-c41b-41ac-9653-138d62736de0" containerName="registry" containerID="cri-o://f070010096b3c531c43a09d273bc9262b361ddf20b56752ea4c71f8b2d774696" gracePeriod=30 Jul 18 03:55:26.941222 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:26.941158 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:55:26.941950 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:26.941912 2558 generic.go:356] "Generic (PLEG): container finished" podID="b3eeda2e-c41b-41ac-9653-138d62736de0" containerID="f070010096b3c531c43a09d273bc9262b361ddf20b56752ea4c71f8b2d774696" exitCode=0 Jul 18 03:55:26.942021 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:26.941986 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" event={"ID":"b3eeda2e-c41b-41ac-9653-138d62736de0","Type":"ContainerDied","Data":"f070010096b3c531c43a09d273bc9262b361ddf20b56752ea4c71f8b2d774696"} Jul 18 03:55:26.942077 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:26.942065 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" event={"ID":"b3eeda2e-c41b-41ac-9653-138d62736de0","Type":"ContainerDied","Data":"802ef657aa9647c73bace7b8ae4e48334abe58830d38a9e7839e46002b5f00d2"} Jul 18 03:55:26.942115 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:26.942091 2558 scope.go:117] "RemoveContainer" containerID="f070010096b3c531c43a09d273bc9262b361ddf20b56752ea4c71f8b2d774696" Jul 18 03:55:26.950026 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:26.949918 2558 scope.go:117] "RemoveContainer" containerID="f070010096b3c531c43a09d273bc9262b361ddf20b56752ea4c71f8b2d774696" Jul 18 03:55:26.950196 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:55:26.950178 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f070010096b3c531c43a09d273bc9262b361ddf20b56752ea4c71f8b2d774696\": container with ID starting with f070010096b3c531c43a09d273bc9262b361ddf20b56752ea4c71f8b2d774696 not found: ID does not exist" containerID="f070010096b3c531c43a09d273bc9262b361ddf20b56752ea4c71f8b2d774696" Jul 18 03:55:26.950249 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:26.950213 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f070010096b3c531c43a09d273bc9262b361ddf20b56752ea4c71f8b2d774696"} err="failed to get container status \"f070010096b3c531c43a09d273bc9262b361ddf20b56752ea4c71f8b2d774696\": rpc error: code = NotFound desc = could not find container \"f070010096b3c531c43a09d273bc9262b361ddf20b56752ea4c71f8b2d774696\": container with ID starting with f070010096b3c531c43a09d273bc9262b361ddf20b56752ea4c71f8b2d774696 not found: ID does not exist" Jul 18 03:55:27.104617 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:27.104568 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-bound-sa-token\") pod \"b3eeda2e-c41b-41ac-9653-138d62736de0\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " Jul 18 03:55:27.104809 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:27.104642 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3eeda2e-c41b-41ac-9653-138d62736de0-trusted-ca\") pod \"b3eeda2e-c41b-41ac-9653-138d62736de0\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " Jul 18 03:55:27.104809 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:27.104741 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b3eeda2e-c41b-41ac-9653-138d62736de0-image-registry-private-configuration\") pod \"b3eeda2e-c41b-41ac-9653-138d62736de0\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " Jul 18 03:55:27.104809 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:27.104782 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-certificates\") pod \"b3eeda2e-c41b-41ac-9653-138d62736de0\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " Jul 18 03:55:27.104809 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:27.104800 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b3eeda2e-c41b-41ac-9653-138d62736de0-ca-trust-extracted\") pod \"b3eeda2e-c41b-41ac-9653-138d62736de0\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " Jul 18 03:55:27.105059 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:27.104839 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b3eeda2e-c41b-41ac-9653-138d62736de0-installation-pull-secrets\") pod \"b3eeda2e-c41b-41ac-9653-138d62736de0\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " Jul 18 03:55:27.105059 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:27.104869 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgqqp\" (UniqueName: \"kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-kube-api-access-tgqqp\") pod \"b3eeda2e-c41b-41ac-9653-138d62736de0\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " Jul 18 03:55:27.105059 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:27.104914 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls\") pod \"b3eeda2e-c41b-41ac-9653-138d62736de0\" (UID: \"b3eeda2e-c41b-41ac-9653-138d62736de0\") " Jul 18 03:55:27.105207 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:27.105137 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3eeda2e-c41b-41ac-9653-138d62736de0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b3eeda2e-c41b-41ac-9653-138d62736de0" (UID: "b3eeda2e-c41b-41ac-9653-138d62736de0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 03:55:27.105207 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:27.105196 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b3eeda2e-c41b-41ac-9653-138d62736de0" (UID: "b3eeda2e-c41b-41ac-9653-138d62736de0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 03:55:27.105314 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:27.105230 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3eeda2e-c41b-41ac-9653-138d62736de0-trusted-ca\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:55:27.107281 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:27.107254 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-kube-api-access-tgqqp" (OuterVolumeSpecName: "kube-api-access-tgqqp") pod "b3eeda2e-c41b-41ac-9653-138d62736de0" (UID: "b3eeda2e-c41b-41ac-9653-138d62736de0"). InnerVolumeSpecName "kube-api-access-tgqqp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 03:55:27.107409 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:27.107356 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b3eeda2e-c41b-41ac-9653-138d62736de0" (UID: "b3eeda2e-c41b-41ac-9653-138d62736de0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 03:55:27.107504 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:27.107481 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3eeda2e-c41b-41ac-9653-138d62736de0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b3eeda2e-c41b-41ac-9653-138d62736de0" (UID: "b3eeda2e-c41b-41ac-9653-138d62736de0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 03:55:27.107626 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:27.107601 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3eeda2e-c41b-41ac-9653-138d62736de0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b3eeda2e-c41b-41ac-9653-138d62736de0" (UID: "b3eeda2e-c41b-41ac-9653-138d62736de0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 03:55:27.107740 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:27.107723 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b3eeda2e-c41b-41ac-9653-138d62736de0" (UID: "b3eeda2e-c41b-41ac-9653-138d62736de0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 03:55:27.113678 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:27.113655 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3eeda2e-c41b-41ac-9653-138d62736de0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b3eeda2e-c41b-41ac-9653-138d62736de0" (UID: "b3eeda2e-c41b-41ac-9653-138d62736de0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 03:55:27.205865 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:27.205761 2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-bound-sa-token\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:55:27.205865 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:27.205807 2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b3eeda2e-c41b-41ac-9653-138d62736de0-image-registry-private-configuration\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:55:27.205865 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:27.205817 2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-certificates\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:55:27.205865 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:27.205827 2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b3eeda2e-c41b-41ac-9653-138d62736de0-ca-trust-extracted\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:55:27.205865 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:27.205836 2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b3eeda2e-c41b-41ac-9653-138d62736de0-installation-pull-secrets\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:55:27.205865 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:27.205845 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgqqp\" (UniqueName: \"kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-kube-api-access-tgqqp\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:55:27.205865 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:27.205854 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3eeda2e-c41b-41ac-9653-138d62736de0-registry-tls\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:55:27.946914 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:27.946880 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67b88fc4d6-t5z9g" Jul 18 03:55:27.962038 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:27.962008 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67b88fc4d6-t5z9g"] Jul 18 03:55:27.967467 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:27.967439 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-67b88fc4d6-t5z9g"] Jul 18 03:55:29.765290 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:29.765254 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3eeda2e-c41b-41ac-9653-138d62736de0" path="/var/lib/kubelet/pods/b3eeda2e-c41b-41ac-9653-138d62736de0/volumes" Jul 18 03:55:29.796701 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:29.796664 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:55:32.832924 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:32.832886 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:55:32.881200 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:32.881164 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:55:44.930736 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:44.930702 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:55:58.858652 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:58.858556 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:55:58.909319 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:55:58.909280 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:56:07.673876 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:07.673787 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:56:07.722301 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:07.722268 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:56:07.816318 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:07.816285 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:56:07.914927 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:07.914882 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:56:08.617763 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:08.617721 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:56:08.714948 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:08.714901 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:56:10.728099 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:10.728058 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:56:10.777390 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:10.777349 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:56:13.711809 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:13.711756 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs\") pod \"network-metrics-daemon-f8944\" (UID: \"15496aee-38ed-4f76-b18f-b84cd34b2dc9\") " pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:56:13.714067 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:13.714046 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15496aee-38ed-4f76-b18f-b84cd34b2dc9-metrics-certs\") pod \"network-metrics-daemon-f8944\" (UID: \"15496aee-38ed-4f76-b18f-b84cd34b2dc9\") " pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:56:13.863701 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:13.863670 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g4mng\"" Jul 18 03:56:13.871924 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:13.871904 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8944" Jul 18 03:56:14.005049 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:14.004960 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f8944"] Jul 18 03:56:14.008559 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:56:14.008528 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15496aee_38ed_4f76_b18f_b84cd34b2dc9.slice/crio-7bf199cc0df9b4e64533809bd83461f05ce4a55263bf4112a083926fe85b9717 WatchSource:0}: Error finding container 7bf199cc0df9b4e64533809bd83461f05ce4a55263bf4112a083926fe85b9717: Status 404 returned error can't find the container with id 7bf199cc0df9b4e64533809bd83461f05ce4a55263bf4112a083926fe85b9717 Jul 18 03:56:14.010547 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:14.010531 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 03:56:14.134649 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:14.134614 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f8944" event={"ID":"15496aee-38ed-4f76-b18f-b84cd34b2dc9","Type":"ContainerStarted","Data":"7bf199cc0df9b4e64533809bd83461f05ce4a55263bf4112a083926fe85b9717"} Jul 18 03:56:15.142087 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:15.142014 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f8944" event={"ID":"15496aee-38ed-4f76-b18f-b84cd34b2dc9","Type":"ContainerStarted","Data":"ca265bbae6ca9f579688cf7e74f141c36cfcf4a6478998bf5fb70943c116a58a"} Jul 18 03:56:16.147293 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:16.147258 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f8944" event={"ID":"15496aee-38ed-4f76-b18f-b84cd34b2dc9","Type":"ContainerStarted","Data":"11605bfa476904d7e3f7108a493eb6ac835a8d9395dedb9e6546fb4847ad0b8f"} Jul 18 03:56:16.162850 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:16.162803 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-f8944" podStartSLOduration=376.153439097 podStartE2EDuration="6m17.162785869s" totalImagesPullingTime="1.009346772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:49:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:56:16.161313051 +0000 UTC m=+376.922946684" watchObservedRunningTime="2026-07-18 03:56:16.162785869 +0000 UTC m=+376.924419557" Jul 18 03:56:16.271835 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:16.271797 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:56:16.325446 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:16.325409 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:56:17.838068 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:17.838010 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:56:17.937481 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:17.937426 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:56:18.157027 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:18.156997 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:56:18.208528 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:18.208493 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:56:18.302273 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:18.302241 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-676c77dc67-wqr2c"] Jul 18 03:56:18.350102 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:18.350069 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:56:18.448917 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:18.448816 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:56:18.549601 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:18.549561 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:56:18.608959 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:18.608898 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:56:43.322709 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:43.322668 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-676c77dc67-wqr2c" podUID="50576047-d8e8-4a53-9a3b-9e6221343712" containerName="console" containerID="cri-o://a6bf45ff3e4d9d684b69ca89942e8c36a357f14e54fcaccd80383496bd40224a" gracePeriod=15 Jul 18 03:56:43.568468 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:43.568443 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:56:43.628106 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:43.628071 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50576047-d8e8-4a53-9a3b-9e6221343712-oauth-serving-cert\") pod \"50576047-d8e8-4a53-9a3b-9e6221343712\" (UID: \"50576047-d8e8-4a53-9a3b-9e6221343712\") " Jul 18 03:56:43.628268 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:43.628130 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50576047-d8e8-4a53-9a3b-9e6221343712-console-oauth-config\") pod \"50576047-d8e8-4a53-9a3b-9e6221343712\" (UID: \"50576047-d8e8-4a53-9a3b-9e6221343712\") " Jul 18 03:56:43.628268 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:43.628156 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v85bx\" (UniqueName: \"kubernetes.io/projected/50576047-d8e8-4a53-9a3b-9e6221343712-kube-api-access-v85bx\") pod \"50576047-d8e8-4a53-9a3b-9e6221343712\" (UID: \"50576047-d8e8-4a53-9a3b-9e6221343712\") " Jul 18 03:56:43.628268 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:43.628185 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50576047-d8e8-4a53-9a3b-9e6221343712-console-config\") pod \"50576047-d8e8-4a53-9a3b-9e6221343712\" (UID: \"50576047-d8e8-4a53-9a3b-9e6221343712\") " Jul 18 03:56:43.628268 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:43.628215 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50576047-d8e8-4a53-9a3b-9e6221343712-service-ca\") pod \"50576047-d8e8-4a53-9a3b-9e6221343712\" (UID: \"50576047-d8e8-4a53-9a3b-9e6221343712\") " Jul 18 03:56:43.628268 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:43.628248 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50576047-d8e8-4a53-9a3b-9e6221343712-console-serving-cert\") pod \"50576047-d8e8-4a53-9a3b-9e6221343712\" (UID: \"50576047-d8e8-4a53-9a3b-9e6221343712\") " Jul 18 03:56:43.628268 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:43.628268 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50576047-d8e8-4a53-9a3b-9e6221343712-trusted-ca-bundle\") pod \"50576047-d8e8-4a53-9a3b-9e6221343712\" (UID: \"50576047-d8e8-4a53-9a3b-9e6221343712\") " Jul 18 03:56:43.628601 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:43.628544 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50576047-d8e8-4a53-9a3b-9e6221343712-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "50576047-d8e8-4a53-9a3b-9e6221343712" (UID: "50576047-d8e8-4a53-9a3b-9e6221343712"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 03:56:43.628699 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:43.628673 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50576047-d8e8-4a53-9a3b-9e6221343712-console-config" (OuterVolumeSpecName: "console-config") pod "50576047-d8e8-4a53-9a3b-9e6221343712" (UID: "50576047-d8e8-4a53-9a3b-9e6221343712"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 03:56:43.628775 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:43.628717 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50576047-d8e8-4a53-9a3b-9e6221343712-service-ca" (OuterVolumeSpecName: "service-ca") pod "50576047-d8e8-4a53-9a3b-9e6221343712" (UID: "50576047-d8e8-4a53-9a3b-9e6221343712"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 03:56:43.628870 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:43.628823 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50576047-d8e8-4a53-9a3b-9e6221343712-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "50576047-d8e8-4a53-9a3b-9e6221343712" (UID: "50576047-d8e8-4a53-9a3b-9e6221343712"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 03:56:43.630234 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:43.630211 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50576047-d8e8-4a53-9a3b-9e6221343712-kube-api-access-v85bx" (OuterVolumeSpecName: "kube-api-access-v85bx") pod "50576047-d8e8-4a53-9a3b-9e6221343712" (UID: "50576047-d8e8-4a53-9a3b-9e6221343712"). InnerVolumeSpecName "kube-api-access-v85bx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 03:56:43.630388 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:43.630364 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50576047-d8e8-4a53-9a3b-9e6221343712-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "50576047-d8e8-4a53-9a3b-9e6221343712" (UID: "50576047-d8e8-4a53-9a3b-9e6221343712"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 03:56:43.630388 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:43.630379 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50576047-d8e8-4a53-9a3b-9e6221343712-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "50576047-d8e8-4a53-9a3b-9e6221343712" (UID: "50576047-d8e8-4a53-9a3b-9e6221343712"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 03:56:43.729178 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:43.729135 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50576047-d8e8-4a53-9a3b-9e6221343712-console-serving-cert\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:56:43.729178 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:43.729171 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50576047-d8e8-4a53-9a3b-9e6221343712-trusted-ca-bundle\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:56:43.729178 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:43.729182 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50576047-d8e8-4a53-9a3b-9e6221343712-oauth-serving-cert\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:56:43.729407 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:43.729193 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50576047-d8e8-4a53-9a3b-9e6221343712-console-oauth-config\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:56:43.729407 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:43.729203 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v85bx\" (UniqueName: \"kubernetes.io/projected/50576047-d8e8-4a53-9a3b-9e6221343712-kube-api-access-v85bx\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:56:43.729407 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:43.729212 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50576047-d8e8-4a53-9a3b-9e6221343712-console-config\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:56:43.729407 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:43.729221 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50576047-d8e8-4a53-9a3b-9e6221343712-service-ca\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:56:44.258057 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:44.258020 2558 generic.go:356] "Generic (PLEG): container finished" podID="50576047-d8e8-4a53-9a3b-9e6221343712" containerID="a6bf45ff3e4d9d684b69ca89942e8c36a357f14e54fcaccd80383496bd40224a" exitCode=0 Jul 18 03:56:44.258216 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:44.258070 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-676c77dc67-wqr2c" Jul 18 03:56:44.258216 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:44.258111 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-676c77dc67-wqr2c" event={"ID":"50576047-d8e8-4a53-9a3b-9e6221343712","Type":"ContainerDied","Data":"a6bf45ff3e4d9d684b69ca89942e8c36a357f14e54fcaccd80383496bd40224a"} Jul 18 03:56:44.258216 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:44.258169 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-676c77dc67-wqr2c" event={"ID":"50576047-d8e8-4a53-9a3b-9e6221343712","Type":"ContainerDied","Data":"4af4adb7b1099d0fb5a404f02b13d4668b1410efc75eeb7ebe3cb32b43c47ccf"} Jul 18 03:56:44.258216 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:44.258190 2558 scope.go:117] "RemoveContainer" containerID="a6bf45ff3e4d9d684b69ca89942e8c36a357f14e54fcaccd80383496bd40224a" Jul 18 03:56:44.266391 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:44.266370 2558 scope.go:117] "RemoveContainer" containerID="a6bf45ff3e4d9d684b69ca89942e8c36a357f14e54fcaccd80383496bd40224a" Jul 18 03:56:44.266629 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:56:44.266613 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6bf45ff3e4d9d684b69ca89942e8c36a357f14e54fcaccd80383496bd40224a\": container with ID starting with a6bf45ff3e4d9d684b69ca89942e8c36a357f14e54fcaccd80383496bd40224a not found: ID does not exist" containerID="a6bf45ff3e4d9d684b69ca89942e8c36a357f14e54fcaccd80383496bd40224a" Jul 18 03:56:44.266685 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:44.266640 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6bf45ff3e4d9d684b69ca89942e8c36a357f14e54fcaccd80383496bd40224a"} err="failed to get container status \"a6bf45ff3e4d9d684b69ca89942e8c36a357f14e54fcaccd80383496bd40224a\": rpc error: code = NotFound desc = could not find container \"a6bf45ff3e4d9d684b69ca89942e8c36a357f14e54fcaccd80383496bd40224a\": container with ID starting with a6bf45ff3e4d9d684b69ca89942e8c36a357f14e54fcaccd80383496bd40224a not found: ID does not exist" Jul 18 03:56:44.273096 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:44.273075 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-676c77dc67-wqr2c"] Jul 18 03:56:44.277404 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:44.277383 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-676c77dc67-wqr2c"] Jul 18 03:56:45.765189 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:45.765151 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50576047-d8e8-4a53-9a3b-9e6221343712" path="/var/lib/kubelet/pods/50576047-d8e8-4a53-9a3b-9e6221343712/volumes" Jul 18 03:56:55.834129 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:55.834088 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:56:55.885366 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:55.885330 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:56:58.853673 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:58.853628 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:56:58.955142 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:58.955104 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:56:59.406200 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.406166 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9"] Jul 18 03:56:59.406500 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.406485 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50576047-d8e8-4a53-9a3b-9e6221343712" containerName="console" Jul 18 03:56:59.406545 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.406501 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="50576047-d8e8-4a53-9a3b-9e6221343712" containerName="console" Jul 18 03:56:59.406545 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.406520 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78f4628f-2511-4b81-abac-703f4cb46379" containerName="console" Jul 18 03:56:59.406545 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.406526 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="78f4628f-2511-4b81-abac-703f4cb46379" containerName="console" Jul 18 03:56:59.406545 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.406533 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3eeda2e-c41b-41ac-9653-138d62736de0" containerName="registry" Jul 18 03:56:59.406545 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.406538 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3eeda2e-c41b-41ac-9653-138d62736de0" containerName="registry" Jul 18 03:56:59.406709 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.406549 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd826334-05bb-4633-b9ab-1f02db519ef7" containerName="console" Jul 18 03:56:59.406709 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.406554 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd826334-05bb-4633-b9ab-1f02db519ef7" containerName="console" Jul 18 03:56:59.406709 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.406605 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd826334-05bb-4633-b9ab-1f02db519ef7" containerName="console" Jul 18 03:56:59.406709 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.406613 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="50576047-d8e8-4a53-9a3b-9e6221343712" containerName="console" Jul 18 03:56:59.406709 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.406619 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3eeda2e-c41b-41ac-9653-138d62736de0" containerName="registry" Jul 18 03:56:59.406709 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.406627 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="78f4628f-2511-4b81-abac-703f4cb46379" containerName="console" Jul 18 03:56:59.409776 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.409758 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9" Jul 18 03:56:59.412166 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.412144 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 18 03:56:59.412276 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.412217 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 18 03:56:59.412276 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.412217 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5rl2w\"" Jul 18 03:56:59.419470 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.419448 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9"] Jul 18 03:56:59.450804 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.450775 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqkb4\" (UniqueName: \"kubernetes.io/projected/5c167e30-d7ef-4a49-966a-55921d6a0c9a-kube-api-access-mqkb4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9\" (UID: \"5c167e30-d7ef-4a49-966a-55921d6a0c9a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9" Jul 18 03:56:59.450918 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.450821 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c167e30-d7ef-4a49-966a-55921d6a0c9a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9\" (UID: \"5c167e30-d7ef-4a49-966a-55921d6a0c9a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9" Jul 18 03:56:59.450918 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.450870 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c167e30-d7ef-4a49-966a-55921d6a0c9a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9\" (UID: \"5c167e30-d7ef-4a49-966a-55921d6a0c9a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9" Jul 18 03:56:59.551726 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.551696 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c167e30-d7ef-4a49-966a-55921d6a0c9a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9\" (UID: \"5c167e30-d7ef-4a49-966a-55921d6a0c9a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9" Jul 18 03:56:59.551871 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.551733 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c167e30-d7ef-4a49-966a-55921d6a0c9a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9\" (UID: \"5c167e30-d7ef-4a49-966a-55921d6a0c9a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9" Jul 18 03:56:59.551871 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.551799 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqkb4\" (UniqueName: \"kubernetes.io/projected/5c167e30-d7ef-4a49-966a-55921d6a0c9a-kube-api-access-mqkb4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9\" (UID: \"5c167e30-d7ef-4a49-966a-55921d6a0c9a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9" Jul 18 03:56:59.552151 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.552131 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c167e30-d7ef-4a49-966a-55921d6a0c9a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9\" (UID: \"5c167e30-d7ef-4a49-966a-55921d6a0c9a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9" Jul 18 03:56:59.552221 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.552182 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c167e30-d7ef-4a49-966a-55921d6a0c9a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9\" (UID: \"5c167e30-d7ef-4a49-966a-55921d6a0c9a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9" Jul 18 03:56:59.560020 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.559994 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqkb4\" (UniqueName: \"kubernetes.io/projected/5c167e30-d7ef-4a49-966a-55921d6a0c9a-kube-api-access-mqkb4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9\" (UID: \"5c167e30-d7ef-4a49-966a-55921d6a0c9a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9" Jul 18 03:56:59.722115 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.722089 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5rl2w\"" Jul 18 03:56:59.730135 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.730116 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9" Jul 18 03:56:59.859238 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:56:59.859205 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9"] Jul 18 03:56:59.862428 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:56:59.862395 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c167e30_d7ef_4a49_966a_55921d6a0c9a.slice/crio-67585267ff25fb36e5f8a8fdb161a8e40416ce69ee67d1d430e6f730ebe16cc8 WatchSource:0}: Error finding container 67585267ff25fb36e5f8a8fdb161a8e40416ce69ee67d1d430e6f730ebe16cc8: Status 404 returned error can't find the container with id 67585267ff25fb36e5f8a8fdb161a8e40416ce69ee67d1d430e6f730ebe16cc8 Jul 18 03:57:00.328740 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:00.328698 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9" event={"ID":"5c167e30-d7ef-4a49-966a-55921d6a0c9a","Type":"ContainerStarted","Data":"67585267ff25fb36e5f8a8fdb161a8e40416ce69ee67d1d430e6f730ebe16cc8"} Jul 18 03:57:06.354848 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:06.354809 2558 generic.go:356] "Generic (PLEG): container finished" podID="5c167e30-d7ef-4a49-966a-55921d6a0c9a" containerID="8ff9e063d4929d8512469d822ec6789c64baafa3092bee2027f437e4d89aed58" exitCode=0 Jul 18 03:57:06.355343 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:06.354894 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9" event={"ID":"5c167e30-d7ef-4a49-966a-55921d6a0c9a","Type":"ContainerDied","Data":"8ff9e063d4929d8512469d822ec6789c64baafa3092bee2027f437e4d89aed58"} Jul 18 03:57:09.369600 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:09.369560 2558 generic.go:356] "Generic (PLEG): container finished" podID="5c167e30-d7ef-4a49-966a-55921d6a0c9a" containerID="26c765851d608bcc470f810cf70743585d3389b890e7d06c3ddc9adda8c84656" exitCode=0 Jul 18 03:57:09.370001 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:09.369615 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9" event={"ID":"5c167e30-d7ef-4a49-966a-55921d6a0c9a","Type":"ContainerDied","Data":"26c765851d608bcc470f810cf70743585d3389b890e7d06c3ddc9adda8c84656"} Jul 18 03:57:16.404189 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:16.404148 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9" event={"ID":"5c167e30-d7ef-4a49-966a-55921d6a0c9a","Type":"ContainerStarted","Data":"e4f20005759b18f511a75e3d75779d038854292c73588b209ab757838b14b18e"} Jul 18 03:57:16.426320 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:16.426266 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9" podStartSLOduration=3.073106394 podStartE2EDuration="17.426250323s" totalImagesPullingTime="14.353143929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:56:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:57:16.424500257 +0000 UTC m=+437.186133890" watchObservedRunningTime="2026-07-18 03:57:16.426250323 +0000 UTC m=+437.187883954" Jul 18 03:57:17.409999 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:17.409961 2558 generic.go:356] "Generic (PLEG): container finished" podID="5c167e30-d7ef-4a49-966a-55921d6a0c9a" containerID="e4f20005759b18f511a75e3d75779d038854292c73588b209ab757838b14b18e" exitCode=0 Jul 18 03:57:17.410374 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:17.409967 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9" event={"ID":"5c167e30-d7ef-4a49-966a-55921d6a0c9a","Type":"ContainerDied","Data":"e4f20005759b18f511a75e3d75779d038854292c73588b209ab757838b14b18e"} Jul 18 03:57:18.543972 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:18.543928 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9" Jul 18 03:57:18.628026 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:18.627991 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c167e30-d7ef-4a49-966a-55921d6a0c9a-util\") pod \"5c167e30-d7ef-4a49-966a-55921d6a0c9a\" (UID: \"5c167e30-d7ef-4a49-966a-55921d6a0c9a\") " Jul 18 03:57:18.628206 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:18.628036 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c167e30-d7ef-4a49-966a-55921d6a0c9a-bundle\") pod \"5c167e30-d7ef-4a49-966a-55921d6a0c9a\" (UID: \"5c167e30-d7ef-4a49-966a-55921d6a0c9a\") " Jul 18 03:57:18.628206 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:18.628101 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqkb4\" (UniqueName: \"kubernetes.io/projected/5c167e30-d7ef-4a49-966a-55921d6a0c9a-kube-api-access-mqkb4\") pod \"5c167e30-d7ef-4a49-966a-55921d6a0c9a\" (UID: \"5c167e30-d7ef-4a49-966a-55921d6a0c9a\") " Jul 18 03:57:18.628836 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:18.628809 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c167e30-d7ef-4a49-966a-55921d6a0c9a-bundle" (OuterVolumeSpecName: "bundle") pod "5c167e30-d7ef-4a49-966a-55921d6a0c9a" (UID: "5c167e30-d7ef-4a49-966a-55921d6a0c9a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 03:57:18.630406 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:18.630387 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c167e30-d7ef-4a49-966a-55921d6a0c9a-kube-api-access-mqkb4" (OuterVolumeSpecName: "kube-api-access-mqkb4") pod "5c167e30-d7ef-4a49-966a-55921d6a0c9a" (UID: "5c167e30-d7ef-4a49-966a-55921d6a0c9a"). InnerVolumeSpecName "kube-api-access-mqkb4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 03:57:18.632567 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:18.632547 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c167e30-d7ef-4a49-966a-55921d6a0c9a-util" (OuterVolumeSpecName: "util") pod "5c167e30-d7ef-4a49-966a-55921d6a0c9a" (UID: "5c167e30-d7ef-4a49-966a-55921d6a0c9a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 03:57:18.728996 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:18.728886 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c167e30-d7ef-4a49-966a-55921d6a0c9a-util\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:57:18.728996 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:18.728917 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c167e30-d7ef-4a49-966a-55921d6a0c9a-bundle\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:57:18.728996 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:18.728926 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqkb4\" (UniqueName: \"kubernetes.io/projected/5c167e30-d7ef-4a49-966a-55921d6a0c9a-kube-api-access-mqkb4\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:57:19.420223 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:19.420189 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9" Jul 18 03:57:19.420401 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:19.420191 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kl7w9" event={"ID":"5c167e30-d7ef-4a49-966a-55921d6a0c9a","Type":"ContainerDied","Data":"67585267ff25fb36e5f8a8fdb161a8e40416ce69ee67d1d430e6f730ebe16cc8"} Jul 18 03:57:19.420401 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:19.420317 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67585267ff25fb36e5f8a8fdb161a8e40416ce69ee67d1d430e6f730ebe16cc8" Jul 18 03:57:20.164928 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:20.164894 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:21.540405 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:21.540367 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:22.107141 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:22.107109 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7hszt"] Jul 18 03:57:22.107417 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:22.107405 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c167e30-d7ef-4a49-966a-55921d6a0c9a" containerName="pull" Jul 18 03:57:22.107461 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:22.107418 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c167e30-d7ef-4a49-966a-55921d6a0c9a" containerName="pull" Jul 18 03:57:22.107461 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:22.107428 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c167e30-d7ef-4a49-966a-55921d6a0c9a" containerName="extract" Jul 18 03:57:22.107461 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:22.107434 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c167e30-d7ef-4a49-966a-55921d6a0c9a" containerName="extract" Jul 18 03:57:22.107461 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:22.107445 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c167e30-d7ef-4a49-966a-55921d6a0c9a" containerName="util" Jul 18 03:57:22.107461 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:22.107450 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c167e30-d7ef-4a49-966a-55921d6a0c9a" containerName="util" Jul 18 03:57:22.107618 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:22.107510 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c167e30-d7ef-4a49-966a-55921d6a0c9a" containerName="extract" Jul 18 03:57:22.110918 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:22.110899 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7hszt" Jul 18 03:57:22.113589 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:22.113559 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-2zlc7\"" Jul 18 03:57:22.113714 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:22.113621 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 18 03:57:22.113782 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:22.113699 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 18 03:57:22.120327 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:22.120295 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7hszt"] Jul 18 03:57:22.256234 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:22.256198 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dql44\" (UniqueName: \"kubernetes.io/projected/a7afbde2-4380-46cf-85b9-a7cf64082c1f-kube-api-access-dql44\") pod \"cert-manager-operator-controller-manager-55c444bf86-7hszt\" (UID: \"a7afbde2-4380-46cf-85b9-a7cf64082c1f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7hszt" Jul 18 03:57:22.256404 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:22.256243 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7afbde2-4380-46cf-85b9-a7cf64082c1f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7hszt\" (UID: \"a7afbde2-4380-46cf-85b9-a7cf64082c1f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7hszt" Jul 18 03:57:22.357092 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:22.357051 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7afbde2-4380-46cf-85b9-a7cf64082c1f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7hszt\" (UID: \"a7afbde2-4380-46cf-85b9-a7cf64082c1f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7hszt" Jul 18 03:57:22.357290 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:22.357145 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dql44\" (UniqueName: \"kubernetes.io/projected/a7afbde2-4380-46cf-85b9-a7cf64082c1f-kube-api-access-dql44\") pod \"cert-manager-operator-controller-manager-55c444bf86-7hszt\" (UID: \"a7afbde2-4380-46cf-85b9-a7cf64082c1f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7hszt" Jul 18 03:57:22.357445 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:22.357424 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7afbde2-4380-46cf-85b9-a7cf64082c1f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7hszt\" (UID: \"a7afbde2-4380-46cf-85b9-a7cf64082c1f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7hszt" Jul 18 03:57:22.369295 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:22.369270 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dql44\" (UniqueName: \"kubernetes.io/projected/a7afbde2-4380-46cf-85b9-a7cf64082c1f-kube-api-access-dql44\") pod \"cert-manager-operator-controller-manager-55c444bf86-7hszt\" (UID: \"a7afbde2-4380-46cf-85b9-a7cf64082c1f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7hszt" Jul 18 03:57:22.421166 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:22.421136 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7hszt" Jul 18 03:57:22.553443 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:22.553403 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7hszt"] Jul 18 03:57:22.557850 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:57:22.557825 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7afbde2_4380_46cf_85b9_a7cf64082c1f.slice/crio-ed9f34ed97fd936cea8c50037dc7345ce425a1de2c28d2e64e13987b709e16e0 WatchSource:0}: Error finding container ed9f34ed97fd936cea8c50037dc7345ce425a1de2c28d2e64e13987b709e16e0: Status 404 returned error can't find the container with id ed9f34ed97fd936cea8c50037dc7345ce425a1de2c28d2e64e13987b709e16e0 Jul 18 03:57:23.439533 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:23.439492 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7hszt" event={"ID":"a7afbde2-4380-46cf-85b9-a7cf64082c1f","Type":"ContainerStarted","Data":"ed9f34ed97fd936cea8c50037dc7345ce425a1de2c28d2e64e13987b709e16e0"} Jul 18 03:57:23.773758 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:23.773670 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:23.874005 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:23.873973 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:24.445886 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:24.445796 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7hszt" event={"ID":"a7afbde2-4380-46cf-85b9-a7cf64082c1f","Type":"ContainerStarted","Data":"3c50e9b45b99199ee20ff7fffde2f13d1a5620d1b1bbd19bcb2b87becf73fef9"} Jul 18 03:57:24.468510 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:24.468456 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7hszt" podStartSLOduration=0.895378545 podStartE2EDuration="2.46843838s" totalImagesPullingTime="1.573059835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:57:24.465819394 +0000 UTC m=+445.227453026" watchObservedRunningTime="2026-07-18 03:57:24.46843838 +0000 UTC m=+445.230072013" Jul 18 03:57:24.838577 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:24.838460 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:24.942872 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:24.942832 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:25.782715 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:25.782681 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px"] Jul 18 03:57:25.786319 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:25.786295 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px" Jul 18 03:57:25.788613 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:25.788590 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5rl2w\"" Jul 18 03:57:25.788708 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:25.788598 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 18 03:57:25.789409 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:25.789392 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 18 03:57:25.794268 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:25.794237 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px"] Jul 18 03:57:25.886284 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:25.886243 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px\" (UID: \"ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px" Jul 18 03:57:25.886672 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:25.886299 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px\" (UID: \"ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px" Jul 18 03:57:25.886672 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:25.886363 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f26wx\" (UniqueName: \"kubernetes.io/projected/ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff-kube-api-access-f26wx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px\" (UID: \"ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px" Jul 18 03:57:25.987503 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:25.987466 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f26wx\" (UniqueName: \"kubernetes.io/projected/ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff-kube-api-access-f26wx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px\" (UID: \"ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px" Jul 18 03:57:25.987677 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:25.987544 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px\" (UID: \"ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px" Jul 18 03:57:25.987677 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:25.987593 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px\" (UID: \"ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px" Jul 18 03:57:25.987987 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:25.987963 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px\" (UID: \"ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px" Jul 18 03:57:25.988030 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:25.988015 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px\" (UID: \"ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px" Jul 18 03:57:25.994809 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:25.994781 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:25.995670 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:25.995648 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f26wx\" (UniqueName: \"kubernetes.io/projected/ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff-kube-api-access-f26wx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px\" (UID: \"ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px" Jul 18 03:57:26.091445 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:26.091365 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:26.096147 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:26.096128 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px" Jul 18 03:57:26.226704 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:26.226673 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px"] Jul 18 03:57:26.229500 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:57:26.229462 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee4e6f92_7348_4fd0_a6c1_2fe6d46ea4ff.slice/crio-efc51868b23c8e450cfb82daec770ed56818bc6d291edc21b8e02ae72ae76f73 WatchSource:0}: Error finding container efc51868b23c8e450cfb82daec770ed56818bc6d291edc21b8e02ae72ae76f73: Status 404 returned error can't find the container with id efc51868b23c8e450cfb82daec770ed56818bc6d291edc21b8e02ae72ae76f73 Jul 18 03:57:26.456433 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:26.456398 2558 generic.go:356] "Generic (PLEG): container finished" podID="ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff" containerID="8a9a1ca788acf8c2e10e619bf1b41c668611e95363398eb37edfc3467f7a035f" exitCode=0 Jul 18 03:57:26.456607 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:26.456491 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px" event={"ID":"ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff","Type":"ContainerDied","Data":"8a9a1ca788acf8c2e10e619bf1b41c668611e95363398eb37edfc3467f7a035f"} Jul 18 03:57:26.456607 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:26.456550 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px" event={"ID":"ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff","Type":"ContainerStarted","Data":"efc51868b23c8e450cfb82daec770ed56818bc6d291edc21b8e02ae72ae76f73"} Jul 18 03:57:28.050141 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:28.050081 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:28.397706 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:28.397669 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:28.411578 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:28.411543 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fn459"] Jul 18 03:57:28.414654 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:28.414630 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fn459" Jul 18 03:57:28.417068 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:28.417048 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 18 03:57:28.417155 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:28.417092 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-vp5vh\"" Jul 18 03:57:28.418008 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:28.417993 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 18 03:57:28.423714 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:28.423696 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fn459"] Jul 18 03:57:28.468674 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:28.468642 2558 generic.go:356] "Generic (PLEG): container finished" podID="ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff" containerID="f6b20087ac48238ca8e01f189718f6594d9946e4877120fb05997f2475b5cd16" exitCode=0 Jul 18 03:57:28.468813 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:28.468705 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px" event={"ID":"ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff","Type":"ContainerDied","Data":"f6b20087ac48238ca8e01f189718f6594d9946e4877120fb05997f2475b5cd16"} Jul 18 03:57:28.509367 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:28.509335 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d13d763c-d381-4344-91ed-b5c7457b4af3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fn459\" (UID: \"d13d763c-d381-4344-91ed-b5c7457b4af3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fn459" Jul 18 03:57:28.509507 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:28.509386 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp6d6\" (UniqueName: \"kubernetes.io/projected/d13d763c-d381-4344-91ed-b5c7457b4af3-kube-api-access-cp6d6\") pod \"cert-manager-cainjector-559cdd8c87-fn459\" (UID: \"d13d763c-d381-4344-91ed-b5c7457b4af3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fn459" Jul 18 03:57:28.610733 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:28.610700 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d13d763c-d381-4344-91ed-b5c7457b4af3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fn459\" (UID: \"d13d763c-d381-4344-91ed-b5c7457b4af3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fn459" Jul 18 03:57:28.610868 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:28.610742 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp6d6\" (UniqueName: \"kubernetes.io/projected/d13d763c-d381-4344-91ed-b5c7457b4af3-kube-api-access-cp6d6\") pod \"cert-manager-cainjector-559cdd8c87-fn459\" (UID: \"d13d763c-d381-4344-91ed-b5c7457b4af3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fn459" Jul 18 03:57:28.619079 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:28.619056 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp6d6\" (UniqueName: \"kubernetes.io/projected/d13d763c-d381-4344-91ed-b5c7457b4af3-kube-api-access-cp6d6\") pod \"cert-manager-cainjector-559cdd8c87-fn459\" (UID: \"d13d763c-d381-4344-91ed-b5c7457b4af3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fn459" Jul 18 03:57:28.619314 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:28.619296 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d13d763c-d381-4344-91ed-b5c7457b4af3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fn459\" (UID: \"d13d763c-d381-4344-91ed-b5c7457b4af3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fn459" Jul 18 03:57:28.748094 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:28.748061 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fn459" Jul 18 03:57:28.872397 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:28.872368 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fn459"] Jul 18 03:57:28.875601 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:57:28.875575 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd13d763c_d381_4344_91ed_b5c7457b4af3.slice/crio-7c3818bf8fbfbf9c61e2b66333ac4708238291cc670da27fad285075143cadae WatchSource:0}: Error finding container 7c3818bf8fbfbf9c61e2b66333ac4708238291cc670da27fad285075143cadae: Status 404 returned error can't find the container with id 7c3818bf8fbfbf9c61e2b66333ac4708238291cc670da27fad285075143cadae Jul 18 03:57:29.479321 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:29.479288 2558 generic.go:356] "Generic (PLEG): container finished" podID="ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff" containerID="dbd5852f1d8f7edf322cb55632a5203cd356a7989215bf792f195fdf6152d886" exitCode=0 Jul 18 03:57:29.479729 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:29.479362 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px" event={"ID":"ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff","Type":"ContainerDied","Data":"dbd5852f1d8f7edf322cb55632a5203cd356a7989215bf792f195fdf6152d886"} Jul 18 03:57:29.480591 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:29.480566 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fn459" event={"ID":"d13d763c-d381-4344-91ed-b5c7457b4af3","Type":"ContainerStarted","Data":"7c3818bf8fbfbf9c61e2b66333ac4708238291cc670da27fad285075143cadae"} Jul 18 03:57:30.561128 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:30.561051 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:30.658968 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:30.658912 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:31.456467 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:31.456443 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px" Jul 18 03:57:31.492516 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:31.492487 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px" Jul 18 03:57:31.492647 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:31.492494 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv79px" event={"ID":"ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff","Type":"ContainerDied","Data":"efc51868b23c8e450cfb82daec770ed56818bc6d291edc21b8e02ae72ae76f73"} Jul 18 03:57:31.492647 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:31.492608 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="efc51868b23c8e450cfb82daec770ed56818bc6d291edc21b8e02ae72ae76f73" Jul 18 03:57:31.634855 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:31.634822 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff-util\") pod \"ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff\" (UID: \"ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff\") " Jul 18 03:57:31.635353 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:31.634890 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff-bundle\") pod \"ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff\" (UID: \"ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff\") " Jul 18 03:57:31.635353 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:31.634920 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f26wx\" (UniqueName: \"kubernetes.io/projected/ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff-kube-api-access-f26wx\") pod \"ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff\" (UID: \"ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff\") " Jul 18 03:57:31.635353 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:31.635288 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff-bundle" (OuterVolumeSpecName: "bundle") pod "ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff" (UID: "ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 03:57:31.637157 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:31.637133 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff-kube-api-access-f26wx" (OuterVolumeSpecName: "kube-api-access-f26wx") pod "ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff" (UID: "ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff"). InnerVolumeSpecName "kube-api-access-f26wx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 03:57:31.639272 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:31.639243 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff-util" (OuterVolumeSpecName: "util") pod "ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff" (UID: "ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 03:57:31.736096 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:31.736002 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff-util\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:57:31.736096 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:31.736034 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff-bundle\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:57:31.736096 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:31.736048 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f26wx\" (UniqueName: \"kubernetes.io/projected/ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff-kube-api-access-f26wx\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:57:32.306703 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:32.306662 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:32.361189 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:32.361153 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:32.499524 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:32.499484 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fn459" event={"ID":"d13d763c-d381-4344-91ed-b5c7457b4af3","Type":"ContainerStarted","Data":"8a9c5ac453d77b81b9a4e01763d0f089a036c8bc1053536fa7c5b52a49e85a4b"} Jul 18 03:57:32.515567 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:32.515500 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fn459" podStartSLOduration=1.884279826 podStartE2EDuration="4.515482225s" totalImagesPullingTime="2.631202399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:57:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:57:32.513972178 +0000 UTC m=+453.275605811" watchObservedRunningTime="2026-07-18 03:57:32.515482225 +0000 UTC m=+453.277115857" Jul 18 03:57:36.609629 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:36.609593 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:36.985169 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:36.985127 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:37.083948 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:37.083890 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:39.202316 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:39.202278 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vsv42"] Jul 18 03:57:39.202763 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:39.202603 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff" containerName="extract" Jul 18 03:57:39.202763 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:39.202613 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff" containerName="extract" Jul 18 03:57:39.202763 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:39.202624 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff" containerName="util" Jul 18 03:57:39.202763 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:39.202630 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff" containerName="util" Jul 18 03:57:39.202763 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:39.202636 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff" containerName="pull" Jul 18 03:57:39.202763 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:39.202642 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff" containerName="pull" Jul 18 03:57:39.202763 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:39.202698 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee4e6f92-7348-4fd0-a6c1-2fe6d46ea4ff" containerName="extract" Jul 18 03:57:39.205081 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:39.205065 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vsv42" Jul 18 03:57:39.207437 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:39.207417 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 18 03:57:39.207681 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:39.207666 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 18 03:57:39.207832 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:39.207818 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-97c5b\"" Jul 18 03:57:39.215710 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:39.215681 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vsv42"] Jul 18 03:57:39.299174 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:39.299135 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/646b96cc-f2ab-46b6-8e24-a8b4845b993b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vsv42\" (UID: \"646b96cc-f2ab-46b6-8e24-a8b4845b993b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vsv42" Jul 18 03:57:39.299343 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:39.299238 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb52l\" (UniqueName: \"kubernetes.io/projected/646b96cc-f2ab-46b6-8e24-a8b4845b993b-kube-api-access-qb52l\") pod \"openshift-lws-operator-fd8ccff4c-vsv42\" (UID: \"646b96cc-f2ab-46b6-8e24-a8b4845b993b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vsv42" Jul 18 03:57:39.399907 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:39.399868 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb52l\" (UniqueName: \"kubernetes.io/projected/646b96cc-f2ab-46b6-8e24-a8b4845b993b-kube-api-access-qb52l\") pod \"openshift-lws-operator-fd8ccff4c-vsv42\" (UID: \"646b96cc-f2ab-46b6-8e24-a8b4845b993b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vsv42" Jul 18 03:57:39.400096 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:39.399954 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/646b96cc-f2ab-46b6-8e24-a8b4845b993b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vsv42\" (UID: \"646b96cc-f2ab-46b6-8e24-a8b4845b993b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vsv42" Jul 18 03:57:39.400315 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:39.400297 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/646b96cc-f2ab-46b6-8e24-a8b4845b993b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vsv42\" (UID: \"646b96cc-f2ab-46b6-8e24-a8b4845b993b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vsv42" Jul 18 03:57:39.407705 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:39.407675 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb52l\" (UniqueName: \"kubernetes.io/projected/646b96cc-f2ab-46b6-8e24-a8b4845b993b-kube-api-access-qb52l\") pod \"openshift-lws-operator-fd8ccff4c-vsv42\" (UID: \"646b96cc-f2ab-46b6-8e24-a8b4845b993b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vsv42" Jul 18 03:57:39.513780 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:39.513699 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vsv42" Jul 18 03:57:39.642107 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:39.642080 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vsv42"] Jul 18 03:57:39.644589 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:57:39.644562 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod646b96cc_f2ab_46b6_8e24_a8b4845b993b.slice/crio-a4c9a4a2a492e3a1b119308ce59eb9d0aec2cb5712a87f8dcab34e93b1cfc374 WatchSource:0}: Error finding container a4c9a4a2a492e3a1b119308ce59eb9d0aec2cb5712a87f8dcab34e93b1cfc374: Status 404 returned error can't find the container with id a4c9a4a2a492e3a1b119308ce59eb9d0aec2cb5712a87f8dcab34e93b1cfc374 Jul 18 03:57:40.543766 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:40.543723 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vsv42" event={"ID":"646b96cc-f2ab-46b6-8e24-a8b4845b993b","Type":"ContainerStarted","Data":"a4c9a4a2a492e3a1b119308ce59eb9d0aec2cb5712a87f8dcab34e93b1cfc374"} Jul 18 03:57:42.553306 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:42.553270 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vsv42" event={"ID":"646b96cc-f2ab-46b6-8e24-a8b4845b993b","Type":"ContainerStarted","Data":"f1824498cea1a4bbb815f92fa2dfd107d4e016bb9f3f3ebc3f9f72d27e596e21"} Jul 18 03:57:42.569133 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:42.569081 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vsv42" podStartSLOduration=1.7172993189999999 podStartE2EDuration="3.569064901s" totalImagesPullingTime="1.851765582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:57:42.567411654 +0000 UTC m=+463.329045286" watchObservedRunningTime="2026-07-18 03:57:42.569064901 +0000 UTC m=+463.330698533" Jul 18 03:57:43.268453 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:43.268415 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:43.369189 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:43.369155 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:44.668031 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:44.667997 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:45.234762 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:45.234728 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:46.430765 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:46.430730 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x"] Jul 18 03:57:46.438524 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:46.438499 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x" Jul 18 03:57:46.440998 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:46.440965 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x"] Jul 18 03:57:46.440998 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:46.440980 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 18 03:57:46.441827 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:46.441805 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 18 03:57:46.441976 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:46.441863 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5rl2w\"" Jul 18 03:57:46.457747 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:46.457722 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acec4bc2-00c2-404b-823f-cc9c7c158a66-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x\" (UID: \"acec4bc2-00c2-404b-823f-cc9c7c158a66\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x" Jul 18 03:57:46.457859 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:46.457772 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acec4bc2-00c2-404b-823f-cc9c7c158a66-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x\" (UID: \"acec4bc2-00c2-404b-823f-cc9c7c158a66\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x" Jul 18 03:57:46.457900 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:46.457851 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lssk8\" (UniqueName: \"kubernetes.io/projected/acec4bc2-00c2-404b-823f-cc9c7c158a66-kube-api-access-lssk8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x\" (UID: \"acec4bc2-00c2-404b-823f-cc9c7c158a66\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x" Jul 18 03:57:46.558323 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:46.558290 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acec4bc2-00c2-404b-823f-cc9c7c158a66-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x\" (UID: \"acec4bc2-00c2-404b-823f-cc9c7c158a66\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x" Jul 18 03:57:46.558484 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:46.558344 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acec4bc2-00c2-404b-823f-cc9c7c158a66-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x\" (UID: \"acec4bc2-00c2-404b-823f-cc9c7c158a66\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x" Jul 18 03:57:46.558484 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:46.558389 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lssk8\" (UniqueName: \"kubernetes.io/projected/acec4bc2-00c2-404b-823f-cc9c7c158a66-kube-api-access-lssk8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x\" (UID: \"acec4bc2-00c2-404b-823f-cc9c7c158a66\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x" Jul 18 03:57:46.558686 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:46.558667 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acec4bc2-00c2-404b-823f-cc9c7c158a66-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x\" (UID: \"acec4bc2-00c2-404b-823f-cc9c7c158a66\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x" Jul 18 03:57:46.558807 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:46.558790 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acec4bc2-00c2-404b-823f-cc9c7c158a66-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x\" (UID: \"acec4bc2-00c2-404b-823f-cc9c7c158a66\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x" Jul 18 03:57:46.568620 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:46.568574 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lssk8\" (UniqueName: \"kubernetes.io/projected/acec4bc2-00c2-404b-823f-cc9c7c158a66-kube-api-access-lssk8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x\" (UID: \"acec4bc2-00c2-404b-823f-cc9c7c158a66\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x" Jul 18 03:57:46.749421 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:46.749329 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x" Jul 18 03:57:46.881520 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:46.881491 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x"] Jul 18 03:57:46.883381 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:57:46.883353 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacec4bc2_00c2_404b_823f_cc9c7c158a66.slice/crio-7aa2dcb7b6536ec3a37ee39f2128363a854bdf729107863b9fe510d1af3cb103 WatchSource:0}: Error finding container 7aa2dcb7b6536ec3a37ee39f2128363a854bdf729107863b9fe510d1af3cb103: Status 404 returned error can't find the container with id 7aa2dcb7b6536ec3a37ee39f2128363a854bdf729107863b9fe510d1af3cb103 Jul 18 03:57:47.577435 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:47.577406 2558 generic.go:356] "Generic (PLEG): container finished" podID="acec4bc2-00c2-404b-823f-cc9c7c158a66" containerID="4538ef4a867d62890f7977f1f136f7b1fca446317222b3ac4f98634bf7eba5b9" exitCode=0 Jul 18 03:57:47.577762 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:47.577483 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x" event={"ID":"acec4bc2-00c2-404b-823f-cc9c7c158a66","Type":"ContainerDied","Data":"4538ef4a867d62890f7977f1f136f7b1fca446317222b3ac4f98634bf7eba5b9"} Jul 18 03:57:47.577762 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:47.577522 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x" event={"ID":"acec4bc2-00c2-404b-823f-cc9c7c158a66","Type":"ContainerStarted","Data":"7aa2dcb7b6536ec3a37ee39f2128363a854bdf729107863b9fe510d1af3cb103"} Jul 18 03:57:48.583840 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:48.583749 2558 generic.go:356] "Generic (PLEG): container finished" podID="acec4bc2-00c2-404b-823f-cc9c7c158a66" containerID="1894a53cd42c06f06d59c92383663ee494c2505603956aa82b95b5fdc8c4b683" exitCode=0 Jul 18 03:57:48.584230 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:48.583837 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x" event={"ID":"acec4bc2-00c2-404b-823f-cc9c7c158a66","Type":"ContainerDied","Data":"1894a53cd42c06f06d59c92383663ee494c2505603956aa82b95b5fdc8c4b683"} Jul 18 03:57:49.591669 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:49.591632 2558 generic.go:356] "Generic (PLEG): container finished" podID="acec4bc2-00c2-404b-823f-cc9c7c158a66" containerID="5ac8b6fa66bad4765db59ede651fdf1f18186bdcac4664fd1c28a981cfbcb517" exitCode=0 Jul 18 03:57:49.592055 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:49.591721 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x" event={"ID":"acec4bc2-00c2-404b-823f-cc9c7c158a66","Type":"ContainerDied","Data":"5ac8b6fa66bad4765db59ede651fdf1f18186bdcac4664fd1c28a981cfbcb517"} Jul 18 03:57:50.739237 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:50.739203 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x" Jul 18 03:57:50.796030 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:50.795996 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acec4bc2-00c2-404b-823f-cc9c7c158a66-util\") pod \"acec4bc2-00c2-404b-823f-cc9c7c158a66\" (UID: \"acec4bc2-00c2-404b-823f-cc9c7c158a66\") " Jul 18 03:57:50.796199 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:50.796059 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acec4bc2-00c2-404b-823f-cc9c7c158a66-bundle\") pod \"acec4bc2-00c2-404b-823f-cc9c7c158a66\" (UID: \"acec4bc2-00c2-404b-823f-cc9c7c158a66\") " Jul 18 03:57:50.796199 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:50.796111 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lssk8\" (UniqueName: \"kubernetes.io/projected/acec4bc2-00c2-404b-823f-cc9c7c158a66-kube-api-access-lssk8\") pod \"acec4bc2-00c2-404b-823f-cc9c7c158a66\" (UID: \"acec4bc2-00c2-404b-823f-cc9c7c158a66\") " Jul 18 03:57:50.796791 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:50.796766 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acec4bc2-00c2-404b-823f-cc9c7c158a66-bundle" (OuterVolumeSpecName: "bundle") pod "acec4bc2-00c2-404b-823f-cc9c7c158a66" (UID: "acec4bc2-00c2-404b-823f-cc9c7c158a66"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 03:57:50.798249 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:50.798222 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acec4bc2-00c2-404b-823f-cc9c7c158a66-kube-api-access-lssk8" (OuterVolumeSpecName: "kube-api-access-lssk8") pod "acec4bc2-00c2-404b-823f-cc9c7c158a66" (UID: "acec4bc2-00c2-404b-823f-cc9c7c158a66"). InnerVolumeSpecName "kube-api-access-lssk8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 03:57:50.801456 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:50.801418 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acec4bc2-00c2-404b-823f-cc9c7c158a66-util" (OuterVolumeSpecName: "util") pod "acec4bc2-00c2-404b-823f-cc9c7c158a66" (UID: "acec4bc2-00c2-404b-823f-cc9c7c158a66"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 03:57:50.897187 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:50.897153 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acec4bc2-00c2-404b-823f-cc9c7c158a66-bundle\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:57:50.897187 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:50.897183 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lssk8\" (UniqueName: \"kubernetes.io/projected/acec4bc2-00c2-404b-823f-cc9c7c158a66-kube-api-access-lssk8\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:57:50.897187 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:50.897193 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acec4bc2-00c2-404b-823f-cc9c7c158a66-util\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:57:51.603624 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:51.603597 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x" Jul 18 03:57:51.603814 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:51.603630 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj79x" event={"ID":"acec4bc2-00c2-404b-823f-cc9c7c158a66","Type":"ContainerDied","Data":"7aa2dcb7b6536ec3a37ee39f2128363a854bdf729107863b9fe510d1af3cb103"} Jul 18 03:57:51.603814 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:51.603676 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7aa2dcb7b6536ec3a37ee39f2128363a854bdf729107863b9fe510d1af3cb103" Jul 18 03:57:58.184597 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:58.184547 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:58.288381 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:58.288336 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:58.776227 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:58.776182 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:58.989676 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:58.989629 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:59.100433 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.100335 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:59.127912 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.127883 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f994c8d8-k2pcg"] Jul 18 03:57:59.128249 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.128235 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acec4bc2-00c2-404b-823f-cc9c7c158a66" containerName="extract" Jul 18 03:57:59.128294 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.128271 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="acec4bc2-00c2-404b-823f-cc9c7c158a66" containerName="extract" Jul 18 03:57:59.128332 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.128295 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acec4bc2-00c2-404b-823f-cc9c7c158a66" containerName="pull" Jul 18 03:57:59.128332 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.128302 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="acec4bc2-00c2-404b-823f-cc9c7c158a66" containerName="pull" Jul 18 03:57:59.128332 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.128313 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acec4bc2-00c2-404b-823f-cc9c7c158a66" containerName="util" Jul 18 03:57:59.128332 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.128318 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="acec4bc2-00c2-404b-823f-cc9c7c158a66" containerName="util" Jul 18 03:57:59.128449 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.128367 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="acec4bc2-00c2-404b-823f-cc9c7c158a66" containerName="extract" Jul 18 03:57:59.132345 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.132326 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-k2pcg" Jul 18 03:57:59.135270 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.135246 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 18 03:57:59.135411 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.135378 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l7xz5\"" Jul 18 03:57:59.135515 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.135499 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 18 03:57:59.135585 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.135571 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 18 03:57:59.135628 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.135601 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 18 03:57:59.150698 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.150665 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f994c8d8-k2pcg"] Jul 18 03:57:59.170721 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.170677 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9c5x\" (UniqueName: \"kubernetes.io/projected/34733b92-fcd1-4ea3-89c2-58c893425e8c-kube-api-access-j9c5x\") pod \"opendatahub-operator-controller-manager-5f994c8d8-k2pcg\" (UID: \"34733b92-fcd1-4ea3-89c2-58c893425e8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-k2pcg" Jul 18 03:57:59.170878 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.170742 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/34733b92-fcd1-4ea3-89c2-58c893425e8c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f994c8d8-k2pcg\" (UID: \"34733b92-fcd1-4ea3-89c2-58c893425e8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-k2pcg" Jul 18 03:57:59.170878 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.170843 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/34733b92-fcd1-4ea3-89c2-58c893425e8c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f994c8d8-k2pcg\" (UID: \"34733b92-fcd1-4ea3-89c2-58c893425e8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-k2pcg" Jul 18 03:57:59.171053 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.170901 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/34733b92-fcd1-4ea3-89c2-58c893425e8c-manifests\") pod \"opendatahub-operator-controller-manager-5f994c8d8-k2pcg\" (UID: \"34733b92-fcd1-4ea3-89c2-58c893425e8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-k2pcg" Jul 18 03:57:59.171053 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.170968 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34733b92-fcd1-4ea3-89c2-58c893425e8c-tmp\") pod \"opendatahub-operator-controller-manager-5f994c8d8-k2pcg\" (UID: \"34733b92-fcd1-4ea3-89c2-58c893425e8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-k2pcg" Jul 18 03:57:59.261467 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.261429 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:59.271547 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.271519 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/34733b92-fcd1-4ea3-89c2-58c893425e8c-manifests\") pod \"opendatahub-operator-controller-manager-5f994c8d8-k2pcg\" (UID: \"34733b92-fcd1-4ea3-89c2-58c893425e8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-k2pcg" Jul 18 03:57:59.271633 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.271560 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34733b92-fcd1-4ea3-89c2-58c893425e8c-tmp\") pod \"opendatahub-operator-controller-manager-5f994c8d8-k2pcg\" (UID: \"34733b92-fcd1-4ea3-89c2-58c893425e8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-k2pcg" Jul 18 03:57:59.271633 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.271594 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9c5x\" (UniqueName: \"kubernetes.io/projected/34733b92-fcd1-4ea3-89c2-58c893425e8c-kube-api-access-j9c5x\") pod \"opendatahub-operator-controller-manager-5f994c8d8-k2pcg\" (UID: \"34733b92-fcd1-4ea3-89c2-58c893425e8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-k2pcg" Jul 18 03:57:59.271732 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.271632 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/34733b92-fcd1-4ea3-89c2-58c893425e8c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f994c8d8-k2pcg\" (UID: \"34733b92-fcd1-4ea3-89c2-58c893425e8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-k2pcg" Jul 18 03:57:59.271732 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.271659 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/34733b92-fcd1-4ea3-89c2-58c893425e8c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f994c8d8-k2pcg\" (UID: \"34733b92-fcd1-4ea3-89c2-58c893425e8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-k2pcg" Jul 18 03:57:59.272015 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.271979 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/34733b92-fcd1-4ea3-89c2-58c893425e8c-manifests\") pod \"opendatahub-operator-controller-manager-5f994c8d8-k2pcg\" (UID: \"34733b92-fcd1-4ea3-89c2-58c893425e8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-k2pcg" Jul 18 03:57:59.273871 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.273844 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34733b92-fcd1-4ea3-89c2-58c893425e8c-tmp\") pod \"opendatahub-operator-controller-manager-5f994c8d8-k2pcg\" (UID: \"34733b92-fcd1-4ea3-89c2-58c893425e8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-k2pcg" Jul 18 03:57:59.274152 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.274134 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/34733b92-fcd1-4ea3-89c2-58c893425e8c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f994c8d8-k2pcg\" (UID: \"34733b92-fcd1-4ea3-89c2-58c893425e8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-k2pcg" Jul 18 03:57:59.274221 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.274138 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/34733b92-fcd1-4ea3-89c2-58c893425e8c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f994c8d8-k2pcg\" (UID: \"34733b92-fcd1-4ea3-89c2-58c893425e8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-k2pcg" Jul 18 03:57:59.279561 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.279525 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9c5x\" (UniqueName: \"kubernetes.io/projected/34733b92-fcd1-4ea3-89c2-58c893425e8c-kube-api-access-j9c5x\") pod \"opendatahub-operator-controller-manager-5f994c8d8-k2pcg\" (UID: \"34733b92-fcd1-4ea3-89c2-58c893425e8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-k2pcg" Jul 18 03:57:59.362021 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.361913 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:59.443150 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.443111 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-k2pcg" Jul 18 03:57:59.464250 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.464216 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:59.565157 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.565125 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:57:59.583727 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.583694 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f994c8d8-k2pcg"] Jul 18 03:57:59.587273 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:57:59.587245 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34733b92_fcd1_4ea3_89c2_58c893425e8c.slice/crio-1b3375dff3fe7916c1a34674a4314e5cfc4de1ea42f842b97c5120448e357e2a WatchSource:0}: Error finding container 1b3375dff3fe7916c1a34674a4314e5cfc4de1ea42f842b97c5120448e357e2a: Status 404 returned error can't find the container with id 1b3375dff3fe7916c1a34674a4314e5cfc4de1ea42f842b97c5120448e357e2a Jul 18 03:57:59.642283 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.642253 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-k2pcg" event={"ID":"34733b92-fcd1-4ea3-89c2-58c893425e8c","Type":"ContainerStarted","Data":"1b3375dff3fe7916c1a34674a4314e5cfc4de1ea42f842b97c5120448e357e2a"} Jul 18 03:57:59.668072 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:57:59.668031 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:02.661864 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:02.661824 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-k2pcg" event={"ID":"34733b92-fcd1-4ea3-89c2-58c893425e8c","Type":"ContainerStarted","Data":"2aece3aa50e6c27f3ff5f140212e10ac4849882bf53b37359ef90062c4fde67f"} Jul 18 03:58:03.667664 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:03.667634 2558 generic.go:356] "Generic (PLEG): container finished" podID="34733b92-fcd1-4ea3-89c2-58c893425e8c" containerID="2aece3aa50e6c27f3ff5f140212e10ac4849882bf53b37359ef90062c4fde67f" exitCode=0 Jul 18 03:58:03.667993 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:03.667714 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-k2pcg" event={"ID":"34733b92-fcd1-4ea3-89c2-58c893425e8c","Type":"ContainerDied","Data":"2aece3aa50e6c27f3ff5f140212e10ac4849882bf53b37359ef90062c4fde67f"} Jul 18 03:58:04.674184 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:04.674145 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-k2pcg" event={"ID":"34733b92-fcd1-4ea3-89c2-58c893425e8c","Type":"ContainerStarted","Data":"6dbf45183b9c32816c3b22c3f63741747b56cc56630c6d116af3a7117cdba7af"} Jul 18 03:58:04.674579 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:04.674261 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-k2pcg" Jul 18 03:58:04.694556 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:04.694504 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-k2pcg" podStartSLOduration=1.358799952 podStartE2EDuration="5.694485788s" totalImagesPullingTime="3.311749106s" totalInitContainerRuntime="1.02393673s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:57:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:58:04.692161642 +0000 UTC m=+485.453795274" watchObservedRunningTime="2026-07-18 03:58:04.694485788 +0000 UTC m=+485.456119420" Jul 18 03:58:10.303906 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:10.303860 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:10.405118 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:10.405082 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:15.681152 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:15.681114 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-k2pcg" Jul 18 03:58:18.058893 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:18.058860 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:18.153473 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:18.153428 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:18.652880 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:18.652841 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-s8p9r"] Jul 18 03:58:18.662632 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:18.662609 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-s8p9r" Jul 18 03:58:18.665383 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:18.665359 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 18 03:58:18.665557 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:18.665537 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-cwgqv\"" Jul 18 03:58:18.689701 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:18.689664 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-s8p9r"] Jul 18 03:58:18.723987 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:18.723951 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:18.749468 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:18.749427 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5kt4\" (UniqueName: \"kubernetes.io/projected/6bcc5736-fa15-4656-9f8b-599811d2d1ee-kube-api-access-z5kt4\") pod \"odh-model-controller-7998c67dc4-s8p9r\" (UID: \"6bcc5736-fa15-4656-9f8b-599811d2d1ee\") " pod="opendatahub/odh-model-controller-7998c67dc4-s8p9r" Jul 18 03:58:18.749645 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:18.749541 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bcc5736-fa15-4656-9f8b-599811d2d1ee-cert\") pod \"odh-model-controller-7998c67dc4-s8p9r\" (UID: \"6bcc5736-fa15-4656-9f8b-599811d2d1ee\") " pod="opendatahub/odh-model-controller-7998c67dc4-s8p9r" Jul 18 03:58:18.821397 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:18.821352 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:18.850045 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:18.850006 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5kt4\" (UniqueName: \"kubernetes.io/projected/6bcc5736-fa15-4656-9f8b-599811d2d1ee-kube-api-access-z5kt4\") pod \"odh-model-controller-7998c67dc4-s8p9r\" (UID: \"6bcc5736-fa15-4656-9f8b-599811d2d1ee\") " pod="opendatahub/odh-model-controller-7998c67dc4-s8p9r" Jul 18 03:58:18.850229 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:18.850097 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bcc5736-fa15-4656-9f8b-599811d2d1ee-cert\") pod \"odh-model-controller-7998c67dc4-s8p9r\" (UID: \"6bcc5736-fa15-4656-9f8b-599811d2d1ee\") " pod="opendatahub/odh-model-controller-7998c67dc4-s8p9r" Jul 18 03:58:18.850300 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:58:18.850241 2558 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 18 03:58:18.850349 ip-10-0-138-224 kubenswrapper[2558]: E0718 03:58:18.850315 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bcc5736-fa15-4656-9f8b-599811d2d1ee-cert podName:6bcc5736-fa15-4656-9f8b-599811d2d1ee nodeName:}" failed. No retries permitted until 2026-07-18 03:58:19.350298869 +0000 UTC m=+500.111932479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6bcc5736-fa15-4656-9f8b-599811d2d1ee-cert") pod "odh-model-controller-7998c67dc4-s8p9r" (UID: "6bcc5736-fa15-4656-9f8b-599811d2d1ee") : secret "odh-model-controller-webhook-cert" not found Jul 18 03:58:18.865369 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:18.865333 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5kt4\" (UniqueName: \"kubernetes.io/projected/6bcc5736-fa15-4656-9f8b-599811d2d1ee-kube-api-access-z5kt4\") pod \"odh-model-controller-7998c67dc4-s8p9r\" (UID: \"6bcc5736-fa15-4656-9f8b-599811d2d1ee\") " pod="opendatahub/odh-model-controller-7998c67dc4-s8p9r" Jul 18 03:58:19.098544 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.098453 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:19.297846 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.297804 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:19.355449 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.355342 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bcc5736-fa15-4656-9f8b-599811d2d1ee-cert\") pod \"odh-model-controller-7998c67dc4-s8p9r\" (UID: \"6bcc5736-fa15-4656-9f8b-599811d2d1ee\") " pod="opendatahub/odh-model-controller-7998c67dc4-s8p9r" Jul 18 03:58:19.357827 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.357801 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bcc5736-fa15-4656-9f8b-599811d2d1ee-cert\") pod \"odh-model-controller-7998c67dc4-s8p9r\" (UID: \"6bcc5736-fa15-4656-9f8b-599811d2d1ee\") " pod="opendatahub/odh-model-controller-7998c67dc4-s8p9r" Jul 18 03:58:19.403645 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.403616 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:19.572205 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.572159 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-s8p9r" Jul 18 03:58:19.575214 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.575183 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:19.654287 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.654257 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6df5b785c7-f4rzs"] Jul 18 03:58:19.659254 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.659228 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-f4rzs" Jul 18 03:58:19.663356 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.663333 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 18 03:58:19.664126 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.664101 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 18 03:58:19.664243 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.664101 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-45xn5\"" Jul 18 03:58:19.664243 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.664189 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 18 03:58:19.685203 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.685129 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6df5b785c7-f4rzs"] Jul 18 03:58:19.714731 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.714692 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:19.734359 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.734336 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-s8p9r"] Jul 18 03:58:19.738017 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:58:19.737231 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bcc5736_fa15_4656_9f8b_599811d2d1ee.slice/crio-aaa0018642f4d0373b4e5e36bd166c2df5bba065f454cdafa74fbd5875931cc0 WatchSource:0}: Error finding container aaa0018642f4d0373b4e5e36bd166c2df5bba065f454cdafa74fbd5875931cc0: Status 404 returned error can't find the container with id aaa0018642f4d0373b4e5e36bd166c2df5bba065f454cdafa74fbd5875931cc0 Jul 18 03:58:19.754042 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.754005 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-s8p9r" event={"ID":"6bcc5736-fa15-4656-9f8b-599811d2d1ee","Type":"ContainerStarted","Data":"aaa0018642f4d0373b4e5e36bd166c2df5bba065f454cdafa74fbd5875931cc0"} Jul 18 03:58:19.758500 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.758472 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/23bc6faa-28a4-4b43-aab1-8a6c40ad8ae6-manager-config\") pod \"lws-controller-manager-6df5b785c7-f4rzs\" (UID: \"23bc6faa-28a4-4b43-aab1-8a6c40ad8ae6\") " pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-f4rzs" Jul 18 03:58:19.758636 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.758538 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23bc6faa-28a4-4b43-aab1-8a6c40ad8ae6-cert\") pod \"lws-controller-manager-6df5b785c7-f4rzs\" (UID: \"23bc6faa-28a4-4b43-aab1-8a6c40ad8ae6\") " pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-f4rzs" Jul 18 03:58:19.758636 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.758574 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnhb6\" (UniqueName: \"kubernetes.io/projected/23bc6faa-28a4-4b43-aab1-8a6c40ad8ae6-kube-api-access-cnhb6\") pod \"lws-controller-manager-6df5b785c7-f4rzs\" (UID: \"23bc6faa-28a4-4b43-aab1-8a6c40ad8ae6\") " pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-f4rzs" Jul 18 03:58:19.758636 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.758602 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/23bc6faa-28a4-4b43-aab1-8a6c40ad8ae6-metrics-cert\") pod \"lws-controller-manager-6df5b785c7-f4rzs\" (UID: \"23bc6faa-28a4-4b43-aab1-8a6c40ad8ae6\") " pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-f4rzs" Jul 18 03:58:19.859748 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.859699 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnhb6\" (UniqueName: \"kubernetes.io/projected/23bc6faa-28a4-4b43-aab1-8a6c40ad8ae6-kube-api-access-cnhb6\") pod \"lws-controller-manager-6df5b785c7-f4rzs\" (UID: \"23bc6faa-28a4-4b43-aab1-8a6c40ad8ae6\") " pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-f4rzs" Jul 18 03:58:19.859931 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.859758 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/23bc6faa-28a4-4b43-aab1-8a6c40ad8ae6-metrics-cert\") pod \"lws-controller-manager-6df5b785c7-f4rzs\" (UID: \"23bc6faa-28a4-4b43-aab1-8a6c40ad8ae6\") " pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-f4rzs" Jul 18 03:58:19.859931 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.859912 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/23bc6faa-28a4-4b43-aab1-8a6c40ad8ae6-manager-config\") pod \"lws-controller-manager-6df5b785c7-f4rzs\" (UID: \"23bc6faa-28a4-4b43-aab1-8a6c40ad8ae6\") " pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-f4rzs" Jul 18 03:58:19.860074 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.860010 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23bc6faa-28a4-4b43-aab1-8a6c40ad8ae6-cert\") pod \"lws-controller-manager-6df5b785c7-f4rzs\" (UID: \"23bc6faa-28a4-4b43-aab1-8a6c40ad8ae6\") " pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-f4rzs" Jul 18 03:58:19.860538 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.860510 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/23bc6faa-28a4-4b43-aab1-8a6c40ad8ae6-manager-config\") pod \"lws-controller-manager-6df5b785c7-f4rzs\" (UID: \"23bc6faa-28a4-4b43-aab1-8a6c40ad8ae6\") " pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-f4rzs" Jul 18 03:58:19.862271 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.862252 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23bc6faa-28a4-4b43-aab1-8a6c40ad8ae6-cert\") pod \"lws-controller-manager-6df5b785c7-f4rzs\" (UID: \"23bc6faa-28a4-4b43-aab1-8a6c40ad8ae6\") " pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-f4rzs" Jul 18 03:58:19.862326 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.862276 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/23bc6faa-28a4-4b43-aab1-8a6c40ad8ae6-metrics-cert\") pod \"lws-controller-manager-6df5b785c7-f4rzs\" (UID: \"23bc6faa-28a4-4b43-aab1-8a6c40ad8ae6\") " pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-f4rzs" Jul 18 03:58:19.877633 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.877570 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnhb6\" (UniqueName: \"kubernetes.io/projected/23bc6faa-28a4-4b43-aab1-8a6c40ad8ae6-kube-api-access-cnhb6\") pod \"lws-controller-manager-6df5b785c7-f4rzs\" (UID: \"23bc6faa-28a4-4b43-aab1-8a6c40ad8ae6\") " pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-f4rzs" Jul 18 03:58:19.972432 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.972396 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-f4rzs" Jul 18 03:58:19.992061 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:19.991994 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:20.112452 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:20.112398 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6df5b785c7-f4rzs"] Jul 18 03:58:20.114693 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:58:20.114654 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23bc6faa_28a4_4b43_aab1_8a6c40ad8ae6.slice/crio-4d4a237ff4976a8a1aa21168bba23cb17b02f3508d2283655d86e167b85f052a WatchSource:0}: Error finding container 4d4a237ff4976a8a1aa21168bba23cb17b02f3508d2283655d86e167b85f052a: Status 404 returned error can't find the container with id 4d4a237ff4976a8a1aa21168bba23cb17b02f3508d2283655d86e167b85f052a Jul 18 03:58:20.130885 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:20.130807 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:20.144662 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:20.144634 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-85c5cf7cfd-czh97"] Jul 18 03:58:20.149371 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:20.149352 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85c5cf7cfd-czh97" Jul 18 03:58:20.151889 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:20.151866 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 18 03:58:20.152029 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:20.151886 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-pp46s\"" Jul 18 03:58:20.152102 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:20.152085 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 18 03:58:20.152241 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:20.152219 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 18 03:58:20.152335 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:20.152320 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 18 03:58:20.157698 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:20.157324 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85c5cf7cfd-czh97"] Jul 18 03:58:20.264745 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:20.264702 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c98c55ac-695d-4d25-ad7c-f38d1b4da1ea-tls-certs\") pod \"kube-auth-proxy-85c5cf7cfd-czh97\" (UID: \"c98c55ac-695d-4d25-ad7c-f38d1b4da1ea\") " pod="openshift-ingress/kube-auth-proxy-85c5cf7cfd-czh97" Jul 18 03:58:20.264964 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:20.264789 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r54lw\" (UniqueName: \"kubernetes.io/projected/c98c55ac-695d-4d25-ad7c-f38d1b4da1ea-kube-api-access-r54lw\") pod \"kube-auth-proxy-85c5cf7cfd-czh97\" (UID: \"c98c55ac-695d-4d25-ad7c-f38d1b4da1ea\") " pod="openshift-ingress/kube-auth-proxy-85c5cf7cfd-czh97" Jul 18 03:58:20.264964 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:20.264817 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c98c55ac-695d-4d25-ad7c-f38d1b4da1ea-tmp\") pod \"kube-auth-proxy-85c5cf7cfd-czh97\" (UID: \"c98c55ac-695d-4d25-ad7c-f38d1b4da1ea\") " pod="openshift-ingress/kube-auth-proxy-85c5cf7cfd-czh97" Jul 18 03:58:20.366043 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:20.366005 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r54lw\" (UniqueName: \"kubernetes.io/projected/c98c55ac-695d-4d25-ad7c-f38d1b4da1ea-kube-api-access-r54lw\") pod \"kube-auth-proxy-85c5cf7cfd-czh97\" (UID: \"c98c55ac-695d-4d25-ad7c-f38d1b4da1ea\") " pod="openshift-ingress/kube-auth-proxy-85c5cf7cfd-czh97" Jul 18 03:58:20.366043 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:20.366053 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c98c55ac-695d-4d25-ad7c-f38d1b4da1ea-tmp\") pod \"kube-auth-proxy-85c5cf7cfd-czh97\" (UID: \"c98c55ac-695d-4d25-ad7c-f38d1b4da1ea\") " pod="openshift-ingress/kube-auth-proxy-85c5cf7cfd-czh97" Jul 18 03:58:20.366300 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:20.366122 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c98c55ac-695d-4d25-ad7c-f38d1b4da1ea-tls-certs\") pod \"kube-auth-proxy-85c5cf7cfd-czh97\" (UID: \"c98c55ac-695d-4d25-ad7c-f38d1b4da1ea\") " pod="openshift-ingress/kube-auth-proxy-85c5cf7cfd-czh97" Jul 18 03:58:20.368896 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:20.368862 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c98c55ac-695d-4d25-ad7c-f38d1b4da1ea-tmp\") pod \"kube-auth-proxy-85c5cf7cfd-czh97\" (UID: \"c98c55ac-695d-4d25-ad7c-f38d1b4da1ea\") " pod="openshift-ingress/kube-auth-proxy-85c5cf7cfd-czh97" Jul 18 03:58:20.369236 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:20.369210 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c98c55ac-695d-4d25-ad7c-f38d1b4da1ea-tls-certs\") pod \"kube-auth-proxy-85c5cf7cfd-czh97\" (UID: \"c98c55ac-695d-4d25-ad7c-f38d1b4da1ea\") " pod="openshift-ingress/kube-auth-proxy-85c5cf7cfd-czh97" Jul 18 03:58:20.374187 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:20.374159 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r54lw\" (UniqueName: \"kubernetes.io/projected/c98c55ac-695d-4d25-ad7c-f38d1b4da1ea-kube-api-access-r54lw\") pod \"kube-auth-proxy-85c5cf7cfd-czh97\" (UID: \"c98c55ac-695d-4d25-ad7c-f38d1b4da1ea\") " pod="openshift-ingress/kube-auth-proxy-85c5cf7cfd-czh97" Jul 18 03:58:20.460714 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:20.460628 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85c5cf7cfd-czh97" Jul 18 03:58:20.647288 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:20.647064 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85c5cf7cfd-czh97"] Jul 18 03:58:20.650423 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:58:20.650386 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc98c55ac_695d_4d25_ad7c_f38d1b4da1ea.slice/crio-1eb45d311dbf75682d46f15ea00d8116f12778741cb213820fee4b560ae558e0 WatchSource:0}: Error finding container 1eb45d311dbf75682d46f15ea00d8116f12778741cb213820fee4b560ae558e0: Status 404 returned error can't find the container with id 1eb45d311dbf75682d46f15ea00d8116f12778741cb213820fee4b560ae558e0 Jul 18 03:58:20.763120 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:20.763027 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-f4rzs" event={"ID":"23bc6faa-28a4-4b43-aab1-8a6c40ad8ae6","Type":"ContainerStarted","Data":"4d4a237ff4976a8a1aa21168bba23cb17b02f3508d2283655d86e167b85f052a"} Jul 18 03:58:20.764408 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:20.764378 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85c5cf7cfd-czh97" event={"ID":"c98c55ac-695d-4d25-ad7c-f38d1b4da1ea","Type":"ContainerStarted","Data":"1eb45d311dbf75682d46f15ea00d8116f12778741cb213820fee4b560ae558e0"} Jul 18 03:58:21.161233 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:21.161086 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:21.224439 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:21.224397 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:21.974817 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:21.974752 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:24.787791 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:24.787750 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85c5cf7cfd-czh97" event={"ID":"c98c55ac-695d-4d25-ad7c-f38d1b4da1ea","Type":"ContainerStarted","Data":"6cc2d98333c87e0370264b0b6b74d6271445e3707aece780e182d307544aa814"} Jul 18 03:58:24.789325 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:24.789289 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-s8p9r" event={"ID":"6bcc5736-fa15-4656-9f8b-599811d2d1ee","Type":"ContainerStarted","Data":"d72164e534dff9f5440e7b38b069ca841b530e2ae643612e42ae52bb32956c2f"} Jul 18 03:58:24.789490 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:24.789387 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-s8p9r" Jul 18 03:58:24.790820 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:24.790791 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-f4rzs" event={"ID":"23bc6faa-28a4-4b43-aab1-8a6c40ad8ae6","Type":"ContainerStarted","Data":"1afa7e06fb7d995f3334a20ac7c19577b2754c5f212d50d488b8bc67178aa5f9"} Jul 18 03:58:24.790954 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:24.790922 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-f4rzs" Jul 18 03:58:24.807042 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:24.806995 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-85c5cf7cfd-czh97" podStartSLOduration=1.698644568 podStartE2EDuration="4.806979804s" totalImagesPullingTime="3.108335236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:58:24.806476055 +0000 UTC m=+505.568109688" watchObservedRunningTime="2026-07-18 03:58:24.806979804 +0000 UTC m=+505.568613430" Jul 18 03:58:24.826716 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:24.826664 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-s8p9r" podStartSLOduration=2.806474858 podStartE2EDuration="6.826644s" totalImagesPullingTime="4.020169142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:58:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:58:24.824995095 +0000 UTC m=+505.586628729" watchObservedRunningTime="2026-07-18 03:58:24.826644 +0000 UTC m=+505.588277633" Jul 18 03:58:24.842622 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:24.842572 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-f4rzs" podStartSLOduration=2.206345831 podStartE2EDuration="5.842555304s" totalImagesPullingTime="3.636209473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:58:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:58:24.841439318 +0000 UTC m=+505.603072950" watchObservedRunningTime="2026-07-18 03:58:24.842555304 +0000 UTC m=+505.604188940" Jul 18 03:58:24.855961 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:24.855886 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:24.955471 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:24.955434 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:25.683806 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:25.683772 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:25.784532 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:25.784492 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:25.885453 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:25.885416 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:28.733981 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:28.733924 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:28.845871 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:28.845825 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:29.156309 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:29.156253 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:29.484218 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:29.484125 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:30.013478 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:30.013442 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:30.106489 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:30.106450 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:33.656417 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:33.656383 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:33.713676 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:33.713647 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:35.796929 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:35.796895 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-s8p9r" Jul 18 03:58:35.797347 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:35.796993 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-f4rzs" Jul 18 03:58:44.145115 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:44.145077 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:44.232186 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:44.232148 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:47.288054 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:47.288023 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:49.238281 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:49.238239 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:49.285737 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:49.285695 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:58:59.046371 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:58:59.046273 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:59:07.120351 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:07.120313 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:59:19.484917 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:19.484874 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:59:19.581390 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:19.581354 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:59:19.661306 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:19.661266 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:59:20.419345 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:20.419292 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:59:20.621634 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:20.621596 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:59:35.232907 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.232874 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z"] Jul 18 03:59:35.236467 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.236449 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z" Jul 18 03:59:35.238762 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.238735 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 18 03:59:35.238877 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.238763 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 18 03:59:35.239562 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.239545 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rh7pr\"" Jul 18 03:59:35.242962 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.242928 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z"] Jul 18 03:59:35.299207 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.299174 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b467b5e-1621-4ccf-b9cb-a0508b90b9ae-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z\" (UID: \"6b467b5e-1621-4ccf-b9cb-a0508b90b9ae\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z" Jul 18 03:59:35.299355 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.299212 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct46m\" (UniqueName: \"kubernetes.io/projected/6b467b5e-1621-4ccf-b9cb-a0508b90b9ae-kube-api-access-ct46m\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z\" (UID: \"6b467b5e-1621-4ccf-b9cb-a0508b90b9ae\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z" Jul 18 03:59:35.299355 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.299246 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b467b5e-1621-4ccf-b9cb-a0508b90b9ae-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z\" (UID: \"6b467b5e-1621-4ccf-b9cb-a0508b90b9ae\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z" Jul 18 03:59:35.400206 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.400172 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b467b5e-1621-4ccf-b9cb-a0508b90b9ae-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z\" (UID: \"6b467b5e-1621-4ccf-b9cb-a0508b90b9ae\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z" Jul 18 03:59:35.400206 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.400210 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct46m\" (UniqueName: \"kubernetes.io/projected/6b467b5e-1621-4ccf-b9cb-a0508b90b9ae-kube-api-access-ct46m\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z\" (UID: \"6b467b5e-1621-4ccf-b9cb-a0508b90b9ae\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z" Jul 18 03:59:35.400388 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.400233 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b467b5e-1621-4ccf-b9cb-a0508b90b9ae-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z\" (UID: \"6b467b5e-1621-4ccf-b9cb-a0508b90b9ae\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z" Jul 18 03:59:35.400600 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.400582 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b467b5e-1621-4ccf-b9cb-a0508b90b9ae-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z\" (UID: \"6b467b5e-1621-4ccf-b9cb-a0508b90b9ae\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z" Jul 18 03:59:35.400683 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.400666 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b467b5e-1621-4ccf-b9cb-a0508b90b9ae-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z\" (UID: \"6b467b5e-1621-4ccf-b9cb-a0508b90b9ae\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z" Jul 18 03:59:35.408087 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.408062 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct46m\" (UniqueName: \"kubernetes.io/projected/6b467b5e-1621-4ccf-b9cb-a0508b90b9ae-kube-api-access-ct46m\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z\" (UID: \"6b467b5e-1621-4ccf-b9cb-a0508b90b9ae\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z" Jul 18 03:59:35.546873 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.546795 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z" Jul 18 03:59:35.634298 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.634270 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn"] Jul 18 03:59:35.638724 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.638701 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn" Jul 18 03:59:35.644498 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.644463 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn"] Jul 18 03:59:35.690974 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.690931 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z"] Jul 18 03:59:35.693336 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:59:35.693300 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b467b5e_1621_4ccf_b9cb_a0508b90b9ae.slice/crio-00eaf4a5aadb8550365280004e4e303065c28f1c104fe7f627c0a41b89cfa146 WatchSource:0}: Error finding container 00eaf4a5aadb8550365280004e4e303065c28f1c104fe7f627c0a41b89cfa146: Status 404 returned error can't find the container with id 00eaf4a5aadb8550365280004e4e303065c28f1c104fe7f627c0a41b89cfa146 Jul 18 03:59:35.703118 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.703094 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f63caf2-3a84-4418-8c8c-486f9657e033-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn\" (UID: \"8f63caf2-3a84-4418-8c8c-486f9657e033\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn" Jul 18 03:59:35.703223 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.703135 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j92f\" (UniqueName: \"kubernetes.io/projected/8f63caf2-3a84-4418-8c8c-486f9657e033-kube-api-access-7j92f\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn\" (UID: \"8f63caf2-3a84-4418-8c8c-486f9657e033\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn" Jul 18 03:59:35.703223 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.703204 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f63caf2-3a84-4418-8c8c-486f9657e033-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn\" (UID: \"8f63caf2-3a84-4418-8c8c-486f9657e033\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn" Jul 18 03:59:35.804242 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.804184 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f63caf2-3a84-4418-8c8c-486f9657e033-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn\" (UID: \"8f63caf2-3a84-4418-8c8c-486f9657e033\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn" Jul 18 03:59:35.804371 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.804349 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f63caf2-3a84-4418-8c8c-486f9657e033-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn\" (UID: \"8f63caf2-3a84-4418-8c8c-486f9657e033\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn" Jul 18 03:59:35.804443 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.804413 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j92f\" (UniqueName: \"kubernetes.io/projected/8f63caf2-3a84-4418-8c8c-486f9657e033-kube-api-access-7j92f\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn\" (UID: \"8f63caf2-3a84-4418-8c8c-486f9657e033\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn" Jul 18 03:59:35.804597 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.804573 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f63caf2-3a84-4418-8c8c-486f9657e033-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn\" (UID: \"8f63caf2-3a84-4418-8c8c-486f9657e033\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn" Jul 18 03:59:35.804660 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.804633 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f63caf2-3a84-4418-8c8c-486f9657e033-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn\" (UID: \"8f63caf2-3a84-4418-8c8c-486f9657e033\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn" Jul 18 03:59:35.811845 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.811821 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j92f\" (UniqueName: \"kubernetes.io/projected/8f63caf2-3a84-4418-8c8c-486f9657e033-kube-api-access-7j92f\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn\" (UID: \"8f63caf2-3a84-4418-8c8c-486f9657e033\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn" Jul 18 03:59:35.952453 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:35.952404 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn" Jul 18 03:59:36.031173 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.031138 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228"] Jul 18 03:59:36.037100 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.037067 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228" Jul 18 03:59:36.040247 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.040201 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228"] Jul 18 03:59:36.090228 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.090203 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn"] Jul 18 03:59:36.092377 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:59:36.092352 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f63caf2_3a84_4418_8c8c_486f9657e033.slice/crio-87791a24a85bd80addb2c865c2f40d1934253fa35f4d7d6197aa45d4274c984a WatchSource:0}: Error finding container 87791a24a85bd80addb2c865c2f40d1934253fa35f4d7d6197aa45d4274c984a: Status 404 returned error can't find the container with id 87791a24a85bd80addb2c865c2f40d1934253fa35f4d7d6197aa45d4274c984a Jul 18 03:59:36.107198 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.107172 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv974\" (UniqueName: \"kubernetes.io/projected/2bbea6b5-98a5-43bd-9360-9b161303e521-kube-api-access-lv974\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228\" (UID: \"2bbea6b5-98a5-43bd-9360-9b161303e521\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228" Jul 18 03:59:36.107260 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.107230 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bbea6b5-98a5-43bd-9360-9b161303e521-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228\" (UID: \"2bbea6b5-98a5-43bd-9360-9b161303e521\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228" Jul 18 03:59:36.107309 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.107279 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bbea6b5-98a5-43bd-9360-9b161303e521-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228\" (UID: \"2bbea6b5-98a5-43bd-9360-9b161303e521\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228" Jul 18 03:59:36.141722 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.141692 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn" event={"ID":"8f63caf2-3a84-4418-8c8c-486f9657e033","Type":"ContainerStarted","Data":"87791a24a85bd80addb2c865c2f40d1934253fa35f4d7d6197aa45d4274c984a"} Jul 18 03:59:36.143302 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.143277 2558 generic.go:356] "Generic (PLEG): container finished" podID="6b467b5e-1621-4ccf-b9cb-a0508b90b9ae" containerID="d7c00e852572cd27a5aa4012a33c2a651dbbd11358326325f422b852551ca917" exitCode=0 Jul 18 03:59:36.143412 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.143335 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z" event={"ID":"6b467b5e-1621-4ccf-b9cb-a0508b90b9ae","Type":"ContainerDied","Data":"d7c00e852572cd27a5aa4012a33c2a651dbbd11358326325f422b852551ca917"} Jul 18 03:59:36.143412 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.143366 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z" event={"ID":"6b467b5e-1621-4ccf-b9cb-a0508b90b9ae","Type":"ContainerStarted","Data":"00eaf4a5aadb8550365280004e4e303065c28f1c104fe7f627c0a41b89cfa146"} Jul 18 03:59:36.208324 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.208293 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv974\" (UniqueName: \"kubernetes.io/projected/2bbea6b5-98a5-43bd-9360-9b161303e521-kube-api-access-lv974\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228\" (UID: \"2bbea6b5-98a5-43bd-9360-9b161303e521\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228" Jul 18 03:59:36.208470 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.208335 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bbea6b5-98a5-43bd-9360-9b161303e521-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228\" (UID: \"2bbea6b5-98a5-43bd-9360-9b161303e521\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228" Jul 18 03:59:36.208470 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.208383 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bbea6b5-98a5-43bd-9360-9b161303e521-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228\" (UID: \"2bbea6b5-98a5-43bd-9360-9b161303e521\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228" Jul 18 03:59:36.208775 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.208749 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bbea6b5-98a5-43bd-9360-9b161303e521-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228\" (UID: \"2bbea6b5-98a5-43bd-9360-9b161303e521\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228" Jul 18 03:59:36.208832 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.208800 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bbea6b5-98a5-43bd-9360-9b161303e521-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228\" (UID: \"2bbea6b5-98a5-43bd-9360-9b161303e521\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228" Jul 18 03:59:36.218482 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.218460 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv974\" (UniqueName: \"kubernetes.io/projected/2bbea6b5-98a5-43bd-9360-9b161303e521-kube-api-access-lv974\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228\" (UID: \"2bbea6b5-98a5-43bd-9360-9b161303e521\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228" Jul 18 03:59:36.350542 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.350460 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228" Jul 18 03:59:36.429389 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.429354 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn"] Jul 18 03:59:36.433643 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.433457 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn" Jul 18 03:59:36.444789 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.444760 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn"] Jul 18 03:59:36.483465 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.483438 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228"] Jul 18 03:59:36.485188 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:59:36.485153 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bbea6b5_98a5_43bd_9360_9b161303e521.slice/crio-7733fbb41b77fb4112089dcf1d39a054511b20d0f14ce936163b426d06f794ab WatchSource:0}: Error finding container 7733fbb41b77fb4112089dcf1d39a054511b20d0f14ce936163b426d06f794ab: Status 404 returned error can't find the container with id 7733fbb41b77fb4112089dcf1d39a054511b20d0f14ce936163b426d06f794ab Jul 18 03:59:36.511481 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.511454 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v42dc\" (UniqueName: \"kubernetes.io/projected/a056882e-fb98-4525-8538-1c9cfdd1d4b6-kube-api-access-v42dc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn\" (UID: \"a056882e-fb98-4525-8538-1c9cfdd1d4b6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn" Jul 18 03:59:36.511581 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.511516 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a056882e-fb98-4525-8538-1c9cfdd1d4b6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn\" (UID: \"a056882e-fb98-4525-8538-1c9cfdd1d4b6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn" Jul 18 03:59:36.511635 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.511582 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a056882e-fb98-4525-8538-1c9cfdd1d4b6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn\" (UID: \"a056882e-fb98-4525-8538-1c9cfdd1d4b6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn" Jul 18 03:59:36.612862 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.612787 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a056882e-fb98-4525-8538-1c9cfdd1d4b6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn\" (UID: \"a056882e-fb98-4525-8538-1c9cfdd1d4b6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn" Jul 18 03:59:36.612862 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.612851 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a056882e-fb98-4525-8538-1c9cfdd1d4b6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn\" (UID: \"a056882e-fb98-4525-8538-1c9cfdd1d4b6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn" Jul 18 03:59:36.613082 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.612877 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v42dc\" (UniqueName: \"kubernetes.io/projected/a056882e-fb98-4525-8538-1c9cfdd1d4b6-kube-api-access-v42dc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn\" (UID: \"a056882e-fb98-4525-8538-1c9cfdd1d4b6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn" Jul 18 03:59:36.613194 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.613172 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a056882e-fb98-4525-8538-1c9cfdd1d4b6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn\" (UID: \"a056882e-fb98-4525-8538-1c9cfdd1d4b6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn" Jul 18 03:59:36.613278 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.613246 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a056882e-fb98-4525-8538-1c9cfdd1d4b6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn\" (UID: \"a056882e-fb98-4525-8538-1c9cfdd1d4b6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn" Jul 18 03:59:36.621200 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.621175 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v42dc\" (UniqueName: \"kubernetes.io/projected/a056882e-fb98-4525-8538-1c9cfdd1d4b6-kube-api-access-v42dc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn\" (UID: \"a056882e-fb98-4525-8538-1c9cfdd1d4b6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn" Jul 18 03:59:36.746245 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.746194 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn" Jul 18 03:59:36.887053 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:36.887029 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn"] Jul 18 03:59:36.888981 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:59:36.888954 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda056882e_fb98_4525_8538_1c9cfdd1d4b6.slice/crio-cd9009884b1174a0f8ade27933234c8cf5a5fa61d915ead831a45fe35719f1d8 WatchSource:0}: Error finding container cd9009884b1174a0f8ade27933234c8cf5a5fa61d915ead831a45fe35719f1d8: Status 404 returned error can't find the container with id cd9009884b1174a0f8ade27933234c8cf5a5fa61d915ead831a45fe35719f1d8 Jul 18 03:59:37.150892 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:37.150797 2558 generic.go:356] "Generic (PLEG): container finished" podID="2bbea6b5-98a5-43bd-9360-9b161303e521" containerID="ff85776ce3d69843a806babcfadb48351958ff6d7f4884f6fb75bca2efb01429" exitCode=0 Jul 18 03:59:37.150892 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:37.150849 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228" event={"ID":"2bbea6b5-98a5-43bd-9360-9b161303e521","Type":"ContainerDied","Data":"ff85776ce3d69843a806babcfadb48351958ff6d7f4884f6fb75bca2efb01429"} Jul 18 03:59:37.151379 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:37.150900 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228" event={"ID":"2bbea6b5-98a5-43bd-9360-9b161303e521","Type":"ContainerStarted","Data":"7733fbb41b77fb4112089dcf1d39a054511b20d0f14ce936163b426d06f794ab"} Jul 18 03:59:37.152525 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:37.152502 2558 generic.go:356] "Generic (PLEG): container finished" podID="8f63caf2-3a84-4418-8c8c-486f9657e033" containerID="030894ce365e64400ca92a916961075cc73d0b2cb2c9866eb0b3723da9324127" exitCode=0 Jul 18 03:59:37.152624 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:37.152593 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn" event={"ID":"8f63caf2-3a84-4418-8c8c-486f9657e033","Type":"ContainerDied","Data":"030894ce365e64400ca92a916961075cc73d0b2cb2c9866eb0b3723da9324127"} Jul 18 03:59:37.154699 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:37.154678 2558 generic.go:356] "Generic (PLEG): container finished" podID="6b467b5e-1621-4ccf-b9cb-a0508b90b9ae" containerID="471c089c31284cf4271246a3ac607f8e4d632e180881d07bc6630718e5167b6d" exitCode=0 Jul 18 03:59:37.154762 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:37.154742 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z" event={"ID":"6b467b5e-1621-4ccf-b9cb-a0508b90b9ae","Type":"ContainerDied","Data":"471c089c31284cf4271246a3ac607f8e4d632e180881d07bc6630718e5167b6d"} Jul 18 03:59:37.156332 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:37.156310 2558 generic.go:356] "Generic (PLEG): container finished" podID="a056882e-fb98-4525-8538-1c9cfdd1d4b6" containerID="5c82fce842831b349d7a4a2c9aa062a25717be7ac3e74e45dc56c2da8ad59da4" exitCode=0 Jul 18 03:59:37.156474 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:37.156449 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn" event={"ID":"a056882e-fb98-4525-8538-1c9cfdd1d4b6","Type":"ContainerDied","Data":"5c82fce842831b349d7a4a2c9aa062a25717be7ac3e74e45dc56c2da8ad59da4"} Jul 18 03:59:37.156554 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:37.156502 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn" event={"ID":"a056882e-fb98-4525-8538-1c9cfdd1d4b6","Type":"ContainerStarted","Data":"cd9009884b1174a0f8ade27933234c8cf5a5fa61d915ead831a45fe35719f1d8"} Jul 18 03:59:38.164147 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:38.164063 2558 generic.go:356] "Generic (PLEG): container finished" podID="2bbea6b5-98a5-43bd-9360-9b161303e521" containerID="5dddcc6608f6c4ffa976a49ed430e0221c32e2a350a09a5daa8c6bc215fe1f50" exitCode=0 Jul 18 03:59:38.164592 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:38.164147 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228" event={"ID":"2bbea6b5-98a5-43bd-9360-9b161303e521","Type":"ContainerDied","Data":"5dddcc6608f6c4ffa976a49ed430e0221c32e2a350a09a5daa8c6bc215fe1f50"} Jul 18 03:59:38.166380 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:38.166354 2558 generic.go:356] "Generic (PLEG): container finished" podID="6b467b5e-1621-4ccf-b9cb-a0508b90b9ae" containerID="1736bcbc7bae3915ba2bd47b070f761b5d258b3e95e047e9acb0c2d36033e498" exitCode=0 Jul 18 03:59:38.166458 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:38.166425 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z" event={"ID":"6b467b5e-1621-4ccf-b9cb-a0508b90b9ae","Type":"ContainerDied","Data":"1736bcbc7bae3915ba2bd47b070f761b5d258b3e95e047e9acb0c2d36033e498"} Jul 18 03:59:38.168487 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:38.168459 2558 generic.go:356] "Generic (PLEG): container finished" podID="a056882e-fb98-4525-8538-1c9cfdd1d4b6" containerID="b37f278ae9b59c45d803906a64b8619084b1631da885934ac597479a78fcee1f" exitCode=0 Jul 18 03:59:38.168621 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:38.168484 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn" event={"ID":"a056882e-fb98-4525-8538-1c9cfdd1d4b6","Type":"ContainerDied","Data":"b37f278ae9b59c45d803906a64b8619084b1631da885934ac597479a78fcee1f"} Jul 18 03:59:39.176002 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:39.175963 2558 generic.go:356] "Generic (PLEG): container finished" podID="a056882e-fb98-4525-8538-1c9cfdd1d4b6" containerID="a05de449c8fc0bc3a636f1319664070f38ab7f668a6d6ac34ec3670e2b42a623" exitCode=0 Jul 18 03:59:39.176441 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:39.176104 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn" event={"ID":"a056882e-fb98-4525-8538-1c9cfdd1d4b6","Type":"ContainerDied","Data":"a05de449c8fc0bc3a636f1319664070f38ab7f668a6d6ac34ec3670e2b42a623"} Jul 18 03:59:39.178207 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:39.178182 2558 generic.go:356] "Generic (PLEG): container finished" podID="2bbea6b5-98a5-43bd-9360-9b161303e521" containerID="ac4859357cf288109674e9fbdfdd2abaed52e11cc5cf469d6795b6327d6bb68c" exitCode=0 Jul 18 03:59:39.178341 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:39.178269 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228" event={"ID":"2bbea6b5-98a5-43bd-9360-9b161303e521","Type":"ContainerDied","Data":"ac4859357cf288109674e9fbdfdd2abaed52e11cc5cf469d6795b6327d6bb68c"} Jul 18 03:59:39.180190 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:39.180168 2558 generic.go:356] "Generic (PLEG): container finished" podID="8f63caf2-3a84-4418-8c8c-486f9657e033" containerID="030202dfe46083d196ed377beca1ad708860a1a8cd5329acd04f07d8c2bebdc3" exitCode=0 Jul 18 03:59:39.180295 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:39.180252 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn" event={"ID":"8f63caf2-3a84-4418-8c8c-486f9657e033","Type":"ContainerDied","Data":"030202dfe46083d196ed377beca1ad708860a1a8cd5329acd04f07d8c2bebdc3"} Jul 18 03:59:39.327925 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:39.327898 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z" Jul 18 03:59:39.438088 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:39.438002 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b467b5e-1621-4ccf-b9cb-a0508b90b9ae-bundle\") pod \"6b467b5e-1621-4ccf-b9cb-a0508b90b9ae\" (UID: \"6b467b5e-1621-4ccf-b9cb-a0508b90b9ae\") " Jul 18 03:59:39.438088 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:39.438077 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b467b5e-1621-4ccf-b9cb-a0508b90b9ae-util\") pod \"6b467b5e-1621-4ccf-b9cb-a0508b90b9ae\" (UID: \"6b467b5e-1621-4ccf-b9cb-a0508b90b9ae\") " Jul 18 03:59:39.438291 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:39.438144 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ct46m\" (UniqueName: \"kubernetes.io/projected/6b467b5e-1621-4ccf-b9cb-a0508b90b9ae-kube-api-access-ct46m\") pod \"6b467b5e-1621-4ccf-b9cb-a0508b90b9ae\" (UID: \"6b467b5e-1621-4ccf-b9cb-a0508b90b9ae\") " Jul 18 03:59:39.438576 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:39.438543 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b467b5e-1621-4ccf-b9cb-a0508b90b9ae-bundle" (OuterVolumeSpecName: "bundle") pod "6b467b5e-1621-4ccf-b9cb-a0508b90b9ae" (UID: "6b467b5e-1621-4ccf-b9cb-a0508b90b9ae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 03:59:39.440462 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:39.440435 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b467b5e-1621-4ccf-b9cb-a0508b90b9ae-kube-api-access-ct46m" (OuterVolumeSpecName: "kube-api-access-ct46m") pod "6b467b5e-1621-4ccf-b9cb-a0508b90b9ae" (UID: "6b467b5e-1621-4ccf-b9cb-a0508b90b9ae"). InnerVolumeSpecName "kube-api-access-ct46m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 03:59:39.443504 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:39.443482 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b467b5e-1621-4ccf-b9cb-a0508b90b9ae-util" (OuterVolumeSpecName: "util") pod "6b467b5e-1621-4ccf-b9cb-a0508b90b9ae" (UID: "6b467b5e-1621-4ccf-b9cb-a0508b90b9ae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 03:59:39.539763 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:39.539719 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ct46m\" (UniqueName: \"kubernetes.io/projected/6b467b5e-1621-4ccf-b9cb-a0508b90b9ae-kube-api-access-ct46m\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:59:39.539763 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:39.539752 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b467b5e-1621-4ccf-b9cb-a0508b90b9ae-bundle\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:59:39.539763 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:39.539762 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b467b5e-1621-4ccf-b9cb-a0508b90b9ae-util\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:59:40.187165 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:40.187131 2558 generic.go:356] "Generic (PLEG): container finished" podID="8f63caf2-3a84-4418-8c8c-486f9657e033" containerID="551b62ac64542d49e32d03749e9903df11f8ab7261c69dc6549dc42fe3ed91bb" exitCode=0 Jul 18 03:59:40.187575 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:40.187214 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn" event={"ID":"8f63caf2-3a84-4418-8c8c-486f9657e033","Type":"ContainerDied","Data":"551b62ac64542d49e32d03749e9903df11f8ab7261c69dc6549dc42fe3ed91bb"} Jul 18 03:59:40.189212 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:40.189190 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z" Jul 18 03:59:40.189315 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:40.189222 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z" event={"ID":"6b467b5e-1621-4ccf-b9cb-a0508b90b9ae","Type":"ContainerDied","Data":"00eaf4a5aadb8550365280004e4e303065c28f1c104fe7f627c0a41b89cfa146"} Jul 18 03:59:40.189315 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:40.189259 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00eaf4a5aadb8550365280004e4e303065c28f1c104fe7f627c0a41b89cfa146" Jul 18 03:59:40.345017 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:40.344995 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228" Jul 18 03:59:40.348359 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:40.348338 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn" Jul 18 03:59:40.447803 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:40.447725 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a056882e-fb98-4525-8538-1c9cfdd1d4b6-bundle\") pod \"a056882e-fb98-4525-8538-1c9cfdd1d4b6\" (UID: \"a056882e-fb98-4525-8538-1c9cfdd1d4b6\") " Jul 18 03:59:40.447803 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:40.447763 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bbea6b5-98a5-43bd-9360-9b161303e521-bundle\") pod \"2bbea6b5-98a5-43bd-9360-9b161303e521\" (UID: \"2bbea6b5-98a5-43bd-9360-9b161303e521\") " Jul 18 03:59:40.447803 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:40.447787 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lv974\" (UniqueName: \"kubernetes.io/projected/2bbea6b5-98a5-43bd-9360-9b161303e521-kube-api-access-lv974\") pod \"2bbea6b5-98a5-43bd-9360-9b161303e521\" (UID: \"2bbea6b5-98a5-43bd-9360-9b161303e521\") " Jul 18 03:59:40.448212 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:40.447853 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a056882e-fb98-4525-8538-1c9cfdd1d4b6-util\") pod \"a056882e-fb98-4525-8538-1c9cfdd1d4b6\" (UID: \"a056882e-fb98-4525-8538-1c9cfdd1d4b6\") " Jul 18 03:59:40.448212 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:40.447916 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v42dc\" (UniqueName: \"kubernetes.io/projected/a056882e-fb98-4525-8538-1c9cfdd1d4b6-kube-api-access-v42dc\") pod \"a056882e-fb98-4525-8538-1c9cfdd1d4b6\" (UID: \"a056882e-fb98-4525-8538-1c9cfdd1d4b6\") " Jul 18 03:59:40.448212 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:40.448018 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bbea6b5-98a5-43bd-9360-9b161303e521-util\") pod \"2bbea6b5-98a5-43bd-9360-9b161303e521\" (UID: \"2bbea6b5-98a5-43bd-9360-9b161303e521\") " Jul 18 03:59:40.448556 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:40.448527 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a056882e-fb98-4525-8538-1c9cfdd1d4b6-bundle" (OuterVolumeSpecName: "bundle") pod "a056882e-fb98-4525-8538-1c9cfdd1d4b6" (UID: "a056882e-fb98-4525-8538-1c9cfdd1d4b6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 03:59:40.448702 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:40.448533 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bbea6b5-98a5-43bd-9360-9b161303e521-bundle" (OuterVolumeSpecName: "bundle") pod "2bbea6b5-98a5-43bd-9360-9b161303e521" (UID: "2bbea6b5-98a5-43bd-9360-9b161303e521"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 03:59:40.450123 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:40.450098 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bbea6b5-98a5-43bd-9360-9b161303e521-kube-api-access-lv974" (OuterVolumeSpecName: "kube-api-access-lv974") pod "2bbea6b5-98a5-43bd-9360-9b161303e521" (UID: "2bbea6b5-98a5-43bd-9360-9b161303e521"). InnerVolumeSpecName "kube-api-access-lv974". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 03:59:40.450236 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:40.450220 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a056882e-fb98-4525-8538-1c9cfdd1d4b6-kube-api-access-v42dc" (OuterVolumeSpecName: "kube-api-access-v42dc") pod "a056882e-fb98-4525-8538-1c9cfdd1d4b6" (UID: "a056882e-fb98-4525-8538-1c9cfdd1d4b6"). InnerVolumeSpecName "kube-api-access-v42dc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 03:59:40.456515 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:40.456491 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a056882e-fb98-4525-8538-1c9cfdd1d4b6-util" (OuterVolumeSpecName: "util") pod "a056882e-fb98-4525-8538-1c9cfdd1d4b6" (UID: "a056882e-fb98-4525-8538-1c9cfdd1d4b6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 03:59:40.456967 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:40.456946 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bbea6b5-98a5-43bd-9360-9b161303e521-util" (OuterVolumeSpecName: "util") pod "2bbea6b5-98a5-43bd-9360-9b161303e521" (UID: "2bbea6b5-98a5-43bd-9360-9b161303e521"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 03:59:40.548845 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:40.548795 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bbea6b5-98a5-43bd-9360-9b161303e521-util\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:59:40.548845 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:40.548840 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a056882e-fb98-4525-8538-1c9cfdd1d4b6-bundle\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:59:40.548845 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:40.548849 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bbea6b5-98a5-43bd-9360-9b161303e521-bundle\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:59:40.548845 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:40.548858 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lv974\" (UniqueName: \"kubernetes.io/projected/2bbea6b5-98a5-43bd-9360-9b161303e521-kube-api-access-lv974\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:59:40.548845 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:40.548866 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a056882e-fb98-4525-8538-1c9cfdd1d4b6-util\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:59:40.549160 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:40.548875 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v42dc\" (UniqueName: \"kubernetes.io/projected/a056882e-fb98-4525-8538-1c9cfdd1d4b6-kube-api-access-v42dc\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:59:41.198223 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:41.198189 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228" Jul 18 03:59:41.198684 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:41.198217 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228" event={"ID":"2bbea6b5-98a5-43bd-9360-9b161303e521","Type":"ContainerDied","Data":"7733fbb41b77fb4112089dcf1d39a054511b20d0f14ce936163b426d06f794ab"} Jul 18 03:59:41.198684 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:41.198277 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7733fbb41b77fb4112089dcf1d39a054511b20d0f14ce936163b426d06f794ab" Jul 18 03:59:41.200054 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:41.200034 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn" Jul 18 03:59:41.200166 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:41.200064 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn" event={"ID":"a056882e-fb98-4525-8538-1c9cfdd1d4b6","Type":"ContainerDied","Data":"cd9009884b1174a0f8ade27933234c8cf5a5fa61d915ead831a45fe35719f1d8"} Jul 18 03:59:41.200166 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:41.200095 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cd9009884b1174a0f8ade27933234c8cf5a5fa61d915ead831a45fe35719f1d8" Jul 18 03:59:41.332725 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:41.332692 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn" Jul 18 03:59:41.456038 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:41.455957 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f63caf2-3a84-4418-8c8c-486f9657e033-util\") pod \"8f63caf2-3a84-4418-8c8c-486f9657e033\" (UID: \"8f63caf2-3a84-4418-8c8c-486f9657e033\") " Jul 18 03:59:41.456038 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:41.456036 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f63caf2-3a84-4418-8c8c-486f9657e033-bundle\") pod \"8f63caf2-3a84-4418-8c8c-486f9657e033\" (UID: \"8f63caf2-3a84-4418-8c8c-486f9657e033\") " Jul 18 03:59:41.456273 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:41.456073 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7j92f\" (UniqueName: \"kubernetes.io/projected/8f63caf2-3a84-4418-8c8c-486f9657e033-kube-api-access-7j92f\") pod \"8f63caf2-3a84-4418-8c8c-486f9657e033\" (UID: \"8f63caf2-3a84-4418-8c8c-486f9657e033\") " Jul 18 03:59:41.456451 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:41.456425 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f63caf2-3a84-4418-8c8c-486f9657e033-bundle" (OuterVolumeSpecName: "bundle") pod "8f63caf2-3a84-4418-8c8c-486f9657e033" (UID: "8f63caf2-3a84-4418-8c8c-486f9657e033"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 03:59:41.458177 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:41.458157 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f63caf2-3a84-4418-8c8c-486f9657e033-kube-api-access-7j92f" (OuterVolumeSpecName: "kube-api-access-7j92f") pod "8f63caf2-3a84-4418-8c8c-486f9657e033" (UID: "8f63caf2-3a84-4418-8c8c-486f9657e033"). InnerVolumeSpecName "kube-api-access-7j92f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 03:59:41.495387 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:41.495347 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f63caf2-3a84-4418-8c8c-486f9657e033-util" (OuterVolumeSpecName: "util") pod "8f63caf2-3a84-4418-8c8c-486f9657e033" (UID: "8f63caf2-3a84-4418-8c8c-486f9657e033"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 03:59:41.557508 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:41.557474 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f63caf2-3a84-4418-8c8c-486f9657e033-util\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:59:41.557508 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:41.557503 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f63caf2-3a84-4418-8c8c-486f9657e033-bundle\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:59:41.557508 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:41.557514 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7j92f\" (UniqueName: \"kubernetes.io/projected/8f63caf2-3a84-4418-8c8c-486f9657e033-kube-api-access-7j92f\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 03:59:42.206976 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:42.206929 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn" event={"ID":"8f63caf2-3a84-4418-8c8c-486f9657e033","Type":"ContainerDied","Data":"87791a24a85bd80addb2c865c2f40d1934253fa35f4d7d6197aa45d4274c984a"} Jul 18 03:59:42.207342 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:42.206994 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87791a24a85bd80addb2c865c2f40d1934253fa35f4d7d6197aa45d4274c984a" Jul 18 03:59:42.207342 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:42.206927 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn" Jul 18 03:59:48.403251 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:48.403211 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:59:52.602412 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:52.602377 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:59:55.006217 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:55.006176 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:59:55.240918 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:55.240877 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:59:55.601642 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:55.601611 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:59:58.051855 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.051817 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-766dc8b5fc-gfs8l"] Jul 18 03:59:58.052380 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.052273 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a056882e-fb98-4525-8538-1c9cfdd1d4b6" containerName="util" Jul 18 03:59:58.052380 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.052294 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a056882e-fb98-4525-8538-1c9cfdd1d4b6" containerName="util" Jul 18 03:59:58.052380 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.052311 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bbea6b5-98a5-43bd-9360-9b161303e521" containerName="util" Jul 18 03:59:58.052380 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.052320 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bbea6b5-98a5-43bd-9360-9b161303e521" containerName="util" Jul 18 03:59:58.052380 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.052330 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f63caf2-3a84-4418-8c8c-486f9657e033" containerName="pull" Jul 18 03:59:58.052380 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.052339 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f63caf2-3a84-4418-8c8c-486f9657e033" containerName="pull" Jul 18 03:59:58.052380 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.052353 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bbea6b5-98a5-43bd-9360-9b161303e521" containerName="extract" Jul 18 03:59:58.052380 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.052361 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bbea6b5-98a5-43bd-9360-9b161303e521" containerName="extract" Jul 18 03:59:58.052380 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.052378 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f63caf2-3a84-4418-8c8c-486f9657e033" containerName="extract" Jul 18 03:59:58.052380 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.052386 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f63caf2-3a84-4418-8c8c-486f9657e033" containerName="extract" Jul 18 03:59:58.052995 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.052396 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a056882e-fb98-4525-8538-1c9cfdd1d4b6" containerName="pull" Jul 18 03:59:58.052995 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.052406 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a056882e-fb98-4525-8538-1c9cfdd1d4b6" containerName="pull" Jul 18 03:59:58.052995 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.052418 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f63caf2-3a84-4418-8c8c-486f9657e033" containerName="util" Jul 18 03:59:58.052995 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.052426 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f63caf2-3a84-4418-8c8c-486f9657e033" containerName="util" Jul 18 03:59:58.052995 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.052439 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b467b5e-1621-4ccf-b9cb-a0508b90b9ae" containerName="util" Jul 18 03:59:58.052995 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.052448 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b467b5e-1621-4ccf-b9cb-a0508b90b9ae" containerName="util" Jul 18 03:59:58.052995 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.052457 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b467b5e-1621-4ccf-b9cb-a0508b90b9ae" containerName="extract" Jul 18 03:59:58.052995 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.052467 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b467b5e-1621-4ccf-b9cb-a0508b90b9ae" containerName="extract" Jul 18 03:59:58.052995 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.052479 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a056882e-fb98-4525-8538-1c9cfdd1d4b6" containerName="extract" Jul 18 03:59:58.052995 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.052487 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a056882e-fb98-4525-8538-1c9cfdd1d4b6" containerName="extract" Jul 18 03:59:58.052995 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.052499 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b467b5e-1621-4ccf-b9cb-a0508b90b9ae" containerName="pull" Jul 18 03:59:58.052995 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.052507 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b467b5e-1621-4ccf-b9cb-a0508b90b9ae" containerName="pull" Jul 18 03:59:58.052995 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.052526 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bbea6b5-98a5-43bd-9360-9b161303e521" containerName="pull" Jul 18 03:59:58.052995 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.052534 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bbea6b5-98a5-43bd-9360-9b161303e521" containerName="pull" Jul 18 03:59:58.052995 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.052626 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f63caf2-3a84-4418-8c8c-486f9657e033" containerName="extract" Jul 18 03:59:58.052995 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.052639 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a056882e-fb98-4525-8538-1c9cfdd1d4b6" containerName="extract" Jul 18 03:59:58.052995 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.052647 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bbea6b5-98a5-43bd-9360-9b161303e521" containerName="extract" Jul 18 03:59:58.052995 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.052659 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b467b5e-1621-4ccf-b9cb-a0508b90b9ae" containerName="extract" Jul 18 03:59:58.055767 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.055743 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766dc8b5fc-gfs8l" Jul 18 03:59:58.058179 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.058158 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 18 03:59:58.058283 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.058166 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 18 03:59:58.059108 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.059082 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 18 03:59:58.059108 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.059086 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 18 03:59:58.059108 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.059110 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-94tc7\"" Jul 18 03:59:58.059452 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.059133 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 18 03:59:58.059452 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.059215 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 18 03:59:58.059579 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.059467 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 18 03:59:58.064598 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.064576 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 18 03:59:58.065525 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.065506 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-766dc8b5fc-gfs8l"] Jul 18 03:59:58.101212 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.101176 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:59:58.203920 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.203881 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32981299-3df7-4fcf-91d7-07246e4a0083-console-config\") pod \"console-766dc8b5fc-gfs8l\" (UID: \"32981299-3df7-4fcf-91d7-07246e4a0083\") " pod="openshift-console/console-766dc8b5fc-gfs8l" Jul 18 03:59:58.203920 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.203922 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln6rc\" (UniqueName: \"kubernetes.io/projected/32981299-3df7-4fcf-91d7-07246e4a0083-kube-api-access-ln6rc\") pod \"console-766dc8b5fc-gfs8l\" (UID: \"32981299-3df7-4fcf-91d7-07246e4a0083\") " pod="openshift-console/console-766dc8b5fc-gfs8l" Jul 18 03:59:58.204180 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.204013 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32981299-3df7-4fcf-91d7-07246e4a0083-service-ca\") pod \"console-766dc8b5fc-gfs8l\" (UID: \"32981299-3df7-4fcf-91d7-07246e4a0083\") " pod="openshift-console/console-766dc8b5fc-gfs8l" Jul 18 03:59:58.204180 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.204059 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32981299-3df7-4fcf-91d7-07246e4a0083-oauth-serving-cert\") pod \"console-766dc8b5fc-gfs8l\" (UID: \"32981299-3df7-4fcf-91d7-07246e4a0083\") " pod="openshift-console/console-766dc8b5fc-gfs8l" Jul 18 03:59:58.204180 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.204127 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32981299-3df7-4fcf-91d7-07246e4a0083-console-serving-cert\") pod \"console-766dc8b5fc-gfs8l\" (UID: \"32981299-3df7-4fcf-91d7-07246e4a0083\") " pod="openshift-console/console-766dc8b5fc-gfs8l" Jul 18 03:59:58.204180 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.204142 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32981299-3df7-4fcf-91d7-07246e4a0083-console-oauth-config\") pod \"console-766dc8b5fc-gfs8l\" (UID: \"32981299-3df7-4fcf-91d7-07246e4a0083\") " pod="openshift-console/console-766dc8b5fc-gfs8l" Jul 18 03:59:58.204180 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.204164 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32981299-3df7-4fcf-91d7-07246e4a0083-trusted-ca-bundle\") pod \"console-766dc8b5fc-gfs8l\" (UID: \"32981299-3df7-4fcf-91d7-07246e4a0083\") " pod="openshift-console/console-766dc8b5fc-gfs8l" Jul 18 03:59:58.304675 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.304563 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32981299-3df7-4fcf-91d7-07246e4a0083-console-serving-cert\") pod \"console-766dc8b5fc-gfs8l\" (UID: \"32981299-3df7-4fcf-91d7-07246e4a0083\") " pod="openshift-console/console-766dc8b5fc-gfs8l" Jul 18 03:59:58.304675 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.304613 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32981299-3df7-4fcf-91d7-07246e4a0083-console-oauth-config\") pod \"console-766dc8b5fc-gfs8l\" (UID: \"32981299-3df7-4fcf-91d7-07246e4a0083\") " pod="openshift-console/console-766dc8b5fc-gfs8l" Jul 18 03:59:58.304675 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.304647 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32981299-3df7-4fcf-91d7-07246e4a0083-trusted-ca-bundle\") pod \"console-766dc8b5fc-gfs8l\" (UID: \"32981299-3df7-4fcf-91d7-07246e4a0083\") " pod="openshift-console/console-766dc8b5fc-gfs8l" Jul 18 03:59:58.304981 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.304721 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32981299-3df7-4fcf-91d7-07246e4a0083-console-config\") pod \"console-766dc8b5fc-gfs8l\" (UID: \"32981299-3df7-4fcf-91d7-07246e4a0083\") " pod="openshift-console/console-766dc8b5fc-gfs8l" Jul 18 03:59:58.304981 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.304748 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln6rc\" (UniqueName: \"kubernetes.io/projected/32981299-3df7-4fcf-91d7-07246e4a0083-kube-api-access-ln6rc\") pod \"console-766dc8b5fc-gfs8l\" (UID: \"32981299-3df7-4fcf-91d7-07246e4a0083\") " pod="openshift-console/console-766dc8b5fc-gfs8l" Jul 18 03:59:58.304981 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.304776 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32981299-3df7-4fcf-91d7-07246e4a0083-service-ca\") pod \"console-766dc8b5fc-gfs8l\" (UID: \"32981299-3df7-4fcf-91d7-07246e4a0083\") " pod="openshift-console/console-766dc8b5fc-gfs8l" Jul 18 03:59:58.304981 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.304810 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32981299-3df7-4fcf-91d7-07246e4a0083-oauth-serving-cert\") pod \"console-766dc8b5fc-gfs8l\" (UID: \"32981299-3df7-4fcf-91d7-07246e4a0083\") " pod="openshift-console/console-766dc8b5fc-gfs8l" Jul 18 03:59:58.305664 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.305609 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32981299-3df7-4fcf-91d7-07246e4a0083-service-ca\") pod \"console-766dc8b5fc-gfs8l\" (UID: \"32981299-3df7-4fcf-91d7-07246e4a0083\") " pod="openshift-console/console-766dc8b5fc-gfs8l" Jul 18 03:59:58.305664 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.305645 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:59:58.305840 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.305703 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32981299-3df7-4fcf-91d7-07246e4a0083-oauth-serving-cert\") pod \"console-766dc8b5fc-gfs8l\" (UID: \"32981299-3df7-4fcf-91d7-07246e4a0083\") " pod="openshift-console/console-766dc8b5fc-gfs8l" Jul 18 03:59:58.306041 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.306018 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32981299-3df7-4fcf-91d7-07246e4a0083-console-config\") pod \"console-766dc8b5fc-gfs8l\" (UID: \"32981299-3df7-4fcf-91d7-07246e4a0083\") " pod="openshift-console/console-766dc8b5fc-gfs8l" Jul 18 03:59:58.306293 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.306275 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32981299-3df7-4fcf-91d7-07246e4a0083-trusted-ca-bundle\") pod \"console-766dc8b5fc-gfs8l\" (UID: \"32981299-3df7-4fcf-91d7-07246e4a0083\") " pod="openshift-console/console-766dc8b5fc-gfs8l" Jul 18 03:59:58.307372 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.307346 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32981299-3df7-4fcf-91d7-07246e4a0083-console-serving-cert\") pod \"console-766dc8b5fc-gfs8l\" (UID: \"32981299-3df7-4fcf-91d7-07246e4a0083\") " pod="openshift-console/console-766dc8b5fc-gfs8l" Jul 18 03:59:58.307372 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.307366 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32981299-3df7-4fcf-91d7-07246e4a0083-console-oauth-config\") pod \"console-766dc8b5fc-gfs8l\" (UID: \"32981299-3df7-4fcf-91d7-07246e4a0083\") " pod="openshift-console/console-766dc8b5fc-gfs8l" Jul 18 03:59:58.318220 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.318194 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln6rc\" (UniqueName: \"kubernetes.io/projected/32981299-3df7-4fcf-91d7-07246e4a0083-kube-api-access-ln6rc\") pod \"console-766dc8b5fc-gfs8l\" (UID: \"32981299-3df7-4fcf-91d7-07246e4a0083\") " pod="openshift-console/console-766dc8b5fc-gfs8l" Jul 18 03:59:58.367136 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.367090 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766dc8b5fc-gfs8l" Jul 18 03:59:58.532649 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.532622 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-766dc8b5fc-gfs8l"] Jul 18 03:59:58.534703 ip-10-0-138-224 kubenswrapper[2558]: W0718 03:59:58.534679 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32981299_3df7_4fcf_91d7_07246e4a0083.slice/crio-339d0fea8ebda07937adddf1333302aa2e22e3f74e01f8e275ecbf7dc44d171c WatchSource:0}: Error finding container 339d0fea8ebda07937adddf1333302aa2e22e3f74e01f8e275ecbf7dc44d171c: Status 404 returned error can't find the container with id 339d0fea8ebda07937adddf1333302aa2e22e3f74e01f8e275ecbf7dc44d171c Jul 18 03:59:58.798812 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.798772 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:59:58.899295 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:58.899259 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 03:59:59.297597 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:59.297504 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766dc8b5fc-gfs8l" event={"ID":"32981299-3df7-4fcf-91d7-07246e4a0083","Type":"ContainerStarted","Data":"92bba31a3352d11be75fe3676abf73ba9fc5043b6b6d3872af10a0dc2279042f"} Jul 18 03:59:59.297970 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:59.297597 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766dc8b5fc-gfs8l" event={"ID":"32981299-3df7-4fcf-91d7-07246e4a0083","Type":"ContainerStarted","Data":"339d0fea8ebda07937adddf1333302aa2e22e3f74e01f8e275ecbf7dc44d171c"} Jul 18 03:59:59.319391 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:59.319316 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-766dc8b5fc-gfs8l" podStartSLOduration=1.3193024850000001 podStartE2EDuration="1.319302485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:59:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:59:59.318542169 +0000 UTC m=+600.080175818" watchObservedRunningTime="2026-07-18 03:59:59.319302485 +0000 UTC m=+600.080936116" Jul 18 03:59:59.712270 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:59.712242 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kfkfb_77a41d30-764b-40f0-9e8d-35b4f6f87009/console-operator/1.log" Jul 18 03:59:59.712447 ip-10-0-138-224 kubenswrapper[2558]: I0718 03:59:59.712328 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kfkfb_77a41d30-764b-40f0-9e8d-35b4f6f87009/console-operator/1.log" Jul 18 04:00:00.247986 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:00.247927 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:00.635225 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:00.635190 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:00.739601 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:00.739565 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:02.261085 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:02.261036 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:04.058584 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:04.058543 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:07.117120 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:07.117082 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:08.368137 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:08.368099 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-766dc8b5fc-gfs8l" Jul 18 04:00:08.368561 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:08.368164 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-766dc8b5fc-gfs8l" Jul 18 04:00:08.373052 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:08.373015 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-766dc8b5fc-gfs8l" Jul 18 04:00:08.807574 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:08.807471 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:08.907758 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:08.907714 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:09.360291 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:09.360260 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-766dc8b5fc-gfs8l" Jul 18 04:00:09.502329 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:09.502287 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:09.703745 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:09.703704 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:09.804871 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:09.804831 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:11.136415 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:11.136373 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6gpk8"] Jul 18 04:00:11.139668 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:11.139628 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:11.140174 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:11.140150 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6gpk8" Jul 18 04:00:11.142466 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:11.142440 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 18 04:00:11.142580 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:11.142472 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 18 04:00:11.143297 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:11.143276 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rh7pr\"" Jul 18 04:00:11.143418 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:11.143313 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 18 04:00:11.143418 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:11.143330 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 18 04:00:11.149086 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:11.149063 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6gpk8"] Jul 18 04:00:11.324445 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:11.324408 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8fd8d7d4-7837-40c4-8087-c8ec1d135185-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6gpk8\" (UID: \"8fd8d7d4-7837-40c4-8087-c8ec1d135185\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6gpk8" Jul 18 04:00:11.324445 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:11.324445 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8fd8d7d4-7837-40c4-8087-c8ec1d135185-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6gpk8\" (UID: \"8fd8d7d4-7837-40c4-8087-c8ec1d135185\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6gpk8" Jul 18 04:00:11.324661 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:11.324489 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhs82\" (UniqueName: \"kubernetes.io/projected/8fd8d7d4-7837-40c4-8087-c8ec1d135185-kube-api-access-zhs82\") pod \"kuadrant-console-plugin-66b5774985-6gpk8\" (UID: \"8fd8d7d4-7837-40c4-8087-c8ec1d135185\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6gpk8" Jul 18 04:00:11.403666 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:11.403574 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:11.425167 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:11.425126 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8fd8d7d4-7837-40c4-8087-c8ec1d135185-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6gpk8\" (UID: \"8fd8d7d4-7837-40c4-8087-c8ec1d135185\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6gpk8" Jul 18 04:00:11.425167 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:11.425170 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8fd8d7d4-7837-40c4-8087-c8ec1d135185-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6gpk8\" (UID: \"8fd8d7d4-7837-40c4-8087-c8ec1d135185\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6gpk8" Jul 18 04:00:11.425424 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:11.425231 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhs82\" (UniqueName: \"kubernetes.io/projected/8fd8d7d4-7837-40c4-8087-c8ec1d135185-kube-api-access-zhs82\") pod \"kuadrant-console-plugin-66b5774985-6gpk8\" (UID: \"8fd8d7d4-7837-40c4-8087-c8ec1d135185\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6gpk8" Jul 18 04:00:11.425781 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:11.425758 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8fd8d7d4-7837-40c4-8087-c8ec1d135185-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6gpk8\" (UID: \"8fd8d7d4-7837-40c4-8087-c8ec1d135185\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6gpk8" Jul 18 04:00:11.427643 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:11.427624 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8fd8d7d4-7837-40c4-8087-c8ec1d135185-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6gpk8\" (UID: \"8fd8d7d4-7837-40c4-8087-c8ec1d135185\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6gpk8" Jul 18 04:00:11.433027 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:11.433004 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhs82\" (UniqueName: \"kubernetes.io/projected/8fd8d7d4-7837-40c4-8087-c8ec1d135185-kube-api-access-zhs82\") pod \"kuadrant-console-plugin-66b5774985-6gpk8\" (UID: \"8fd8d7d4-7837-40c4-8087-c8ec1d135185\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6gpk8" Jul 18 04:00:11.451877 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:11.451844 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6gpk8" Jul 18 04:00:11.590818 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:11.590793 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6gpk8"] Jul 18 04:00:11.593004 ip-10-0-138-224 kubenswrapper[2558]: W0718 04:00:11.592976 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8fd8d7d4_7837_40c4_8087_c8ec1d135185.slice/crio-3fff059abc501a6165df652277c2d2d597211a2ee9cbbc83bb8bb13ff678ca9f WatchSource:0}: Error finding container 3fff059abc501a6165df652277c2d2d597211a2ee9cbbc83bb8bb13ff678ca9f: Status 404 returned error can't find the container with id 3fff059abc501a6165df652277c2d2d597211a2ee9cbbc83bb8bb13ff678ca9f Jul 18 04:00:12.376717 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:12.376676 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6gpk8" event={"ID":"8fd8d7d4-7837-40c4-8087-c8ec1d135185","Type":"ContainerStarted","Data":"3fff059abc501a6165df652277c2d2d597211a2ee9cbbc83bb8bb13ff678ca9f"} Jul 18 04:00:13.012620 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:13.012588 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:13.113761 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:13.113706 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:13.449017 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:13.448977 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:13.546031 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:13.545913 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:17.389342 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:17.389307 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:17.490526 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:17.490490 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:21.658691 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:21.658609 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bnr2c"] Jul 18 04:00:21.700178 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:21.700141 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bnr2c"] Jul 18 04:00:21.700388 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:21.700258 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bnr2c" Jul 18 04:00:21.703354 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:21.703327 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4d7pk\"" Jul 18 04:00:21.800487 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:21.800452 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h29x5\" (UniqueName: \"kubernetes.io/projected/f2099eb6-0e98-4d4e-9f7f-0b97e3dde242-kube-api-access-h29x5\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bnr2c\" (UID: \"f2099eb6-0e98-4d4e-9f7f-0b97e3dde242\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bnr2c" Jul 18 04:00:21.800697 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:21.800509 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2099eb6-0e98-4d4e-9f7f-0b97e3dde242-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bnr2c\" (UID: \"f2099eb6-0e98-4d4e-9f7f-0b97e3dde242\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bnr2c" Jul 18 04:00:21.901322 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:21.901286 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h29x5\" (UniqueName: \"kubernetes.io/projected/f2099eb6-0e98-4d4e-9f7f-0b97e3dde242-kube-api-access-h29x5\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bnr2c\" (UID: \"f2099eb6-0e98-4d4e-9f7f-0b97e3dde242\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bnr2c" Jul 18 04:00:21.901498 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:21.901355 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2099eb6-0e98-4d4e-9f7f-0b97e3dde242-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bnr2c\" (UID: \"f2099eb6-0e98-4d4e-9f7f-0b97e3dde242\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bnr2c" Jul 18 04:00:21.901828 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:21.901802 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2099eb6-0e98-4d4e-9f7f-0b97e3dde242-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bnr2c\" (UID: \"f2099eb6-0e98-4d4e-9f7f-0b97e3dde242\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bnr2c" Jul 18 04:00:21.910091 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:21.910029 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h29x5\" (UniqueName: \"kubernetes.io/projected/f2099eb6-0e98-4d4e-9f7f-0b97e3dde242-kube-api-access-h29x5\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bnr2c\" (UID: \"f2099eb6-0e98-4d4e-9f7f-0b97e3dde242\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bnr2c" Jul 18 04:00:22.013899 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:22.013862 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bnr2c" Jul 18 04:00:23.714045 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:23.714005 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:23.815306 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:23.815267 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:23.954821 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:23.954781 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:24.055320 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:24.055224 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:26.772179 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:26.772135 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:26.873599 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:26.873557 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:31.575132 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:31.575087 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:31.673762 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:31.673723 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:32.926492 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:32.926461 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bnr2c"] Jul 18 04:00:32.927371 ip-10-0-138-224 kubenswrapper[2558]: W0718 04:00:32.927340 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2099eb6_0e98_4d4e_9f7f_0b97e3dde242.slice/crio-6f57c4d01d5dab28ca1f88e71247565c31d4ad319c6d02f8db5ec8278f855d5e WatchSource:0}: Error finding container 6f57c4d01d5dab28ca1f88e71247565c31d4ad319c6d02f8db5ec8278f855d5e: Status 404 returned error can't find the container with id 6f57c4d01d5dab28ca1f88e71247565c31d4ad319c6d02f8db5ec8278f855d5e Jul 18 04:00:33.514123 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:33.514083 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bnr2c" event={"ID":"f2099eb6-0e98-4d4e-9f7f-0b97e3dde242","Type":"ContainerStarted","Data":"6f57c4d01d5dab28ca1f88e71247565c31d4ad319c6d02f8db5ec8278f855d5e"} Jul 18 04:00:33.515665 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:33.515635 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6gpk8" event={"ID":"8fd8d7d4-7837-40c4-8087-c8ec1d135185","Type":"ContainerStarted","Data":"798eaa13ea24416fe5d91316751c6b9b2b99bf0dbf67badfc2e667c3a4d9a2c4"} Jul 18 04:00:33.532738 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:33.532673 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6gpk8" podStartSLOduration=1.289069687 podStartE2EDuration="22.532650775s" totalImagesPullingTime="21.243581088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 04:00:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:00:33.530277742 +0000 UTC m=+634.291911375" watchObservedRunningTime="2026-07-18 04:00:33.532650775 +0000 UTC m=+634.294284409" Jul 18 04:00:35.118246 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:35.118206 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:35.212190 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:35.212158 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:38.547189 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:38.547133 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bnr2c" event={"ID":"f2099eb6-0e98-4d4e-9f7f-0b97e3dde242","Type":"ContainerStarted","Data":"8385c7465573e52984996d13cb2bca8e85bcd8a2af1f52734292cf875b18de69"} Jul 18 04:00:38.547732 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:38.547322 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bnr2c" Jul 18 04:00:38.570403 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:38.570340 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bnr2c" podStartSLOduration=12.527807877 podStartE2EDuration="17.570320971s" totalImagesPullingTime="5.042513094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 04:00:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:00:38.568015714 +0000 UTC m=+639.329649347" watchObservedRunningTime="2026-07-18 04:00:38.570320971 +0000 UTC m=+639.331954603" Jul 18 04:00:46.665347 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:46.665308 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:46.763003 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:46.762963 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:49.555076 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:49.555045 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bnr2c" Jul 18 04:00:50.092968 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:50.092896 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:50.197296 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:50.197250 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:55.257791 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:55.257744 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:55.308851 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:55.308802 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:55.653636 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:55.653601 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:55.707066 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:55.707029 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:57.919921 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:57.919885 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:00:57.975500 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:00:57.975465 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:01:02.289760 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:02.289722 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bnr2c"] Jul 18 04:01:02.290214 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:02.289947 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bnr2c" podUID="f2099eb6-0e98-4d4e-9f7f-0b97e3dde242" containerName="manager" containerID="cri-o://8385c7465573e52984996d13cb2bca8e85bcd8a2af1f52734292cf875b18de69" gracePeriod=10 Jul 18 04:01:02.543467 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:02.543406 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bnr2c" Jul 18 04:01:02.571327 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:02.571290 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h29x5\" (UniqueName: \"kubernetes.io/projected/f2099eb6-0e98-4d4e-9f7f-0b97e3dde242-kube-api-access-h29x5\") pod \"f2099eb6-0e98-4d4e-9f7f-0b97e3dde242\" (UID: \"f2099eb6-0e98-4d4e-9f7f-0b97e3dde242\") " Jul 18 04:01:02.571518 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:02.571344 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2099eb6-0e98-4d4e-9f7f-0b97e3dde242-extensions-socket-volume\") pod \"f2099eb6-0e98-4d4e-9f7f-0b97e3dde242\" (UID: \"f2099eb6-0e98-4d4e-9f7f-0b97e3dde242\") " Jul 18 04:01:02.572111 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:02.572082 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2099eb6-0e98-4d4e-9f7f-0b97e3dde242-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f2099eb6-0e98-4d4e-9f7f-0b97e3dde242" (UID: "f2099eb6-0e98-4d4e-9f7f-0b97e3dde242"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 04:01:02.573596 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:02.573565 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2099eb6-0e98-4d4e-9f7f-0b97e3dde242-kube-api-access-h29x5" (OuterVolumeSpecName: "kube-api-access-h29x5") pod "f2099eb6-0e98-4d4e-9f7f-0b97e3dde242" (UID: "f2099eb6-0e98-4d4e-9f7f-0b97e3dde242"). InnerVolumeSpecName "kube-api-access-h29x5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 04:01:02.672965 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:02.672904 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h29x5\" (UniqueName: \"kubernetes.io/projected/f2099eb6-0e98-4d4e-9f7f-0b97e3dde242-kube-api-access-h29x5\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 04:01:02.672965 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:02.672956 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2099eb6-0e98-4d4e-9f7f-0b97e3dde242-extensions-socket-volume\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 04:01:02.677402 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:02.677368 2558 generic.go:356] "Generic (PLEG): container finished" podID="f2099eb6-0e98-4d4e-9f7f-0b97e3dde242" containerID="8385c7465573e52984996d13cb2bca8e85bcd8a2af1f52734292cf875b18de69" exitCode=0 Jul 18 04:01:02.677525 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:02.677418 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bnr2c" Jul 18 04:01:02.677525 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:02.677433 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bnr2c" event={"ID":"f2099eb6-0e98-4d4e-9f7f-0b97e3dde242","Type":"ContainerDied","Data":"8385c7465573e52984996d13cb2bca8e85bcd8a2af1f52734292cf875b18de69"} Jul 18 04:01:02.677525 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:02.677488 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bnr2c" event={"ID":"f2099eb6-0e98-4d4e-9f7f-0b97e3dde242","Type":"ContainerDied","Data":"6f57c4d01d5dab28ca1f88e71247565c31d4ad319c6d02f8db5ec8278f855d5e"} Jul 18 04:01:02.677525 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:02.677520 2558 scope.go:117] "RemoveContainer" containerID="8385c7465573e52984996d13cb2bca8e85bcd8a2af1f52734292cf875b18de69" Jul 18 04:01:02.686946 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:02.686907 2558 scope.go:117] "RemoveContainer" containerID="8385c7465573e52984996d13cb2bca8e85bcd8a2af1f52734292cf875b18de69" Jul 18 04:01:02.687324 ip-10-0-138-224 kubenswrapper[2558]: E0718 04:01:02.687306 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8385c7465573e52984996d13cb2bca8e85bcd8a2af1f52734292cf875b18de69\": container with ID starting with 8385c7465573e52984996d13cb2bca8e85bcd8a2af1f52734292cf875b18de69 not found: ID does not exist" containerID="8385c7465573e52984996d13cb2bca8e85bcd8a2af1f52734292cf875b18de69" Jul 18 04:01:02.687376 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:02.687334 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8385c7465573e52984996d13cb2bca8e85bcd8a2af1f52734292cf875b18de69"} err="failed to get container status \"8385c7465573e52984996d13cb2bca8e85bcd8a2af1f52734292cf875b18de69\": rpc error: code = NotFound desc = could not find container \"8385c7465573e52984996d13cb2bca8e85bcd8a2af1f52734292cf875b18de69\": container with ID starting with 8385c7465573e52984996d13cb2bca8e85bcd8a2af1f52734292cf875b18de69 not found: ID does not exist" Jul 18 04:01:02.701651 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:02.701619 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bnr2c"] Jul 18 04:01:02.707586 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:02.707547 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bnr2c"] Jul 18 04:01:03.766460 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:03.766426 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2099eb6-0e98-4d4e-9f7f-0b97e3dde242" path="/var/lib/kubelet/pods/f2099eb6-0e98-4d4e-9f7f-0b97e3dde242/volumes" Jul 18 04:01:06.132219 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:06.132190 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:01:06.404609 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:06.404518 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:01:08.441495 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:08.441443 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:01:08.548052 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:08.548001 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:01:08.605773 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:08.605729 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:01:08.815705 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:08.815620 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q5dnd"] Jul 18 04:01:08.816035 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:08.816021 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2099eb6-0e98-4d4e-9f7f-0b97e3dde242" containerName="manager" Jul 18 04:01:08.816086 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:08.816036 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2099eb6-0e98-4d4e-9f7f-0b97e3dde242" containerName="manager" Jul 18 04:01:08.816126 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:08.816095 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2099eb6-0e98-4d4e-9f7f-0b97e3dde242" containerName="manager" Jul 18 04:01:08.822372 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:08.822349 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-q5dnd" Jul 18 04:01:08.824912 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:08.824887 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 18 04:01:08.828077 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:08.828052 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q5dnd"] Jul 18 04:01:08.856148 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:08.856111 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q5dnd"] Jul 18 04:01:08.926417 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:08.926376 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e22c5671-0b7e-4203-9121-63cc8d36fb02-config-file\") pod \"limitador-limitador-54d6d988d5-q5dnd\" (UID: \"e22c5671-0b7e-4203-9121-63cc8d36fb02\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-q5dnd" Jul 18 04:01:08.926606 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:08.926485 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj4vw\" (UniqueName: \"kubernetes.io/projected/e22c5671-0b7e-4203-9121-63cc8d36fb02-kube-api-access-nj4vw\") pod \"limitador-limitador-54d6d988d5-q5dnd\" (UID: \"e22c5671-0b7e-4203-9121-63cc8d36fb02\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-q5dnd" Jul 18 04:01:09.027814 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:09.027778 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e22c5671-0b7e-4203-9121-63cc8d36fb02-config-file\") pod \"limitador-limitador-54d6d988d5-q5dnd\" (UID: \"e22c5671-0b7e-4203-9121-63cc8d36fb02\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-q5dnd" Jul 18 04:01:09.027983 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:09.027863 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj4vw\" (UniqueName: \"kubernetes.io/projected/e22c5671-0b7e-4203-9121-63cc8d36fb02-kube-api-access-nj4vw\") pod \"limitador-limitador-54d6d988d5-q5dnd\" (UID: \"e22c5671-0b7e-4203-9121-63cc8d36fb02\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-q5dnd" Jul 18 04:01:09.028475 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:09.028454 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e22c5671-0b7e-4203-9121-63cc8d36fb02-config-file\") pod \"limitador-limitador-54d6d988d5-q5dnd\" (UID: \"e22c5671-0b7e-4203-9121-63cc8d36fb02\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-q5dnd" Jul 18 04:01:09.035563 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:09.035530 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj4vw\" (UniqueName: \"kubernetes.io/projected/e22c5671-0b7e-4203-9121-63cc8d36fb02-kube-api-access-nj4vw\") pod \"limitador-limitador-54d6d988d5-q5dnd\" (UID: \"e22c5671-0b7e-4203-9121-63cc8d36fb02\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-q5dnd" Jul 18 04:01:09.135728 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:09.135687 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-q5dnd" Jul 18 04:01:09.267725 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:09.267700 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q5dnd"] Jul 18 04:01:09.270028 ip-10-0-138-224 kubenswrapper[2558]: W0718 04:01:09.269998 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode22c5671_0b7e_4203_9121_63cc8d36fb02.slice/crio-f2474b713373791fc22c193eda389fb485f0fb4b8b1a587202c5cba8bd3ecb66 WatchSource:0}: Error finding container f2474b713373791fc22c193eda389fb485f0fb4b8b1a587202c5cba8bd3ecb66: Status 404 returned error can't find the container with id f2474b713373791fc22c193eda389fb485f0fb4b8b1a587202c5cba8bd3ecb66 Jul 18 04:01:09.285473 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:09.285447 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-sqfsf"] Jul 18 04:01:09.290636 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:09.290615 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-sqfsf" Jul 18 04:01:09.293124 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:09.293077 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gfcwm\"" Jul 18 04:01:09.294839 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:09.294811 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-sqfsf"] Jul 18 04:01:09.314179 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:09.314142 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:01:09.331053 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:09.331024 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kj8s\" (UniqueName: \"kubernetes.io/projected/09c9e910-6a42-4327-97cd-aae2e1620a4f-kube-api-access-7kj8s\") pod \"authorino-58cd955675-sqfsf\" (UID: \"09c9e910-6a42-4327-97cd-aae2e1620a4f\") " pod="kuadrant-system/authorino-58cd955675-sqfsf" Jul 18 04:01:09.367994 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:09.367959 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:01:09.403899 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:09.403825 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-dxrnf"] Jul 18 04:01:09.407232 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:09.407214 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dxrnf" Jul 18 04:01:09.412279 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:09.412256 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dxrnf"] Jul 18 04:01:09.431481 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:09.431450 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hfqv\" (UniqueName: \"kubernetes.io/projected/7b65ca5a-01fb-408b-8ca6-ad81d3de0811-kube-api-access-8hfqv\") pod \"authorino-75d556bd77-dxrnf\" (UID: \"7b65ca5a-01fb-408b-8ca6-ad81d3de0811\") " pod="kuadrant-system/authorino-75d556bd77-dxrnf" Jul 18 04:01:09.431625 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:09.431494 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kj8s\" (UniqueName: \"kubernetes.io/projected/09c9e910-6a42-4327-97cd-aae2e1620a4f-kube-api-access-7kj8s\") pod \"authorino-58cd955675-sqfsf\" (UID: \"09c9e910-6a42-4327-97cd-aae2e1620a4f\") " pod="kuadrant-system/authorino-58cd955675-sqfsf" Jul 18 04:01:09.439068 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:09.439039 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kj8s\" (UniqueName: \"kubernetes.io/projected/09c9e910-6a42-4327-97cd-aae2e1620a4f-kube-api-access-7kj8s\") pod \"authorino-58cd955675-sqfsf\" (UID: \"09c9e910-6a42-4327-97cd-aae2e1620a4f\") " pod="kuadrant-system/authorino-58cd955675-sqfsf" Jul 18 04:01:09.532267 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:09.532233 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hfqv\" (UniqueName: \"kubernetes.io/projected/7b65ca5a-01fb-408b-8ca6-ad81d3de0811-kube-api-access-8hfqv\") pod \"authorino-75d556bd77-dxrnf\" (UID: \"7b65ca5a-01fb-408b-8ca6-ad81d3de0811\") " pod="kuadrant-system/authorino-75d556bd77-dxrnf" Jul 18 04:01:09.539783 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:09.539758 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hfqv\" (UniqueName: \"kubernetes.io/projected/7b65ca5a-01fb-408b-8ca6-ad81d3de0811-kube-api-access-8hfqv\") pod \"authorino-75d556bd77-dxrnf\" (UID: \"7b65ca5a-01fb-408b-8ca6-ad81d3de0811\") " pod="kuadrant-system/authorino-75d556bd77-dxrnf" Jul 18 04:01:09.601901 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:09.601843 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-sqfsf" Jul 18 04:01:09.715486 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:09.715451 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-q5dnd" event={"ID":"e22c5671-0b7e-4203-9121-63cc8d36fb02","Type":"ContainerStarted","Data":"f2474b713373791fc22c193eda389fb485f0fb4b8b1a587202c5cba8bd3ecb66"} Jul 18 04:01:09.717625 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:09.717599 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dxrnf" Jul 18 04:01:09.733523 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:09.733495 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-sqfsf"] Jul 18 04:01:09.737393 ip-10-0-138-224 kubenswrapper[2558]: W0718 04:01:09.734475 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09c9e910_6a42_4327_97cd_aae2e1620a4f.slice/crio-e64a7e400680e1c5c973c2338da3bc1cb09d802b770e189c7bbe1fa46bfb8cc1 WatchSource:0}: Error finding container e64a7e400680e1c5c973c2338da3bc1cb09d802b770e189c7bbe1fa46bfb8cc1: Status 404 returned error can't find the container with id e64a7e400680e1c5c973c2338da3bc1cb09d802b770e189c7bbe1fa46bfb8cc1 Jul 18 04:01:09.854245 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:09.854220 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dxrnf"] Jul 18 04:01:09.856106 ip-10-0-138-224 kubenswrapper[2558]: W0718 04:01:09.856079 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b65ca5a_01fb_408b_8ca6_ad81d3de0811.slice/crio-c70025a60bb62b8cef192f3630fba6f14de098566d3b50876358bea08b9665f1 WatchSource:0}: Error finding container c70025a60bb62b8cef192f3630fba6f14de098566d3b50876358bea08b9665f1: Status 404 returned error can't find the container with id c70025a60bb62b8cef192f3630fba6f14de098566d3b50876358bea08b9665f1 Jul 18 04:01:10.730482 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:10.730434 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-sqfsf" event={"ID":"09c9e910-6a42-4327-97cd-aae2e1620a4f","Type":"ContainerStarted","Data":"e64a7e400680e1c5c973c2338da3bc1cb09d802b770e189c7bbe1fa46bfb8cc1"} Jul 18 04:01:10.734180 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:10.734144 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dxrnf" event={"ID":"7b65ca5a-01fb-408b-8ca6-ad81d3de0811","Type":"ContainerStarted","Data":"c70025a60bb62b8cef192f3630fba6f14de098566d3b50876358bea08b9665f1"} Jul 18 04:01:15.773519 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:15.773479 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-sqfsf" event={"ID":"09c9e910-6a42-4327-97cd-aae2e1620a4f","Type":"ContainerStarted","Data":"9823b088fb95d8ddbddd26d48a5ce7d7305ef54512851850ed1bdac65072ca38"} Jul 18 04:01:15.775121 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:15.775072 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-q5dnd" event={"ID":"e22c5671-0b7e-4203-9121-63cc8d36fb02","Type":"ContainerStarted","Data":"742377efcac0fe0a90b8ac43cd7f8f6092e0f26c8d544dfb5259ee5ec032d625"} Jul 18 04:01:15.775256 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:15.775145 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-q5dnd" Jul 18 04:01:15.776473 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:15.776449 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dxrnf" event={"ID":"7b65ca5a-01fb-408b-8ca6-ad81d3de0811","Type":"ContainerStarted","Data":"51300c11099b06fede19cade0925b50673f0105fbb86a24b8904bfb15387c479"} Jul 18 04:01:15.788987 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:15.788927 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-sqfsf" podStartSLOduration=1.703091071 podStartE2EDuration="6.788913305s" totalImagesPullingTime="5.085822234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 04:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:01:15.786895355 +0000 UTC m=+676.548528988" watchObservedRunningTime="2026-07-18 04:01:15.788913305 +0000 UTC m=+676.550546937" Jul 18 04:01:15.801744 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:15.801671 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-dxrnf" podStartSLOduration=1.8746791109999998 podStartE2EDuration="6.801649359s" totalImagesPullingTime="4.926970248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 04:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:01:15.79950643 +0000 UTC m=+676.561140063" watchObservedRunningTime="2026-07-18 04:01:15.801649359 +0000 UTC m=+676.563282994" Jul 18 04:01:15.817871 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:15.817807 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-q5dnd" podStartSLOduration=2.250427807 podStartE2EDuration="7.817782666s" totalImagesPullingTime="5.567354859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 04:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:01:15.816247762 +0000 UTC m=+676.577881408" watchObservedRunningTime="2026-07-18 04:01:15.817782666 +0000 UTC m=+676.579416299" Jul 18 04:01:15.826311 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:15.826277 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-sqfsf"] Jul 18 04:01:17.786732 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:17.786667 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-sqfsf" podUID="09c9e910-6a42-4327-97cd-aae2e1620a4f" containerName="authorino" containerID="cri-o://9823b088fb95d8ddbddd26d48a5ce7d7305ef54512851850ed1bdac65072ca38" gracePeriod=30 Jul 18 04:01:18.038572 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:18.038510 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-sqfsf" Jul 18 04:01:18.120827 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:18.120785 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kj8s\" (UniqueName: \"kubernetes.io/projected/09c9e910-6a42-4327-97cd-aae2e1620a4f-kube-api-access-7kj8s\") pod \"09c9e910-6a42-4327-97cd-aae2e1620a4f\" (UID: \"09c9e910-6a42-4327-97cd-aae2e1620a4f\") " Jul 18 04:01:18.122917 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:18.122886 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09c9e910-6a42-4327-97cd-aae2e1620a4f-kube-api-access-7kj8s" (OuterVolumeSpecName: "kube-api-access-7kj8s") pod "09c9e910-6a42-4327-97cd-aae2e1620a4f" (UID: "09c9e910-6a42-4327-97cd-aae2e1620a4f"). InnerVolumeSpecName "kube-api-access-7kj8s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 04:01:18.222242 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:18.222198 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kj8s\" (UniqueName: \"kubernetes.io/projected/09c9e910-6a42-4327-97cd-aae2e1620a4f-kube-api-access-7kj8s\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 04:01:18.793663 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:18.793623 2558 generic.go:356] "Generic (PLEG): container finished" podID="09c9e910-6a42-4327-97cd-aae2e1620a4f" containerID="9823b088fb95d8ddbddd26d48a5ce7d7305ef54512851850ed1bdac65072ca38" exitCode=0 Jul 18 04:01:18.794062 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:18.793687 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-sqfsf" Jul 18 04:01:18.794062 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:18.793712 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-sqfsf" event={"ID":"09c9e910-6a42-4327-97cd-aae2e1620a4f","Type":"ContainerDied","Data":"9823b088fb95d8ddbddd26d48a5ce7d7305ef54512851850ed1bdac65072ca38"} Jul 18 04:01:18.794062 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:18.793762 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-sqfsf" event={"ID":"09c9e910-6a42-4327-97cd-aae2e1620a4f","Type":"ContainerDied","Data":"e64a7e400680e1c5c973c2338da3bc1cb09d802b770e189c7bbe1fa46bfb8cc1"} Jul 18 04:01:18.794062 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:18.793780 2558 scope.go:117] "RemoveContainer" containerID="9823b088fb95d8ddbddd26d48a5ce7d7305ef54512851850ed1bdac65072ca38" Jul 18 04:01:18.803779 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:18.803760 2558 scope.go:117] "RemoveContainer" containerID="9823b088fb95d8ddbddd26d48a5ce7d7305ef54512851850ed1bdac65072ca38" Jul 18 04:01:18.804080 ip-10-0-138-224 kubenswrapper[2558]: E0718 04:01:18.804058 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9823b088fb95d8ddbddd26d48a5ce7d7305ef54512851850ed1bdac65072ca38\": container with ID starting with 9823b088fb95d8ddbddd26d48a5ce7d7305ef54512851850ed1bdac65072ca38 not found: ID does not exist" containerID="9823b088fb95d8ddbddd26d48a5ce7d7305ef54512851850ed1bdac65072ca38" Jul 18 04:01:18.804169 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:18.804087 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9823b088fb95d8ddbddd26d48a5ce7d7305ef54512851850ed1bdac65072ca38"} err="failed to get container status \"9823b088fb95d8ddbddd26d48a5ce7d7305ef54512851850ed1bdac65072ca38\": rpc error: code = NotFound desc = could not find container \"9823b088fb95d8ddbddd26d48a5ce7d7305ef54512851850ed1bdac65072ca38\": container with ID starting with 9823b088fb95d8ddbddd26d48a5ce7d7305ef54512851850ed1bdac65072ca38 not found: ID does not exist" Jul 18 04:01:18.815663 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:18.815637 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-sqfsf"] Jul 18 04:01:18.818912 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:18.818890 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-sqfsf"] Jul 18 04:01:19.766576 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:19.766530 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09c9e910-6a42-4327-97cd-aae2e1620a4f" path="/var/lib/kubelet/pods/09c9e910-6a42-4327-97cd-aae2e1620a4f/volumes" Jul 18 04:01:26.783796 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:26.783763 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-q5dnd" Jul 18 04:01:29.658836 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:29.658796 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:01:29.760491 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:29.760451 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:01:30.146856 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:30.146809 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:01:41.786403 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:41.786357 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:01:41.944169 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:41.944126 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:01:42.019317 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.019286 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kvpmq"] Jul 18 04:01:42.019656 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.019643 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09c9e910-6a42-4327-97cd-aae2e1620a4f" containerName="authorino" Jul 18 04:01:42.019702 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.019658 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="09c9e910-6a42-4327-97cd-aae2e1620a4f" containerName="authorino" Jul 18 04:01:42.019743 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.019734 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="09c9e910-6a42-4327-97cd-aae2e1620a4f" containerName="authorino" Jul 18 04:01:42.022671 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.022656 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kvpmq" Jul 18 04:01:42.027678 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.027653 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kvpmq"] Jul 18 04:01:42.131187 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.131151 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw82h\" (UniqueName: \"kubernetes.io/projected/243b2b04-d6cf-44f2-a485-0d41def49855-kube-api-access-kw82h\") pod \"authorino-5d4b67c446-kvpmq\" (UID: \"243b2b04-d6cf-44f2-a485-0d41def49855\") " pod="kuadrant-system/authorino-5d4b67c446-kvpmq" Jul 18 04:01:42.232124 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.232083 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw82h\" (UniqueName: \"kubernetes.io/projected/243b2b04-d6cf-44f2-a485-0d41def49855-kube-api-access-kw82h\") pod \"authorino-5d4b67c446-kvpmq\" (UID: \"243b2b04-d6cf-44f2-a485-0d41def49855\") " pod="kuadrant-system/authorino-5d4b67c446-kvpmq" Jul 18 04:01:42.242302 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.242272 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw82h\" (UniqueName: \"kubernetes.io/projected/243b2b04-d6cf-44f2-a485-0d41def49855-kube-api-access-kw82h\") pod \"authorino-5d4b67c446-kvpmq\" (UID: \"243b2b04-d6cf-44f2-a485-0d41def49855\") " pod="kuadrant-system/authorino-5d4b67c446-kvpmq" Jul 18 04:01:42.246682 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.246655 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kvpmq"] Jul 18 04:01:42.246905 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.246890 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kvpmq" Jul 18 04:01:42.266104 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.266075 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d47f6c584-d92sm"] Jul 18 04:01:42.269780 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.269756 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d47f6c584-d92sm" Jul 18 04:01:42.278067 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.278043 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d47f6c584-d92sm"] Jul 18 04:01:42.371991 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.367433 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d47f6c584-d92sm"] Jul 18 04:01:42.371991 ip-10-0-138-224 kubenswrapper[2558]: E0718 04:01:42.368212 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-4rrlr], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d47f6c584-d92sm" podUID="e467f5b1-3920-4ece-ade7-1654371888d5" Jul 18 04:01:42.376315 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.376285 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kvpmq"] Jul 18 04:01:42.378541 ip-10-0-138-224 kubenswrapper[2558]: W0718 04:01:42.378515 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod243b2b04_d6cf_44f2_a485_0d41def49855.slice/crio-5b975d0b0d6f76f1f2a0f8708bb424c994b9645cbf2c39a439b256ba8f44d5a5 WatchSource:0}: Error finding container 5b975d0b0d6f76f1f2a0f8708bb424c994b9645cbf2c39a439b256ba8f44d5a5: Status 404 returned error can't find the container with id 5b975d0b0d6f76f1f2a0f8708bb424c994b9645cbf2c39a439b256ba8f44d5a5 Jul 18 04:01:42.379832 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.379813 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 04:01:42.394192 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.394167 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d88c5c99b-zrm6m"] Jul 18 04:01:42.397714 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.397695 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d88c5c99b-zrm6m" Jul 18 04:01:42.399905 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.399886 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 18 04:01:42.405533 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.405508 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d88c5c99b-zrm6m"] Jul 18 04:01:42.433561 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.433533 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rrlr\" (UniqueName: \"kubernetes.io/projected/e467f5b1-3920-4ece-ade7-1654371888d5-kube-api-access-4rrlr\") pod \"authorino-6d47f6c584-d92sm\" (UID: \"e467f5b1-3920-4ece-ade7-1654371888d5\") " pod="kuadrant-system/authorino-6d47f6c584-d92sm" Jul 18 04:01:42.534421 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.534383 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rrlr\" (UniqueName: \"kubernetes.io/projected/e467f5b1-3920-4ece-ade7-1654371888d5-kube-api-access-4rrlr\") pod \"authorino-6d47f6c584-d92sm\" (UID: \"e467f5b1-3920-4ece-ade7-1654371888d5\") " pod="kuadrant-system/authorino-6d47f6c584-d92sm" Jul 18 04:01:42.534590 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.534480 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/60c9fe0f-95c3-4147-a309-fa4f1779fb74-tls-cert\") pod \"authorino-7d88c5c99b-zrm6m\" (UID: \"60c9fe0f-95c3-4147-a309-fa4f1779fb74\") " pod="kuadrant-system/authorino-7d88c5c99b-zrm6m" Jul 18 04:01:42.534590 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.534522 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf4md\" (UniqueName: \"kubernetes.io/projected/60c9fe0f-95c3-4147-a309-fa4f1779fb74-kube-api-access-bf4md\") pod \"authorino-7d88c5c99b-zrm6m\" (UID: \"60c9fe0f-95c3-4147-a309-fa4f1779fb74\") " pod="kuadrant-system/authorino-7d88c5c99b-zrm6m" Jul 18 04:01:42.541644 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.541623 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rrlr\" (UniqueName: \"kubernetes.io/projected/e467f5b1-3920-4ece-ade7-1654371888d5-kube-api-access-4rrlr\") pod \"authorino-6d47f6c584-d92sm\" (UID: \"e467f5b1-3920-4ece-ade7-1654371888d5\") " pod="kuadrant-system/authorino-6d47f6c584-d92sm" Jul 18 04:01:42.635254 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.635161 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/60c9fe0f-95c3-4147-a309-fa4f1779fb74-tls-cert\") pod \"authorino-7d88c5c99b-zrm6m\" (UID: \"60c9fe0f-95c3-4147-a309-fa4f1779fb74\") " pod="kuadrant-system/authorino-7d88c5c99b-zrm6m" Jul 18 04:01:42.635254 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.635214 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf4md\" (UniqueName: \"kubernetes.io/projected/60c9fe0f-95c3-4147-a309-fa4f1779fb74-kube-api-access-bf4md\") pod \"authorino-7d88c5c99b-zrm6m\" (UID: \"60c9fe0f-95c3-4147-a309-fa4f1779fb74\") " pod="kuadrant-system/authorino-7d88c5c99b-zrm6m" Jul 18 04:01:42.637586 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.637565 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/60c9fe0f-95c3-4147-a309-fa4f1779fb74-tls-cert\") pod \"authorino-7d88c5c99b-zrm6m\" (UID: \"60c9fe0f-95c3-4147-a309-fa4f1779fb74\") " pod="kuadrant-system/authorino-7d88c5c99b-zrm6m" Jul 18 04:01:42.642148 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.642127 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf4md\" (UniqueName: \"kubernetes.io/projected/60c9fe0f-95c3-4147-a309-fa4f1779fb74-kube-api-access-bf4md\") pod \"authorino-7d88c5c99b-zrm6m\" (UID: \"60c9fe0f-95c3-4147-a309-fa4f1779fb74\") " pod="kuadrant-system/authorino-7d88c5c99b-zrm6m" Jul 18 04:01:42.707822 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.707785 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d88c5c99b-zrm6m" Jul 18 04:01:42.856195 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.856169 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d88c5c99b-zrm6m"] Jul 18 04:01:42.858293 ip-10-0-138-224 kubenswrapper[2558]: W0718 04:01:42.858273 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60c9fe0f_95c3_4147_a309_fa4f1779fb74.slice/crio-02ec639bb8ff2f8b255509f88dbd797d0b124c372f62cb5e99b15ef07375625a WatchSource:0}: Error finding container 02ec639bb8ff2f8b255509f88dbd797d0b124c372f62cb5e99b15ef07375625a: Status 404 returned error can't find the container with id 02ec639bb8ff2f8b255509f88dbd797d0b124c372f62cb5e99b15ef07375625a Jul 18 04:01:42.925651 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.925553 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kvpmq" event={"ID":"243b2b04-d6cf-44f2-a485-0d41def49855","Type":"ContainerStarted","Data":"db67567353648c9203660044539bd8b0d923eb9871a67977b94a775a227b42e8"} Jul 18 04:01:42.925651 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.925577 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-kvpmq" podUID="243b2b04-d6cf-44f2-a485-0d41def49855" containerName="authorino" containerID="cri-o://db67567353648c9203660044539bd8b0d923eb9871a67977b94a775a227b42e8" gracePeriod=30 Jul 18 04:01:42.925651 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.925615 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kvpmq" event={"ID":"243b2b04-d6cf-44f2-a485-0d41def49855","Type":"ContainerStarted","Data":"5b975d0b0d6f76f1f2a0f8708bb424c994b9645cbf2c39a439b256ba8f44d5a5"} Jul 18 04:01:42.927400 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.927370 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d47f6c584-d92sm" Jul 18 04:01:42.927892 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.927427 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d88c5c99b-zrm6m" event={"ID":"60c9fe0f-95c3-4147-a309-fa4f1779fb74","Type":"ContainerStarted","Data":"02ec639bb8ff2f8b255509f88dbd797d0b124c372f62cb5e99b15ef07375625a"} Jul 18 04:01:42.935384 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.935365 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d47f6c584-d92sm" Jul 18 04:01:42.939373 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:42.939331 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-kvpmq" podStartSLOduration=0.524241091 podStartE2EDuration="939.318906ms" totalImagesPullingTime="415.077815ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 04:01:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:01:42.938659784 +0000 UTC m=+703.700293417" watchObservedRunningTime="2026-07-18 04:01:42.939318906 +0000 UTC m=+703.700952538" Jul 18 04:01:43.038990 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:43.038957 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rrlr\" (UniqueName: \"kubernetes.io/projected/e467f5b1-3920-4ece-ade7-1654371888d5-kube-api-access-4rrlr\") pod \"e467f5b1-3920-4ece-ade7-1654371888d5\" (UID: \"e467f5b1-3920-4ece-ade7-1654371888d5\") " Jul 18 04:01:43.041178 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:43.041144 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e467f5b1-3920-4ece-ade7-1654371888d5-kube-api-access-4rrlr" (OuterVolumeSpecName: "kube-api-access-4rrlr") pod "e467f5b1-3920-4ece-ade7-1654371888d5" (UID: "e467f5b1-3920-4ece-ade7-1654371888d5"). InnerVolumeSpecName "kube-api-access-4rrlr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 04:01:43.140640 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:43.140605 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rrlr\" (UniqueName: \"kubernetes.io/projected/e467f5b1-3920-4ece-ade7-1654371888d5-kube-api-access-4rrlr\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 04:01:43.162362 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:43.162338 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kvpmq" Jul 18 04:01:43.343157 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:43.343126 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kw82h\" (UniqueName: \"kubernetes.io/projected/243b2b04-d6cf-44f2-a485-0d41def49855-kube-api-access-kw82h\") pod \"243b2b04-d6cf-44f2-a485-0d41def49855\" (UID: \"243b2b04-d6cf-44f2-a485-0d41def49855\") " Jul 18 04:01:43.345214 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:43.345176 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/243b2b04-d6cf-44f2-a485-0d41def49855-kube-api-access-kw82h" (OuterVolumeSpecName: "kube-api-access-kw82h") pod "243b2b04-d6cf-44f2-a485-0d41def49855" (UID: "243b2b04-d6cf-44f2-a485-0d41def49855"). InnerVolumeSpecName "kube-api-access-kw82h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 04:01:43.443843 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:43.443810 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kw82h\" (UniqueName: \"kubernetes.io/projected/243b2b04-d6cf-44f2-a485-0d41def49855-kube-api-access-kw82h\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 04:01:43.933692 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:43.933656 2558 generic.go:356] "Generic (PLEG): container finished" podID="243b2b04-d6cf-44f2-a485-0d41def49855" containerID="db67567353648c9203660044539bd8b0d923eb9871a67977b94a775a227b42e8" exitCode=0 Jul 18 04:01:43.934143 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:43.933701 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kvpmq" Jul 18 04:01:43.934143 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:43.933743 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kvpmq" event={"ID":"243b2b04-d6cf-44f2-a485-0d41def49855","Type":"ContainerDied","Data":"db67567353648c9203660044539bd8b0d923eb9871a67977b94a775a227b42e8"} Jul 18 04:01:43.934143 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:43.933782 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kvpmq" event={"ID":"243b2b04-d6cf-44f2-a485-0d41def49855","Type":"ContainerDied","Data":"5b975d0b0d6f76f1f2a0f8708bb424c994b9645cbf2c39a439b256ba8f44d5a5"} Jul 18 04:01:43.934143 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:43.933805 2558 scope.go:117] "RemoveContainer" containerID="db67567353648c9203660044539bd8b0d923eb9871a67977b94a775a227b42e8" Jul 18 04:01:43.935689 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:43.935669 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d47f6c584-d92sm" Jul 18 04:01:43.935689 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:43.935677 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d88c5c99b-zrm6m" event={"ID":"60c9fe0f-95c3-4147-a309-fa4f1779fb74","Type":"ContainerStarted","Data":"aeea995c6992f53ad681a8ea98025e6db0c9e6968c6d85aa7dcf91be152e8492"} Jul 18 04:01:43.943303 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:43.943283 2558 scope.go:117] "RemoveContainer" containerID="db67567353648c9203660044539bd8b0d923eb9871a67977b94a775a227b42e8" Jul 18 04:01:43.943625 ip-10-0-138-224 kubenswrapper[2558]: E0718 04:01:43.943605 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db67567353648c9203660044539bd8b0d923eb9871a67977b94a775a227b42e8\": container with ID starting with db67567353648c9203660044539bd8b0d923eb9871a67977b94a775a227b42e8 not found: ID does not exist" containerID="db67567353648c9203660044539bd8b0d923eb9871a67977b94a775a227b42e8" Jul 18 04:01:43.943693 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:43.943633 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db67567353648c9203660044539bd8b0d923eb9871a67977b94a775a227b42e8"} err="failed to get container status \"db67567353648c9203660044539bd8b0d923eb9871a67977b94a775a227b42e8\": rpc error: code = NotFound desc = could not find container \"db67567353648c9203660044539bd8b0d923eb9871a67977b94a775a227b42e8\": container with ID starting with db67567353648c9203660044539bd8b0d923eb9871a67977b94a775a227b42e8 not found: ID does not exist" Jul 18 04:01:43.950463 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:43.950418 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7d88c5c99b-zrm6m" podStartSLOduration=1.601350869 podStartE2EDuration="1.950405069s" totalImagesPullingTime="349.0542ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 04:01:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:01:43.949484134 +0000 UTC m=+704.711117767" watchObservedRunningTime="2026-07-18 04:01:43.950405069 +0000 UTC m=+704.712038700" Jul 18 04:01:43.978185 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:43.978152 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dxrnf"] Jul 18 04:01:43.978358 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:43.978338 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-dxrnf" podUID="7b65ca5a-01fb-408b-8ca6-ad81d3de0811" containerName="authorino" containerID="cri-o://51300c11099b06fede19cade0925b50673f0105fbb86a24b8904bfb15387c479" gracePeriod=30 Jul 18 04:01:43.981402 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:43.981369 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d47f6c584-d92sm"] Jul 18 04:01:43.988759 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:43.988729 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d47f6c584-d92sm"] Jul 18 04:01:43.997061 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:43.997033 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kvpmq"] Jul 18 04:01:44.002164 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:44.002131 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kvpmq"] Jul 18 04:01:44.265330 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:44.265293 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dxrnf" Jul 18 04:01:44.451427 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:44.451389 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hfqv\" (UniqueName: \"kubernetes.io/projected/7b65ca5a-01fb-408b-8ca6-ad81d3de0811-kube-api-access-8hfqv\") pod \"7b65ca5a-01fb-408b-8ca6-ad81d3de0811\" (UID: \"7b65ca5a-01fb-408b-8ca6-ad81d3de0811\") " Jul 18 04:01:44.453507 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:44.453476 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b65ca5a-01fb-408b-8ca6-ad81d3de0811-kube-api-access-8hfqv" (OuterVolumeSpecName: "kube-api-access-8hfqv") pod "7b65ca5a-01fb-408b-8ca6-ad81d3de0811" (UID: "7b65ca5a-01fb-408b-8ca6-ad81d3de0811"). InnerVolumeSpecName "kube-api-access-8hfqv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 04:01:44.552150 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:44.552109 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hfqv\" (UniqueName: \"kubernetes.io/projected/7b65ca5a-01fb-408b-8ca6-ad81d3de0811-kube-api-access-8hfqv\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 04:01:44.943221 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:44.943186 2558 generic.go:356] "Generic (PLEG): container finished" podID="7b65ca5a-01fb-408b-8ca6-ad81d3de0811" containerID="51300c11099b06fede19cade0925b50673f0105fbb86a24b8904bfb15387c479" exitCode=0 Jul 18 04:01:44.943685 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:44.943233 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dxrnf" Jul 18 04:01:44.943685 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:44.943268 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dxrnf" event={"ID":"7b65ca5a-01fb-408b-8ca6-ad81d3de0811","Type":"ContainerDied","Data":"51300c11099b06fede19cade0925b50673f0105fbb86a24b8904bfb15387c479"} Jul 18 04:01:44.943685 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:44.943313 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dxrnf" event={"ID":"7b65ca5a-01fb-408b-8ca6-ad81d3de0811","Type":"ContainerDied","Data":"c70025a60bb62b8cef192f3630fba6f14de098566d3b50876358bea08b9665f1"} Jul 18 04:01:44.943685 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:44.943334 2558 scope.go:117] "RemoveContainer" containerID="51300c11099b06fede19cade0925b50673f0105fbb86a24b8904bfb15387c479" Jul 18 04:01:44.952805 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:44.952782 2558 scope.go:117] "RemoveContainer" containerID="51300c11099b06fede19cade0925b50673f0105fbb86a24b8904bfb15387c479" Jul 18 04:01:44.953122 ip-10-0-138-224 kubenswrapper[2558]: E0718 04:01:44.953102 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51300c11099b06fede19cade0925b50673f0105fbb86a24b8904bfb15387c479\": container with ID starting with 51300c11099b06fede19cade0925b50673f0105fbb86a24b8904bfb15387c479 not found: ID does not exist" containerID="51300c11099b06fede19cade0925b50673f0105fbb86a24b8904bfb15387c479" Jul 18 04:01:44.953191 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:44.953130 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51300c11099b06fede19cade0925b50673f0105fbb86a24b8904bfb15387c479"} err="failed to get container status \"51300c11099b06fede19cade0925b50673f0105fbb86a24b8904bfb15387c479\": rpc error: code = NotFound desc = could not find container \"51300c11099b06fede19cade0925b50673f0105fbb86a24b8904bfb15387c479\": container with ID starting with 51300c11099b06fede19cade0925b50673f0105fbb86a24b8904bfb15387c479 not found: ID does not exist" Jul 18 04:01:44.969217 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:44.966670 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dxrnf"] Jul 18 04:01:44.972158 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:44.972128 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dxrnf"] Jul 18 04:01:45.766532 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:45.766494 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="243b2b04-d6cf-44f2-a485-0d41def49855" path="/var/lib/kubelet/pods/243b2b04-d6cf-44f2-a485-0d41def49855/volumes" Jul 18 04:01:45.766824 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:45.766810 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b65ca5a-01fb-408b-8ca6-ad81d3de0811" path="/var/lib/kubelet/pods/7b65ca5a-01fb-408b-8ca6-ad81d3de0811/volumes" Jul 18 04:01:45.767169 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:45.767154 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e467f5b1-3920-4ece-ade7-1654371888d5" path="/var/lib/kubelet/pods/e467f5b1-3920-4ece-ade7-1654371888d5/volumes" Jul 18 04:01:48.485266 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:48.485220 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:01:48.577634 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:48.577593 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:01:48.648364 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:48.648318 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:01:48.761757 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:48.761668 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:01:51.715028 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:51.714922 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:01:51.824476 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:01:51.824420 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:02:16.406985 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:02:16.406923 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:02:24.409213 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:02:24.409151 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:02:24.510054 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:02:24.510020 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:02:24.890342 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:02:24.890288 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:02:25.404368 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:02:25.404329 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:02:25.497297 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:02:25.497255 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:02:25.621521 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:02:25.621484 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q5dnd"] Jul 18 04:02:36.715823 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:02:36.715774 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:02:36.813265 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:02:36.813223 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:02:48.000123 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:02:48.000088 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:02:48.275856 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:02:48.275767 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q5dnd"] Jul 18 04:02:55.596795 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:02:55.596737 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:02:56.663314 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:02:56.663269 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q5dnd"] Jul 18 04:03:01.970877 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:03:01.970838 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:03:03.068086 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:03:03.068039 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q5dnd"] Jul 18 04:03:10.274113 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:03:10.274059 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:03:11.867691 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:03:11.867659 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q5dnd"] Jul 18 04:03:23.089471 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:03:23.089381 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:03:26.066123 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:03:26.066088 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q5dnd"] Jul 18 04:03:43.992840 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:03:43.992796 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:03:46.568226 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:03:46.568184 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q5dnd"] Jul 18 04:04:30.548635 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:30.548595 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:04:35.140988 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:35.140954 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c86464669-8njsc"] Jul 18 04:04:35.141501 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:35.141373 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b65ca5a-01fb-408b-8ca6-ad81d3de0811" containerName="authorino" Jul 18 04:04:35.141501 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:35.141390 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b65ca5a-01fb-408b-8ca6-ad81d3de0811" containerName="authorino" Jul 18 04:04:35.141501 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:35.141413 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="243b2b04-d6cf-44f2-a485-0d41def49855" containerName="authorino" Jul 18 04:04:35.141501 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:35.141419 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="243b2b04-d6cf-44f2-a485-0d41def49855" containerName="authorino" Jul 18 04:04:35.141501 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:35.141489 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="243b2b04-d6cf-44f2-a485-0d41def49855" containerName="authorino" Jul 18 04:04:35.141501 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:35.141501 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b65ca5a-01fb-408b-8ca6-ad81d3de0811" containerName="authorino" Jul 18 04:04:35.144500 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:35.144481 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c86464669-8njsc" Jul 18 04:04:35.151833 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:35.151806 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c86464669-8njsc"] Jul 18 04:04:35.218088 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:35.218050 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86xdc\" (UniqueName: \"kubernetes.io/projected/b9071075-cfb3-4b34-ab96-74a9b17fa33d-kube-api-access-86xdc\") pod \"authorino-c86464669-8njsc\" (UID: \"b9071075-cfb3-4b34-ab96-74a9b17fa33d\") " pod="kuadrant-system/authorino-c86464669-8njsc" Jul 18 04:04:35.218088 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:35.218093 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b9071075-cfb3-4b34-ab96-74a9b17fa33d-tls-cert\") pod \"authorino-c86464669-8njsc\" (UID: \"b9071075-cfb3-4b34-ab96-74a9b17fa33d\") " pod="kuadrant-system/authorino-c86464669-8njsc" Jul 18 04:04:35.318989 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:35.318952 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86xdc\" (UniqueName: \"kubernetes.io/projected/b9071075-cfb3-4b34-ab96-74a9b17fa33d-kube-api-access-86xdc\") pod \"authorino-c86464669-8njsc\" (UID: \"b9071075-cfb3-4b34-ab96-74a9b17fa33d\") " pod="kuadrant-system/authorino-c86464669-8njsc" Jul 18 04:04:35.318989 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:35.318991 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b9071075-cfb3-4b34-ab96-74a9b17fa33d-tls-cert\") pod \"authorino-c86464669-8njsc\" (UID: \"b9071075-cfb3-4b34-ab96-74a9b17fa33d\") " pod="kuadrant-system/authorino-c86464669-8njsc" Jul 18 04:04:35.321350 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:35.321323 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b9071075-cfb3-4b34-ab96-74a9b17fa33d-tls-cert\") pod \"authorino-c86464669-8njsc\" (UID: \"b9071075-cfb3-4b34-ab96-74a9b17fa33d\") " pod="kuadrant-system/authorino-c86464669-8njsc" Jul 18 04:04:35.325636 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:35.325611 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86xdc\" (UniqueName: \"kubernetes.io/projected/b9071075-cfb3-4b34-ab96-74a9b17fa33d-kube-api-access-86xdc\") pod \"authorino-c86464669-8njsc\" (UID: \"b9071075-cfb3-4b34-ab96-74a9b17fa33d\") " pod="kuadrant-system/authorino-c86464669-8njsc" Jul 18 04:04:35.454965 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:35.454872 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c86464669-8njsc" Jul 18 04:04:35.583764 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:35.583738 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c86464669-8njsc"] Jul 18 04:04:35.585823 ip-10-0-138-224 kubenswrapper[2558]: W0718 04:04:35.585789 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9071075_cfb3_4b34_ab96_74a9b17fa33d.slice/crio-a7ed1de8762b9674dafffb7fda9607bf821f5ed6f9efde9c4f48eadf7be9ef3b WatchSource:0}: Error finding container a7ed1de8762b9674dafffb7fda9607bf821f5ed6f9efde9c4f48eadf7be9ef3b: Status 404 returned error can't find the container with id a7ed1de8762b9674dafffb7fda9607bf821f5ed6f9efde9c4f48eadf7be9ef3b Jul 18 04:04:35.870500 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:35.870467 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c86464669-8njsc" event={"ID":"b9071075-cfb3-4b34-ab96-74a9b17fa33d","Type":"ContainerStarted","Data":"a7ed1de8762b9674dafffb7fda9607bf821f5ed6f9efde9c4f48eadf7be9ef3b"} Jul 18 04:04:36.878508 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:36.878469 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c86464669-8njsc" event={"ID":"b9071075-cfb3-4b34-ab96-74a9b17fa33d","Type":"ContainerStarted","Data":"9ee6f5b1eb5de06769c79d4e80118cdd203000438fa9bce9f6c146228629465f"} Jul 18 04:04:36.895584 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:36.895524 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c86464669-8njsc" podStartSLOduration=1.3301050779999999 podStartE2EDuration="1.895509705s" totalImagesPullingTime="565.404627ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 04:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:04:36.894776457 +0000 UTC m=+877.656410090" watchObservedRunningTime="2026-07-18 04:04:36.895509705 +0000 UTC m=+877.657143369" Jul 18 04:04:36.923904 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:36.923855 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d88c5c99b-zrm6m"] Jul 18 04:04:36.924337 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:36.924307 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7d88c5c99b-zrm6m" podUID="60c9fe0f-95c3-4147-a309-fa4f1779fb74" containerName="authorino" containerID="cri-o://aeea995c6992f53ad681a8ea98025e6db0c9e6968c6d85aa7dcf91be152e8492" gracePeriod=30 Jul 18 04:04:37.197522 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:37.197494 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d88c5c99b-zrm6m" Jul 18 04:04:37.243879 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:37.243843 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bf4md\" (UniqueName: \"kubernetes.io/projected/60c9fe0f-95c3-4147-a309-fa4f1779fb74-kube-api-access-bf4md\") pod \"60c9fe0f-95c3-4147-a309-fa4f1779fb74\" (UID: \"60c9fe0f-95c3-4147-a309-fa4f1779fb74\") " Jul 18 04:04:37.244053 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:37.243922 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/60c9fe0f-95c3-4147-a309-fa4f1779fb74-tls-cert\") pod \"60c9fe0f-95c3-4147-a309-fa4f1779fb74\" (UID: \"60c9fe0f-95c3-4147-a309-fa4f1779fb74\") " Jul 18 04:04:37.246082 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:37.246044 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60c9fe0f-95c3-4147-a309-fa4f1779fb74-kube-api-access-bf4md" (OuterVolumeSpecName: "kube-api-access-bf4md") pod "60c9fe0f-95c3-4147-a309-fa4f1779fb74" (UID: "60c9fe0f-95c3-4147-a309-fa4f1779fb74"). InnerVolumeSpecName "kube-api-access-bf4md". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 04:04:37.256429 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:37.256396 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60c9fe0f-95c3-4147-a309-fa4f1779fb74-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "60c9fe0f-95c3-4147-a309-fa4f1779fb74" (UID: "60c9fe0f-95c3-4147-a309-fa4f1779fb74"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 04:04:37.345054 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:37.345008 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bf4md\" (UniqueName: \"kubernetes.io/projected/60c9fe0f-95c3-4147-a309-fa4f1779fb74-kube-api-access-bf4md\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 04:04:37.345054 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:37.345040 2558 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/60c9fe0f-95c3-4147-a309-fa4f1779fb74-tls-cert\") on node \"ip-10-0-138-224.ec2.internal\" DevicePath \"\"" Jul 18 04:04:37.409279 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:37.409243 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:04:37.510441 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:37.510350 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:04:37.886284 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:37.886249 2558 generic.go:356] "Generic (PLEG): container finished" podID="60c9fe0f-95c3-4147-a309-fa4f1779fb74" containerID="aeea995c6992f53ad681a8ea98025e6db0c9e6968c6d85aa7dcf91be152e8492" exitCode=0 Jul 18 04:04:37.886747 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:37.886297 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d88c5c99b-zrm6m" Jul 18 04:04:37.886747 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:37.886343 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d88c5c99b-zrm6m" event={"ID":"60c9fe0f-95c3-4147-a309-fa4f1779fb74","Type":"ContainerDied","Data":"aeea995c6992f53ad681a8ea98025e6db0c9e6968c6d85aa7dcf91be152e8492"} Jul 18 04:04:37.886747 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:37.886395 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d88c5c99b-zrm6m" event={"ID":"60c9fe0f-95c3-4147-a309-fa4f1779fb74","Type":"ContainerDied","Data":"02ec639bb8ff2f8b255509f88dbd797d0b124c372f62cb5e99b15ef07375625a"} Jul 18 04:04:37.886747 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:37.886423 2558 scope.go:117] "RemoveContainer" containerID="aeea995c6992f53ad681a8ea98025e6db0c9e6968c6d85aa7dcf91be152e8492" Jul 18 04:04:37.895868 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:37.895848 2558 scope.go:117] "RemoveContainer" containerID="aeea995c6992f53ad681a8ea98025e6db0c9e6968c6d85aa7dcf91be152e8492" Jul 18 04:04:37.896128 ip-10-0-138-224 kubenswrapper[2558]: E0718 04:04:37.896109 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aeea995c6992f53ad681a8ea98025e6db0c9e6968c6d85aa7dcf91be152e8492\": container with ID starting with aeea995c6992f53ad681a8ea98025e6db0c9e6968c6d85aa7dcf91be152e8492 not found: ID does not exist" containerID="aeea995c6992f53ad681a8ea98025e6db0c9e6968c6d85aa7dcf91be152e8492" Jul 18 04:04:37.896191 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:37.896137 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeea995c6992f53ad681a8ea98025e6db0c9e6968c6d85aa7dcf91be152e8492"} err="failed to get container status \"aeea995c6992f53ad681a8ea98025e6db0c9e6968c6d85aa7dcf91be152e8492\": rpc error: code = NotFound desc = could not find container \"aeea995c6992f53ad681a8ea98025e6db0c9e6968c6d85aa7dcf91be152e8492\": container with ID starting with aeea995c6992f53ad681a8ea98025e6db0c9e6968c6d85aa7dcf91be152e8492 not found: ID does not exist" Jul 18 04:04:37.901524 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:37.901499 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d88c5c99b-zrm6m"] Jul 18 04:04:37.903613 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:37.903587 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7d88c5c99b-zrm6m"] Jul 18 04:04:38.521342 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:38.521281 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:04:38.621482 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:38.621446 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:04:39.766352 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:39.766316 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60c9fe0f-95c3-4147-a309-fa4f1779fb74" path="/var/lib/kubelet/pods/60c9fe0f-95c3-4147-a309-fa4f1779fb74/volumes" Jul 18 04:04:59.747570 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:59.747490 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kfkfb_77a41d30-764b-40f0-9e8d-35b4f6f87009/console-operator/1.log" Jul 18 04:04:59.749520 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:04:59.749492 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kfkfb_77a41d30-764b-40f0-9e8d-35b4f6f87009/console-operator/1.log" Jul 18 04:05:11.464145 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:11.464101 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:05:16.990849 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:16.990819 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-c86464669-8njsc_b9071075-cfb3-4b34-ab96-74a9b17fa33d/authorino/0.log" Jul 18 04:05:22.689589 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:22.689554 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-s8p9r_6bcc5736-fa15-4656-9f8b-599811d2d1ee/manager/0.log" Jul 18 04:05:22.911798 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:22.911764 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f994c8d8-k2pcg_34733b92-fcd1-4ea3-89c2-58c893425e8c/copy-manifests/0.log" Jul 18 04:05:22.918789 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:22.918766 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f994c8d8-k2pcg_34733b92-fcd1-4ea3-89c2-58c893425e8c/manager/0.log" Jul 18 04:05:24.245653 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:24.245625 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn_8f63caf2-3a84-4418-8c8c-486f9657e033/util/0.log" Jul 18 04:05:24.252206 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:24.252179 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn_8f63caf2-3a84-4418-8c8c-486f9657e033/pull/0.log" Jul 18 04:05:24.258211 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:24.258191 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn_8f63caf2-3a84-4418-8c8c-486f9657e033/extract/0.log" Jul 18 04:05:24.368026 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:24.367966 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z_6b467b5e-1621-4ccf-b9cb-a0508b90b9ae/pull/0.log" Jul 18 04:05:24.373735 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:24.373705 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z_6b467b5e-1621-4ccf-b9cb-a0508b90b9ae/extract/0.log" Jul 18 04:05:24.379017 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:24.379000 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z_6b467b5e-1621-4ccf-b9cb-a0508b90b9ae/util/0.log" Jul 18 04:05:24.490072 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:24.490043 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228_2bbea6b5-98a5-43bd-9360-9b161303e521/util/0.log" Jul 18 04:05:24.496190 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:24.496112 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228_2bbea6b5-98a5-43bd-9360-9b161303e521/pull/0.log" Jul 18 04:05:24.502039 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:24.502011 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228_2bbea6b5-98a5-43bd-9360-9b161303e521/extract/0.log" Jul 18 04:05:24.618806 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:24.618775 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn_a056882e-fb98-4525-8538-1c9cfdd1d4b6/pull/0.log" Jul 18 04:05:24.625074 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:24.625046 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn_a056882e-fb98-4525-8538-1c9cfdd1d4b6/extract/0.log" Jul 18 04:05:24.630594 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:24.630576 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn_a056882e-fb98-4525-8538-1c9cfdd1d4b6/util/0.log" Jul 18 04:05:24.750514 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:24.750430 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-c86464669-8njsc_b9071075-cfb3-4b34-ab96-74a9b17fa33d/authorino/0.log" Jul 18 04:05:25.098970 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:25.098882 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6gpk8_8fd8d7d4-7837-40c4-8087-c8ec1d135185/kuadrant-console-plugin/0.log" Jul 18 04:05:25.501165 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:25.501136 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-q5dnd_e22c5671-0b7e-4203-9121-63cc8d36fb02/limitador/0.log" Jul 18 04:05:26.178173 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:26.178139 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85c5cf7cfd-czh97_c98c55ac-695d-4d25-ad7c-f38d1b4da1ea/kube-auth-proxy/0.log" Jul 18 04:05:32.521659 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:32.521619 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2q2dr/must-gather-fzrkr"] Jul 18 04:05:32.522315 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:32.522291 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60c9fe0f-95c3-4147-a309-fa4f1779fb74" containerName="authorino" Jul 18 04:05:32.522402 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:32.522318 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="60c9fe0f-95c3-4147-a309-fa4f1779fb74" containerName="authorino" Jul 18 04:05:32.522459 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:32.522426 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="60c9fe0f-95c3-4147-a309-fa4f1779fb74" containerName="authorino" Jul 18 04:05:32.525411 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:32.525385 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2q2dr/must-gather-fzrkr" Jul 18 04:05:32.527701 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:32.527677 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2q2dr\"/\"openshift-service-ca.crt\"" Jul 18 04:05:32.527814 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:32.527734 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2q2dr\"/\"default-dockercfg-tcmmh\"" Jul 18 04:05:32.528578 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:32.528558 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2q2dr\"/\"kube-root-ca.crt\"" Jul 18 04:05:32.533092 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:32.532488 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2c83a524-97e6-49f8-b060-db29a01209fa-must-gather-output\") pod \"must-gather-fzrkr\" (UID: \"2c83a524-97e6-49f8-b060-db29a01209fa\") " pod="openshift-must-gather-2q2dr/must-gather-fzrkr" Jul 18 04:05:32.533092 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:32.532533 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r8kh\" (UniqueName: \"kubernetes.io/projected/2c83a524-97e6-49f8-b060-db29a01209fa-kube-api-access-4r8kh\") pod \"must-gather-fzrkr\" (UID: \"2c83a524-97e6-49f8-b060-db29a01209fa\") " pod="openshift-must-gather-2q2dr/must-gather-fzrkr" Jul 18 04:05:32.533927 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:32.533904 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2q2dr/must-gather-fzrkr"] Jul 18 04:05:32.536706 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:32.536677 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:05:32.596527 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:32.596486 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:05:32.633704 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:32.633670 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2c83a524-97e6-49f8-b060-db29a01209fa-must-gather-output\") pod \"must-gather-fzrkr\" (UID: \"2c83a524-97e6-49f8-b060-db29a01209fa\") " pod="openshift-must-gather-2q2dr/must-gather-fzrkr" Jul 18 04:05:32.633867 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:32.633709 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r8kh\" (UniqueName: \"kubernetes.io/projected/2c83a524-97e6-49f8-b060-db29a01209fa-kube-api-access-4r8kh\") pod \"must-gather-fzrkr\" (UID: \"2c83a524-97e6-49f8-b060-db29a01209fa\") " pod="openshift-must-gather-2q2dr/must-gather-fzrkr" Jul 18 04:05:32.634085 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:32.634066 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2c83a524-97e6-49f8-b060-db29a01209fa-must-gather-output\") pod \"must-gather-fzrkr\" (UID: \"2c83a524-97e6-49f8-b060-db29a01209fa\") " pod="openshift-must-gather-2q2dr/must-gather-fzrkr" Jul 18 04:05:32.641298 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:32.641276 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r8kh\" (UniqueName: \"kubernetes.io/projected/2c83a524-97e6-49f8-b060-db29a01209fa-kube-api-access-4r8kh\") pod \"must-gather-fzrkr\" (UID: \"2c83a524-97e6-49f8-b060-db29a01209fa\") " pod="openshift-must-gather-2q2dr/must-gather-fzrkr" Jul 18 04:05:32.835286 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:32.835205 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2q2dr/must-gather-fzrkr" Jul 18 04:05:32.971165 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:32.971135 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2q2dr/must-gather-fzrkr"] Jul 18 04:05:32.972785 ip-10-0-138-224 kubenswrapper[2558]: W0718 04:05:32.972757 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c83a524_97e6_49f8_b060_db29a01209fa.slice/crio-1bcae5dbb8d0b21f20887a89367c5ce39e10d321e032054487e8f90ea6ea739f WatchSource:0}: Error finding container 1bcae5dbb8d0b21f20887a89367c5ce39e10d321e032054487e8f90ea6ea739f: Status 404 returned error can't find the container with id 1bcae5dbb8d0b21f20887a89367c5ce39e10d321e032054487e8f90ea6ea739f Jul 18 04:05:33.186033 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:33.185993 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2q2dr/must-gather-fzrkr" event={"ID":"2c83a524-97e6-49f8-b060-db29a01209fa","Type":"ContainerStarted","Data":"1bcae5dbb8d0b21f20887a89367c5ce39e10d321e032054487e8f90ea6ea739f"} Jul 18 04:05:33.317152 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:33.317108 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" limit=1024 Jul 18 04:05:34.197128 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:34.197090 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2q2dr/must-gather-fzrkr" event={"ID":"2c83a524-97e6-49f8-b060-db29a01209fa","Type":"ContainerStarted","Data":"190894a6ad42d385cec00910935c0631c5fe1a324b23b84f7bb5ffa941535050"} Jul 18 04:05:34.197128 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:34.197136 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2q2dr/must-gather-fzrkr" event={"ID":"2c83a524-97e6-49f8-b060-db29a01209fa","Type":"ContainerStarted","Data":"c7bb196f4c78036416ddabe82d34121d3f0c2671ebe0aacd0a573380b627dd6d"} Jul 18 04:05:34.212516 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:34.212462 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2q2dr/must-gather-fzrkr" podStartSLOduration=1.436482848 podStartE2EDuration="2.212445624s" totalImagesPullingTime="775.962776ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 04:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:05:34.210518062 +0000 UTC m=+934.972151718" watchObservedRunningTime="2026-07-18 04:05:34.212445624 +0000 UTC m=+934.974079255" Jul 18 04:05:35.233557 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:35.233519 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7dx5n_eadafdbc-08a4-43cb-8bf8-1afbf235bd6f/global-pull-secret-syncer/0.log" Jul 18 04:05:35.387489 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:35.387427 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-74gks_0ee054bb-d92c-45b8-933e-2bebaf9aada6/konnectivity-agent/0.log" Jul 18 04:05:35.506105 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:35.506018 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-224.ec2.internal_90a4a6eaac46277c0148bd75d4544ffb/haproxy/0.log" Jul 18 04:05:40.129292 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:40.129238 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn_8f63caf2-3a84-4418-8c8c-486f9657e033/extract/0.log" Jul 18 04:05:40.152857 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:40.152809 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn_8f63caf2-3a84-4418-8c8c-486f9657e033/util/0.log" Jul 18 04:05:40.174479 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:40.174444 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lrvbn_8f63caf2-3a84-4418-8c8c-486f9657e033/pull/0.log" Jul 18 04:05:40.200532 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:40.200481 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z_6b467b5e-1621-4ccf-b9cb-a0508b90b9ae/extract/0.log" Jul 18 04:05:40.222079 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:40.222043 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z_6b467b5e-1621-4ccf-b9cb-a0508b90b9ae/util/0.log" Jul 18 04:05:40.250848 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:40.250800 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mfn7z_6b467b5e-1621-4ccf-b9cb-a0508b90b9ae/pull/0.log" Jul 18 04:05:40.285581 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:40.285549 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228_2bbea6b5-98a5-43bd-9360-9b161303e521/extract/0.log" Jul 18 04:05:40.310703 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:40.310669 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228_2bbea6b5-98a5-43bd-9360-9b161303e521/util/0.log" Jul 18 04:05:40.333479 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:40.333446 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tm228_2bbea6b5-98a5-43bd-9360-9b161303e521/pull/0.log" Jul 18 04:05:40.361240 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:40.361202 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn_a056882e-fb98-4525-8538-1c9cfdd1d4b6/extract/0.log" Jul 18 04:05:40.387929 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:40.387825 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn_a056882e-fb98-4525-8538-1c9cfdd1d4b6/util/0.log" Jul 18 04:05:40.411479 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:40.411420 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tffxn_a056882e-fb98-4525-8538-1c9cfdd1d4b6/pull/0.log" Jul 18 04:05:40.454738 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:40.454701 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-c86464669-8njsc_b9071075-cfb3-4b34-ab96-74a9b17fa33d/authorino/0.log" Jul 18 04:05:40.537145 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:40.537116 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6gpk8_8fd8d7d4-7837-40c4-8087-c8ec1d135185/kuadrant-console-plugin/0.log" Jul 18 04:05:40.666033 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:40.665929 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-q5dnd_e22c5671-0b7e-4203-9121-63cc8d36fb02/limitador/0.log" Jul 18 04:05:42.351889 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:42.351828 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2763ec4f-c61f-41cc-80ce-ba7159ef68e9/alertmanager/0.log" Jul 18 04:05:42.381789 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:42.381759 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2763ec4f-c61f-41cc-80ce-ba7159ef68e9/config-reloader/0.log" Jul 18 04:05:42.401258 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:42.401225 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2763ec4f-c61f-41cc-80ce-ba7159ef68e9/kube-rbac-proxy-web/0.log" Jul 18 04:05:42.423098 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:42.423057 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2763ec4f-c61f-41cc-80ce-ba7159ef68e9/kube-rbac-proxy/0.log" Jul 18 04:05:42.445775 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:42.445747 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2763ec4f-c61f-41cc-80ce-ba7159ef68e9/kube-rbac-proxy-metric/0.log" Jul 18 04:05:42.466353 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:42.466321 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2763ec4f-c61f-41cc-80ce-ba7159ef68e9/prom-label-proxy/0.log" Jul 18 04:05:42.486090 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:42.486050 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2763ec4f-c61f-41cc-80ce-ba7159ef68e9/init-config-reloader/0.log" Jul 18 04:05:42.527752 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:42.527715 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-jgfd4_a6be9298-a8db-40bf-ad68-451199795a99/cluster-monitoring-operator/0.log" Jul 18 04:05:42.639562 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:42.639524 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-hd2dk_23c5acf2-3fd9-4a50-a895-78d223c74651/monitoring-plugin/0.log" Jul 18 04:05:42.670376 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:42.670344 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4skkm_f67ef240-2ef0-4c46-8265-4ba4de3d2319/node-exporter/0.log" Jul 18 04:05:42.695546 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:42.695493 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4skkm_f67ef240-2ef0-4c46-8265-4ba4de3d2319/kube-rbac-proxy/0.log" Jul 18 04:05:42.713093 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:42.713042 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4skkm_f67ef240-2ef0-4c46-8265-4ba4de3d2319/init-textfile/0.log" Jul 18 04:05:43.309425 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:43.309392 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7546445765-kf497_061bee92-c378-4bb6-9a27-0ce8a9a16795/thanos-query/0.log" Jul 18 04:05:43.333210 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:43.333168 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7546445765-kf497_061bee92-c378-4bb6-9a27-0ce8a9a16795/kube-rbac-proxy-web/0.log" Jul 18 04:05:43.353301 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:43.353268 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7546445765-kf497_061bee92-c378-4bb6-9a27-0ce8a9a16795/kube-rbac-proxy/0.log" Jul 18 04:05:43.375247 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:43.375196 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7546445765-kf497_061bee92-c378-4bb6-9a27-0ce8a9a16795/prom-label-proxy/0.log" Jul 18 04:05:43.395966 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:43.395881 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7546445765-kf497_061bee92-c378-4bb6-9a27-0ce8a9a16795/kube-rbac-proxy-rules/0.log" Jul 18 04:05:43.416863 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:43.416821 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7546445765-kf497_061bee92-c378-4bb6-9a27-0ce8a9a16795/kube-rbac-proxy-metrics/0.log" Jul 18 04:05:44.669951 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:44.669903 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-77mmr_f2341662-76e0-4fcd-bd08-f9aa4128746b/networking-console-plugin/0.log" Jul 18 04:05:45.295116 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:45.295087 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kfkfb_77a41d30-764b-40f0-9e8d-35b4f6f87009/console-operator/1.log" Jul 18 04:05:45.300534 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:45.300493 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kfkfb_77a41d30-764b-40f0-9e8d-35b4f6f87009/console-operator/2.log" Jul 18 04:05:45.839167 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:45.839138 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-766dc8b5fc-gfs8l_32981299-3df7-4fcf-91d7-07246e4a0083/console/0.log" Jul 18 04:05:45.872307 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:45.872269 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2q2dr/perf-node-gather-daemonset-qs6mw"] Jul 18 04:05:45.877918 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:45.877887 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-qs6mw" Jul 18 04:05:45.883447 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:45.883409 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2q2dr/perf-node-gather-daemonset-qs6mw"] Jul 18 04:05:45.965451 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:45.965225 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0e55695-a476-40aa-bfbf-0ac23daf4664-lib-modules\") pod \"perf-node-gather-daemonset-qs6mw\" (UID: \"f0e55695-a476-40aa-bfbf-0ac23daf4664\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-qs6mw" Jul 18 04:05:45.965451 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:45.965346 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0e55695-a476-40aa-bfbf-0ac23daf4664-sys\") pod \"perf-node-gather-daemonset-qs6mw\" (UID: \"f0e55695-a476-40aa-bfbf-0ac23daf4664\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-qs6mw" Jul 18 04:05:45.965451 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:45.965380 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f0e55695-a476-40aa-bfbf-0ac23daf4664-proc\") pod \"perf-node-gather-daemonset-qs6mw\" (UID: \"f0e55695-a476-40aa-bfbf-0ac23daf4664\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-qs6mw" Jul 18 04:05:45.965451 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:45.965416 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f0e55695-a476-40aa-bfbf-0ac23daf4664-podres\") pod \"perf-node-gather-daemonset-qs6mw\" (UID: \"f0e55695-a476-40aa-bfbf-0ac23daf4664\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-qs6mw" Jul 18 04:05:45.965820 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:45.965476 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdszh\" (UniqueName: \"kubernetes.io/projected/f0e55695-a476-40aa-bfbf-0ac23daf4664-kube-api-access-zdszh\") pod \"perf-node-gather-daemonset-qs6mw\" (UID: \"f0e55695-a476-40aa-bfbf-0ac23daf4664\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-qs6mw" Jul 18 04:05:46.066633 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:46.066591 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0e55695-a476-40aa-bfbf-0ac23daf4664-sys\") pod \"perf-node-gather-daemonset-qs6mw\" (UID: \"f0e55695-a476-40aa-bfbf-0ac23daf4664\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-qs6mw" Jul 18 04:05:46.066825 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:46.066648 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f0e55695-a476-40aa-bfbf-0ac23daf4664-proc\") pod \"perf-node-gather-daemonset-qs6mw\" (UID: \"f0e55695-a476-40aa-bfbf-0ac23daf4664\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-qs6mw" Jul 18 04:05:46.066825 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:46.066679 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f0e55695-a476-40aa-bfbf-0ac23daf4664-podres\") pod \"perf-node-gather-daemonset-qs6mw\" (UID: \"f0e55695-a476-40aa-bfbf-0ac23daf4664\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-qs6mw" Jul 18 04:05:46.066825 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:46.066705 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdszh\" (UniqueName: \"kubernetes.io/projected/f0e55695-a476-40aa-bfbf-0ac23daf4664-kube-api-access-zdszh\") pod \"perf-node-gather-daemonset-qs6mw\" (UID: \"f0e55695-a476-40aa-bfbf-0ac23daf4664\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-qs6mw" Jul 18 04:05:46.066825 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:46.066769 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0e55695-a476-40aa-bfbf-0ac23daf4664-lib-modules\") pod \"perf-node-gather-daemonset-qs6mw\" (UID: \"f0e55695-a476-40aa-bfbf-0ac23daf4664\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-qs6mw" Jul 18 04:05:46.067064 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:46.067006 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0e55695-a476-40aa-bfbf-0ac23daf4664-lib-modules\") pod \"perf-node-gather-daemonset-qs6mw\" (UID: \"f0e55695-a476-40aa-bfbf-0ac23daf4664\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-qs6mw" Jul 18 04:05:46.067118 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:46.067066 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0e55695-a476-40aa-bfbf-0ac23daf4664-sys\") pod \"perf-node-gather-daemonset-qs6mw\" (UID: \"f0e55695-a476-40aa-bfbf-0ac23daf4664\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-qs6mw" Jul 18 04:05:46.067173 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:46.067116 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f0e55695-a476-40aa-bfbf-0ac23daf4664-proc\") pod \"perf-node-gather-daemonset-qs6mw\" (UID: \"f0e55695-a476-40aa-bfbf-0ac23daf4664\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-qs6mw" Jul 18 04:05:46.067230 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:46.067191 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f0e55695-a476-40aa-bfbf-0ac23daf4664-podres\") pod \"perf-node-gather-daemonset-qs6mw\" (UID: \"f0e55695-a476-40aa-bfbf-0ac23daf4664\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-qs6mw" Jul 18 04:05:46.075597 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:46.075552 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdszh\" (UniqueName: \"kubernetes.io/projected/f0e55695-a476-40aa-bfbf-0ac23daf4664-kube-api-access-zdszh\") pod \"perf-node-gather-daemonset-qs6mw\" (UID: \"f0e55695-a476-40aa-bfbf-0ac23daf4664\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-qs6mw" Jul 18 04:05:46.192753 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:46.192705 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-qs6mw" Jul 18 04:05:46.387702 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:46.387112 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2q2dr/perf-node-gather-daemonset-qs6mw"] Jul 18 04:05:46.387702 ip-10-0-138-224 kubenswrapper[2558]: W0718 04:05:46.387630 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf0e55695_a476_40aa_bfbf_0ac23daf4664.slice/crio-3c3c657e960e194b1da880026a40b1d6b2daf231e13b1d59bbe419d46b5347f6 WatchSource:0}: Error finding container 3c3c657e960e194b1da880026a40b1d6b2daf231e13b1d59bbe419d46b5347f6: Status 404 returned error can't find the container with id 3c3c657e960e194b1da880026a40b1d6b2daf231e13b1d59bbe419d46b5347f6 Jul 18 04:05:46.608248 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:46.608216 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-7gngv_4689e3a1-9fac-4e73-86c9-5c3a73ef7eb4/volume-data-source-validator/0.log" Jul 18 04:05:47.299720 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:47.299635 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-qs6mw" event={"ID":"f0e55695-a476-40aa-bfbf-0ac23daf4664","Type":"ContainerStarted","Data":"120d99449c969bf9e613bfc30b017831b6b6f1fa3f54a60823036997cf9e4cee"} Jul 18 04:05:47.300201 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:47.299764 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-qs6mw" event={"ID":"f0e55695-a476-40aa-bfbf-0ac23daf4664","Type":"ContainerStarted","Data":"3c3c657e960e194b1da880026a40b1d6b2daf231e13b1d59bbe419d46b5347f6"} Jul 18 04:05:47.300201 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:47.299799 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-qs6mw" Jul 18 04:05:47.316686 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:47.316625 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-qs6mw" podStartSLOduration=2.316604447 podStartE2EDuration="2.316604447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 04:05:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:05:47.314714267 +0000 UTC m=+948.076347902" watchObservedRunningTime="2026-07-18 04:05:47.316604447 +0000 UTC m=+948.078238080" Jul 18 04:05:47.632086 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:47.632052 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-njlzd_2ed19b61-20f5-4efa-b877-e3b733109b6f/dns/0.log" Jul 18 04:05:47.650582 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:47.650554 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-njlzd_2ed19b61-20f5-4efa-b877-e3b733109b6f/kube-rbac-proxy/0.log" Jul 18 04:05:47.734135 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:47.734105 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l94vd_6f0209eb-dee6-49e8-85c5-55a211a0f069/dns-node-resolver/0.log" Jul 18 04:05:48.313272 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:48.313243 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x92wq_8434d441-42df-4bd3-9f63-9d5a4d3f1521/node-ca/0.log" Jul 18 04:05:49.259437 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:49.259401 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85c5cf7cfd-czh97_c98c55ac-695d-4d25-ad7c-f38d1b4da1ea/kube-auth-proxy/0.log" Jul 18 04:05:49.977667 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:49.977618 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9czfx_46e600e7-76a1-49e4-bcd7-00c1caaaf2e0/serve-healthcheck-canary/0.log" Jul 18 04:05:50.550750 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:50.550681 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lcwxm_b495171b-e4dc-4857-91cd-ef47ece9e51d/kube-rbac-proxy/0.log" Jul 18 04:05:50.569099 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:50.569064 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lcwxm_b495171b-e4dc-4857-91cd-ef47ece9e51d/exporter/0.log" Jul 18 04:05:50.592306 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:50.592273 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lcwxm_b495171b-e4dc-4857-91cd-ef47ece9e51d/extractor/0.log" Jul 18 04:05:52.835250 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:52.835209 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-s8p9r_6bcc5736-fa15-4656-9f8b-599811d2d1ee/manager/0.log" Jul 18 04:05:52.906792 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:52.906760 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f994c8d8-k2pcg_34733b92-fcd1-4ea3-89c2-58c893425e8c/manager/0.log" Jul 18 04:05:52.923754 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:52.923726 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f994c8d8-k2pcg_34733b92-fcd1-4ea3-89c2-58c893425e8c/copy-manifests/0.log" Jul 18 04:05:53.322143 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:53.322019 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-qs6mw" Jul 18 04:05:54.122962 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:54.122899 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6df5b785c7-f4rzs_23bc6faa-28a4-4b43-aab1-8a6c40ad8ae6/manager/0.log" Jul 18 04:05:54.148578 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:54.148548 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-vsv42_646b96cc-f2ab-46b6-8e24-a8b4845b993b/openshift-lws-operator/0.log" Jul 18 04:05:56.335564 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:56.335468 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85c5cf7cfd-czh97_c98c55ac-695d-4d25-ad7c-f38d1b4da1ea/kube-auth-proxy/0.log" Jul 18 04:05:57.772753 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:57.772725 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85c5cf7cfd-czh97_c98c55ac-695d-4d25-ad7c-f38d1b4da1ea/kube-auth-proxy/0.log" Jul 18 04:05:59.377428 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:59.377390 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-n2b9n_3cdbb382-6147-4cc7-887d-96a4650fe81c/migrator/0.log" Jul 18 04:05:59.394798 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:59.394764 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-n2b9n_3cdbb382-6147-4cc7-887d-96a4650fe81c/graceful-termination/0.log" Jul 18 04:05:59.734618 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:59.734543 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-9sclg_9ab82b85-02c2-4fa0-9a5a-2bced519bf92/kube-storage-version-migrator-operator/1.log" Jul 18 04:05:59.736239 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:05:59.736213 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-9sclg_9ab82b85-02c2-4fa0-9a5a-2bced519bf92/kube-storage-version-migrator-operator/0.log" Jul 18 04:06:00.677743 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:06:00.677709 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4srql_6e77f13c-e59f-4453-b512-73bb702f5b6e/kube-multus-additional-cni-plugins/0.log" Jul 18 04:06:00.696890 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:06:00.696861 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4srql_6e77f13c-e59f-4453-b512-73bb702f5b6e/egress-router-binary-copy/0.log" Jul 18 04:06:00.717214 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:06:00.717188 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4srql_6e77f13c-e59f-4453-b512-73bb702f5b6e/cni-plugins/0.log" Jul 18 04:06:00.735616 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:06:00.735578 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4srql_6e77f13c-e59f-4453-b512-73bb702f5b6e/bond-cni-plugin/0.log" Jul 18 04:06:00.770874 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:06:00.770846 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4srql_6e77f13c-e59f-4453-b512-73bb702f5b6e/routeoverride-cni/0.log" Jul 18 04:06:00.790314 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:06:00.790277 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4srql_6e77f13c-e59f-4453-b512-73bb702f5b6e/whereabouts-cni-bincopy/0.log" Jul 18 04:06:00.808651 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:06:00.808627 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4srql_6e77f13c-e59f-4453-b512-73bb702f5b6e/whereabouts-cni/0.log" Jul 18 04:06:01.153236 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:06:01.153201 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-f66jw_2824c8d5-c431-4f95-9219-f9969dc5907a/kube-multus/0.log" Jul 18 04:06:01.238236 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:06:01.238204 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f8944_15496aee-38ed-4f76-b18f-b84cd34b2dc9/network-metrics-daemon/0.log" Jul 18 04:06:01.255925 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:06:01.255896 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f8944_15496aee-38ed-4f76-b18f-b84cd34b2dc9/kube-rbac-proxy/0.log" Jul 18 04:06:02.113702 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:06:02.113670 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4f9kj_b8f0a789-ad90-4aee-9a37-c63373aaf151/ovn-controller/0.log" Jul 18 04:06:02.128684 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:06:02.128653 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4f9kj_b8f0a789-ad90-4aee-9a37-c63373aaf151/ovn-acl-logging/0.log" Jul 18 04:06:02.159724 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:06:02.159694 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4f9kj_b8f0a789-ad90-4aee-9a37-c63373aaf151/kube-rbac-proxy-node/0.log" Jul 18 04:06:02.187898 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:06:02.187864 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4f9kj_b8f0a789-ad90-4aee-9a37-c63373aaf151/kube-rbac-proxy-ovn-metrics/0.log" Jul 18 04:06:02.203082 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:06:02.203048 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4f9kj_b8f0a789-ad90-4aee-9a37-c63373aaf151/northd/0.log" Jul 18 04:06:02.222626 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:06:02.222584 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4f9kj_b8f0a789-ad90-4aee-9a37-c63373aaf151/nbdb/0.log" Jul 18 04:06:02.260214 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:06:02.260189 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4f9kj_b8f0a789-ad90-4aee-9a37-c63373aaf151/sbdb/0.log" Jul 18 04:06:02.360850 ip-10-0-138-224 kubenswrapper[2558]: I0718 04:06:02.360813 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4f9kj_b8f0a789-ad90-4aee-9a37-c63373aaf151/ovnkube-controller/0.log"