Jul 06 22:09:00.029147 ip-10-0-137-47 systemd[1]: Starting Kubernetes Kubelet... Jul 06 22:09:00.479135 ip-10-0-137-47 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 22:09:00.479135 ip-10-0-137-47 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 22:09:00.479135 ip-10-0-137-47 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 22:09:00.479135 ip-10-0-137-47 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 22:09:00.479135 ip-10-0-137-47 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 22:09:00.479135 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.474704 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 22:09:00.495496 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485003 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:09:00.495496 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485021 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:09:00.495496 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485026 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:09:00.495496 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485030 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:09:00.495496 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485034 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:09:00.495496 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485037 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:09:00.495496 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485040 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:09:00.495496 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485042 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:09:00.495496 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485045 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:09:00.495496 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485048 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:09:00.495496 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485053 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:09:00.495496 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485057 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:09:00.495496 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485061 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:09:00.495496 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485064 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:09:00.495496 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485066 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:09:00.495496 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485069 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:09:00.495496 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485072 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:09:00.495496 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485074 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:09:00.495496 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485077 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:09:00.497358 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485080 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:09:00.497358 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485082 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:09:00.497358 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485085 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:09:00.497358 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485088 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:09:00.497358 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485090 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:09:00.497358 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485093 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:09:00.497358 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485095 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:09:00.497358 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485098 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:09:00.497358 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485101 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:09:00.497358 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485104 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:09:00.497358 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485107 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:09:00.497358 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485110 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:09:00.497358 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485112 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:09:00.497358 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485118 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:09:00.497358 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485122 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:09:00.497358 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485125 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:09:00.497358 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485128 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:09:00.497358 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485130 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:09:00.497358 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485133 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:09:00.497358 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485135 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:09:00.509982 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485138 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:09:00.509982 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485141 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:09:00.509982 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485143 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:09:00.509982 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485146 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:09:00.509982 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485148 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:09:00.509982 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485151 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:09:00.509982 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485153 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:09:00.509982 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485156 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:09:00.509982 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485158 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:09:00.509982 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485160 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:09:00.509982 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485164 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:09:00.509982 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485167 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:09:00.509982 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485171 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:09:00.509982 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485174 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:09:00.509982 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485177 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:09:00.509982 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485179 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:09:00.509982 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485182 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:09:00.509982 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485184 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:09:00.509982 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485186 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:09:00.511874 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485189 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:09:00.511874 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485191 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:09:00.511874 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485194 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:09:00.511874 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485197 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:09:00.511874 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485200 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:09:00.511874 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485202 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:09:00.511874 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485206 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:09:00.511874 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485209 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:09:00.511874 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485211 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:09:00.511874 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485214 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:09:00.511874 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485217 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:09:00.511874 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485219 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:09:00.511874 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485222 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:09:00.511874 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485224 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:09:00.511874 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485227 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:09:00.511874 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485230 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:09:00.511874 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485232 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:09:00.511874 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485235 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:09:00.511874 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485237 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:09:00.514279 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485240 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:09:00.514279 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485243 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:09:00.514279 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485246 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:09:00.514279 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485248 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:09:00.514279 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485251 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:09:00.514279 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485254 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:09:00.514279 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485257 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:09:00.514279 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485262 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:09:00.514279 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485265 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:09:00.514279 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485271 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:09:00.514279 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485274 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:09:00.514279 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485277 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:09:00.514279 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485279 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:09:00.514279 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485282 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:09:00.514279 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485285 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:09:00.514279 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485288 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:09:00.514279 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485290 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:09:00.514279 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485293 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:09:00.514279 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485295 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:09:00.514279 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485298 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:09:00.529619 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485300 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:09:00.529619 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.485303 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:09:00.529619 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486070 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:09:00.529619 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486081 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:09:00.529619 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486084 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:09:00.529619 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486086 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:09:00.529619 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486089 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:09:00.529619 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486092 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:09:00.529619 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486094 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:09:00.529619 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486097 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:09:00.529619 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486099 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:09:00.529619 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486102 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:09:00.529619 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486104 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:09:00.529619 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486107 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:09:00.529619 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486110 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:09:00.529619 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486113 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:09:00.529619 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486116 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:09:00.529619 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486118 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:09:00.529619 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486121 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:09:00.529619 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486124 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:09:00.531918 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486127 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:09:00.531918 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486130 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:09:00.531918 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486132 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:09:00.531918 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486135 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:09:00.531918 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486137 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:09:00.531918 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486140 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:09:00.531918 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486142 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:09:00.531918 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486145 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:09:00.531918 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486147 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:09:00.531918 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486150 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:09:00.531918 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486152 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:09:00.531918 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486155 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:09:00.531918 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486157 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:09:00.531918 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486159 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:09:00.531918 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486162 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:09:00.531918 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486165 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:09:00.531918 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486168 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:09:00.531918 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486171 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:09:00.531918 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486173 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:09:00.531918 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486176 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:09:00.533646 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486179 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:09:00.533646 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486181 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:09:00.533646 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486184 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:09:00.533646 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486186 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:09:00.533646 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486189 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:09:00.533646 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486191 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:09:00.533646 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486193 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:09:00.533646 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486196 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:09:00.533646 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486198 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:09:00.533646 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486201 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:09:00.533646 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486204 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:09:00.533646 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486207 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:09:00.533646 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486210 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:09:00.533646 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486213 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:09:00.533646 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486215 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:09:00.533646 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486217 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:09:00.533646 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486220 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:09:00.533646 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486222 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:09:00.533646 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486224 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:09:00.533646 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486227 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:09:00.535964 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486229 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:09:00.535964 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486232 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:09:00.535964 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486237 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:09:00.535964 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486242 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:09:00.535964 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486245 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:09:00.535964 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486247 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:09:00.535964 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486250 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:09:00.535964 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486253 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:09:00.535964 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486256 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:09:00.535964 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486259 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:09:00.535964 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486262 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:09:00.535964 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486266 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:09:00.535964 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486269 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:09:00.535964 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486272 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:09:00.535964 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486276 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:09:00.535964 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486279 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:09:00.535964 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486282 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:09:00.535964 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486285 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:09:00.535964 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486288 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:09:00.549598 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486290 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:09:00.549598 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486295 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:09:00.549598 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486297 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:09:00.549598 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486300 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:09:00.549598 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486302 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:09:00.549598 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486305 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:09:00.549598 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486308 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:09:00.549598 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486310 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:09:00.549598 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486313 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:09:00.549598 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486317 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:09:00.549598 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486319 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:09:00.549598 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486322 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:09:00.549598 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486325 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:09:00.549598 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486327 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:09:00.549598 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486330 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:09:00.549598 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486332 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:09:00.549598 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486337 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:09:00.549598 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486340 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:09:00.549598 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486342 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:09:00.552122 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486345 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:09:00.552122 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486348 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:09:00.552122 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486350 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:09:00.552122 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486742 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:09:00.552122 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486746 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:09:00.552122 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486750 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:09:00.552122 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486752 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:09:00.552122 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486757 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:09:00.552122 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486760 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:09:00.552122 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486764 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:09:00.552122 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486767 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:09:00.552122 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486770 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:09:00.552122 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486772 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:09:00.552122 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486775 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:09:00.552122 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486779 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:09:00.552122 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486782 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:09:00.552122 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486784 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:09:00.552122 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486787 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:09:00.553950 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486791 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:09:00.553950 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486795 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:09:00.553950 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486798 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:09:00.553950 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486801 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:09:00.553950 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486803 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:09:00.553950 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486806 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:09:00.553950 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486808 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:09:00.553950 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486811 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:09:00.553950 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486814 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:09:00.553950 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486816 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:09:00.553950 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486819 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:09:00.553950 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486823 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:09:00.553950 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486825 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:09:00.553950 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486828 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:09:00.553950 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486831 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:09:00.553950 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486833 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:09:00.553950 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486836 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:09:00.553950 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486838 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:09:00.553950 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486861 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:09:00.553950 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486864 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:09:00.556332 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486866 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:09:00.556332 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486869 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:09:00.556332 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486872 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:09:00.556332 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486874 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:09:00.556332 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486876 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:09:00.556332 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486879 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:09:00.556332 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486881 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:09:00.556332 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486889 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:09:00.556332 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486893 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:09:00.556332 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486895 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:09:00.556332 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486898 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:09:00.556332 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486900 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:09:00.556332 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486903 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:09:00.556332 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486905 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:09:00.556332 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486908 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:09:00.556332 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486911 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:09:00.556332 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486913 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:09:00.556332 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486916 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:09:00.556332 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486918 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:09:00.631261 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486921 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:09:00.631261 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486923 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:09:00.631261 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486926 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:09:00.631261 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486928 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:09:00.631261 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486932 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:09:00.631261 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486934 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:09:00.631261 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486937 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:09:00.631261 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486939 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:09:00.631261 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486942 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:09:00.631261 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486944 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:09:00.631261 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486946 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:09:00.631261 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486949 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:09:00.631261 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486951 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:09:00.631261 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486954 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:09:00.631261 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486956 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:09:00.631261 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486958 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:09:00.631261 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486961 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:09:00.631261 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486964 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:09:00.631261 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486966 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:09:00.562145 ip-10-0-137-47 systemd[1]: Started Kubernetes Kubelet. Jul 06 22:09:00.795639 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486969 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:09:00.795639 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486971 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:09:00.795639 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486975 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:09:00.795639 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486977 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:09:00.795639 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486980 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:09:00.795639 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486982 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:09:00.795639 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486985 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:09:00.795639 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486987 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:09:00.795639 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486990 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:09:00.795639 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486993 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:09:00.795639 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486996 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:09:00.795639 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.486998 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:09:00.795639 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487000 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:09:00.795639 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487003 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:09:00.795639 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487005 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:09:00.795639 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487007 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:09:00.795639 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487010 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:09:00.795639 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487014 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:09:00.795639 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487016 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:09:00.795639 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487020 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:09:00.795639 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487023 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:09:00.818662 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487026 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:09:00.818662 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487028 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:09:00.818662 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487031 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:09:00.818662 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487033 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:09:00.818662 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487036 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:09:00.818662 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487107 2566 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 22:09:00.818662 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487120 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 22:09:00.818662 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487126 2566 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 22:09:00.818662 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487131 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 22:09:00.818662 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487135 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 22:09:00.818662 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487138 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 22:09:00.818662 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487142 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 22:09:00.818662 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487161 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 22:09:00.818662 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487165 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 22:09:00.818662 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487168 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 22:09:00.818662 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487171 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 22:09:00.818662 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487174 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 22:09:00.818662 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487178 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 22:09:00.818662 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487181 2566 flags.go:64] FLAG: --cgroup-root="" Jul 06 22:09:00.818662 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487183 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 22:09:00.818662 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487186 2566 flags.go:64] FLAG: --client-ca-file="" Jul 06 22:09:00.818662 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487189 2566 flags.go:64] FLAG: --cloud-provider="external" Jul 06 22:09:00.818662 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487192 2566 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 22:09:00.819669 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487196 2566 flags.go:64] FLAG: --cluster-domain="" Jul 06 22:09:00.819669 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487199 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 22:09:00.819669 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487202 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 22:09:00.819669 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487205 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 22:09:00.819669 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487208 2566 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 22:09:00.819669 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487213 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 22:09:00.819669 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487216 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 22:09:00.819669 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487219 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 22:09:00.819669 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487222 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 22:09:00.819669 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487225 2566 flags.go:64] FLAG: --contention-profiling="false" Jul 06 22:09:00.819669 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487228 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 22:09:00.819669 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487231 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 22:09:00.819669 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487234 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 22:09:00.819669 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487237 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 22:09:00.819669 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487241 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 22:09:00.819669 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487244 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 22:09:00.819669 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487247 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 22:09:00.819669 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487249 2566 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 22:09:00.819669 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487252 2566 flags.go:64] FLAG: --enable-server="true" Jul 06 22:09:00.819669 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487255 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 22:09:00.819669 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487262 2566 flags.go:64] FLAG: --event-burst="100" Jul 06 22:09:00.819669 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487265 2566 flags.go:64] FLAG: --event-qps="50" Jul 06 22:09:00.819669 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487269 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 22:09:00.819669 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487272 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 22:09:00.820634 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487275 2566 flags.go:64] FLAG: --eviction-hard="" Jul 06 22:09:00.820634 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487279 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 22:09:00.820634 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487282 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 22:09:00.820634 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487285 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 22:09:00.820634 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487288 2566 flags.go:64] FLAG: --eviction-soft="" Jul 06 22:09:00.820634 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487291 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 22:09:00.820634 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487294 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 22:09:00.820634 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487298 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 22:09:00.820634 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487301 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 22:09:00.820634 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487304 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 22:09:00.820634 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487306 2566 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 22:09:00.820634 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487309 2566 flags.go:64] FLAG: --feature-gates="" Jul 06 22:09:00.820634 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487313 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 22:09:00.820634 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487317 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 22:09:00.820634 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487320 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 22:09:00.820634 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487324 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 22:09:00.820634 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487327 2566 flags.go:64] FLAG: --healthz-port="10248" Jul 06 22:09:00.820634 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487329 2566 flags.go:64] FLAG: --help="false" Jul 06 22:09:00.820634 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487332 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-137-47.ec2.internal" Jul 06 22:09:00.820634 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487335 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 22:09:00.820634 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487338 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 22:09:00.820634 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487341 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 22:09:00.820634 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487344 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 22:09:00.820634 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487348 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 22:09:00.821448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487351 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 22:09:00.821448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487353 2566 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 22:09:00.821448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487356 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 22:09:00.821448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487359 2566 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 22:09:00.821448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487362 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 22:09:00.821448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487365 2566 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 22:09:00.821448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487368 2566 flags.go:64] FLAG: --kube-reserved="" Jul 06 22:09:00.821448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487371 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 22:09:00.821448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487374 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 22:09:00.821448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487377 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 22:09:00.821448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487380 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 22:09:00.821448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487382 2566 flags.go:64] FLAG: --lock-file="" Jul 06 22:09:00.821448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487385 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 22:09:00.821448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487388 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 22:09:00.821448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487391 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 22:09:00.821448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487396 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 22:09:00.821448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487399 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 22:09:00.821448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487402 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 22:09:00.821448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487405 2566 flags.go:64] FLAG: --logging-format="text" Jul 06 22:09:00.821448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487408 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 22:09:00.821448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487411 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 22:09:00.821448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487415 2566 flags.go:64] FLAG: --manifest-url="" Jul 06 22:09:00.821448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487418 2566 flags.go:64] FLAG: --manifest-url-header="" Jul 06 22:09:00.821448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487423 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 22:09:00.821448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487426 2566 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 22:09:00.822295 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487430 2566 flags.go:64] FLAG: --max-pods="110" Jul 06 22:09:00.822295 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487433 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 22:09:00.822295 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487436 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 22:09:00.822295 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487439 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 22:09:00.822295 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487442 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 22:09:00.822295 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487445 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 22:09:00.822295 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487448 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 22:09:00.822295 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487450 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 22:09:00.822295 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487457 2566 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 22:09:00.822295 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487461 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 22:09:00.822295 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487464 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 22:09:00.822295 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487466 2566 flags.go:64] FLAG: --pod-cidr="" Jul 06 22:09:00.822295 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487469 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 22:09:00.822295 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487477 2566 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 22:09:00.822295 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487480 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 22:09:00.822295 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487482 2566 flags.go:64] FLAG: --pods-per-core="0" Jul 06 22:09:00.822295 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487485 2566 flags.go:64] FLAG: --port="10250" Jul 06 22:09:00.822295 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487488 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 22:09:00.822295 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487491 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02b14d8d8bae61625" Jul 06 22:09:00.822295 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487494 2566 flags.go:64] FLAG: --qos-reserved="" Jul 06 22:09:00.822295 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487497 2566 flags.go:64] FLAG: --read-only-port="10255" Jul 06 22:09:00.822295 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487499 2566 flags.go:64] FLAG: --register-node="true" Jul 06 22:09:00.822295 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487502 2566 flags.go:64] FLAG: --register-with-taints="" Jul 06 22:09:00.822295 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487506 2566 flags.go:64] FLAG: --registry-burst="10" Jul 06 22:09:00.823194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487509 2566 flags.go:64] FLAG: --registry-qps="5" Jul 06 22:09:00.823194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487512 2566 flags.go:64] FLAG: --reserved-cpus="" Jul 06 22:09:00.823194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487515 2566 flags.go:64] FLAG: --reserved-memory="" Jul 06 22:09:00.823194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487518 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 22:09:00.823194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487521 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 22:09:00.823194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487527 2566 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 22:09:00.823194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487529 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 22:09:00.823194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487532 2566 flags.go:64] FLAG: --runonce="false" Jul 06 22:09:00.823194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487535 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 22:09:00.823194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487538 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 22:09:00.823194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487541 2566 flags.go:64] FLAG: --seccomp-default="false" Jul 06 22:09:00.823194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487543 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 22:09:00.823194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487546 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 22:09:00.823194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487549 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 22:09:00.823194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487552 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 22:09:00.823194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487555 2566 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 22:09:00.823194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487558 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 22:09:00.823194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487564 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 22:09:00.823194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487567 2566 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 22:09:00.823194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487570 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 22:09:00.823194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487573 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 22:09:00.823194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487577 2566 flags.go:64] FLAG: --system-cgroups="" Jul 06 22:09:00.823194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487580 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 22:09:00.823194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487585 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 22:09:00.823194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487588 2566 flags.go:64] FLAG: --tls-cert-file="" Jul 06 22:09:00.827250 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487591 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 22:09:00.827250 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487595 2566 flags.go:64] FLAG: --tls-min-version="" Jul 06 22:09:00.827250 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487597 2566 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 22:09:00.827250 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487600 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 22:09:00.827250 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487603 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 22:09:00.827250 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487606 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 22:09:00.827250 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487608 2566 flags.go:64] FLAG: --v="2" Jul 06 22:09:00.827250 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487612 2566 flags.go:64] FLAG: --version="false" Jul 06 22:09:00.827250 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487617 2566 flags.go:64] FLAG: --vmodule="" Jul 06 22:09:00.827250 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487620 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 22:09:00.827250 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.487623 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 22:09:00.827250 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487736 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:09:00.827250 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487742 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:09:00.827250 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487745 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:09:00.827250 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487748 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:09:00.827250 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487751 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:09:00.827250 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487754 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:09:00.827250 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487756 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:09:00.827250 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487759 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:09:00.827250 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487762 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:09:00.827250 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487764 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:09:00.827250 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487767 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:09:00.828274 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487769 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:09:00.828274 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487772 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:09:00.828274 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487774 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:09:00.828274 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487777 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:09:00.828274 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487780 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:09:00.828274 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487782 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:09:00.828274 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487787 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:09:00.828274 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487789 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:09:00.828274 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487792 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:09:00.828274 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487795 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:09:00.828274 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487797 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:09:00.828274 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487799 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:09:00.828274 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487802 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:09:00.828274 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487804 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:09:00.828274 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487807 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:09:00.828274 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487809 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:09:00.828274 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487812 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:09:00.828274 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487815 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:09:00.828274 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487817 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:09:00.830271 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487820 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:09:00.830271 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487822 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:09:00.830271 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487825 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:09:00.830271 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487829 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:09:00.830271 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487831 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:09:00.830271 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487834 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:09:00.830271 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487836 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:09:00.830271 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487857 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:09:00.830271 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487860 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:09:00.830271 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487863 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:09:00.830271 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487866 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:09:00.830271 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487868 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:09:00.830271 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487871 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:09:00.830271 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487874 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:09:00.830271 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487876 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:09:00.830271 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487881 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:09:00.830271 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487885 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:09:00.830271 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487888 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:09:00.830271 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487891 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:09:00.830271 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487895 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:09:00.832420 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487898 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:09:00.832420 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487900 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:09:00.832420 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487903 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:09:00.832420 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487905 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:09:00.832420 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487908 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:09:00.832420 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487910 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:09:00.832420 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487913 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:09:00.832420 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487915 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:09:00.832420 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487918 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:09:00.832420 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487920 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:09:00.832420 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487923 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:09:00.832420 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487925 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:09:00.832420 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487927 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:09:00.832420 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487931 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:09:00.832420 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487934 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:09:00.832420 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487938 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:09:00.832420 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487942 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:09:00.832420 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487945 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:09:00.832420 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487947 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:09:00.832420 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487950 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:09:00.835038 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487952 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:09:00.835038 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487955 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:09:00.835038 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487957 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:09:00.835038 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487960 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:09:00.835038 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487962 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:09:00.835038 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487965 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:09:00.835038 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487967 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:09:00.835038 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487970 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:09:00.835038 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487972 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:09:00.835038 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487974 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:09:00.835038 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487977 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:09:00.835038 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487980 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:09:00.835038 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487994 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:09:00.835038 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487997 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:09:00.835038 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.487999 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:09:00.835038 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.488002 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:09:00.835038 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.488005 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:09:00.835038 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.488007 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:09:00.835038 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.488010 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:09:00.835038 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.488012 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:09:00.836551 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.488015 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:09:00.836551 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.488017 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:09:00.836551 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.488020 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:09:00.836551 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.488022 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:09:00.836551 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.488025 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:09:00.836551 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.488028 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:09:00.836551 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.488032 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:09:00.836551 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.488036 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:09:00.836551 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.488039 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:09:00.836551 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.488612 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 22:09:00.836551 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.497165 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 22:09:00.836551 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.497182 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 22:09:00.836551 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.498030 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 22:09:00.836551 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.498039 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 22:09:00.836551 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498126 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:09:00.837381 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498133 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:09:00.837381 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498136 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:09:00.837381 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498139 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:09:00.837381 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498142 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:09:00.837381 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498145 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:09:00.837381 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498148 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:09:00.837381 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498151 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:09:00.837381 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498154 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:09:00.837381 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498156 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:09:00.837381 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498159 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:09:00.837381 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498161 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:09:00.837381 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498164 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:09:00.837381 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498166 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:09:00.837381 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498169 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:09:00.837381 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498171 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:09:00.837381 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498174 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:09:00.837381 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498177 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:09:00.837381 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498179 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:09:00.837381 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498182 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:09:00.837381 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498185 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:09:00.839465 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498188 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:09:00.839465 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498190 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:09:00.839465 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498192 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:09:00.839465 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498201 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:09:00.839465 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498204 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:09:00.839465 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498207 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:09:00.839465 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498210 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:09:00.839465 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498212 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:09:00.839465 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498215 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:09:00.839465 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498217 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:09:00.839465 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498220 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:09:00.839465 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498222 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:09:00.839465 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498225 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:09:00.839465 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498227 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:09:00.839465 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498230 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:09:00.839465 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498232 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:09:00.839465 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498235 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:09:00.839465 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498238 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:09:00.839465 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498240 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:09:00.839465 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498243 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:09:00.840580 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498246 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:09:00.840580 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498250 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:09:00.840580 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498254 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:09:00.840580 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498256 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:09:00.840580 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498259 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:09:00.840580 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498261 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:09:00.840580 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498264 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:09:00.840580 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498267 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:09:00.840580 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498269 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:09:00.840580 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498271 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:09:00.840580 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498274 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:09:00.840580 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498276 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:09:00.840580 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498279 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:09:00.840580 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498281 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:09:00.840580 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498284 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:09:00.840580 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498286 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:09:00.840580 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498294 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:09:00.840580 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498297 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:09:00.840580 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498300 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:09:00.840580 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498302 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:09:00.842242 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498304 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:09:00.842242 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498307 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:09:00.842242 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498310 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:09:00.842242 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498312 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:09:00.842242 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498314 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:09:00.842242 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498317 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:09:00.842242 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498319 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:09:00.842242 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498322 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:09:00.842242 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498324 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:09:00.842242 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498327 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:09:00.842242 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498329 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:09:00.842242 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498332 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:09:00.842242 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498334 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:09:00.842242 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498337 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:09:00.842242 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498341 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:09:00.842242 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498344 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:09:00.842242 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498347 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:09:00.842242 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498351 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:09:00.842242 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498355 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:09:00.843775 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498357 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:09:00.843775 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498360 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:09:00.843775 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498366 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:09:00.843775 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498369 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:09:00.843775 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498371 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:09:00.843775 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498374 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:09:00.843775 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498376 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:09:00.843775 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498379 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:09:00.843775 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498381 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:09:00.843775 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498384 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:09:00.843775 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498392 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:09:00.843775 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498394 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:09:00.843775 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498397 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:09:00.843775 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498400 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:09:00.843775 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498402 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:09:00.843775 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498405 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:09:00.843775 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498408 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:09:00.843775 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498410 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:09:00.843775 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498412 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:09:00.844884 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.498418 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 22:09:00.844884 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498553 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:09:00.844884 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498565 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:09:00.844884 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498568 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:09:00.844884 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498571 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:09:00.844884 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498574 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:09:00.844884 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498577 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:09:00.844884 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498579 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:09:00.844884 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498582 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:09:00.844884 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498584 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:09:00.844884 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498587 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:09:00.844884 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498589 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:09:00.844884 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498592 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:09:00.844884 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498594 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:09:00.844884 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498597 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:09:00.846173 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498599 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:09:00.846173 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498603 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:09:00.846173 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498605 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:09:00.846173 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498608 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:09:00.846173 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498611 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:09:00.846173 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498613 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:09:00.846173 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498616 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:09:00.846173 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498618 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:09:00.846173 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498621 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:09:00.846173 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498632 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:09:00.846173 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498635 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:09:00.846173 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498638 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:09:00.846173 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498640 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:09:00.846173 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498643 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:09:00.846173 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498645 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:09:00.846173 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498648 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:09:00.846173 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498651 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:09:00.846173 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498653 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:09:00.846173 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498656 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:09:00.846173 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498659 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:09:00.847145 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498662 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:09:00.847145 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498664 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:09:00.847145 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498667 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:09:00.847145 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498669 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:09:00.847145 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498672 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:09:00.847145 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498674 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:09:00.847145 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498676 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:09:00.847145 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498679 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:09:00.847145 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498681 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:09:00.847145 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498684 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:09:00.847145 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498686 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:09:00.847145 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498688 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:09:00.847145 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498691 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:09:00.847145 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498695 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:09:00.847145 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498698 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:09:00.847145 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498700 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:09:00.847145 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498703 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:09:00.847145 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498705 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:09:00.847145 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498708 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:09:00.847145 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498710 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:09:00.855413 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498713 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:09:00.855413 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498715 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:09:00.855413 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498723 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:09:00.855413 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498726 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:09:00.855413 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498729 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:09:00.855413 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498731 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:09:00.855413 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498734 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:09:00.855413 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498736 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:09:00.855413 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498739 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:09:00.855413 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498741 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:09:00.855413 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498744 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:09:00.855413 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498747 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:09:00.855413 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498749 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:09:00.855413 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498752 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:09:00.855413 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498754 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:09:00.855413 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498757 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:09:00.855413 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498760 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:09:00.855413 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498762 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:09:00.855413 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498765 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:09:00.855413 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498767 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:09:00.856269 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498769 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:09:00.856269 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498774 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:09:00.856269 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498776 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:09:00.856269 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498779 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:09:00.856269 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498781 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:09:00.856269 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498787 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:09:00.856269 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498791 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:09:00.856269 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498794 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:09:00.856269 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498797 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:09:00.856269 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498800 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:09:00.856269 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498802 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:09:00.856269 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498805 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:09:00.856269 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498807 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:09:00.856269 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498810 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:09:00.856269 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498812 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:09:00.856269 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498821 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:09:00.856269 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498824 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:09:00.856269 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498826 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:09:00.856269 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498828 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:09:00.863563 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498831 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:09:00.863563 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498835 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:09:00.863563 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498853 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:09:00.863563 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498858 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:09:00.863563 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498862 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:09:00.863563 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:00.498865 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:09:00.863563 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.498871 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 22:09:00.863563 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.498993 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 22:09:00.863563 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.501370 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 22:09:00.863563 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.502963 2566 server.go:1019] "Starting client certificate rotation" Jul 06 22:09:00.863563 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.503074 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 22:09:00.863563 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.503106 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 22:09:00.863982 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.506201 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 22:09:00.863982 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.510771 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 22:09:00.863982 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.524159 2566 log.go:25] "Validated CRI v1 runtime API" Jul 06 22:09:00.863982 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.527174 2566 log.go:25] "Validated CRI v1 image API" Jul 06 22:09:00.863982 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.527968 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 22:09:00.863982 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.530777 2566 fs.go:135] Filesystem UUIDs: map[4edecf62-49c0-433c-ad76-000c40d63fcc:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b9a4571d-a07c-439b-a1b4-11ec7e86b3a3:/dev/nvme0n1p4] Jul 06 22:09:00.863982 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.530792 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 22:09:00.863982 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.535956 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 22:09:00.864314 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.536866 2566 manager.go:216] Machine: {Timestamp:2026-07-06 22:09:00.535486402 +0000 UTC m=+0.390451859 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3208253 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22fc7d0b790c742c44c6e09201116c SystemUUID:ec22fc7d-0b79-0c74-2c44-c6e09201116c BootID:82436d77-44cd-4e1f-b96c-24176f42275e Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d2:2c:3e:6b:ad Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d2:2c:3e:6b:ad Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:bb:41:0d:c8:dc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 22:09:00.864314 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.536967 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 22:09:00.864314 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.537057 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 22:09:00.864314 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.540675 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 22:09:00.864314 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.540706 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-47.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 22:09:00.864314 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.541527 2566 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 22:09:00.864314 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.541538 2566 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 22:09:00.864314 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.541548 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 22:09:00.864314 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.542295 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 22:09:00.864314 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.544178 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 22:09:00.864314 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.547657 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 06 22:09:00.864314 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.547797 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 22:09:00.864314 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.547833 2566 kubelet.go:486] "Attempting to sync node with API server" Jul 06 22:09:00.864314 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.547856 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 22:09:00.864314 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.547871 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 22:09:00.864314 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.547882 2566 kubelet.go:398] "Adding apiserver pod source" Jul 06 22:09:00.864314 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.547899 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 22:09:00.864314 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.548315 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.548332 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.550876 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.553870 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.553905 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.555394 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.555410 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.555420 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.555427 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.555439 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.555451 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.555462 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.555470 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.555478 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.555484 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.555501 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.555510 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.557212 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.557221 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:00.560741 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.560920 2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-47.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.561070 2566 server.go:1268] "Started kubelet" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.561182 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.561277 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.561797 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.563223 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sqsmp" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:00.563397 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-47.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.563682 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.564683 2566 server.go:310] "Adding debug handlers to kubelet server" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.568807 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sqsmp" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:00.569150 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.572252 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:00.572362 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-47.ec2.internal\" not found" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.572256 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.573045 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.573060 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.573046 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:00.572133 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-47.ec2.internal.18bfd2c98d3066a6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-47.ec2.internal,UID:ip-10-0-137-47.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-47.ec2.internal,},FirstTimestamp:2026-07-06 22:09:00.561024678 +0000 UTC m=+0.415990137,LastTimestamp:2026-07-06 22:09:00.561024678 +0000 UTC m=+0.415990137,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-47.ec2.internal,}" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.573248 2566 reconstruct.go:97] "Volume reconstruction finished" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.573256 2566 reconciler.go:29] "Reconciler: start to sync state" Jul 06 22:09:00.864913 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.573436 2566 factory.go:153] Registering CRI-O factory Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.573449 2566 factory.go:223] Registration of the crio container factory successfully Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.573487 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.573496 2566 factory.go:55] Registering systemd factory Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.573504 2566 factory.go:223] Registration of the systemd container factory successfully Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.573526 2566 factory.go:103] Registering Raw factory Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.573543 2566 manager.go:1196] Started watching for new ooms in manager Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.574607 2566 manager.go:349] Starting recovery of all containers Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.578447 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:00.582188 2566 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-47.ec2.internal\" not found" node="ip-10-0-137-47.ec2.internal" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.585462 2566 manager.go:354] Recovery completed Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.590313 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.592270 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-47.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.592305 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-47.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.592318 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-47.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.593004 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.593016 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.593035 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.593010 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.593963 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-47.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.593986 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-47.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.594000 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-47.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.594109 2566 policy_none.go:49] "None policy: Start" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.594122 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.594135 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.595114 2566 policy_none.go:47] "Start" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.666401 2566 manager.go:337] "Starting Device Plugin manager" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:00.666439 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.666449 2566 server.go:87] "Starting device plugin registration server" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.666765 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.666777 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.666885 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.666977 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.666987 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:00.667449 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:00.667504 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-47.ec2.internal\" not found" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.719110 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.720243 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.720291 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.720323 2566 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:00.720363 2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.723141 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.767659 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.768699 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-47.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.768733 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-47.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.768747 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-47.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.768770 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-47.ec2.internal" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.777772 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-47.ec2.internal" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:00.777792 2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-47.ec2.internal\": node \"ip-10-0-137-47.ec2.internal\" not found" Jul 06 22:09:00.866051 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:00.792802 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-47.ec2.internal\" not found" Jul 06 22:09:00.867276 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.821362 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-47.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-47.ec2.internal"] Jul 06 22:09:00.867276 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.821459 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:09:00.867276 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.822618 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-47.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:09:00.867276 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.822650 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-47.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:09:00.867276 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.822663 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-47.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:09:00.867276 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.824085 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:09:00.867276 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.824212 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-47.ec2.internal" Jul 06 22:09:00.867276 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.824246 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:09:00.867276 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.824965 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-47.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:09:00.867276 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.824990 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-47.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:09:00.867276 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.825001 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-47.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:09:00.867276 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.824965 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-47.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:09:00.867276 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.825075 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-47.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:09:00.867276 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.825088 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-47.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:09:00.867276 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.828266 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-47.ec2.internal" Jul 06 22:09:00.867276 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.828291 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:09:00.867276 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.829056 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-47.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:09:00.867276 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.829086 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-47.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:09:00.867276 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.829103 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-47.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:09:01.012809 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.874556 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3f28b5bc82b8c792024d97a7b33da272-config\") pod \"kube-apiserver-proxy-ip-10-0-137-47.ec2.internal\" (UID: \"3f28b5bc82b8c792024d97a7b33da272\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-47.ec2.internal" Jul 06 22:09:01.012809 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.874750 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8ab0104f50ba57a98f6742c4a020f3b5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-47.ec2.internal\" (UID: \"8ab0104f50ba57a98f6742c4a020f3b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-47.ec2.internal" Jul 06 22:09:01.012809 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.874771 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ab0104f50ba57a98f6742c4a020f3b5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-47.ec2.internal\" (UID: \"8ab0104f50ba57a98f6742c4a020f3b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-47.ec2.internal" Jul 06 22:09:01.012809 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:00.883663 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-47.ec2.internal\" not found" node="ip-10-0-137-47.ec2.internal" Jul 06 22:09:01.012809 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:00.887919 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-47.ec2.internal\" not found" node="ip-10-0-137-47.ec2.internal" Jul 06 22:09:01.012809 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:00.892877 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-47.ec2.internal\" not found" Jul 06 22:09:01.012809 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.975540 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3f28b5bc82b8c792024d97a7b33da272-config\") pod \"kube-apiserver-proxy-ip-10-0-137-47.ec2.internal\" (UID: \"3f28b5bc82b8c792024d97a7b33da272\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-47.ec2.internal" Jul 06 22:09:01.012809 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.975565 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8ab0104f50ba57a98f6742c4a020f3b5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-47.ec2.internal\" (UID: \"8ab0104f50ba57a98f6742c4a020f3b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-47.ec2.internal" Jul 06 22:09:01.012809 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.975597 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ab0104f50ba57a98f6742c4a020f3b5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-47.ec2.internal\" (UID: \"8ab0104f50ba57a98f6742c4a020f3b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-47.ec2.internal" Jul 06 22:09:01.012809 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.975647 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8ab0104f50ba57a98f6742c4a020f3b5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-47.ec2.internal\" (UID: \"8ab0104f50ba57a98f6742c4a020f3b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-47.ec2.internal" Jul 06 22:09:01.012809 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.975649 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ab0104f50ba57a98f6742c4a020f3b5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-47.ec2.internal\" (UID: \"8ab0104f50ba57a98f6742c4a020f3b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-47.ec2.internal" Jul 06 22:09:01.012809 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:00.975702 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3f28b5bc82b8c792024d97a7b33da272-config\") pod \"kube-apiserver-proxy-ip-10-0-137-47.ec2.internal\" (UID: \"3f28b5bc82b8c792024d97a7b33da272\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-47.ec2.internal" Jul 06 22:09:01.012809 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:00.993072 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-47.ec2.internal\" not found" Jul 06 22:09:01.129818 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:01.093758 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-47.ec2.internal\" not found" Jul 06 22:09:01.276213 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:01.187325 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-47.ec2.internal" Jul 06 22:09:01.276213 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:01.191628 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-47.ec2.internal" Jul 06 22:09:01.276213 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:01.194074 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-47.ec2.internal\" not found" Jul 06 22:09:01.414058 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:01.294349 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-47.ec2.internal\" not found" Jul 06 22:09:01.414058 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:01.395423 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-47.ec2.internal\" not found" Jul 06 22:09:01.566826 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:01.438693 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:09:01.566826 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:01.495906 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-47.ec2.internal\" not found" Jul 06 22:09:01.566826 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:01.502577 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 22:09:01.566826 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:01.502724 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 22:09:01.566826 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:01.502738 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 22:09:01.566826 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:01.502738 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 22:09:01.690181 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:01.574801 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 22:04:00 +0000 UTC" deadline="2028-03-16 01:54:42.16097053 +0000 UTC" Jul 06 22:09:01.690181 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:01.574825 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14835h45m40.586148704s" Jul 06 22:09:01.690181 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:01.596728 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-47.ec2.internal\" not found" Jul 06 22:09:01.829904 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:01.697373 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-47.ec2.internal\" not found" Jul 06 22:09:01.829904 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:01.797807 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-47.ec2.internal\" not found" Jul 06 22:09:01.991255 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:01.839725 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f28b5bc82b8c792024d97a7b33da272.slice/crio-d0ee1480754794b99fc20f2cfe21352f99b4ba58270e4de3bbadd3c0f164971a WatchSource:0}: Error finding container d0ee1480754794b99fc20f2cfe21352f99b4ba58270e4de3bbadd3c0f164971a: Status 404 returned error can't find the container with id d0ee1480754794b99fc20f2cfe21352f99b4ba58270e4de3bbadd3c0f164971a Jul 06 22:09:01.991255 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:01.840237 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ab0104f50ba57a98f6742c4a020f3b5.slice/crio-469c9e8a939a687b64fb7b82b74cd2b3bfaae940a6036f3282fb3e4c22ffcfbc WatchSource:0}: Error finding container 469c9e8a939a687b64fb7b82b74cd2b3bfaae940a6036f3282fb3e4c22ffcfbc: Status 404 returned error can't find the container with id 469c9e8a939a687b64fb7b82b74cd2b3bfaae940a6036f3282fb3e4c22ffcfbc Jul 06 22:09:01.991255 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:01.846724 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 22:09:01.991255 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:01.897932 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-47.ec2.internal\" not found" Jul 06 22:09:02.143422 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:01.998652 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-47.ec2.internal\" not found" Jul 06 22:09:02.143422 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:02.099778 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-47.ec2.internal\" not found" Jul 06 22:09:02.280399 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.179535 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:09:02.280399 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.275017 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-47.ec2.internal" Jul 06 22:09:02.399741 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.287235 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 22:09:02.399741 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.288549 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-47.ec2.internal" Jul 06 22:09:02.399741 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.298590 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 22:09:02.562169 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.549722 2566 apiserver.go:52] "Watching apiserver" Jul 06 22:09:02.562169 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.557409 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 22:09:02.562169 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.557993 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-7gbfj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-47.ec2.internal","openshift-multus/multus-additional-cni-plugins-7pwsx","openshift-network-diagnostics/network-check-target-5lz4c","openshift-network-operator/iptables-alerter-s67c4","openshift-ovn-kubernetes/ovnkube-node-jd89j","kube-system/global-pull-secret-syncer-jxlqd","kube-system/konnectivity-agent-6qdg8","kube-system/kube-apiserver-proxy-ip-10-0-137-47.ec2.internal","openshift-cluster-node-tuning-operator/tuned-slnnv","openshift-dns/node-resolver-lbxng","openshift-image-registry/node-ca-fm45f","openshift-multus/multus-rxtpx"] Jul 06 22:09:02.562169 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.560292 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.562169 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.561542 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fm45f" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.562722 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.563920 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7pwsx" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.565129 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xpkj6\"" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.565320 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.565495 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.565531 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.565579 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:02.565667 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lz4c" podUID="16197990-fb02-48a4-a024-5b467398b37f" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.566647 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.567225 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s67c4" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.567807 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.567884 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.568080 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.568162 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.568283 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.568391 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.568486 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.568636 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.568786 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-d76rs\"" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.568902 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lzpnm\"" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.568086 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.569165 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.569237 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.569431 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qgn5c\"" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.569456 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6qdg8" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.569634 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.569719 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.569989 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.570096 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d2xcg\"" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.572392 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:02.572550 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gbfj" podUID="ca356800-b17f-42ba-adab-dbd69bc554db" Jul 06 22:09:02.573517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.573219 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 22:09:02.575989 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.574979 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 22:09:02.575989 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.575136 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 22:09:02.575989 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.575530 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b9xc7\"" Jul 06 22:09:02.579723 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.577413 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z" Jul 06 22:09:02.579723 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.579193 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:02.579723 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:02.579288 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlqd" podUID="529d219d-5011-4cd4-8dde-30b659530d16" Jul 06 22:09:02.580194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.579806 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 22:09:02.580194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.579912 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 22:09:02.581374 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.580263 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-t8zkp\"" Jul 06 22:09:02.581374 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.580478 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 22:09:02.581374 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.581081 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.585159 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.581951 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lbxng" Jul 06 22:09:02.585159 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.583316 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:09:02.585159 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.583482 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 22:09:02.585159 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.583844 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wd69f\"" Jul 06 22:09:02.585159 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.584120 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 22:09:02.585159 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.584344 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 22:09:02.585159 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.584390 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ncx2v\"" Jul 06 22:09:02.646989 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.587711 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 22:09:02.646989 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589005 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b55a9306-a1b1-4824-bacd-cd43906b7951-ovn-node-metrics-cert\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.646989 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589038 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hq6c\" (UniqueName: \"kubernetes.io/projected/4a098846-36ce-4c7a-aed0-d34810c73d9c-kube-api-access-7hq6c\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.646989 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589068 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d1c5e61-2ad1-421b-a5f6-3595e1e60795-os-release\") pod \"multus-additional-cni-plugins-7pwsx\" (UID: \"0d1c5e61-2ad1-421b-a5f6-3595e1e60795\") " pod="openshift-multus/multus-additional-cni-plugins-7pwsx" Jul 06 22:09:02.646989 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589093 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca356800-b17f-42ba-adab-dbd69bc554db-metrics-certs\") pod \"network-metrics-daemon-7gbfj\" (UID: \"ca356800-b17f-42ba-adab-dbd69bc554db\") " pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:02.646989 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589122 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-multus-socket-dir-parent\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.646989 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589147 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d1c5e61-2ad1-421b-a5f6-3595e1e60795-cni-binary-copy\") pod \"multus-additional-cni-plugins-7pwsx\" (UID: \"0d1c5e61-2ad1-421b-a5f6-3595e1e60795\") " pod="openshift-multus/multus-additional-cni-plugins-7pwsx" Jul 06 22:09:02.646989 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589170 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0d978ee1-0806-48e2-94e8-ebb1864485a4-agent-certs\") pod \"konnectivity-agent-6qdg8\" (UID: \"0d978ee1-0806-48e2-94e8-ebb1864485a4\") " pod="kube-system/konnectivity-agent-6qdg8" Jul 06 22:09:02.646989 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589195 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-system-cni-dir\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.646989 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589222 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d1c5e61-2ad1-421b-a5f6-3595e1e60795-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7pwsx\" (UID: \"0d1c5e61-2ad1-421b-a5f6-3595e1e60795\") " pod="openshift-multus/multus-additional-cni-plugins-7pwsx" Jul 06 22:09:02.646989 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589248 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d1c5e61-2ad1-421b-a5f6-3595e1e60795-system-cni-dir\") pod \"multus-additional-cni-plugins-7pwsx\" (UID: \"0d1c5e61-2ad1-421b-a5f6-3595e1e60795\") " pod="openshift-multus/multus-additional-cni-plugins-7pwsx" Jul 06 22:09:02.646989 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589272 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0d1c5e61-2ad1-421b-a5f6-3595e1e60795-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7pwsx\" (UID: \"0d1c5e61-2ad1-421b-a5f6-3595e1e60795\") " pod="openshift-multus/multus-additional-cni-plugins-7pwsx" Jul 06 22:09:02.646989 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589300 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0d1c5e61-2ad1-421b-a5f6-3595e1e60795-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7pwsx\" (UID: \"0d1c5e61-2ad1-421b-a5f6-3595e1e60795\") " pod="openshift-multus/multus-additional-cni-plugins-7pwsx" Jul 06 22:09:02.646989 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589326 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1072af1b-bac2-46fe-87b9-19a132f47409-socket-dir\") pod \"aws-ebs-csi-driver-node-phq4z\" (UID: \"1072af1b-bac2-46fe-87b9-19a132f47409\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z" Jul 06 22:09:02.646989 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589349 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvtqs\" (UniqueName: \"kubernetes.io/projected/ca356800-b17f-42ba-adab-dbd69bc554db-kube-api-access-dvtqs\") pod \"network-metrics-daemon-7gbfj\" (UID: \"ca356800-b17f-42ba-adab-dbd69bc554db\") " pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:02.646989 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589377 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-etc-openvswitch\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.647940 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589401 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-multus-cni-dir\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.647940 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589426 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d1c5e61-2ad1-421b-a5f6-3595e1e60795-cnibin\") pod \"multus-additional-cni-plugins-7pwsx\" (UID: \"0d1c5e61-2ad1-421b-a5f6-3595e1e60795\") " pod="openshift-multus/multus-additional-cni-plugins-7pwsx" Jul 06 22:09:02.647940 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589455 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wqhm\" (UniqueName: \"kubernetes.io/projected/0d1c5e61-2ad1-421b-a5f6-3595e1e60795-kube-api-access-5wqhm\") pod \"multus-additional-cni-plugins-7pwsx\" (UID: \"0d1c5e61-2ad1-421b-a5f6-3595e1e60795\") " pod="openshift-multus/multus-additional-cni-plugins-7pwsx" Jul 06 22:09:02.647940 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589480 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd5dk\" (UniqueName: \"kubernetes.io/projected/5bf2872c-ee99-4736-a1fb-bb6f0cbcd951-kube-api-access-gd5dk\") pod \"iptables-alerter-s67c4\" (UID: \"5bf2872c-ee99-4736-a1fb-bb6f0cbcd951\") " pod="openshift-network-operator/iptables-alerter-s67c4" Jul 06 22:09:02.647940 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589503 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1072af1b-bac2-46fe-87b9-19a132f47409-etc-selinux\") pod \"aws-ebs-csi-driver-node-phq4z\" (UID: \"1072af1b-bac2-46fe-87b9-19a132f47409\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z" Jul 06 22:09:02.647940 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589529 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k686c\" (UniqueName: \"kubernetes.io/projected/8e89a94f-c9c4-4b73-bbb1-ea7f02dc8f9b-kube-api-access-k686c\") pod \"node-ca-fm45f\" (UID: \"8e89a94f-c9c4-4b73-bbb1-ea7f02dc8f9b\") " pod="openshift-image-registry/node-ca-fm45f" Jul 06 22:09:02.647940 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589561 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-os-release\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.647940 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589586 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-host-run-k8s-cni-cncf-io\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.647940 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589613 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4a098846-36ce-4c7a-aed0-d34810c73d9c-multus-daemon-config\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.647940 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589639 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1072af1b-bac2-46fe-87b9-19a132f47409-kubelet-dir\") pod \"aws-ebs-csi-driver-node-phq4z\" (UID: \"1072af1b-bac2-46fe-87b9-19a132f47409\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z" Jul 06 22:09:02.647940 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589664 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5ggm\" (UniqueName: \"kubernetes.io/projected/16197990-fb02-48a4-a024-5b467398b37f-kube-api-access-k5ggm\") pod \"network-check-target-5lz4c\" (UID: \"16197990-fb02-48a4-a024-5b467398b37f\") " pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:09:02.647940 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589706 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-node-log\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.647940 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589730 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-log-socket\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.647940 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589754 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-hostroot\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.647940 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589777 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5bf2872c-ee99-4736-a1fb-bb6f0cbcd951-host-slash\") pod \"iptables-alerter-s67c4\" (UID: \"5bf2872c-ee99-4736-a1fb-bb6f0cbcd951\") " pod="openshift-network-operator/iptables-alerter-s67c4" Jul 06 22:09:02.647940 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589802 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1072af1b-bac2-46fe-87b9-19a132f47409-device-dir\") pod \"aws-ebs-csi-driver-node-phq4z\" (UID: \"1072af1b-bac2-46fe-87b9-19a132f47409\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z" Jul 06 22:09:02.654449 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589831 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-host-run-netns\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.654449 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589854 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b55a9306-a1b1-4824-bacd-cd43906b7951-env-overrides\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.654449 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589895 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-host-var-lib-cni-bin\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.654449 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589939 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1072af1b-bac2-46fe-87b9-19a132f47409-registration-dir\") pod \"aws-ebs-csi-driver-node-phq4z\" (UID: \"1072af1b-bac2-46fe-87b9-19a132f47409\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z" Jul 06 22:09:02.654449 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589966 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-host-slash\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.654449 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.589993 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b55a9306-a1b1-4824-bacd-cd43906b7951-ovnkube-script-lib\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.654449 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.590019 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-host-run-netns\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.654449 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.590044 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-host-var-lib-kubelet\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.654449 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.590069 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-host-kubelet\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.654449 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.590124 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-run-systemd\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.654449 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.590150 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-var-lib-openvswitch\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.654449 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.590176 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-host-cni-bin\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.654449 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.590203 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.654449 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.590230 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-multus-conf-dir\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.654449 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.590253 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-run-ovn\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.654449 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.590282 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-host-run-ovn-kubernetes\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.657599 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.590306 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e89a94f-c9c4-4b73-bbb1-ea7f02dc8f9b-host\") pod \"node-ca-fm45f\" (UID: \"8e89a94f-c9c4-4b73-bbb1-ea7f02dc8f9b\") " pod="openshift-image-registry/node-ca-fm45f" Jul 06 22:09:02.657599 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.590331 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5bf2872c-ee99-4736-a1fb-bb6f0cbcd951-iptables-alerter-script\") pod \"iptables-alerter-s67c4\" (UID: \"5bf2872c-ee99-4736-a1fb-bb6f0cbcd951\") " pod="openshift-network-operator/iptables-alerter-s67c4" Jul 06 22:09:02.657599 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.590359 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b55a9306-a1b1-4824-bacd-cd43906b7951-ovnkube-config\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.657599 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.590385 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq2jt\" (UniqueName: \"kubernetes.io/projected/b55a9306-a1b1-4824-bacd-cd43906b7951-kube-api-access-cq2jt\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.657599 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.590411 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-host-run-multus-certs\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.657599 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.590436 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-etc-kubernetes\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.657599 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.590460 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0d978ee1-0806-48e2-94e8-ebb1864485a4-konnectivity-ca\") pod \"konnectivity-agent-6qdg8\" (UID: \"0d978ee1-0806-48e2-94e8-ebb1864485a4\") " pod="kube-system/konnectivity-agent-6qdg8" Jul 06 22:09:02.657599 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.590494 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1072af1b-bac2-46fe-87b9-19a132f47409-sys-fs\") pod \"aws-ebs-csi-driver-node-phq4z\" (UID: \"1072af1b-bac2-46fe-87b9-19a132f47409\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z" Jul 06 22:09:02.657599 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.590545 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e89a94f-c9c4-4b73-bbb1-ea7f02dc8f9b-serviceca\") pod \"node-ca-fm45f\" (UID: \"8e89a94f-c9c4-4b73-bbb1-ea7f02dc8f9b\") " pod="openshift-image-registry/node-ca-fm45f" Jul 06 22:09:02.657599 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.590577 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-host-var-lib-cni-multus\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.657599 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.590617 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmjhb\" (UniqueName: \"kubernetes.io/projected/1072af1b-bac2-46fe-87b9-19a132f47409-kube-api-access-cmjhb\") pod \"aws-ebs-csi-driver-node-phq4z\" (UID: \"1072af1b-bac2-46fe-87b9-19a132f47409\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z" Jul 06 22:09:02.657599 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.590644 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-systemd-units\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.657599 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.590671 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-run-openvswitch\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.657599 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.590720 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a098846-36ce-4c7a-aed0-d34810c73d9c-cni-binary-copy\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.657599 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.590934 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-host-cni-netd\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.657599 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.590958 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-cnibin\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.657599 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.620577 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-h2v8w" Jul 06 22:09:02.657599 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.629372 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-h2v8w" Jul 06 22:09:02.669343 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.667103 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:09:02.674940 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.674896 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 22:09:02.693204 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.691371 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-etc-kubernetes\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.693204 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.691414 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-run\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.693204 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.691463 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-host-run-multus-certs\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.693204 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.691490 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-etc-kubernetes\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.693204 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.691515 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0d978ee1-0806-48e2-94e8-ebb1864485a4-konnectivity-ca\") pod \"konnectivity-agent-6qdg8\" (UID: \"0d978ee1-0806-48e2-94e8-ebb1864485a4\") " pod="kube-system/konnectivity-agent-6qdg8" Jul 06 22:09:02.693204 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.691541 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1072af1b-bac2-46fe-87b9-19a132f47409-sys-fs\") pod \"aws-ebs-csi-driver-node-phq4z\" (UID: \"1072af1b-bac2-46fe-87b9-19a132f47409\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z" Jul 06 22:09:02.693204 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.691564 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-etc-tuned\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.693204 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.691599 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1566a0b0-dbc3-4448-874e-151da27d7a27-tmp-dir\") pod \"node-resolver-lbxng\" (UID: \"1566a0b0-dbc3-4448-874e-151da27d7a27\") " pod="openshift-dns/node-resolver-lbxng" Jul 06 22:09:02.693204 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.691623 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e89a94f-c9c4-4b73-bbb1-ea7f02dc8f9b-serviceca\") pod \"node-ca-fm45f\" (UID: \"8e89a94f-c9c4-4b73-bbb1-ea7f02dc8f9b\") " pod="openshift-image-registry/node-ca-fm45f" Jul 06 22:09:02.693204 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.691649 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-host-var-lib-cni-multus\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.693204 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.691674 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmjhb\" (UniqueName: \"kubernetes.io/projected/1072af1b-bac2-46fe-87b9-19a132f47409-kube-api-access-cmjhb\") pod \"aws-ebs-csi-driver-node-phq4z\" (UID: \"1072af1b-bac2-46fe-87b9-19a132f47409\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z" Jul 06 22:09:02.693204 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.691701 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-host\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.693204 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.691726 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-systemd-units\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.693204 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.691752 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-run-openvswitch\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.693204 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.691775 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a098846-36ce-4c7a-aed0-d34810c73d9c-cni-binary-copy\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.693204 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.691804 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-tmp\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.693204 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.691832 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-host-cni-netd\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.694113 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.691856 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-cnibin\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.694113 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.691879 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-etc-sysctl-d\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.694113 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.691924 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-etc-sysctl-conf\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.694113 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.691947 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-sys\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.694113 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.691971 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-lib-modules\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.694113 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.692011 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b55a9306-a1b1-4824-bacd-cd43906b7951-ovn-node-metrics-cert\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.694113 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.692038 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hq6c\" (UniqueName: \"kubernetes.io/projected/4a098846-36ce-4c7a-aed0-d34810c73d9c-kube-api-access-7hq6c\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.694113 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.692064 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d1c5e61-2ad1-421b-a5f6-3595e1e60795-os-release\") pod \"multus-additional-cni-plugins-7pwsx\" (UID: \"0d1c5e61-2ad1-421b-a5f6-3595e1e60795\") " pod="openshift-multus/multus-additional-cni-plugins-7pwsx" Jul 06 22:09:02.694113 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.692090 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca356800-b17f-42ba-adab-dbd69bc554db-metrics-certs\") pod \"network-metrics-daemon-7gbfj\" (UID: \"ca356800-b17f-42ba-adab-dbd69bc554db\") " pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:02.694113 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.692116 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/529d219d-5011-4cd4-8dde-30b659530d16-dbus\") pod \"global-pull-secret-syncer-jxlqd\" (UID: \"529d219d-5011-4cd4-8dde-30b659530d16\") " pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:02.694113 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.692138 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-var-lib-kubelet\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.694113 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.692161 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1566a0b0-dbc3-4448-874e-151da27d7a27-hosts-file\") pod \"node-resolver-lbxng\" (UID: \"1566a0b0-dbc3-4448-874e-151da27d7a27\") " pod="openshift-dns/node-resolver-lbxng" Jul 06 22:09:02.694113 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.692188 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-multus-socket-dir-parent\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.694113 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.692213 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d1c5e61-2ad1-421b-a5f6-3595e1e60795-cni-binary-copy\") pod \"multus-additional-cni-plugins-7pwsx\" (UID: \"0d1c5e61-2ad1-421b-a5f6-3595e1e60795\") " pod="openshift-multus/multus-additional-cni-plugins-7pwsx" Jul 06 22:09:02.694113 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.692239 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0d978ee1-0806-48e2-94e8-ebb1864485a4-agent-certs\") pod \"konnectivity-agent-6qdg8\" (UID: \"0d978ee1-0806-48e2-94e8-ebb1864485a4\") " pod="kube-system/konnectivity-agent-6qdg8" Jul 06 22:09:02.694113 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.692270 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-system-cni-dir\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.694113 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.692296 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d1c5e61-2ad1-421b-a5f6-3595e1e60795-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7pwsx\" (UID: \"0d1c5e61-2ad1-421b-a5f6-3595e1e60795\") " pod="openshift-multus/multus-additional-cni-plugins-7pwsx" Jul 06 22:09:02.694966 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.692325 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d1c5e61-2ad1-421b-a5f6-3595e1e60795-system-cni-dir\") pod \"multus-additional-cni-plugins-7pwsx\" (UID: \"0d1c5e61-2ad1-421b-a5f6-3595e1e60795\") " pod="openshift-multus/multus-additional-cni-plugins-7pwsx" Jul 06 22:09:02.694966 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.692350 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0d1c5e61-2ad1-421b-a5f6-3595e1e60795-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7pwsx\" (UID: \"0d1c5e61-2ad1-421b-a5f6-3595e1e60795\") " pod="openshift-multus/multus-additional-cni-plugins-7pwsx" Jul 06 22:09:02.694966 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.692377 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0d1c5e61-2ad1-421b-a5f6-3595e1e60795-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7pwsx\" (UID: \"0d1c5e61-2ad1-421b-a5f6-3595e1e60795\") " pod="openshift-multus/multus-additional-cni-plugins-7pwsx" Jul 06 22:09:02.694966 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.692407 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1072af1b-bac2-46fe-87b9-19a132f47409-socket-dir\") pod \"aws-ebs-csi-driver-node-phq4z\" (UID: \"1072af1b-bac2-46fe-87b9-19a132f47409\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z" Jul 06 22:09:02.694966 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.692433 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvtqs\" (UniqueName: \"kubernetes.io/projected/ca356800-b17f-42ba-adab-dbd69bc554db-kube-api-access-dvtqs\") pod \"network-metrics-daemon-7gbfj\" (UID: \"ca356800-b17f-42ba-adab-dbd69bc554db\") " pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:02.694966 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.692484 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-etc-kubernetes\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.694966 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.691836 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1072af1b-bac2-46fe-87b9-19a132f47409-sys-fs\") pod \"aws-ebs-csi-driver-node-phq4z\" (UID: \"1072af1b-bac2-46fe-87b9-19a132f47409\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z" Jul 06 22:09:02.694966 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.692754 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-host-run-multus-certs\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.694966 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.692767 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-systemd-units\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.694966 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693263 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e89a94f-c9c4-4b73-bbb1-ea7f02dc8f9b-serviceca\") pod \"node-ca-fm45f\" (UID: \"8e89a94f-c9c4-4b73-bbb1-ea7f02dc8f9b\") " pod="openshift-image-registry/node-ca-fm45f" Jul 06 22:09:02.694966 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693273 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d1c5e61-2ad1-421b-a5f6-3595e1e60795-cni-binary-copy\") pod \"multus-additional-cni-plugins-7pwsx\" (UID: \"0d1c5e61-2ad1-421b-a5f6-3595e1e60795\") " pod="openshift-multus/multus-additional-cni-plugins-7pwsx" Jul 06 22:09:02.694966 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693307 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d1c5e61-2ad1-421b-a5f6-3595e1e60795-system-cni-dir\") pod \"multus-additional-cni-plugins-7pwsx\" (UID: \"0d1c5e61-2ad1-421b-a5f6-3595e1e60795\") " pod="openshift-multus/multus-additional-cni-plugins-7pwsx" Jul 06 22:09:02.694966 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693315 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-run-openvswitch\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.694966 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693299 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 22:09:02.694966 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693344 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-etc-openvswitch\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.694966 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693372 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-multus-cni-dir\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.694966 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693396 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d1c5e61-2ad1-421b-a5f6-3595e1e60795-cnibin\") pod \"multus-additional-cni-plugins-7pwsx\" (UID: \"0d1c5e61-2ad1-421b-a5f6-3595e1e60795\") " pod="openshift-multus/multus-additional-cni-plugins-7pwsx" Jul 06 22:09:02.695820 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693422 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wqhm\" (UniqueName: \"kubernetes.io/projected/0d1c5e61-2ad1-421b-a5f6-3595e1e60795-kube-api-access-5wqhm\") pod \"multus-additional-cni-plugins-7pwsx\" (UID: \"0d1c5e61-2ad1-421b-a5f6-3595e1e60795\") " pod="openshift-multus/multus-additional-cni-plugins-7pwsx" Jul 06 22:09:02.695820 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693451 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd5dk\" (UniqueName: \"kubernetes.io/projected/5bf2872c-ee99-4736-a1fb-bb6f0cbcd951-kube-api-access-gd5dk\") pod \"iptables-alerter-s67c4\" (UID: \"5bf2872c-ee99-4736-a1fb-bb6f0cbcd951\") " pod="openshift-network-operator/iptables-alerter-s67c4" Jul 06 22:09:02.695820 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693477 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1072af1b-bac2-46fe-87b9-19a132f47409-etc-selinux\") pod \"aws-ebs-csi-driver-node-phq4z\" (UID: \"1072af1b-bac2-46fe-87b9-19a132f47409\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z" Jul 06 22:09:02.695820 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693533 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-etc-systemd\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.695820 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693568 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k686c\" (UniqueName: \"kubernetes.io/projected/8e89a94f-c9c4-4b73-bbb1-ea7f02dc8f9b-kube-api-access-k686c\") pod \"node-ca-fm45f\" (UID: \"8e89a94f-c9c4-4b73-bbb1-ea7f02dc8f9b\") " pod="openshift-image-registry/node-ca-fm45f" Jul 06 22:09:02.695820 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693572 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d1c5e61-2ad1-421b-a5f6-3595e1e60795-os-release\") pod \"multus-additional-cni-plugins-7pwsx\" (UID: \"0d1c5e61-2ad1-421b-a5f6-3595e1e60795\") " pod="openshift-multus/multus-additional-cni-plugins-7pwsx" Jul 06 22:09:02.695820 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693606 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-os-release\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.695820 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693636 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-host-run-k8s-cni-cncf-io\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.695820 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693661 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4a098846-36ce-4c7a-aed0-d34810c73d9c-multus-daemon-config\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.695820 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693685 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1072af1b-bac2-46fe-87b9-19a132f47409-kubelet-dir\") pod \"aws-ebs-csi-driver-node-phq4z\" (UID: \"1072af1b-bac2-46fe-87b9-19a132f47409\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z" Jul 06 22:09:02.695820 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693710 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5ggm\" (UniqueName: \"kubernetes.io/projected/16197990-fb02-48a4-a024-5b467398b37f-kube-api-access-k5ggm\") pod \"network-check-target-5lz4c\" (UID: \"16197990-fb02-48a4-a024-5b467398b37f\") " pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:09:02.695820 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693724 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0d978ee1-0806-48e2-94e8-ebb1864485a4-konnectivity-ca\") pod \"konnectivity-agent-6qdg8\" (UID: \"0d978ee1-0806-48e2-94e8-ebb1864485a4\") " pod="kube-system/konnectivity-agent-6qdg8" Jul 06 22:09:02.695820 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693736 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/529d219d-5011-4cd4-8dde-30b659530d16-kubelet-config\") pod \"global-pull-secret-syncer-jxlqd\" (UID: \"529d219d-5011-4cd4-8dde-30b659530d16\") " pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:02.695820 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693776 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/529d219d-5011-4cd4-8dde-30b659530d16-original-pull-secret\") pod \"global-pull-secret-syncer-jxlqd\" (UID: \"529d219d-5011-4cd4-8dde-30b659530d16\") " pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:02.695820 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693785 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-host-run-k8s-cni-cncf-io\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.695820 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693809 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-node-log\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.695820 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693842 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-etc-openvswitch\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.696648 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693855 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-log-socket\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.696648 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693881 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-hostroot\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.696648 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693907 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5bf2872c-ee99-4736-a1fb-bb6f0cbcd951-host-slash\") pod \"iptables-alerter-s67c4\" (UID: \"5bf2872c-ee99-4736-a1fb-bb6f0cbcd951\") " pod="openshift-network-operator/iptables-alerter-s67c4" Jul 06 22:09:02.696648 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693946 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1072af1b-bac2-46fe-87b9-19a132f47409-device-dir\") pod \"aws-ebs-csi-driver-node-phq4z\" (UID: \"1072af1b-bac2-46fe-87b9-19a132f47409\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z" Jul 06 22:09:02.696648 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693993 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-multus-cni-dir\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.696648 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.693986 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-host-run-netns\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.696648 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694037 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-host-run-netns\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.696648 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694038 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b55a9306-a1b1-4824-bacd-cd43906b7951-env-overrides\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.696648 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694072 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-host-var-lib-cni-bin\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.696648 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694100 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1072af1b-bac2-46fe-87b9-19a132f47409-registration-dir\") pod \"aws-ebs-csi-driver-node-phq4z\" (UID: \"1072af1b-bac2-46fe-87b9-19a132f47409\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z" Jul 06 22:09:02.696648 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694125 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-host-slash\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.696648 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694183 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b55a9306-a1b1-4824-bacd-cd43906b7951-ovnkube-script-lib\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.696648 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694214 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-host-run-netns\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.696648 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694221 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4a098846-36ce-4c7a-aed0-d34810c73d9c-multus-daemon-config\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.696648 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694225 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-multus-socket-dir-parent\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.696648 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694241 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-host-var-lib-kubelet\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.696648 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694272 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-etc-modprobe-d\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.697521 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694278 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1072af1b-bac2-46fe-87b9-19a132f47409-kubelet-dir\") pod \"aws-ebs-csi-driver-node-phq4z\" (UID: \"1072af1b-bac2-46fe-87b9-19a132f47409\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z" Jul 06 22:09:02.697521 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694302 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-host-kubelet\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.697521 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:02.694326 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:09:02.697521 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694366 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-run-systemd\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.697521 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:02.694388 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca356800-b17f-42ba-adab-dbd69bc554db-metrics-certs podName:ca356800-b17f-42ba-adab-dbd69bc554db nodeName:}" failed. No retries permitted until 2026-07-06 22:09:03.194368596 +0000 UTC m=+3.049334061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca356800-b17f-42ba-adab-dbd69bc554db-metrics-certs") pod "network-metrics-daemon-7gbfj" (UID: "ca356800-b17f-42ba-adab-dbd69bc554db") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:09:02.697521 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694328 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-run-systemd\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.697521 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694427 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-os-release\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.697521 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694451 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b55a9306-a1b1-4824-bacd-cd43906b7951-env-overrides\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.697521 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694443 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-var-lib-openvswitch\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.697521 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694484 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-var-lib-openvswitch\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.697521 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694500 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-host-cni-bin\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.697521 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694549 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.697521 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694553 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d1c5e61-2ad1-421b-a5f6-3595e1e60795-cnibin\") pod \"multus-additional-cni-plugins-7pwsx\" (UID: \"0d1c5e61-2ad1-421b-a5f6-3595e1e60795\") " pod="openshift-multus/multus-additional-cni-plugins-7pwsx" Jul 06 22:09:02.697521 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694591 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-multus-conf-dir\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.697521 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694617 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-node-log\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.697521 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694623 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc4r7\" (UniqueName: \"kubernetes.io/projected/1566a0b0-dbc3-4448-874e-151da27d7a27-kube-api-access-hc4r7\") pod \"node-resolver-lbxng\" (UID: \"1566a0b0-dbc3-4448-874e-151da27d7a27\") " pod="openshift-dns/node-resolver-lbxng" Jul 06 22:09:02.697521 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694618 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-hostroot\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.698513 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694652 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-run-ovn\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.698513 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694664 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-log-socket\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.698513 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694681 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-host-run-ovn-kubernetes\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.698513 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694685 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-cnibin\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.698513 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694686 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5bf2872c-ee99-4736-a1fb-bb6f0cbcd951-host-slash\") pod \"iptables-alerter-s67c4\" (UID: \"5bf2872c-ee99-4736-a1fb-bb6f0cbcd951\") " pod="openshift-network-operator/iptables-alerter-s67c4" Jul 06 22:09:02.698513 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694706 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e89a94f-c9c4-4b73-bbb1-ea7f02dc8f9b-host\") pod \"node-ca-fm45f\" (UID: \"8e89a94f-c9c4-4b73-bbb1-ea7f02dc8f9b\") " pod="openshift-image-registry/node-ca-fm45f" Jul 06 22:09:02.698513 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694729 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1072af1b-bac2-46fe-87b9-19a132f47409-device-dir\") pod \"aws-ebs-csi-driver-node-phq4z\" (UID: \"1072af1b-bac2-46fe-87b9-19a132f47409\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z" Jul 06 22:09:02.698513 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694747 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e89a94f-c9c4-4b73-bbb1-ea7f02dc8f9b-host\") pod \"node-ca-fm45f\" (UID: \"8e89a94f-c9c4-4b73-bbb1-ea7f02dc8f9b\") " pod="openshift-image-registry/node-ca-fm45f" Jul 06 22:09:02.698513 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694750 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-host-cni-netd\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.698513 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694797 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1072af1b-bac2-46fe-87b9-19a132f47409-registration-dir\") pod \"aws-ebs-csi-driver-node-phq4z\" (UID: \"1072af1b-bac2-46fe-87b9-19a132f47409\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z" Jul 06 22:09:02.698513 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694888 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-system-cni-dir\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.698513 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694934 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.698513 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694942 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d1c5e61-2ad1-421b-a5f6-3595e1e60795-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7pwsx\" (UID: \"0d1c5e61-2ad1-421b-a5f6-3595e1e60795\") " pod="openshift-multus/multus-additional-cni-plugins-7pwsx" Jul 06 22:09:02.698513 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694954 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-host-var-lib-cni-bin\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.698513 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.694975 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-host-var-lib-kubelet\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.698513 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.695032 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-run-ovn\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.698513 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.695035 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-host-cni-bin\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.698513 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.695044 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1072af1b-bac2-46fe-87b9-19a132f47409-etc-selinux\") pod \"aws-ebs-csi-driver-node-phq4z\" (UID: \"1072af1b-bac2-46fe-87b9-19a132f47409\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z" Jul 06 22:09:02.699439 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.695054 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1072af1b-bac2-46fe-87b9-19a132f47409-socket-dir\") pod \"aws-ebs-csi-driver-node-phq4z\" (UID: \"1072af1b-bac2-46fe-87b9-19a132f47409\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z" Jul 06 22:09:02.699439 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.695074 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-host-kubelet\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.699439 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.695085 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5bf2872c-ee99-4736-a1fb-bb6f0cbcd951-iptables-alerter-script\") pod \"iptables-alerter-s67c4\" (UID: \"5bf2872c-ee99-4736-a1fb-bb6f0cbcd951\") " pod="openshift-network-operator/iptables-alerter-s67c4" Jul 06 22:09:02.699439 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.695098 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-host-run-netns\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.699439 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.695120 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px5lk\" (UniqueName: \"kubernetes.io/projected/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-kube-api-access-px5lk\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.699439 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.695138 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-host-run-ovn-kubernetes\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.699439 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.695152 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b55a9306-a1b1-4824-bacd-cd43906b7951-ovnkube-config\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.699439 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.695199 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b55a9306-a1b1-4824-bacd-cd43906b7951-host-slash\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.699439 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.695271 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-multus-conf-dir\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.699439 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.695365 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0d1c5e61-2ad1-421b-a5f6-3595e1e60795-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7pwsx\" (UID: \"0d1c5e61-2ad1-421b-a5f6-3595e1e60795\") " pod="openshift-multus/multus-additional-cni-plugins-7pwsx" Jul 06 22:09:02.699439 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.695432 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq2jt\" (UniqueName: \"kubernetes.io/projected/b55a9306-a1b1-4824-bacd-cd43906b7951-kube-api-access-cq2jt\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.699439 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.695474 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0d1c5e61-2ad1-421b-a5f6-3595e1e60795-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7pwsx\" (UID: \"0d1c5e61-2ad1-421b-a5f6-3595e1e60795\") " pod="openshift-multus/multus-additional-cni-plugins-7pwsx" Jul 06 22:09:02.699439 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.695487 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-etc-sysconfig\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.699439 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.695657 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a098846-36ce-4c7a-aed0-d34810c73d9c-cni-binary-copy\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.699439 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.695664 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b55a9306-a1b1-4824-bacd-cd43906b7951-ovnkube-config\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.699439 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.695718 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4a098846-36ce-4c7a-aed0-d34810c73d9c-host-var-lib-cni-multus\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.699439 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.695917 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5bf2872c-ee99-4736-a1fb-bb6f0cbcd951-iptables-alerter-script\") pod \"iptables-alerter-s67c4\" (UID: \"5bf2872c-ee99-4736-a1fb-bb6f0cbcd951\") " pod="openshift-network-operator/iptables-alerter-s67c4" Jul 06 22:09:02.700337 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.696183 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b55a9306-a1b1-4824-bacd-cd43906b7951-ovnkube-script-lib\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.704293 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.703365 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b55a9306-a1b1-4824-bacd-cd43906b7951-ovn-node-metrics-cert\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.704293 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.703846 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0d978ee1-0806-48e2-94e8-ebb1864485a4-agent-certs\") pod \"konnectivity-agent-6qdg8\" (UID: \"0d978ee1-0806-48e2-94e8-ebb1864485a4\") " pod="kube-system/konnectivity-agent-6qdg8" Jul 06 22:09:02.704293 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:02.704179 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:09:02.704293 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:02.704200 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:09:02.704293 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:02.704213 2566 projected.go:196] Error preparing data for projected volume kube-api-access-k5ggm for pod openshift-network-diagnostics/network-check-target-5lz4c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:09:02.704293 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:02.704285 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16197990-fb02-48a4-a024-5b467398b37f-kube-api-access-k5ggm podName:16197990-fb02-48a4-a024-5b467398b37f nodeName:}" failed. No retries permitted until 2026-07-06 22:09:03.204261384 +0000 UTC m=+3.059226847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-k5ggm" (UniqueName: "kubernetes.io/projected/16197990-fb02-48a4-a024-5b467398b37f-kube-api-access-k5ggm") pod "network-check-target-5lz4c" (UID: "16197990-fb02-48a4-a024-5b467398b37f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:09:02.708213 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.708184 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hq6c\" (UniqueName: \"kubernetes.io/projected/4a098846-36ce-4c7a-aed0-d34810c73d9c-kube-api-access-7hq6c\") pod \"multus-rxtpx\" (UID: \"4a098846-36ce-4c7a-aed0-d34810c73d9c\") " pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.710690 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.710665 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmjhb\" (UniqueName: \"kubernetes.io/projected/1072af1b-bac2-46fe-87b9-19a132f47409-kube-api-access-cmjhb\") pod \"aws-ebs-csi-driver-node-phq4z\" (UID: \"1072af1b-bac2-46fe-87b9-19a132f47409\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z" Jul 06 22:09:02.714795 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.714767 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq2jt\" (UniqueName: \"kubernetes.io/projected/b55a9306-a1b1-4824-bacd-cd43906b7951-kube-api-access-cq2jt\") pod \"ovnkube-node-jd89j\" (UID: \"b55a9306-a1b1-4824-bacd-cd43906b7951\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.717429 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.717317 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvtqs\" (UniqueName: \"kubernetes.io/projected/ca356800-b17f-42ba-adab-dbd69bc554db-kube-api-access-dvtqs\") pod \"network-metrics-daemon-7gbfj\" (UID: \"ca356800-b17f-42ba-adab-dbd69bc554db\") " pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:02.717698 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.717670 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wqhm\" (UniqueName: \"kubernetes.io/projected/0d1c5e61-2ad1-421b-a5f6-3595e1e60795-kube-api-access-5wqhm\") pod \"multus-additional-cni-plugins-7pwsx\" (UID: \"0d1c5e61-2ad1-421b-a5f6-3595e1e60795\") " pod="openshift-multus/multus-additional-cni-plugins-7pwsx" Jul 06 22:09:02.721688 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.721657 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd5dk\" (UniqueName: \"kubernetes.io/projected/5bf2872c-ee99-4736-a1fb-bb6f0cbcd951-kube-api-access-gd5dk\") pod \"iptables-alerter-s67c4\" (UID: \"5bf2872c-ee99-4736-a1fb-bb6f0cbcd951\") " pod="openshift-network-operator/iptables-alerter-s67c4" Jul 06 22:09:02.723660 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.723606 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k686c\" (UniqueName: \"kubernetes.io/projected/8e89a94f-c9c4-4b73-bbb1-ea7f02dc8f9b-kube-api-access-k686c\") pod \"node-ca-fm45f\" (UID: \"8e89a94f-c9c4-4b73-bbb1-ea7f02dc8f9b\") " pod="openshift-image-registry/node-ca-fm45f" Jul 06 22:09:02.726212 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.726153 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-47.ec2.internal" event={"ID":"3f28b5bc82b8c792024d97a7b33da272","Type":"ContainerStarted","Data":"d0ee1480754794b99fc20f2cfe21352f99b4ba58270e4de3bbadd3c0f164971a"} Jul 06 22:09:02.726949 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.726850 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s67c4" Jul 06 22:09:02.730427 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.730400 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-47.ec2.internal" event={"ID":"8ab0104f50ba57a98f6742c4a020f3b5","Type":"ContainerStarted","Data":"469c9e8a939a687b64fb7b82b74cd2b3bfaae940a6036f3282fb3e4c22ffcfbc"} Jul 06 22:09:02.742273 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:02.742235 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bf2872c_ee99_4736_a1fb_bb6f0cbcd951.slice/crio-e5d3c40ab9f459091f0faa85523cb20988169dfbaed50b3e7e95c2c9c72833a0 WatchSource:0}: Error finding container e5d3c40ab9f459091f0faa85523cb20988169dfbaed50b3e7e95c2c9c72833a0: Status 404 returned error can't find the container with id e5d3c40ab9f459091f0faa85523cb20988169dfbaed50b3e7e95c2c9c72833a0 Jul 06 22:09:02.758696 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.758672 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6qdg8" Jul 06 22:09:02.768945 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.768920 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z" Jul 06 22:09:02.774062 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:02.774029 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d978ee1_0806_48e2_94e8_ebb1864485a4.slice/crio-cd9a602dd2534d4930b4c226f1ef8ff8cee2838c4ece01d311b425c04dca9cd9 WatchSource:0}: Error finding container cd9a602dd2534d4930b4c226f1ef8ff8cee2838c4ece01d311b425c04dca9cd9: Status 404 returned error can't find the container with id cd9a602dd2534d4930b4c226f1ef8ff8cee2838c4ece01d311b425c04dca9cd9 Jul 06 22:09:02.779833 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:02.779804 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1072af1b_bac2_46fe_87b9_19a132f47409.slice/crio-25ca130ff4f3417b2ae9ccb8eca262d0426c50d4fd82dba495ac0ac69500bf48 WatchSource:0}: Error finding container 25ca130ff4f3417b2ae9ccb8eca262d0426c50d4fd82dba495ac0ac69500bf48: Status 404 returned error can't find the container with id 25ca130ff4f3417b2ae9ccb8eca262d0426c50d4fd82dba495ac0ac69500bf48 Jul 06 22:09:02.796415 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.796384 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-etc-modprobe-d\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.796543 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.796437 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc4r7\" (UniqueName: \"kubernetes.io/projected/1566a0b0-dbc3-4448-874e-151da27d7a27-kube-api-access-hc4r7\") pod \"node-resolver-lbxng\" (UID: \"1566a0b0-dbc3-4448-874e-151da27d7a27\") " pod="openshift-dns/node-resolver-lbxng" Jul 06 22:09:02.796543 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.796476 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px5lk\" (UniqueName: \"kubernetes.io/projected/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-kube-api-access-px5lk\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.796543 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.796499 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-etc-sysconfig\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.796543 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.796525 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-etc-kubernetes\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.796768 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.796547 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-run\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.796768 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.796570 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-etc-modprobe-d\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.796768 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.796585 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-etc-tuned\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.796768 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.796610 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1566a0b0-dbc3-4448-874e-151da27d7a27-tmp-dir\") pod \"node-resolver-lbxng\" (UID: \"1566a0b0-dbc3-4448-874e-151da27d7a27\") " pod="openshift-dns/node-resolver-lbxng" Jul 06 22:09:02.796768 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.796652 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-host\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.796768 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.796639 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-etc-kubernetes\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.796768 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.796677 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-tmp\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.796768 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.796704 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-etc-sysctl-d\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.796768 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.796726 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-etc-sysctl-conf\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.796768 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.796748 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-sys\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.797258 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.796796 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-lib-modules\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.797258 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.796819 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-etc-sysconfig\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.797258 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.796836 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/529d219d-5011-4cd4-8dde-30b659530d16-dbus\") pod \"global-pull-secret-syncer-jxlqd\" (UID: \"529d219d-5011-4cd4-8dde-30b659530d16\") " pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:02.797258 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.796860 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-var-lib-kubelet\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.797258 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.796889 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1566a0b0-dbc3-4448-874e-151da27d7a27-hosts-file\") pod \"node-resolver-lbxng\" (UID: \"1566a0b0-dbc3-4448-874e-151da27d7a27\") " pod="openshift-dns/node-resolver-lbxng" Jul 06 22:09:02.797258 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.796952 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-run\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.797258 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.796986 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-etc-systemd\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.797258 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.797030 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/529d219d-5011-4cd4-8dde-30b659530d16-kubelet-config\") pod \"global-pull-secret-syncer-jxlqd\" (UID: \"529d219d-5011-4cd4-8dde-30b659530d16\") " pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:02.797258 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.797039 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-etc-systemd\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.797258 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.797054 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/529d219d-5011-4cd4-8dde-30b659530d16-original-pull-secret\") pod \"global-pull-secret-syncer-jxlqd\" (UID: \"529d219d-5011-4cd4-8dde-30b659530d16\") " pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:02.797258 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.797091 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-host\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.797258 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:02.797136 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:09:02.797258 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.797167 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/529d219d-5011-4cd4-8dde-30b659530d16-dbus\") pod \"global-pull-secret-syncer-jxlqd\" (UID: \"529d219d-5011-4cd4-8dde-30b659530d16\") " pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:02.797258 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:02.797177 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/529d219d-5011-4cd4-8dde-30b659530d16-original-pull-secret podName:529d219d-5011-4cd4-8dde-30b659530d16 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:03.297163731 +0000 UTC m=+3.152129177 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/529d219d-5011-4cd4-8dde-30b659530d16-original-pull-secret") pod "global-pull-secret-syncer-jxlqd" (UID: "529d219d-5011-4cd4-8dde-30b659530d16") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:09:02.797258 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.797205 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-lib-modules\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.797258 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.797215 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-var-lib-kubelet\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.798073 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.797287 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1566a0b0-dbc3-4448-874e-151da27d7a27-hosts-file\") pod \"node-resolver-lbxng\" (UID: \"1566a0b0-dbc3-4448-874e-151da27d7a27\") " pod="openshift-dns/node-resolver-lbxng" Jul 06 22:09:02.798073 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.797720 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-etc-sysctl-conf\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.798073 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.797841 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-etc-sysctl-d\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.798073 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.798006 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/529d219d-5011-4cd4-8dde-30b659530d16-kubelet-config\") pod \"global-pull-secret-syncer-jxlqd\" (UID: \"529d219d-5011-4cd4-8dde-30b659530d16\") " pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:02.798273 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.798079 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-sys\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.798407 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.798387 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1566a0b0-dbc3-4448-874e-151da27d7a27-tmp-dir\") pod \"node-resolver-lbxng\" (UID: \"1566a0b0-dbc3-4448-874e-151da27d7a27\") " pod="openshift-dns/node-resolver-lbxng" Jul 06 22:09:02.801072 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.801048 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-etc-tuned\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.802121 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.802101 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-tmp\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.806204 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.806179 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc4r7\" (UniqueName: \"kubernetes.io/projected/1566a0b0-dbc3-4448-874e-151da27d7a27-kube-api-access-hc4r7\") pod \"node-resolver-lbxng\" (UID: \"1566a0b0-dbc3-4448-874e-151da27d7a27\") " pod="openshift-dns/node-resolver-lbxng" Jul 06 22:09:02.807332 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.807313 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px5lk\" (UniqueName: \"kubernetes.io/projected/68ddaafe-8f13-4c5f-b134-7e71ca1f24da-kube-api-access-px5lk\") pod \"tuned-slnnv\" (UID: \"68ddaafe-8f13-4c5f-b134-7e71ca1f24da\") " pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:02.879865 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.879761 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:02.884788 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.884765 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:09:02.890665 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:02.890626 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb55a9306_a1b1_4824_bacd_cd43906b7951.slice/crio-10b5e7c9ae834feed82e6754e79a9dc4f2849d7adf8ca44d5c048a138dd45a3b WatchSource:0}: Error finding container 10b5e7c9ae834feed82e6754e79a9dc4f2849d7adf8ca44d5c048a138dd45a3b: Status 404 returned error can't find the container with id 10b5e7c9ae834feed82e6754e79a9dc4f2849d7adf8ca44d5c048a138dd45a3b Jul 06 22:09:02.891733 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.891702 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fm45f" Jul 06 22:09:02.900897 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.900875 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rxtpx" Jul 06 22:09:02.902258 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:02.902222 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e89a94f_c9c4_4b73_bbb1_ea7f02dc8f9b.slice/crio-12e1789d1d010125f320f63621aa9ddfee19e27df36ca0b61177441117cb2382 WatchSource:0}: Error finding container 12e1789d1d010125f320f63621aa9ddfee19e27df36ca0b61177441117cb2382: Status 404 returned error can't find the container with id 12e1789d1d010125f320f63621aa9ddfee19e27df36ca0b61177441117cb2382 Jul 06 22:09:02.909872 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:02.909838 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7pwsx" Jul 06 22:09:02.910064 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:02.910040 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a098846_36ce_4c7a_aed0_d34810c73d9c.slice/crio-d4bf053231333cea36aac0d5e5996873b6e6ac2f0f782de4318741f93140939f WatchSource:0}: Error finding container d4bf053231333cea36aac0d5e5996873b6e6ac2f0f782de4318741f93140939f: Status 404 returned error can't find the container with id d4bf053231333cea36aac0d5e5996873b6e6ac2f0f782de4318741f93140939f Jul 06 22:09:02.920266 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:02.920225 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d1c5e61_2ad1_421b_a5f6_3595e1e60795.slice/crio-85adc9584dad4ef2a7795865e518f4cbf81faf87704eed4b18d3138cb9977ece WatchSource:0}: Error finding container 85adc9584dad4ef2a7795865e518f4cbf81faf87704eed4b18d3138cb9977ece: Status 404 returned error can't find the container with id 85adc9584dad4ef2a7795865e518f4cbf81faf87704eed4b18d3138cb9977ece Jul 06 22:09:03.085562 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:03.085513 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-slnnv" Jul 06 22:09:03.092839 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:03.092811 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lbxng" Jul 06 22:09:03.201332 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:03.201292 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca356800-b17f-42ba-adab-dbd69bc554db-metrics-certs\") pod \"network-metrics-daemon-7gbfj\" (UID: \"ca356800-b17f-42ba-adab-dbd69bc554db\") " pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:03.201544 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:03.201479 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:09:03.201606 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:03.201588 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca356800-b17f-42ba-adab-dbd69bc554db-metrics-certs podName:ca356800-b17f-42ba-adab-dbd69bc554db nodeName:}" failed. No retries permitted until 2026-07-06 22:09:04.201563052 +0000 UTC m=+4.056528518 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca356800-b17f-42ba-adab-dbd69bc554db-metrics-certs") pod "network-metrics-daemon-7gbfj" (UID: "ca356800-b17f-42ba-adab-dbd69bc554db") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:09:03.302632 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:03.302597 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5ggm\" (UniqueName: \"kubernetes.io/projected/16197990-fb02-48a4-a024-5b467398b37f-kube-api-access-k5ggm\") pod \"network-check-target-5lz4c\" (UID: \"16197990-fb02-48a4-a024-5b467398b37f\") " pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:09:03.302632 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:03.302637 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/529d219d-5011-4cd4-8dde-30b659530d16-original-pull-secret\") pod \"global-pull-secret-syncer-jxlqd\" (UID: \"529d219d-5011-4cd4-8dde-30b659530d16\") " pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:03.302910 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:03.302760 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:09:03.302910 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:03.302796 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:09:03.302910 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:03.302821 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:09:03.302910 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:03.302826 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/529d219d-5011-4cd4-8dde-30b659530d16-original-pull-secret podName:529d219d-5011-4cd4-8dde-30b659530d16 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:04.302808152 +0000 UTC m=+4.157773610 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/529d219d-5011-4cd4-8dde-30b659530d16-original-pull-secret") pod "global-pull-secret-syncer-jxlqd" (UID: "529d219d-5011-4cd4-8dde-30b659530d16") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:09:03.302910 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:03.302835 2566 projected.go:196] Error preparing data for projected volume kube-api-access-k5ggm for pod openshift-network-diagnostics/network-check-target-5lz4c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:09:03.303162 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:03.302915 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16197990-fb02-48a4-a024-5b467398b37f-kube-api-access-k5ggm podName:16197990-fb02-48a4-a024-5b467398b37f nodeName:}" failed. No retries permitted until 2026-07-06 22:09:04.302895978 +0000 UTC m=+4.157861443 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-k5ggm" (UniqueName: "kubernetes.io/projected/16197990-fb02-48a4-a024-5b467398b37f-kube-api-access-k5ggm") pod "network-check-target-5lz4c" (UID: "16197990-fb02-48a4-a024-5b467398b37f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:09:03.632461 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:03.632326 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 22:04:02 +0000 UTC" deadline="2028-02-01 13:31:45.680268166 +0000 UTC" Jul 06 22:09:03.632461 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:03.632396 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13791h22m42.047877527s" Jul 06 22:09:03.721445 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:03.721396 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:03.721628 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:03.721565 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:09:03.721628 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:03.721573 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlqd" podUID="529d219d-5011-4cd4-8dde-30b659530d16" Jul 06 22:09:03.721628 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:03.721610 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:03.721758 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:03.721731 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lz4c" podUID="16197990-fb02-48a4-a024-5b467398b37f" Jul 06 22:09:03.721972 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:03.721948 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gbfj" podUID="ca356800-b17f-42ba-adab-dbd69bc554db" Jul 06 22:09:03.733048 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:03.732975 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rxtpx" event={"ID":"4a098846-36ce-4c7a-aed0-d34810c73d9c","Type":"ContainerStarted","Data":"d4bf053231333cea36aac0d5e5996873b6e6ac2f0f782de4318741f93140939f"} Jul 06 22:09:03.734301 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:03.734269 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6qdg8" event={"ID":"0d978ee1-0806-48e2-94e8-ebb1864485a4","Type":"ContainerStarted","Data":"cd9a602dd2534d4930b4c226f1ef8ff8cee2838c4ece01d311b425c04dca9cd9"} Jul 06 22:09:03.735564 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:03.735536 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s67c4" event={"ID":"5bf2872c-ee99-4736-a1fb-bb6f0cbcd951","Type":"ContainerStarted","Data":"e5d3c40ab9f459091f0faa85523cb20988169dfbaed50b3e7e95c2c9c72833a0"} Jul 06 22:09:03.736686 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:03.736658 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7pwsx" event={"ID":"0d1c5e61-2ad1-421b-a5f6-3595e1e60795","Type":"ContainerStarted","Data":"85adc9584dad4ef2a7795865e518f4cbf81faf87704eed4b18d3138cb9977ece"} Jul 06 22:09:03.737784 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:03.737761 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fm45f" event={"ID":"8e89a94f-c9c4-4b73-bbb1-ea7f02dc8f9b","Type":"ContainerStarted","Data":"12e1789d1d010125f320f63621aa9ddfee19e27df36ca0b61177441117cb2382"} Jul 06 22:09:03.739071 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:03.739048 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" event={"ID":"b55a9306-a1b1-4824-bacd-cd43906b7951","Type":"ContainerStarted","Data":"10b5e7c9ae834feed82e6754e79a9dc4f2849d7adf8ca44d5c048a138dd45a3b"} Jul 06 22:09:03.740218 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:03.740194 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z" event={"ID":"1072af1b-bac2-46fe-87b9-19a132f47409","Type":"ContainerStarted","Data":"25ca130ff4f3417b2ae9ccb8eca262d0426c50d4fd82dba495ac0ac69500bf48"} Jul 06 22:09:04.210828 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:04.210153 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca356800-b17f-42ba-adab-dbd69bc554db-metrics-certs\") pod \"network-metrics-daemon-7gbfj\" (UID: \"ca356800-b17f-42ba-adab-dbd69bc554db\") " pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:04.210828 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:04.210399 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:09:04.210828 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:04.210468 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca356800-b17f-42ba-adab-dbd69bc554db-metrics-certs podName:ca356800-b17f-42ba-adab-dbd69bc554db nodeName:}" failed. No retries permitted until 2026-07-06 22:09:06.210448004 +0000 UTC m=+6.065413455 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca356800-b17f-42ba-adab-dbd69bc554db-metrics-certs") pod "network-metrics-daemon-7gbfj" (UID: "ca356800-b17f-42ba-adab-dbd69bc554db") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:09:04.311331 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:04.311278 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5ggm\" (UniqueName: \"kubernetes.io/projected/16197990-fb02-48a4-a024-5b467398b37f-kube-api-access-k5ggm\") pod \"network-check-target-5lz4c\" (UID: \"16197990-fb02-48a4-a024-5b467398b37f\") " pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:09:04.311331 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:04.311338 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/529d219d-5011-4cd4-8dde-30b659530d16-original-pull-secret\") pod \"global-pull-secret-syncer-jxlqd\" (UID: \"529d219d-5011-4cd4-8dde-30b659530d16\") " pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:04.311606 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:04.311510 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:09:04.311606 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:04.311577 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/529d219d-5011-4cd4-8dde-30b659530d16-original-pull-secret podName:529d219d-5011-4cd4-8dde-30b659530d16 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:06.31155753 +0000 UTC m=+6.166522980 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/529d219d-5011-4cd4-8dde-30b659530d16-original-pull-secret") pod "global-pull-secret-syncer-jxlqd" (UID: "529d219d-5011-4cd4-8dde-30b659530d16") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:09:04.311734 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:04.311672 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:09:04.311734 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:04.311687 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:09:04.311734 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:04.311703 2566 projected.go:196] Error preparing data for projected volume kube-api-access-k5ggm for pod openshift-network-diagnostics/network-check-target-5lz4c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:09:04.311896 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:04.311742 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16197990-fb02-48a4-a024-5b467398b37f-kube-api-access-k5ggm podName:16197990-fb02-48a4-a024-5b467398b37f nodeName:}" failed. No retries permitted until 2026-07-06 22:09:06.311729323 +0000 UTC m=+6.166694785 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-k5ggm" (UniqueName: "kubernetes.io/projected/16197990-fb02-48a4-a024-5b467398b37f-kube-api-access-k5ggm") pod "network-check-target-5lz4c" (UID: "16197990-fb02-48a4-a024-5b467398b37f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:09:04.459522 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:04.459493 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:09:04.460898 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:04.460839 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68ddaafe_8f13_4c5f_b134_7e71ca1f24da.slice/crio-48647897a2385dd5e058223b7c52ca2bba6ccc2cd3644c63668ab3e8c74555e2 WatchSource:0}: Error finding container 48647897a2385dd5e058223b7c52ca2bba6ccc2cd3644c63668ab3e8c74555e2: Status 404 returned error can't find the container with id 48647897a2385dd5e058223b7c52ca2bba6ccc2cd3644c63668ab3e8c74555e2 Jul 06 22:09:04.465756 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:04.465725 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1566a0b0_dbc3_4448_874e_151da27d7a27.slice/crio-e839dfdb13177646a1c8d70abc6bcbd36694b5b565ca40a458b8effa59db8e6c WatchSource:0}: Error finding container e839dfdb13177646a1c8d70abc6bcbd36694b5b565ca40a458b8effa59db8e6c: Status 404 returned error can't find the container with id e839dfdb13177646a1c8d70abc6bcbd36694b5b565ca40a458b8effa59db8e6c Jul 06 22:09:04.632631 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:04.632550 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 22:04:02 +0000 UTC" deadline="2028-02-24 19:26:01.22370157 +0000 UTC" Jul 06 22:09:04.632631 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:04.632591 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14349h16m56.591116166s" Jul 06 22:09:04.748344 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:04.748018 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-47.ec2.internal" event={"ID":"3f28b5bc82b8c792024d97a7b33da272","Type":"ContainerStarted","Data":"1690a145e3d02b0dd958575abe2def3d43898dc858ef82f589ba48468049eecc"} Jul 06 22:09:04.754226 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:04.754018 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lbxng" event={"ID":"1566a0b0-dbc3-4448-874e-151da27d7a27","Type":"ContainerStarted","Data":"e839dfdb13177646a1c8d70abc6bcbd36694b5b565ca40a458b8effa59db8e6c"} Jul 06 22:09:04.760499 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:04.760468 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-slnnv" event={"ID":"68ddaafe-8f13-4c5f-b134-7e71ca1f24da","Type":"ContainerStarted","Data":"48647897a2385dd5e058223b7c52ca2bba6ccc2cd3644c63668ab3e8c74555e2"} Jul 06 22:09:05.721208 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:05.721176 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:05.721629 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:05.721316 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlqd" podUID="529d219d-5011-4cd4-8dde-30b659530d16" Jul 06 22:09:05.721761 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:05.721741 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:09:05.721869 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:05.721841 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lz4c" podUID="16197990-fb02-48a4-a024-5b467398b37f" Jul 06 22:09:05.721959 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:05.721938 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:05.722051 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:05.722026 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gbfj" podUID="ca356800-b17f-42ba-adab-dbd69bc554db" Jul 06 22:09:05.772145 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:05.772042 2566 generic.go:356] "Generic (PLEG): container finished" podID="8ab0104f50ba57a98f6742c4a020f3b5" containerID="dbef27ba0bb9fd215d433365908649a42ba81472e460193d4d3aeb7f1f1e3b39" exitCode=0 Jul 06 22:09:05.772308 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:05.772142 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-47.ec2.internal" event={"ID":"8ab0104f50ba57a98f6742c4a020f3b5","Type":"ContainerDied","Data":"dbef27ba0bb9fd215d433365908649a42ba81472e460193d4d3aeb7f1f1e3b39"} Jul 06 22:09:05.795366 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:05.795299 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-47.ec2.internal" podStartSLOduration=3.79527687 podStartE2EDuration="3.79527687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:09:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:09:04.769565402 +0000 UTC m=+4.624530851" watchObservedRunningTime="2026-07-06 22:09:05.79527687 +0000 UTC m=+5.650242345" Jul 06 22:09:06.230105 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:06.230071 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca356800-b17f-42ba-adab-dbd69bc554db-metrics-certs\") pod \"network-metrics-daemon-7gbfj\" (UID: \"ca356800-b17f-42ba-adab-dbd69bc554db\") " pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:06.230294 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:06.230227 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:09:06.230366 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:06.230334 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca356800-b17f-42ba-adab-dbd69bc554db-metrics-certs podName:ca356800-b17f-42ba-adab-dbd69bc554db nodeName:}" failed. No retries permitted until 2026-07-06 22:09:10.230311095 +0000 UTC m=+10.085276554 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca356800-b17f-42ba-adab-dbd69bc554db-metrics-certs") pod "network-metrics-daemon-7gbfj" (UID: "ca356800-b17f-42ba-adab-dbd69bc554db") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:09:06.331481 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:06.331444 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5ggm\" (UniqueName: \"kubernetes.io/projected/16197990-fb02-48a4-a024-5b467398b37f-kube-api-access-k5ggm\") pod \"network-check-target-5lz4c\" (UID: \"16197990-fb02-48a4-a024-5b467398b37f\") " pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:09:06.331671 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:06.331495 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/529d219d-5011-4cd4-8dde-30b659530d16-original-pull-secret\") pod \"global-pull-secret-syncer-jxlqd\" (UID: \"529d219d-5011-4cd4-8dde-30b659530d16\") " pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:06.331671 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:06.331638 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:09:06.331784 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:06.331706 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/529d219d-5011-4cd4-8dde-30b659530d16-original-pull-secret podName:529d219d-5011-4cd4-8dde-30b659530d16 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:10.331677399 +0000 UTC m=+10.186642859 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/529d219d-5011-4cd4-8dde-30b659530d16-original-pull-secret") pod "global-pull-secret-syncer-jxlqd" (UID: "529d219d-5011-4cd4-8dde-30b659530d16") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:09:06.332119 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:06.332103 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:09:06.332220 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:06.332122 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:09:06.332220 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:06.332131 2566 projected.go:196] Error preparing data for projected volume kube-api-access-k5ggm for pod openshift-network-diagnostics/network-check-target-5lz4c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:09:06.332220 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:06.332165 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16197990-fb02-48a4-a024-5b467398b37f-kube-api-access-k5ggm podName:16197990-fb02-48a4-a024-5b467398b37f nodeName:}" failed. No retries permitted until 2026-07-06 22:09:10.332153861 +0000 UTC m=+10.187119305 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-k5ggm" (UniqueName: "kubernetes.io/projected/16197990-fb02-48a4-a024-5b467398b37f-kube-api-access-k5ggm") pod "network-check-target-5lz4c" (UID: "16197990-fb02-48a4-a024-5b467398b37f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:09:07.721253 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:07.721220 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:07.721253 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:07.721244 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:09:07.721934 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:07.721363 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlqd" podUID="529d219d-5011-4cd4-8dde-30b659530d16" Jul 06 22:09:07.721934 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:07.721417 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lz4c" podUID="16197990-fb02-48a4-a024-5b467398b37f" Jul 06 22:09:07.721934 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:07.721467 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:07.721934 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:07.721546 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gbfj" podUID="ca356800-b17f-42ba-adab-dbd69bc554db" Jul 06 22:09:09.721102 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:09.721023 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:09.721102 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:09.721055 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:09:09.721102 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:09.721071 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:09.721691 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:09.721166 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlqd" podUID="529d219d-5011-4cd4-8dde-30b659530d16" Jul 06 22:09:09.721691 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:09.721208 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lz4c" podUID="16197990-fb02-48a4-a024-5b467398b37f" Jul 06 22:09:09.721691 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:09.721283 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gbfj" podUID="ca356800-b17f-42ba-adab-dbd69bc554db" Jul 06 22:09:10.266994 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:10.266860 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca356800-b17f-42ba-adab-dbd69bc554db-metrics-certs\") pod \"network-metrics-daemon-7gbfj\" (UID: \"ca356800-b17f-42ba-adab-dbd69bc554db\") " pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:10.267166 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:10.267014 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:09:10.267166 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:10.267096 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca356800-b17f-42ba-adab-dbd69bc554db-metrics-certs podName:ca356800-b17f-42ba-adab-dbd69bc554db nodeName:}" failed. No retries permitted until 2026-07-06 22:09:18.267075136 +0000 UTC m=+18.122040601 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca356800-b17f-42ba-adab-dbd69bc554db-metrics-certs") pod "network-metrics-daemon-7gbfj" (UID: "ca356800-b17f-42ba-adab-dbd69bc554db") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:09:10.368088 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:10.367990 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5ggm\" (UniqueName: \"kubernetes.io/projected/16197990-fb02-48a4-a024-5b467398b37f-kube-api-access-k5ggm\") pod \"network-check-target-5lz4c\" (UID: \"16197990-fb02-48a4-a024-5b467398b37f\") " pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:09:10.368088 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:10.368032 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/529d219d-5011-4cd4-8dde-30b659530d16-original-pull-secret\") pod \"global-pull-secret-syncer-jxlqd\" (UID: \"529d219d-5011-4cd4-8dde-30b659530d16\") " pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:10.368307 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:10.368216 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:09:10.368307 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:10.368294 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/529d219d-5011-4cd4-8dde-30b659530d16-original-pull-secret podName:529d219d-5011-4cd4-8dde-30b659530d16 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:18.368275352 +0000 UTC m=+18.223240799 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/529d219d-5011-4cd4-8dde-30b659530d16-original-pull-secret") pod "global-pull-secret-syncer-jxlqd" (UID: "529d219d-5011-4cd4-8dde-30b659530d16") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:09:10.368381 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:10.368218 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:09:10.368381 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:10.368333 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:09:10.368381 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:10.368347 2566 projected.go:196] Error preparing data for projected volume kube-api-access-k5ggm for pod openshift-network-diagnostics/network-check-target-5lz4c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:09:10.368463 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:10.368391 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16197990-fb02-48a4-a024-5b467398b37f-kube-api-access-k5ggm podName:16197990-fb02-48a4-a024-5b467398b37f nodeName:}" failed. No retries permitted until 2026-07-06 22:09:18.3683788 +0000 UTC m=+18.223344244 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-k5ggm" (UniqueName: "kubernetes.io/projected/16197990-fb02-48a4-a024-5b467398b37f-kube-api-access-k5ggm") pod "network-check-target-5lz4c" (UID: "16197990-fb02-48a4-a024-5b467398b37f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:09:11.721053 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:11.721015 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:11.721053 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:11.721050 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:11.721587 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:11.721048 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:09:11.721587 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:11.721143 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlqd" podUID="529d219d-5011-4cd4-8dde-30b659530d16" Jul 06 22:09:11.721587 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:11.721223 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gbfj" podUID="ca356800-b17f-42ba-adab-dbd69bc554db" Jul 06 22:09:11.721587 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:11.721303 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lz4c" podUID="16197990-fb02-48a4-a024-5b467398b37f" Jul 06 22:09:13.720877 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:13.720829 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:13.721257 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:13.720897 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:09:13.721257 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:13.720985 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:13.721257 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:13.720995 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlqd" podUID="529d219d-5011-4cd4-8dde-30b659530d16" Jul 06 22:09:13.721257 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:13.721100 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gbfj" podUID="ca356800-b17f-42ba-adab-dbd69bc554db" Jul 06 22:09:13.721257 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:13.721164 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lz4c" podUID="16197990-fb02-48a4-a024-5b467398b37f" Jul 06 22:09:15.721354 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:15.721324 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:15.721766 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:15.721436 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:09:15.721766 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:15.721449 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlqd" podUID="529d219d-5011-4cd4-8dde-30b659530d16" Jul 06 22:09:15.721766 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:15.721561 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lz4c" podUID="16197990-fb02-48a4-a024-5b467398b37f" Jul 06 22:09:15.721766 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:15.721613 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:15.721766 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:15.721696 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gbfj" podUID="ca356800-b17f-42ba-adab-dbd69bc554db" Jul 06 22:09:17.721409 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:17.721369 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:17.721946 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:17.721369 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:17.721946 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:17.721511 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlqd" podUID="529d219d-5011-4cd4-8dde-30b659530d16" Jul 06 22:09:17.721946 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:17.721369 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:09:17.721946 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:17.721622 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gbfj" podUID="ca356800-b17f-42ba-adab-dbd69bc554db" Jul 06 22:09:17.721946 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:17.721716 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lz4c" podUID="16197990-fb02-48a4-a024-5b467398b37f" Jul 06 22:09:18.332605 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:18.332561 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca356800-b17f-42ba-adab-dbd69bc554db-metrics-certs\") pod \"network-metrics-daemon-7gbfj\" (UID: \"ca356800-b17f-42ba-adab-dbd69bc554db\") " pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:18.332780 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:18.332705 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:09:18.332780 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:18.332780 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca356800-b17f-42ba-adab-dbd69bc554db-metrics-certs podName:ca356800-b17f-42ba-adab-dbd69bc554db nodeName:}" failed. No retries permitted until 2026-07-06 22:09:34.332762782 +0000 UTC m=+34.187728227 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca356800-b17f-42ba-adab-dbd69bc554db-metrics-certs") pod "network-metrics-daemon-7gbfj" (UID: "ca356800-b17f-42ba-adab-dbd69bc554db") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:09:18.433374 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:18.433315 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5ggm\" (UniqueName: \"kubernetes.io/projected/16197990-fb02-48a4-a024-5b467398b37f-kube-api-access-k5ggm\") pod \"network-check-target-5lz4c\" (UID: \"16197990-fb02-48a4-a024-5b467398b37f\") " pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:09:18.433374 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:18.433364 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/529d219d-5011-4cd4-8dde-30b659530d16-original-pull-secret\") pod \"global-pull-secret-syncer-jxlqd\" (UID: \"529d219d-5011-4cd4-8dde-30b659530d16\") " pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:18.433591 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:18.433492 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:09:18.433591 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:18.433495 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:09:18.433591 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:18.433521 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:09:18.433591 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:18.433534 2566 projected.go:196] Error preparing data for projected volume kube-api-access-k5ggm for pod openshift-network-diagnostics/network-check-target-5lz4c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:09:18.433591 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:18.433559 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/529d219d-5011-4cd4-8dde-30b659530d16-original-pull-secret podName:529d219d-5011-4cd4-8dde-30b659530d16 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:34.433541734 +0000 UTC m=+34.288507182 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/529d219d-5011-4cd4-8dde-30b659530d16-original-pull-secret") pod "global-pull-secret-syncer-jxlqd" (UID: "529d219d-5011-4cd4-8dde-30b659530d16") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:09:18.433591 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:18.433583 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16197990-fb02-48a4-a024-5b467398b37f-kube-api-access-k5ggm podName:16197990-fb02-48a4-a024-5b467398b37f nodeName:}" failed. No retries permitted until 2026-07-06 22:09:34.433569513 +0000 UTC m=+34.288534978 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-k5ggm" (UniqueName: "kubernetes.io/projected/16197990-fb02-48a4-a024-5b467398b37f-kube-api-access-k5ggm") pod "network-check-target-5lz4c" (UID: "16197990-fb02-48a4-a024-5b467398b37f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:09:19.721373 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:19.721333 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:19.721914 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:19.721506 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:09:19.721914 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:19.721513 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gbfj" podUID="ca356800-b17f-42ba-adab-dbd69bc554db" Jul 06 22:09:19.721914 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:19.721601 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lz4c" podUID="16197990-fb02-48a4-a024-5b467398b37f" Jul 06 22:09:19.721914 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:19.721612 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:19.721914 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:19.721712 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlqd" podUID="529d219d-5011-4cd4-8dde-30b659530d16" Jul 06 22:09:21.721083 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:21.721046 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:21.721464 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:21.721149 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:21.721464 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:21.721165 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlqd" podUID="529d219d-5011-4cd4-8dde-30b659530d16" Jul 06 22:09:21.721464 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:21.721184 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:09:21.721464 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:21.721269 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gbfj" podUID="ca356800-b17f-42ba-adab-dbd69bc554db" Jul 06 22:09:21.721464 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:21.721320 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lz4c" podUID="16197990-fb02-48a4-a024-5b467398b37f" Jul 06 22:09:22.808544 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:22.808505 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-47.ec2.internal" event={"ID":"8ab0104f50ba57a98f6742c4a020f3b5","Type":"ContainerStarted","Data":"4020cde406d138382abd177b4da389664589ab051ce7a05dee682bd2c8cdceab"} Jul 06 22:09:22.810081 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:22.810055 2566 generic.go:356] "Generic (PLEG): container finished" podID="0d1c5e61-2ad1-421b-a5f6-3595e1e60795" containerID="9d314e294c1f3c4536e57a47dec9001566dba115d6a97e04905456a7a7ff3948" exitCode=0 Jul 06 22:09:22.810201 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:22.810142 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7pwsx" event={"ID":"0d1c5e61-2ad1-421b-a5f6-3595e1e60795","Type":"ContainerDied","Data":"9d314e294c1f3c4536e57a47dec9001566dba115d6a97e04905456a7a7ff3948"} Jul 06 22:09:22.811873 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:22.811829 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fm45f" event={"ID":"8e89a94f-c9c4-4b73-bbb1-ea7f02dc8f9b","Type":"ContainerStarted","Data":"55b91d919b81becb1507d147a98e2b00ae179dd8d6caa940fad375842dbf8e39"} Jul 06 22:09:22.814945 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:22.814927 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd89j_b55a9306-a1b1-4824-bacd-cd43906b7951/ovn-acl-logging/0.log" Jul 06 22:09:22.815348 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:22.815325 2566 generic.go:356] "Generic (PLEG): container finished" podID="b55a9306-a1b1-4824-bacd-cd43906b7951" containerID="a3c1852d37bc7d5fb0abb16446ffc2beda86b288b2287bffa118518029963f34" exitCode=1 Jul 06 22:09:22.815455 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:22.815382 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" event={"ID":"b55a9306-a1b1-4824-bacd-cd43906b7951","Type":"ContainerStarted","Data":"e7d04df9caf3e564d890467931fa33b3a5fca1200de8465ada5777df06fc0b25"} Jul 06 22:09:22.815526 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:22.815471 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" event={"ID":"b55a9306-a1b1-4824-bacd-cd43906b7951","Type":"ContainerStarted","Data":"f3fd78d799853c6eb054ba21480228751c692c99adf57d53a78ff154e59d90ec"} Jul 06 22:09:22.815581 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:22.815526 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" event={"ID":"b55a9306-a1b1-4824-bacd-cd43906b7951","Type":"ContainerStarted","Data":"b45dd006025dc799f4bfb3afb6e8e1c48ec399bd5909196a163d39eeb72b9555"} Jul 06 22:09:22.815633 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:22.815578 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" event={"ID":"b55a9306-a1b1-4824-bacd-cd43906b7951","Type":"ContainerStarted","Data":"7839e042a3a15778e27d077ba47dfe3ea384c2d43fb2602293ece27e330df99e"} Jul 06 22:09:22.815686 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:22.815652 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" event={"ID":"b55a9306-a1b1-4824-bacd-cd43906b7951","Type":"ContainerDied","Data":"a3c1852d37bc7d5fb0abb16446ffc2beda86b288b2287bffa118518029963f34"} Jul 06 22:09:22.815737 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:22.815707 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" event={"ID":"b55a9306-a1b1-4824-bacd-cd43906b7951","Type":"ContainerStarted","Data":"2af7125a1def404e0a45821a57ef209fa7f28ae520ae44b18dc9941f37890333"} Jul 06 22:09:22.816970 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:22.816951 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z" event={"ID":"1072af1b-bac2-46fe-87b9-19a132f47409","Type":"ContainerStarted","Data":"bbbbd8a964135c5c8121aa09072266b7db8ccb14009be1019ba320b4194cf8a9"} Jul 06 22:09:22.818480 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:22.818455 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rxtpx" event={"ID":"4a098846-36ce-4c7a-aed0-d34810c73d9c","Type":"ContainerStarted","Data":"6aec33f5f5e29a6ec1767f1bab3b5460ab2ae072da12fd6dd47ba90983770fc9"} Jul 06 22:09:22.819948 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:22.819923 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6qdg8" event={"ID":"0d978ee1-0806-48e2-94e8-ebb1864485a4","Type":"ContainerStarted","Data":"6b9a17e36bac19c12ab25792ed82b74fe11ebfa61efb5a84fd902bc1a96c1714"} Jul 06 22:09:22.821462 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:22.821443 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lbxng" event={"ID":"1566a0b0-dbc3-4448-874e-151da27d7a27","Type":"ContainerStarted","Data":"83ceef5c1acf7f65ec3dfdefb438638007007ebaa49e1e7f5d3f18e114172685"} Jul 06 22:09:22.823018 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:22.823000 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-slnnv" event={"ID":"68ddaafe-8f13-4c5f-b134-7e71ca1f24da","Type":"ContainerStarted","Data":"8f9a1c584b422db8ac02adf5b2f425615dc9b29be836ce1d532e5bdd38f72c08"} Jul 06 22:09:22.825092 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:22.825054 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-47.ec2.internal" podStartSLOduration=20.825041941 podStartE2EDuration="20.825041941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:09:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:09:22.824321804 +0000 UTC m=+22.679287270" watchObservedRunningTime="2026-07-06 22:09:22.825041941 +0000 UTC m=+22.680007408" Jul 06 22:09:22.838478 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:22.838427 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6qdg8" podStartSLOduration=2.930948521 podStartE2EDuration="21.838414215s" totalImagesPullingTime="18.907465694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:09:22.837983142 +0000 UTC m=+22.692948608" watchObservedRunningTime="2026-07-06 22:09:22.838414215 +0000 UTC m=+22.693379681" Jul 06 22:09:22.853607 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:22.853560 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fm45f" podStartSLOduration=2.938655255 podStartE2EDuration="21.853543435s" totalImagesPullingTime="18.91488818s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:09:22.852939357 +0000 UTC m=+22.707904825" watchObservedRunningTime="2026-07-06 22:09:22.853543435 +0000 UTC m=+22.708508900" Jul 06 22:09:22.889474 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:22.889418 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-slnnv" podStartSLOduration=4.510536827 podStartE2EDuration="21.889403072s" totalImagesPullingTime="17.378866245s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:09:22.889327208 +0000 UTC m=+22.744292674" watchObservedRunningTime="2026-07-06 22:09:22.889403072 +0000 UTC m=+22.744368537" Jul 06 22:09:22.903189 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:22.903143 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lbxng" podStartSLOduration=4.688299035 podStartE2EDuration="21.903127362s" totalImagesPullingTime="17.214828327s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:09:22.903028366 +0000 UTC m=+22.757993832" watchObservedRunningTime="2026-07-06 22:09:22.903127362 +0000 UTC m=+22.758092829" Jul 06 22:09:22.924486 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:22.924442 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rxtpx" podStartSLOduration=2.994811932 podStartE2EDuration="21.924426652s" totalImagesPullingTime="18.92961472s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:09:22.924100089 +0000 UTC m=+22.779065553" watchObservedRunningTime="2026-07-06 22:09:22.924426652 +0000 UTC m=+22.779392116" Jul 06 22:09:23.170227 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:23.170200 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 22:09:23.682299 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:23.682129 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T22:09:23.170220241Z","UUID":"1e5e25bd-83de-4b5b-a685-85a9e449bb41","Handler":null,"Name":"","Endpoint":""} Jul 06 22:09:23.683934 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:23.683912 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 22:09:23.684070 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:23.683956 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 22:09:23.721116 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:23.721061 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:23.721116 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:23.721096 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:23.721343 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:23.721232 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:09:23.721343 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:23.721229 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlqd" podUID="529d219d-5011-4cd4-8dde-30b659530d16" Jul 06 22:09:23.721343 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:23.721331 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gbfj" podUID="ca356800-b17f-42ba-adab-dbd69bc554db" Jul 06 22:09:23.721479 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:23.721402 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lz4c" podUID="16197990-fb02-48a4-a024-5b467398b37f" Jul 06 22:09:23.827020 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:23.826980 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z" event={"ID":"1072af1b-bac2-46fe-87b9-19a132f47409","Type":"ContainerStarted","Data":"1d99494429cac45458d36e02bc7e482915ed0b278a6b709eddc2fdfee6bb13be"} Jul 06 22:09:23.829244 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:23.828514 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s67c4" event={"ID":"5bf2872c-ee99-4736-a1fb-bb6f0cbcd951","Type":"ContainerStarted","Data":"5ab84982a7458cf1aa8bb32b88af8d6113199ca2a8bf734a6ef61f4f338f1b05"} Jul 06 22:09:24.832761 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:24.832724 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z" event={"ID":"1072af1b-bac2-46fe-87b9-19a132f47409","Type":"ContainerStarted","Data":"76c61ede985214568a0b24be8b1e2abcc603e2abe77df79039dfb081f74cf127"} Jul 06 22:09:24.851443 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:24.851400 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq4z" podStartSLOduration=2.7676631609999998 podStartE2EDuration="23.85138555s" totalImagesPullingTime="21.083722389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:09:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:09:24.851075356 +0000 UTC m=+24.706040833" watchObservedRunningTime="2026-07-06 22:09:24.85138555 +0000 UTC m=+24.706351017" Jul 06 22:09:24.851652 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:24.851634 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s67c4" podStartSLOduration=4.916126735 podStartE2EDuration="23.851626242s" totalImagesPullingTime="18.935499507s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:09:23.845004727 +0000 UTC m=+23.699970194" watchObservedRunningTime="2026-07-06 22:09:24.851626242 +0000 UTC m=+24.706591703" Jul 06 22:09:25.721170 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:25.721141 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:25.721170 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:25.721169 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:25.721402 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:25.721136 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:09:25.721402 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:25.721256 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlqd" podUID="529d219d-5011-4cd4-8dde-30b659530d16" Jul 06 22:09:25.721402 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:25.721374 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gbfj" podUID="ca356800-b17f-42ba-adab-dbd69bc554db" Jul 06 22:09:25.721520 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:25.721460 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lz4c" podUID="16197990-fb02-48a4-a024-5b467398b37f" Jul 06 22:09:25.837680 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:25.837655 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd89j_b55a9306-a1b1-4824-bacd-cd43906b7951/ovn-acl-logging/0.log" Jul 06 22:09:25.838154 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:25.838049 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" event={"ID":"b55a9306-a1b1-4824-bacd-cd43906b7951","Type":"ContainerStarted","Data":"52a2ea1f4f1920ef69c3ad1bfcf23f8a569d0cc966f3e4c9554d110e7c029555"} Jul 06 22:09:26.077348 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:26.077269 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6qdg8" Jul 06 22:09:26.077906 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:26.077887 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6qdg8" Jul 06 22:09:26.840241 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:26.840208 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6qdg8" Jul 06 22:09:26.840797 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:26.840758 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6qdg8" Jul 06 22:09:27.721555 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:27.721525 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:09:27.721555 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:27.721552 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:27.721770 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:27.721519 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:27.721770 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:27.721634 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lz4c" podUID="16197990-fb02-48a4-a024-5b467398b37f" Jul 06 22:09:27.721770 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:27.721688 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlqd" podUID="529d219d-5011-4cd4-8dde-30b659530d16" Jul 06 22:09:27.721906 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:27.721787 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gbfj" podUID="ca356800-b17f-42ba-adab-dbd69bc554db" Jul 06 22:09:28.848088 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:28.847884 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd89j_b55a9306-a1b1-4824-bacd-cd43906b7951/ovn-acl-logging/0.log" Jul 06 22:09:28.850427 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:28.850338 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" event={"ID":"b55a9306-a1b1-4824-bacd-cd43906b7951","Type":"ContainerStarted","Data":"3c1b074bc2d21e0639d8394b10ccd6f7ec3eaedc080bcca054f9da140c04f8bd"} Jul 06 22:09:28.850798 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:28.850765 2566 scope.go:117] "RemoveContainer" containerID="a3c1852d37bc7d5fb0abb16446ffc2beda86b288b2287bffa118518029963f34" Jul 06 22:09:29.721535 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:29.721504 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:29.721675 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:29.721592 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:09:29.721675 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:29.721598 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlqd" podUID="529d219d-5011-4cd4-8dde-30b659530d16" Jul 06 22:09:29.721675 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:29.721604 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:29.721778 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:29.721678 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lz4c" podUID="16197990-fb02-48a4-a024-5b467398b37f" Jul 06 22:09:29.721778 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:29.721741 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gbfj" podUID="ca356800-b17f-42ba-adab-dbd69bc554db" Jul 06 22:09:29.855661 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:29.855563 2566 generic.go:356] "Generic (PLEG): container finished" podID="0d1c5e61-2ad1-421b-a5f6-3595e1e60795" containerID="1d2767d1758f6953b729bdf915c21e0c7eb60bcf62519fec165b6a1ee563804a" exitCode=0 Jul 06 22:09:29.856178 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:29.855668 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7pwsx" event={"ID":"0d1c5e61-2ad1-421b-a5f6-3595e1e60795","Type":"ContainerDied","Data":"1d2767d1758f6953b729bdf915c21e0c7eb60bcf62519fec165b6a1ee563804a"} Jul 06 22:09:29.864947 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:29.864924 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd89j_b55a9306-a1b1-4824-bacd-cd43906b7951/ovn-acl-logging/0.log" Jul 06 22:09:29.865850 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:29.865353 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" event={"ID":"b55a9306-a1b1-4824-bacd-cd43906b7951","Type":"ContainerStarted","Data":"eb7f9127296cb8a18a6aa936ee89aa772787ec0a0c34d37565bf20a4da3000c0"} Jul 06 22:09:29.865850 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:29.865654 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:29.865850 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:29.865734 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:29.865850 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:29.865780 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:29.884362 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:29.884332 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:29.884524 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:29.884436 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:09:29.909344 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:29.909272 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" podStartSLOduration=9.598429114 podStartE2EDuration="28.909252014s" totalImagesPullingTime="19.3108229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:09:29.908826436 +0000 UTC m=+29.763791930" watchObservedRunningTime="2026-07-06 22:09:29.909252014 +0000 UTC m=+29.764217481" Jul 06 22:09:30.841035 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:30.840793 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7gbfj"] Jul 06 22:09:30.841163 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:30.841153 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:30.841256 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:30.841238 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gbfj" podUID="ca356800-b17f-42ba-adab-dbd69bc554db" Jul 06 22:09:30.843442 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:30.843421 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jxlqd"] Jul 06 22:09:30.843543 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:30.843503 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:30.843602 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:30.843580 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlqd" podUID="529d219d-5011-4cd4-8dde-30b659530d16" Jul 06 22:09:30.844181 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:30.844161 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5lz4c"] Jul 06 22:09:30.844263 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:30.844248 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:09:30.844354 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:30.844335 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lz4c" podUID="16197990-fb02-48a4-a024-5b467398b37f" Jul 06 22:09:30.870916 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:30.870880 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7pwsx" event={"ID":"0d1c5e61-2ad1-421b-a5f6-3595e1e60795","Type":"ContainerStarted","Data":"6912d25e5cd4186aa27f5bf8c2b1806e6891e6fcad4965e4e842f451f25f432d"} Jul 06 22:09:31.875131 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:31.875102 2566 generic.go:356] "Generic (PLEG): container finished" podID="0d1c5e61-2ad1-421b-a5f6-3595e1e60795" containerID="6912d25e5cd4186aa27f5bf8c2b1806e6891e6fcad4965e4e842f451f25f432d" exitCode=0 Jul 06 22:09:31.875575 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:31.875185 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7pwsx" event={"ID":"0d1c5e61-2ad1-421b-a5f6-3595e1e60795","Type":"ContainerDied","Data":"6912d25e5cd4186aa27f5bf8c2b1806e6891e6fcad4965e4e842f451f25f432d"} Jul 06 22:09:32.723792 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:32.723763 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:32.723977 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:32.723881 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:09:32.723977 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:32.723899 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlqd" podUID="529d219d-5011-4cd4-8dde-30b659530d16" Jul 06 22:09:32.723977 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:32.723959 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lz4c" podUID="16197990-fb02-48a4-a024-5b467398b37f" Jul 06 22:09:32.724131 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:32.723997 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:32.724131 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:32.724052 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gbfj" podUID="ca356800-b17f-42ba-adab-dbd69bc554db" Jul 06 22:09:32.879395 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:32.879317 2566 generic.go:356] "Generic (PLEG): container finished" podID="0d1c5e61-2ad1-421b-a5f6-3595e1e60795" containerID="28574771c6fbbc956ff8102830f8cfc6d45f6e24ba8e27e68dfe6890669ffc9c" exitCode=0 Jul 06 22:09:32.879395 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:32.879363 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7pwsx" event={"ID":"0d1c5e61-2ad1-421b-a5f6-3595e1e60795","Type":"ContainerDied","Data":"28574771c6fbbc956ff8102830f8cfc6d45f6e24ba8e27e68dfe6890669ffc9c"} Jul 06 22:09:34.346428 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.346383 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca356800-b17f-42ba-adab-dbd69bc554db-metrics-certs\") pod \"network-metrics-daemon-7gbfj\" (UID: \"ca356800-b17f-42ba-adab-dbd69bc554db\") " pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:34.346964 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:34.346516 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:09:34.346964 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:34.346582 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca356800-b17f-42ba-adab-dbd69bc554db-metrics-certs podName:ca356800-b17f-42ba-adab-dbd69bc554db nodeName:}" failed. No retries permitted until 2026-07-06 22:10:06.346564245 +0000 UTC m=+66.201529709 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca356800-b17f-42ba-adab-dbd69bc554db-metrics-certs") pod "network-metrics-daemon-7gbfj" (UID: "ca356800-b17f-42ba-adab-dbd69bc554db") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:09:34.447262 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.447237 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5ggm\" (UniqueName: \"kubernetes.io/projected/16197990-fb02-48a4-a024-5b467398b37f-kube-api-access-k5ggm\") pod \"network-check-target-5lz4c\" (UID: \"16197990-fb02-48a4-a024-5b467398b37f\") " pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:09:34.447339 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.447274 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/529d219d-5011-4cd4-8dde-30b659530d16-original-pull-secret\") pod \"global-pull-secret-syncer-jxlqd\" (UID: \"529d219d-5011-4cd4-8dde-30b659530d16\") " pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:34.447384 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:34.447373 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:09:34.447414 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:34.447397 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:09:34.447449 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:34.447419 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:09:34.447449 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:34.447428 2566 projected.go:196] Error preparing data for projected volume kube-api-access-k5ggm for pod openshift-network-diagnostics/network-check-target-5lz4c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:09:34.447449 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:34.447447 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/529d219d-5011-4cd4-8dde-30b659530d16-original-pull-secret podName:529d219d-5011-4cd4-8dde-30b659530d16 nodeName:}" failed. No retries permitted until 2026-07-06 22:10:06.447411676 +0000 UTC m=+66.302377125 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/529d219d-5011-4cd4-8dde-30b659530d16-original-pull-secret") pod "global-pull-secret-syncer-jxlqd" (UID: "529d219d-5011-4cd4-8dde-30b659530d16") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:09:34.447549 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:34.447469 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16197990-fb02-48a4-a024-5b467398b37f-kube-api-access-k5ggm podName:16197990-fb02-48a4-a024-5b467398b37f nodeName:}" failed. No retries permitted until 2026-07-06 22:10:06.4474578 +0000 UTC m=+66.302423244 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-k5ggm" (UniqueName: "kubernetes.io/projected/16197990-fb02-48a4-a024-5b467398b37f-kube-api-access-k5ggm") pod "network-check-target-5lz4c" (UID: "16197990-fb02-48a4-a024-5b467398b37f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:09:34.724244 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.724217 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:09:34.724463 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.724217 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:34.724463 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:34.724313 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lz4c" podUID="16197990-fb02-48a4-a024-5b467398b37f" Jul 06 22:09:34.724463 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:34.724394 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gbfj" podUID="ca356800-b17f-42ba-adab-dbd69bc554db" Jul 06 22:09:34.724463 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.724217 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:34.724590 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:34.724466 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlqd" podUID="529d219d-5011-4cd4-8dde-30b659530d16" Jul 06 22:09:34.897925 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.897896 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-47.ec2.internal" event="NodeReady" Jul 06 22:09:34.898104 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.898053 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 22:09:34.945276 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.945245 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-cf9974c67-z4qd4"] Jul 06 22:09:34.946946 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.946931 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:34.951399 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.951378 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kshfh\"" Jul 06 22:09:34.951511 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.951405 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 22:09:34.951511 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.951380 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 22:09:34.952008 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.951991 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 22:09:34.957353 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.957324 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-x2b5k"] Jul 06 22:09:34.957482 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.957467 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 22:09:34.959087 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.959072 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x2b5k" Jul 06 22:09:34.960463 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.960444 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9xgnl"] Jul 06 22:09:34.961458 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.961440 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fbkk6\"" Jul 06 22:09:34.961546 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.961440 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 22:09:34.961546 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.961470 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 22:09:34.962058 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.962039 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9xgnl" Jul 06 22:09:34.962442 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.962425 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 22:09:34.963692 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.963672 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cf9974c67-z4qd4"] Jul 06 22:09:34.964522 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.964499 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 22:09:34.966070 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.966050 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 22:09:34.966229 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.966215 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ddjw7\"" Jul 06 22:09:34.976657 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.976450 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x2b5k"] Jul 06 22:09:34.977099 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:34.977082 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9xgnl"] Jul 06 22:09:35.051796 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.051760 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f5bba360-152a-4076-be57-f8ef9a7bf819-trusted-ca\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:35.051994 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.051810 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f5bba360-152a-4076-be57-f8ef9a7bf819-image-registry-private-configuration\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:35.051994 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.051870 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f5bba360-152a-4076-be57-f8ef9a7bf819-ca-trust-extracted\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:35.051994 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.051890 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f5bba360-152a-4076-be57-f8ef9a7bf819-installation-pull-secrets\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:35.051994 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.051913 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25pjb\" (UniqueName: \"kubernetes.io/projected/145334b3-5315-4006-9dac-73c2770182f9-kube-api-access-25pjb\") pod \"ingress-canary-x2b5k\" (UID: \"145334b3-5315-4006-9dac-73c2770182f9\") " pod="openshift-ingress-canary/ingress-canary-x2b5k" Jul 06 22:09:35.051994 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.051943 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/208e55fc-7d73-40c3-80e1-079cec2157a4-tmp-dir\") pod \"dns-default-9xgnl\" (UID: \"208e55fc-7d73-40c3-80e1-079cec2157a4\") " pod="openshift-dns/dns-default-9xgnl" Jul 06 22:09:35.051994 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.051963 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd4c6\" (UniqueName: \"kubernetes.io/projected/208e55fc-7d73-40c3-80e1-079cec2157a4-kube-api-access-hd4c6\") pod \"dns-default-9xgnl\" (UID: \"208e55fc-7d73-40c3-80e1-079cec2157a4\") " pod="openshift-dns/dns-default-9xgnl" Jul 06 22:09:35.051994 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.051980 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/208e55fc-7d73-40c3-80e1-079cec2157a4-metrics-tls\") pod \"dns-default-9xgnl\" (UID: \"208e55fc-7d73-40c3-80e1-079cec2157a4\") " pod="openshift-dns/dns-default-9xgnl" Jul 06 22:09:35.052354 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.052007 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwdsz\" (UniqueName: \"kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-kube-api-access-mwdsz\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:35.052354 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.052051 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/145334b3-5315-4006-9dac-73c2770182f9-cert\") pod \"ingress-canary-x2b5k\" (UID: \"145334b3-5315-4006-9dac-73c2770182f9\") " pod="openshift-ingress-canary/ingress-canary-x2b5k" Jul 06 22:09:35.052354 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.052128 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-tls\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:35.052354 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.052161 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-certificates\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:35.052354 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.052179 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-bound-sa-token\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:35.052354 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.052194 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/208e55fc-7d73-40c3-80e1-079cec2157a4-config-volume\") pod \"dns-default-9xgnl\" (UID: \"208e55fc-7d73-40c3-80e1-079cec2157a4\") " pod="openshift-dns/dns-default-9xgnl" Jul 06 22:09:35.153124 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.153089 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f5bba360-152a-4076-be57-f8ef9a7bf819-ca-trust-extracted\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:35.153124 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.153126 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f5bba360-152a-4076-be57-f8ef9a7bf819-installation-pull-secrets\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:35.153346 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.153142 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25pjb\" (UniqueName: \"kubernetes.io/projected/145334b3-5315-4006-9dac-73c2770182f9-kube-api-access-25pjb\") pod \"ingress-canary-x2b5k\" (UID: \"145334b3-5315-4006-9dac-73c2770182f9\") " pod="openshift-ingress-canary/ingress-canary-x2b5k" Jul 06 22:09:35.153346 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.153166 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/208e55fc-7d73-40c3-80e1-079cec2157a4-tmp-dir\") pod \"dns-default-9xgnl\" (UID: \"208e55fc-7d73-40c3-80e1-079cec2157a4\") " pod="openshift-dns/dns-default-9xgnl" Jul 06 22:09:35.153346 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.153191 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd4c6\" (UniqueName: \"kubernetes.io/projected/208e55fc-7d73-40c3-80e1-079cec2157a4-kube-api-access-hd4c6\") pod \"dns-default-9xgnl\" (UID: \"208e55fc-7d73-40c3-80e1-079cec2157a4\") " pod="openshift-dns/dns-default-9xgnl" Jul 06 22:09:35.153346 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.153217 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/208e55fc-7d73-40c3-80e1-079cec2157a4-metrics-tls\") pod \"dns-default-9xgnl\" (UID: \"208e55fc-7d73-40c3-80e1-079cec2157a4\") " pod="openshift-dns/dns-default-9xgnl" Jul 06 22:09:35.153346 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.153254 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwdsz\" (UniqueName: \"kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-kube-api-access-mwdsz\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:35.153346 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.153275 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/145334b3-5315-4006-9dac-73c2770182f9-cert\") pod \"ingress-canary-x2b5k\" (UID: \"145334b3-5315-4006-9dac-73c2770182f9\") " pod="openshift-ingress-canary/ingress-canary-x2b5k" Jul 06 22:09:35.153346 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.153304 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-tls\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:35.153346 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:35.153326 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:09:35.153346 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.153340 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-certificates\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:35.153768 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.153365 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-bound-sa-token\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:35.153768 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:35.153399 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/208e55fc-7d73-40c3-80e1-079cec2157a4-metrics-tls podName:208e55fc-7d73-40c3-80e1-079cec2157a4 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:35.653377165 +0000 UTC m=+35.508342623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/208e55fc-7d73-40c3-80e1-079cec2157a4-metrics-tls") pod "dns-default-9xgnl" (UID: "208e55fc-7d73-40c3-80e1-079cec2157a4") : secret "dns-default-metrics-tls" not found Jul 06 22:09:35.153768 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.153423 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/208e55fc-7d73-40c3-80e1-079cec2157a4-config-volume\") pod \"dns-default-9xgnl\" (UID: \"208e55fc-7d73-40c3-80e1-079cec2157a4\") " pod="openshift-dns/dns-default-9xgnl" Jul 06 22:09:35.153768 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.153461 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f5bba360-152a-4076-be57-f8ef9a7bf819-trusted-ca\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:35.153768 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:35.153510 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:09:35.153768 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:35.153531 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cf9974c67-z4qd4: secret "image-registry-tls" not found Jul 06 22:09:35.153768 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.153544 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f5bba360-152a-4076-be57-f8ef9a7bf819-ca-trust-extracted\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:35.153768 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:35.153587 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-tls podName:f5bba360-152a-4076-be57-f8ef9a7bf819 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:35.653571065 +0000 UTC m=+35.508536527 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-tls") pod "image-registry-cf9974c67-z4qd4" (UID: "f5bba360-152a-4076-be57-f8ef9a7bf819") : secret "image-registry-tls" not found Jul 06 22:09:35.153768 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.153511 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f5bba360-152a-4076-be57-f8ef9a7bf819-image-registry-private-configuration\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:35.153768 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.153670 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/208e55fc-7d73-40c3-80e1-079cec2157a4-tmp-dir\") pod \"dns-default-9xgnl\" (UID: \"208e55fc-7d73-40c3-80e1-079cec2157a4\") " pod="openshift-dns/dns-default-9xgnl" Jul 06 22:09:35.154241 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.154146 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/208e55fc-7d73-40c3-80e1-079cec2157a4-config-volume\") pod \"dns-default-9xgnl\" (UID: \"208e55fc-7d73-40c3-80e1-079cec2157a4\") " pod="openshift-dns/dns-default-9xgnl" Jul 06 22:09:35.154286 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.154272 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-certificates\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:35.154527 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.154502 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f5bba360-152a-4076-be57-f8ef9a7bf819-trusted-ca\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:35.157627 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.157515 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f5bba360-152a-4076-be57-f8ef9a7bf819-installation-pull-secrets\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:35.157713 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.157523 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/145334b3-5315-4006-9dac-73c2770182f9-cert\") pod \"ingress-canary-x2b5k\" (UID: \"145334b3-5315-4006-9dac-73c2770182f9\") " pod="openshift-ingress-canary/ingress-canary-x2b5k" Jul 06 22:09:35.157713 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.157532 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f5bba360-152a-4076-be57-f8ef9a7bf819-image-registry-private-configuration\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:35.163532 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.163513 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-bound-sa-token\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:35.164024 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.163996 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwdsz\" (UniqueName: \"kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-kube-api-access-mwdsz\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:35.164128 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.164109 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25pjb\" (UniqueName: \"kubernetes.io/projected/145334b3-5315-4006-9dac-73c2770182f9-kube-api-access-25pjb\") pod \"ingress-canary-x2b5k\" (UID: \"145334b3-5315-4006-9dac-73c2770182f9\") " pod="openshift-ingress-canary/ingress-canary-x2b5k" Jul 06 22:09:35.164262 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.164245 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd4c6\" (UniqueName: \"kubernetes.io/projected/208e55fc-7d73-40c3-80e1-079cec2157a4-kube-api-access-hd4c6\") pod \"dns-default-9xgnl\" (UID: \"208e55fc-7d73-40c3-80e1-079cec2157a4\") " pod="openshift-dns/dns-default-9xgnl" Jul 06 22:09:35.269150 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.269069 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x2b5k" Jul 06 22:09:35.431747 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.431717 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x2b5k"] Jul 06 22:09:35.436094 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:35.436067 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod145334b3_5315_4006_9dac_73c2770182f9.slice/crio-1df380a0cf50a2b96fd6a6e18beb42f34c9afcb203a5969dba2ea832fb06a530 WatchSource:0}: Error finding container 1df380a0cf50a2b96fd6a6e18beb42f34c9afcb203a5969dba2ea832fb06a530: Status 404 returned error can't find the container with id 1df380a0cf50a2b96fd6a6e18beb42f34c9afcb203a5969dba2ea832fb06a530 Jul 06 22:09:35.660929 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.660833 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-tls\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:35.661111 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.660963 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/208e55fc-7d73-40c3-80e1-079cec2157a4-metrics-tls\") pod \"dns-default-9xgnl\" (UID: \"208e55fc-7d73-40c3-80e1-079cec2157a4\") " pod="openshift-dns/dns-default-9xgnl" Jul 06 22:09:35.661111 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:35.660991 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:09:35.661111 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:35.661008 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cf9974c67-z4qd4: secret "image-registry-tls" not found Jul 06 22:09:35.661111 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:35.661063 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:09:35.661111 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:35.661076 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-tls podName:f5bba360-152a-4076-be57-f8ef9a7bf819 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:36.66105657 +0000 UTC m=+36.516022034 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-tls") pod "image-registry-cf9974c67-z4qd4" (UID: "f5bba360-152a-4076-be57-f8ef9a7bf819") : secret "image-registry-tls" not found Jul 06 22:09:35.661111 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:35.661095 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/208e55fc-7d73-40c3-80e1-079cec2157a4-metrics-tls podName:208e55fc-7d73-40c3-80e1-079cec2157a4 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:36.661086131 +0000 UTC m=+36.516051591 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/208e55fc-7d73-40c3-80e1-079cec2157a4-metrics-tls") pod "dns-default-9xgnl" (UID: "208e55fc-7d73-40c3-80e1-079cec2157a4") : secret "dns-default-metrics-tls" not found Jul 06 22:09:35.887365 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:35.887331 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x2b5k" event={"ID":"145334b3-5315-4006-9dac-73c2770182f9","Type":"ContainerStarted","Data":"1df380a0cf50a2b96fd6a6e18beb42f34c9afcb203a5969dba2ea832fb06a530"} Jul 06 22:09:36.669969 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:36.669927 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-tls\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:36.670464 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:36.670117 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:09:36.670464 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:36.670143 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cf9974c67-z4qd4: secret "image-registry-tls" not found Jul 06 22:09:36.670464 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:36.670204 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:09:36.670464 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:36.670208 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-tls podName:f5bba360-152a-4076-be57-f8ef9a7bf819 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:38.670186351 +0000 UTC m=+38.525151799 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-tls") pod "image-registry-cf9974c67-z4qd4" (UID: "f5bba360-152a-4076-be57-f8ef9a7bf819") : secret "image-registry-tls" not found Jul 06 22:09:36.670464 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:36.670261 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/208e55fc-7d73-40c3-80e1-079cec2157a4-metrics-tls podName:208e55fc-7d73-40c3-80e1-079cec2157a4 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:38.67024965 +0000 UTC m=+38.525215099 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/208e55fc-7d73-40c3-80e1-079cec2157a4-metrics-tls") pod "dns-default-9xgnl" (UID: "208e55fc-7d73-40c3-80e1-079cec2157a4") : secret "dns-default-metrics-tls" not found Jul 06 22:09:36.670464 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:36.670120 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/208e55fc-7d73-40c3-80e1-079cec2157a4-metrics-tls\") pod \"dns-default-9xgnl\" (UID: \"208e55fc-7d73-40c3-80e1-079cec2157a4\") " pod="openshift-dns/dns-default-9xgnl" Jul 06 22:09:36.725620 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:36.725578 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:09:36.725796 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:36.725761 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:09:36.726276 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:36.725975 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:09:36.729000 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:36.728766 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 22:09:36.729000 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:36.728778 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 22:09:36.729804 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:36.729780 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 22:09:36.729804 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:36.729798 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dftmz\"" Jul 06 22:09:36.730178 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:36.729986 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 22:09:36.730178 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:36.730048 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pk242\"" Jul 06 22:09:38.687646 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:38.687614 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/208e55fc-7d73-40c3-80e1-079cec2157a4-metrics-tls\") pod \"dns-default-9xgnl\" (UID: \"208e55fc-7d73-40c3-80e1-079cec2157a4\") " pod="openshift-dns/dns-default-9xgnl" Jul 06 22:09:38.688035 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:38.687690 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-tls\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:38.688035 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:38.687758 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:09:38.688035 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:38.687821 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/208e55fc-7d73-40c3-80e1-079cec2157a4-metrics-tls podName:208e55fc-7d73-40c3-80e1-079cec2157a4 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:42.687803281 +0000 UTC m=+42.542768726 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/208e55fc-7d73-40c3-80e1-079cec2157a4-metrics-tls") pod "dns-default-9xgnl" (UID: "208e55fc-7d73-40c3-80e1-079cec2157a4") : secret "dns-default-metrics-tls" not found Jul 06 22:09:38.688035 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:38.687827 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:09:38.688035 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:38.687863 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cf9974c67-z4qd4: secret "image-registry-tls" not found Jul 06 22:09:38.688035 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:38.687917 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-tls podName:f5bba360-152a-4076-be57-f8ef9a7bf819 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:42.68790422 +0000 UTC m=+42.542869673 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-tls") pod "image-registry-cf9974c67-z4qd4" (UID: "f5bba360-152a-4076-be57-f8ef9a7bf819") : secret "image-registry-tls" not found Jul 06 22:09:38.898102 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:38.897920 2566 generic.go:356] "Generic (PLEG): container finished" podID="0d1c5e61-2ad1-421b-a5f6-3595e1e60795" containerID="f07a9453e6bcd7ddbf24836428e6cb0256d30812dd08095ae6b46e4c065f58c5" exitCode=0 Jul 06 22:09:38.898285 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:38.897982 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7pwsx" event={"ID":"0d1c5e61-2ad1-421b-a5f6-3595e1e60795","Type":"ContainerDied","Data":"f07a9453e6bcd7ddbf24836428e6cb0256d30812dd08095ae6b46e4c065f58c5"} Jul 06 22:09:39.686926 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:39.686892 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-mq67q"] Jul 06 22:09:39.701717 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:39.701682 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-mq67q"] Jul 06 22:09:39.702223 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:39.701777 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-mq67q" Jul 06 22:09:39.704262 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:39.704240 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-s6rtb\"" Jul 06 22:09:39.704381 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:39.704240 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 06 22:09:39.704381 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:39.704310 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 06 22:09:39.797600 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:39.797559 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4c51a485-699d-45da-9423-832c8c3c86c9-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-mq67q\" (UID: \"4c51a485-699d-45da-9423-832c8c3c86c9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mq67q" Jul 06 22:09:39.797600 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:39.797602 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4c51a485-699d-45da-9423-832c8c3c86c9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-mq67q\" (UID: \"4c51a485-699d-45da-9423-832c8c3c86c9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mq67q" Jul 06 22:09:39.898402 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:39.898365 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4c51a485-699d-45da-9423-832c8c3c86c9-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-mq67q\" (UID: \"4c51a485-699d-45da-9423-832c8c3c86c9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mq67q" Jul 06 22:09:39.898402 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:39.898407 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4c51a485-699d-45da-9423-832c8c3c86c9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-mq67q\" (UID: \"4c51a485-699d-45da-9423-832c8c3c86c9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mq67q" Jul 06 22:09:39.898670 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:39.898519 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 22:09:39.898670 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:39.898580 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c51a485-699d-45da-9423-832c8c3c86c9-networking-console-plugin-cert podName:4c51a485-699d-45da-9423-832c8c3c86c9 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:40.398565769 +0000 UTC m=+40.253531232 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4c51a485-699d-45da-9423-832c8c3c86c9-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-mq67q" (UID: "4c51a485-699d-45da-9423-832c8c3c86c9") : secret "networking-console-plugin-cert" not found Jul 06 22:09:39.899121 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:39.899098 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4c51a485-699d-45da-9423-832c8c3c86c9-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-mq67q\" (UID: \"4c51a485-699d-45da-9423-832c8c3c86c9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mq67q" Jul 06 22:09:39.902866 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:39.902827 2566 generic.go:356] "Generic (PLEG): container finished" podID="0d1c5e61-2ad1-421b-a5f6-3595e1e60795" containerID="09a57f8a801e5bfd244cd7fe86704d2380beae5e802778b744daebd3e51ca100" exitCode=0 Jul 06 22:09:39.902981 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:39.902880 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7pwsx" event={"ID":"0d1c5e61-2ad1-421b-a5f6-3595e1e60795","Type":"ContainerDied","Data":"09a57f8a801e5bfd244cd7fe86704d2380beae5e802778b744daebd3e51ca100"} Jul 06 22:09:39.904352 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:39.904331 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x2b5k" event={"ID":"145334b3-5315-4006-9dac-73c2770182f9","Type":"ContainerStarted","Data":"7b90915cfcf5ef0d89324e596ee86b168de5cb8bab54aeaa73d7fe1aa01c1559"} Jul 06 22:09:39.972986 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:39.972937 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-x2b5k" podStartSLOduration=2.629412893 podStartE2EDuration="5.972919679s" totalImagesPullingTime="3.343506786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:09:39.97201659 +0000 UTC m=+39.826982050" watchObservedRunningTime="2026-07-06 22:09:39.972919679 +0000 UTC m=+39.827885123" Jul 06 22:09:40.402539 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:40.402498 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4c51a485-699d-45da-9423-832c8c3c86c9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-mq67q\" (UID: \"4c51a485-699d-45da-9423-832c8c3c86c9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mq67q" Jul 06 22:09:40.402707 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:40.402645 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 22:09:40.402743 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:40.402714 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c51a485-699d-45da-9423-832c8c3c86c9-networking-console-plugin-cert podName:4c51a485-699d-45da-9423-832c8c3c86c9 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:41.40269682 +0000 UTC m=+41.257662265 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4c51a485-699d-45da-9423-832c8c3c86c9-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-mq67q" (UID: "4c51a485-699d-45da-9423-832c8c3c86c9") : secret "networking-console-plugin-cert" not found Jul 06 22:09:40.909570 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:40.909526 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7pwsx" event={"ID":"0d1c5e61-2ad1-421b-a5f6-3595e1e60795","Type":"ContainerStarted","Data":"45ea5bd08e1a3ce6ad3a199a1558f1a30350e53fc48bfcd00932f2e7bb436aa8"} Jul 06 22:09:40.933964 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:40.933918 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7pwsx" podStartSLOduration=7.737149502 podStartE2EDuration="39.933902898s" totalImagesPullingTime="32.196753396s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:09:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:09:40.932485714 +0000 UTC m=+40.787451181" watchObservedRunningTime="2026-07-06 22:09:40.933902898 +0000 UTC m=+40.788868365" Jul 06 22:09:41.411419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:41.411379 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4c51a485-699d-45da-9423-832c8c3c86c9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-mq67q\" (UID: \"4c51a485-699d-45da-9423-832c8c3c86c9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mq67q" Jul 06 22:09:41.411588 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:41.411518 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 22:09:41.411588 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:41.411582 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c51a485-699d-45da-9423-832c8c3c86c9-networking-console-plugin-cert podName:4c51a485-699d-45da-9423-832c8c3c86c9 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:43.411566802 +0000 UTC m=+43.266532275 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4c51a485-699d-45da-9423-832c8c3c86c9-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-mq67q" (UID: "4c51a485-699d-45da-9423-832c8c3c86c9") : secret "networking-console-plugin-cert" not found Jul 06 22:09:42.520177 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:42.520147 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-f949n"] Jul 06 22:09:42.549809 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:42.549772 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f949n"] Jul 06 22:09:42.549979 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:42.549898 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f949n" Jul 06 22:09:42.552681 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:42.552654 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-66l9r\"" Jul 06 22:09:42.552938 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:42.552920 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 22:09:42.552938 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:42.552934 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 22:09:42.553089 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:42.552934 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 22:09:42.553564 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:42.553547 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 22:09:42.619229 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:42.619196 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/699501f3-29d3-4e57-b5b9-4f5b4b903097-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f949n\" (UID: \"699501f3-29d3-4e57-b5b9-4f5b4b903097\") " pod="openshift-insights/insights-runtime-extractor-f949n" Jul 06 22:09:42.619386 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:42.619259 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjtpb\" (UniqueName: \"kubernetes.io/projected/699501f3-29d3-4e57-b5b9-4f5b4b903097-kube-api-access-fjtpb\") pod \"insights-runtime-extractor-f949n\" (UID: \"699501f3-29d3-4e57-b5b9-4f5b4b903097\") " pod="openshift-insights/insights-runtime-extractor-f949n" Jul 06 22:09:42.619386 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:42.619298 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/699501f3-29d3-4e57-b5b9-4f5b4b903097-crio-socket\") pod \"insights-runtime-extractor-f949n\" (UID: \"699501f3-29d3-4e57-b5b9-4f5b4b903097\") " pod="openshift-insights/insights-runtime-extractor-f949n" Jul 06 22:09:42.619386 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:42.619330 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/699501f3-29d3-4e57-b5b9-4f5b4b903097-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f949n\" (UID: \"699501f3-29d3-4e57-b5b9-4f5b4b903097\") " pod="openshift-insights/insights-runtime-extractor-f949n" Jul 06 22:09:42.619386 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:42.619352 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/699501f3-29d3-4e57-b5b9-4f5b4b903097-data-volume\") pod \"insights-runtime-extractor-f949n\" (UID: \"699501f3-29d3-4e57-b5b9-4f5b4b903097\") " pod="openshift-insights/insights-runtime-extractor-f949n" Jul 06 22:09:42.719697 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:42.719660 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/699501f3-29d3-4e57-b5b9-4f5b4b903097-crio-socket\") pod \"insights-runtime-extractor-f949n\" (UID: \"699501f3-29d3-4e57-b5b9-4f5b4b903097\") " pod="openshift-insights/insights-runtime-extractor-f949n" Jul 06 22:09:42.719836 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:42.719716 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/208e55fc-7d73-40c3-80e1-079cec2157a4-metrics-tls\") pod \"dns-default-9xgnl\" (UID: \"208e55fc-7d73-40c3-80e1-079cec2157a4\") " pod="openshift-dns/dns-default-9xgnl" Jul 06 22:09:42.719836 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:42.719747 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/699501f3-29d3-4e57-b5b9-4f5b4b903097-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f949n\" (UID: \"699501f3-29d3-4e57-b5b9-4f5b4b903097\") " pod="openshift-insights/insights-runtime-extractor-f949n" Jul 06 22:09:42.719836 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:42.719776 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/699501f3-29d3-4e57-b5b9-4f5b4b903097-data-volume\") pod \"insights-runtime-extractor-f949n\" (UID: \"699501f3-29d3-4e57-b5b9-4f5b4b903097\") " pod="openshift-insights/insights-runtime-extractor-f949n" Jul 06 22:09:42.719836 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:42.719809 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-tls\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:42.720029 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:42.719884 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/699501f3-29d3-4e57-b5b9-4f5b4b903097-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f949n\" (UID: \"699501f3-29d3-4e57-b5b9-4f5b4b903097\") " pod="openshift-insights/insights-runtime-extractor-f949n" Jul 06 22:09:42.720029 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:42.719921 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:09:42.720029 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:42.719969 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:09:42.720029 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:42.719920 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/699501f3-29d3-4e57-b5b9-4f5b4b903097-crio-socket\") pod \"insights-runtime-extractor-f949n\" (UID: \"699501f3-29d3-4e57-b5b9-4f5b4b903097\") " pod="openshift-insights/insights-runtime-extractor-f949n" Jul 06 22:09:42.720029 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:42.719922 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:09:42.720201 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:42.719999 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:09:42.720201 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:42.720050 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cf9974c67-z4qd4: secret "image-registry-tls" not found Jul 06 22:09:42.720201 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:42.720001 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/699501f3-29d3-4e57-b5b9-4f5b4b903097-insights-runtime-extractor-tls podName:699501f3-29d3-4e57-b5b9-4f5b4b903097 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:43.219982126 +0000 UTC m=+43.074947575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/699501f3-29d3-4e57-b5b9-4f5b4b903097-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f949n" (UID: "699501f3-29d3-4e57-b5b9-4f5b4b903097") : secret "insights-runtime-extractor-tls" not found Jul 06 22:09:42.720201 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:42.720083 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjtpb\" (UniqueName: \"kubernetes.io/projected/699501f3-29d3-4e57-b5b9-4f5b4b903097-kube-api-access-fjtpb\") pod \"insights-runtime-extractor-f949n\" (UID: \"699501f3-29d3-4e57-b5b9-4f5b4b903097\") " pod="openshift-insights/insights-runtime-extractor-f949n" Jul 06 22:09:42.720201 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:42.720123 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/699501f3-29d3-4e57-b5b9-4f5b4b903097-kube-rbac-proxy-cm podName:699501f3-29d3-4e57-b5b9-4f5b4b903097 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:43.220111708 +0000 UTC m=+43.075077158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/699501f3-29d3-4e57-b5b9-4f5b4b903097-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f949n" (UID: "699501f3-29d3-4e57-b5b9-4f5b4b903097") : configmap "kube-rbac-proxy" not found Jul 06 22:09:42.720201 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:42.720135 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/208e55fc-7d73-40c3-80e1-079cec2157a4-metrics-tls podName:208e55fc-7d73-40c3-80e1-079cec2157a4 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:50.720129351 +0000 UTC m=+50.575094798 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/208e55fc-7d73-40c3-80e1-079cec2157a4-metrics-tls") pod "dns-default-9xgnl" (UID: "208e55fc-7d73-40c3-80e1-079cec2157a4") : secret "dns-default-metrics-tls" not found Jul 06 22:09:42.720201 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:42.720144 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-tls podName:f5bba360-152a-4076-be57-f8ef9a7bf819 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:50.720139775 +0000 UTC m=+50.575105220 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-tls") pod "image-registry-cf9974c67-z4qd4" (UID: "f5bba360-152a-4076-be57-f8ef9a7bf819") : secret "image-registry-tls" not found Jul 06 22:09:42.720201 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:42.720144 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/699501f3-29d3-4e57-b5b9-4f5b4b903097-data-volume\") pod \"insights-runtime-extractor-f949n\" (UID: \"699501f3-29d3-4e57-b5b9-4f5b4b903097\") " pod="openshift-insights/insights-runtime-extractor-f949n" Jul 06 22:09:42.731879 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:42.731835 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjtpb\" (UniqueName: \"kubernetes.io/projected/699501f3-29d3-4e57-b5b9-4f5b4b903097-kube-api-access-fjtpb\") pod \"insights-runtime-extractor-f949n\" (UID: \"699501f3-29d3-4e57-b5b9-4f5b4b903097\") " pod="openshift-insights/insights-runtime-extractor-f949n" Jul 06 22:09:43.222752 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:43.222711 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/699501f3-29d3-4e57-b5b9-4f5b4b903097-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f949n\" (UID: \"699501f3-29d3-4e57-b5b9-4f5b4b903097\") " pod="openshift-insights/insights-runtime-extractor-f949n" Jul 06 22:09:43.222938 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:43.222829 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:09:43.222938 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:43.222873 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/699501f3-29d3-4e57-b5b9-4f5b4b903097-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f949n\" (UID: \"699501f3-29d3-4e57-b5b9-4f5b4b903097\") " pod="openshift-insights/insights-runtime-extractor-f949n" Jul 06 22:09:43.222938 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:43.222908 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/699501f3-29d3-4e57-b5b9-4f5b4b903097-kube-rbac-proxy-cm podName:699501f3-29d3-4e57-b5b9-4f5b4b903097 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:44.222892951 +0000 UTC m=+44.077858396 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/699501f3-29d3-4e57-b5b9-4f5b4b903097-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f949n" (UID: "699501f3-29d3-4e57-b5b9-4f5b4b903097") : configmap "kube-rbac-proxy" not found Jul 06 22:09:43.223059 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:43.222959 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:09:43.223059 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:43.223000 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/699501f3-29d3-4e57-b5b9-4f5b4b903097-insights-runtime-extractor-tls podName:699501f3-29d3-4e57-b5b9-4f5b4b903097 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:44.222989952 +0000 UTC m=+44.077955398 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/699501f3-29d3-4e57-b5b9-4f5b4b903097-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f949n" (UID: "699501f3-29d3-4e57-b5b9-4f5b4b903097") : secret "insights-runtime-extractor-tls" not found Jul 06 22:09:43.424110 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:43.424069 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4c51a485-699d-45da-9423-832c8c3c86c9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-mq67q\" (UID: \"4c51a485-699d-45da-9423-832c8c3c86c9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mq67q" Jul 06 22:09:43.424277 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:43.424209 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 22:09:43.424319 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:43.424277 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c51a485-699d-45da-9423-832c8c3c86c9-networking-console-plugin-cert podName:4c51a485-699d-45da-9423-832c8c3c86c9 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:47.424261586 +0000 UTC m=+47.279227030 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4c51a485-699d-45da-9423-832c8c3c86c9-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-mq67q" (UID: "4c51a485-699d-45da-9423-832c8c3c86c9") : secret "networking-console-plugin-cert" not found Jul 06 22:09:44.107549 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:44.107511 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxj69"] Jul 06 22:09:44.126748 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:44.126718 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxj69"] Jul 06 22:09:44.126947 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:44.126864 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxj69" Jul 06 22:09:44.129448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:44.129422 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-56jkx\"" Jul 06 22:09:44.129563 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:44.129427 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 06 22:09:44.129563 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:44.129528 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l28q\" (UniqueName: \"kubernetes.io/projected/ebf052be-572f-4484-884a-56f9d8c0de0a-kube-api-access-8l28q\") pod \"migrator-d57d58cc9-zxj69\" (UID: \"ebf052be-572f-4484-884a-56f9d8c0de0a\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxj69" Jul 06 22:09:44.130100 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:44.130084 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 06 22:09:44.230037 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:44.229998 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/699501f3-29d3-4e57-b5b9-4f5b4b903097-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f949n\" (UID: \"699501f3-29d3-4e57-b5b9-4f5b4b903097\") " pod="openshift-insights/insights-runtime-extractor-f949n" Jul 06 22:09:44.230207 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:44.230092 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/699501f3-29d3-4e57-b5b9-4f5b4b903097-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f949n\" (UID: \"699501f3-29d3-4e57-b5b9-4f5b4b903097\") " pod="openshift-insights/insights-runtime-extractor-f949n" Jul 06 22:09:44.230207 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:44.230121 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l28q\" (UniqueName: \"kubernetes.io/projected/ebf052be-572f-4484-884a-56f9d8c0de0a-kube-api-access-8l28q\") pod \"migrator-d57d58cc9-zxj69\" (UID: \"ebf052be-572f-4484-884a-56f9d8c0de0a\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxj69" Jul 06 22:09:44.230207 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:44.230127 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:09:44.230306 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:44.230211 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:09:44.230306 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:44.230214 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/699501f3-29d3-4e57-b5b9-4f5b4b903097-insights-runtime-extractor-tls podName:699501f3-29d3-4e57-b5b9-4f5b4b903097 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:46.230197464 +0000 UTC m=+46.085162911 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/699501f3-29d3-4e57-b5b9-4f5b4b903097-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f949n" (UID: "699501f3-29d3-4e57-b5b9-4f5b4b903097") : secret "insights-runtime-extractor-tls" not found Jul 06 22:09:44.230306 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:44.230279 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/699501f3-29d3-4e57-b5b9-4f5b4b903097-kube-rbac-proxy-cm podName:699501f3-29d3-4e57-b5b9-4f5b4b903097 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:46.230261109 +0000 UTC m=+46.085226562 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/699501f3-29d3-4e57-b5b9-4f5b4b903097-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f949n" (UID: "699501f3-29d3-4e57-b5b9-4f5b4b903097") : configmap "kube-rbac-proxy" not found Jul 06 22:09:44.238335 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:44.238312 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l28q\" (UniqueName: \"kubernetes.io/projected/ebf052be-572f-4484-884a-56f9d8c0de0a-kube-api-access-8l28q\") pod \"migrator-d57d58cc9-zxj69\" (UID: \"ebf052be-572f-4484-884a-56f9d8c0de0a\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxj69" Jul 06 22:09:44.275651 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:44.275622 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lbxng_1566a0b0-dbc3-4448-874e-151da27d7a27/dns-node-resolver/0.log" Jul 06 22:09:44.437306 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:44.437273 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxj69" Jul 06 22:09:44.576469 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:44.576441 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxj69"] Jul 06 22:09:44.579499 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:44.579473 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebf052be_572f_4484_884a_56f9d8c0de0a.slice/crio-d7d382042cc0ea4eaed6ffb41043fbec7b39c809a3a0b10c9d7f6f4ae1393f09 WatchSource:0}: Error finding container d7d382042cc0ea4eaed6ffb41043fbec7b39c809a3a0b10c9d7f6f4ae1393f09: Status 404 returned error can't find the container with id d7d382042cc0ea4eaed6ffb41043fbec7b39c809a3a0b10c9d7f6f4ae1393f09 Jul 06 22:09:44.918899 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:44.918792 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxj69" event={"ID":"ebf052be-572f-4484-884a-56f9d8c0de0a","Type":"ContainerStarted","Data":"d7d382042cc0ea4eaed6ffb41043fbec7b39c809a3a0b10c9d7f6f4ae1393f09"} Jul 06 22:09:45.276566 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:45.276540 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fm45f_8e89a94f-c9c4-4b73-bbb1-ea7f02dc8f9b/node-ca/0.log" Jul 06 22:09:45.877070 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:45.877039 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x2b5k_145334b3-5315-4006-9dac-73c2770182f9/serve-healthcheck-canary/0.log" Jul 06 22:09:46.241912 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:46.241878 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/699501f3-29d3-4e57-b5b9-4f5b4b903097-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f949n\" (UID: \"699501f3-29d3-4e57-b5b9-4f5b4b903097\") " pod="openshift-insights/insights-runtime-extractor-f949n" Jul 06 22:09:46.242094 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:46.241968 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/699501f3-29d3-4e57-b5b9-4f5b4b903097-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f949n\" (UID: \"699501f3-29d3-4e57-b5b9-4f5b4b903097\") " pod="openshift-insights/insights-runtime-extractor-f949n" Jul 06 22:09:46.242094 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:46.242040 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:09:46.242215 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:46.242118 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/699501f3-29d3-4e57-b5b9-4f5b4b903097-kube-rbac-proxy-cm podName:699501f3-29d3-4e57-b5b9-4f5b4b903097 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:50.242097929 +0000 UTC m=+50.097063375 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/699501f3-29d3-4e57-b5b9-4f5b4b903097-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f949n" (UID: "699501f3-29d3-4e57-b5b9-4f5b4b903097") : configmap "kube-rbac-proxy" not found Jul 06 22:09:46.242215 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:46.242128 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:09:46.242326 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:46.242214 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/699501f3-29d3-4e57-b5b9-4f5b4b903097-insights-runtime-extractor-tls podName:699501f3-29d3-4e57-b5b9-4f5b4b903097 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:50.242194827 +0000 UTC m=+50.097160275 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/699501f3-29d3-4e57-b5b9-4f5b4b903097-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f949n" (UID: "699501f3-29d3-4e57-b5b9-4f5b4b903097") : secret "insights-runtime-extractor-tls" not found Jul 06 22:09:47.451734 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:47.451701 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4c51a485-699d-45da-9423-832c8c3c86c9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-mq67q\" (UID: \"4c51a485-699d-45da-9423-832c8c3c86c9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mq67q" Jul 06 22:09:47.452130 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:47.451860 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 22:09:47.452130 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:47.451928 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c51a485-699d-45da-9423-832c8c3c86c9-networking-console-plugin-cert podName:4c51a485-699d-45da-9423-832c8c3c86c9 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:55.451912858 +0000 UTC m=+55.306878308 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4c51a485-699d-45da-9423-832c8c3c86c9-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-mq67q" (UID: "4c51a485-699d-45da-9423-832c8c3c86c9") : secret "networking-console-plugin-cert" not found Jul 06 22:09:47.927030 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:47.926995 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxj69" event={"ID":"ebf052be-572f-4484-884a-56f9d8c0de0a","Type":"ContainerStarted","Data":"449a80c1b55afb6f626cd5a7fc1a9990ca591680e7faf405e2f8287a37985722"} Jul 06 22:09:47.927173 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:47.927046 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxj69" event={"ID":"ebf052be-572f-4484-884a-56f9d8c0de0a","Type":"ContainerStarted","Data":"72a3736b09041261facaf71cd546f683165e06ae2fa5e18437c2020c035771b4"} Jul 06 22:09:47.944078 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:47.944033 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxj69" podStartSLOduration=1.682602683 podStartE2EDuration="3.944017334s" totalImagesPullingTime="2.261414651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:09:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:09:47.942559281 +0000 UTC m=+47.797524748" watchObservedRunningTime="2026-07-06 22:09:47.944017334 +0000 UTC m=+47.798982800" Jul 06 22:09:50.272120 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:50.272073 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/699501f3-29d3-4e57-b5b9-4f5b4b903097-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f949n\" (UID: \"699501f3-29d3-4e57-b5b9-4f5b4b903097\") " pod="openshift-insights/insights-runtime-extractor-f949n" Jul 06 22:09:50.272553 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:50.272178 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/699501f3-29d3-4e57-b5b9-4f5b4b903097-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f949n\" (UID: \"699501f3-29d3-4e57-b5b9-4f5b4b903097\") " pod="openshift-insights/insights-runtime-extractor-f949n" Jul 06 22:09:50.272553 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:50.272200 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:09:50.272553 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:50.272264 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/699501f3-29d3-4e57-b5b9-4f5b4b903097-kube-rbac-proxy-cm podName:699501f3-29d3-4e57-b5b9-4f5b4b903097 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:58.272246085 +0000 UTC m=+58.127211544 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/699501f3-29d3-4e57-b5b9-4f5b4b903097-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f949n" (UID: "699501f3-29d3-4e57-b5b9-4f5b4b903097") : configmap "kube-rbac-proxy" not found Jul 06 22:09:50.272553 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:50.272340 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:09:50.272553 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:50.272398 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/699501f3-29d3-4e57-b5b9-4f5b4b903097-insights-runtime-extractor-tls podName:699501f3-29d3-4e57-b5b9-4f5b4b903097 nodeName:}" failed. No retries permitted until 2026-07-06 22:09:58.272384347 +0000 UTC m=+58.127349791 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/699501f3-29d3-4e57-b5b9-4f5b4b903097-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f949n" (UID: "699501f3-29d3-4e57-b5b9-4f5b4b903097") : secret "insights-runtime-extractor-tls" not found Jul 06 22:09:50.775737 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:50.775696 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/208e55fc-7d73-40c3-80e1-079cec2157a4-metrics-tls\") pod \"dns-default-9xgnl\" (UID: \"208e55fc-7d73-40c3-80e1-079cec2157a4\") " pod="openshift-dns/dns-default-9xgnl" Jul 06 22:09:50.775962 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:50.775763 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-tls\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:09:50.775962 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:50.775881 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:09:50.775962 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:50.775896 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cf9974c67-z4qd4: secret "image-registry-tls" not found Jul 06 22:09:50.775962 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:09:50.775965 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-tls podName:f5bba360-152a-4076-be57-f8ef9a7bf819 nodeName:}" failed. No retries permitted until 2026-07-06 22:10:06.775939884 +0000 UTC m=+66.630905342 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-tls") pod "image-registry-cf9974c67-z4qd4" (UID: "f5bba360-152a-4076-be57-f8ef9a7bf819") : secret "image-registry-tls" not found Jul 06 22:09:50.778040 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:50.778017 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/208e55fc-7d73-40c3-80e1-079cec2157a4-metrics-tls\") pod \"dns-default-9xgnl\" (UID: \"208e55fc-7d73-40c3-80e1-079cec2157a4\") " pod="openshift-dns/dns-default-9xgnl" Jul 06 22:09:50.875375 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:50.875338 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9xgnl" Jul 06 22:09:51.033313 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:51.033240 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9xgnl"] Jul 06 22:09:51.036020 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:51.035987 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod208e55fc_7d73_40c3_80e1_079cec2157a4.slice/crio-89c25c257de6d1c2633aff0a39cff3a1bf881978e8a73235e9ae0815baa58835 WatchSource:0}: Error finding container 89c25c257de6d1c2633aff0a39cff3a1bf881978e8a73235e9ae0815baa58835: Status 404 returned error can't find the container with id 89c25c257de6d1c2633aff0a39cff3a1bf881978e8a73235e9ae0815baa58835 Jul 06 22:09:51.942179 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:51.942141 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9xgnl" event={"ID":"208e55fc-7d73-40c3-80e1-079cec2157a4","Type":"ContainerStarted","Data":"89c25c257de6d1c2633aff0a39cff3a1bf881978e8a73235e9ae0815baa58835"} Jul 06 22:09:53.951916 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:53.951873 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9xgnl" event={"ID":"208e55fc-7d73-40c3-80e1-079cec2157a4","Type":"ContainerStarted","Data":"5675864a260dd577ec616977be397d23ad42c5e007c1aeb004c77b87c637427f"} Jul 06 22:09:53.952349 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:53.951956 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9xgnl" event={"ID":"208e55fc-7d73-40c3-80e1-079cec2157a4","Type":"ContainerStarted","Data":"1e747947982c77c9931b64ac24db8db6aebf9f5ccb30618bda13c46b3f869ba8"} Jul 06 22:09:53.952349 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:53.952004 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9xgnl" Jul 06 22:09:53.969830 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:53.969776 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9xgnl" podStartSLOduration=17.47180362 podStartE2EDuration="19.969763122s" totalImagesPullingTime="2.497959502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:09:53.969069583 +0000 UTC m=+53.824035051" watchObservedRunningTime="2026-07-06 22:09:53.969763122 +0000 UTC m=+53.824728588" Jul 06 22:09:55.517341 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:55.517292 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4c51a485-699d-45da-9423-832c8c3c86c9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-mq67q\" (UID: \"4c51a485-699d-45da-9423-832c8c3c86c9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mq67q" Jul 06 22:09:55.519691 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:55.519665 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4c51a485-699d-45da-9423-832c8c3c86c9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-mq67q\" (UID: \"4c51a485-699d-45da-9423-832c8c3c86c9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mq67q" Jul 06 22:09:55.610811 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:55.610773 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-mq67q" Jul 06 22:09:55.729824 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:55.729793 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-mq67q"] Jul 06 22:09:55.732876 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:55.732831 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c51a485_699d_45da_9423_832c8c3c86c9.slice/crio-32bbd7a8fc58a303bc533120af818e7598f7d866222c15d2f9342f884c14a657 WatchSource:0}: Error finding container 32bbd7a8fc58a303bc533120af818e7598f7d866222c15d2f9342f884c14a657: Status 404 returned error can't find the container with id 32bbd7a8fc58a303bc533120af818e7598f7d866222c15d2f9342f884c14a657 Jul 06 22:09:55.958927 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:55.958889 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-mq67q" event={"ID":"4c51a485-699d-45da-9423-832c8c3c86c9","Type":"ContainerStarted","Data":"32bbd7a8fc58a303bc533120af818e7598f7d866222c15d2f9342f884c14a657"} Jul 06 22:09:57.967474 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:57.967437 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-mq67q" event={"ID":"4c51a485-699d-45da-9423-832c8c3c86c9","Type":"ContainerStarted","Data":"3059bd5cd44d19b1d12257b406a61548b9fcca832fec2a7a5ce89330d4664d7b"} Jul 06 22:09:57.985729 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:57.985671 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-mq67q" podStartSLOduration=17.552614557 podStartE2EDuration="18.985652788s" totalImagesPullingTime="1.433038231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:09:57.984807692 +0000 UTC m=+57.839773162" watchObservedRunningTime="2026-07-06 22:09:57.985652788 +0000 UTC m=+57.840618254" Jul 06 22:09:58.338255 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:58.338158 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/699501f3-29d3-4e57-b5b9-4f5b4b903097-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f949n\" (UID: \"699501f3-29d3-4e57-b5b9-4f5b4b903097\") " pod="openshift-insights/insights-runtime-extractor-f949n" Jul 06 22:09:58.338255 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:58.338247 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/699501f3-29d3-4e57-b5b9-4f5b4b903097-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f949n\" (UID: \"699501f3-29d3-4e57-b5b9-4f5b4b903097\") " pod="openshift-insights/insights-runtime-extractor-f949n" Jul 06 22:09:58.338701 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:58.338678 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/699501f3-29d3-4e57-b5b9-4f5b4b903097-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f949n\" (UID: \"699501f3-29d3-4e57-b5b9-4f5b4b903097\") " pod="openshift-insights/insights-runtime-extractor-f949n" Jul 06 22:09:58.340674 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:58.340646 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/699501f3-29d3-4e57-b5b9-4f5b4b903097-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f949n\" (UID: \"699501f3-29d3-4e57-b5b9-4f5b4b903097\") " pod="openshift-insights/insights-runtime-extractor-f949n" Jul 06 22:09:58.457939 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:58.457895 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f949n" Jul 06 22:09:58.580000 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:58.579968 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f949n"] Jul 06 22:09:58.582955 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:09:58.582926 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod699501f3_29d3_4e57_b5b9_4f5b4b903097.slice/crio-a6dfd5bf2f1ffaf2d0768f555e6e59eee0eee514a33a75abd9d128fd275abf57 WatchSource:0}: Error finding container a6dfd5bf2f1ffaf2d0768f555e6e59eee0eee514a33a75abd9d128fd275abf57: Status 404 returned error can't find the container with id a6dfd5bf2f1ffaf2d0768f555e6e59eee0eee514a33a75abd9d128fd275abf57 Jul 06 22:09:58.970935 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:09:58.970894 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f949n" event={"ID":"699501f3-29d3-4e57-b5b9-4f5b4b903097","Type":"ContainerStarted","Data":"a6dfd5bf2f1ffaf2d0768f555e6e59eee0eee514a33a75abd9d128fd275abf57"} Jul 06 22:10:01.886805 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:01.886766 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jd89j" Jul 06 22:10:02.985445 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:02.985406 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f949n" event={"ID":"699501f3-29d3-4e57-b5b9-4f5b4b903097","Type":"ContainerStarted","Data":"c02744d76a35489e7d73d6171a49a7e72426696ceb24c4d5482bbcb0ab55a4fc"} Jul 06 22:10:03.957512 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:03.957484 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9xgnl" Jul 06 22:10:03.989986 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:03.989949 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f949n" event={"ID":"699501f3-29d3-4e57-b5b9-4f5b4b903097","Type":"ContainerStarted","Data":"833fef1526f8c7eb1f4e2e4da7e82e85b5af5eae61cbd508b0b19d4ee47ae862"} Jul 06 22:10:06.152887 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.152853 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6779655bfb-58sqz"] Jul 06 22:10:06.154884 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.154824 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d77c4b99-z82b2"] Jul 06 22:10:06.155014 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.154972 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6779655bfb-58sqz" Jul 06 22:10:06.156884 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.156867 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d77c4b99-z82b2" Jul 06 22:10:06.158275 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.158253 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-nrhc7\"" Jul 06 22:10:06.160062 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.159514 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 06 22:10:06.160062 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.159607 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 06 22:10:06.160062 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.159803 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 06 22:10:06.162740 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.160472 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 06 22:10:06.162740 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.160700 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 06 22:10:06.169523 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.169501 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cf9974c67-z4qd4"] Jul 06 22:10:06.169764 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:10:06.169745 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" podUID="f5bba360-152a-4076-be57-f8ef9a7bf819" Jul 06 22:10:06.170267 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.170251 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6779655bfb-58sqz"] Jul 06 22:10:06.174546 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.174516 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d77c4b99-z82b2"] Jul 06 22:10:06.205450 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.205412 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5b9p\" (UniqueName: \"kubernetes.io/projected/58c6b79e-0145-4c48-a548-1b0cd145efb4-kube-api-access-b5b9p\") pod \"managed-serviceaccount-addon-agent-6779655bfb-58sqz\" (UID: \"58c6b79e-0145-4c48-a548-1b0cd145efb4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6779655bfb-58sqz" Jul 06 22:10:06.205450 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.205454 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/58c6b79e-0145-4c48-a548-1b0cd145efb4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6779655bfb-58sqz\" (UID: \"58c6b79e-0145-4c48-a548-1b0cd145efb4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6779655bfb-58sqz" Jul 06 22:10:06.205701 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.205536 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz6sb\" (UniqueName: \"kubernetes.io/projected/681e9096-8428-4341-adad-ebd9f708b813-kube-api-access-vz6sb\") pod \"klusterlet-addon-workmgr-67d77c4b99-z82b2\" (UID: \"681e9096-8428-4341-adad-ebd9f708b813\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d77c4b99-z82b2" Jul 06 22:10:06.205701 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.205580 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/681e9096-8428-4341-adad-ebd9f708b813-klusterlet-config\") pod \"klusterlet-addon-workmgr-67d77c4b99-z82b2\" (UID: \"681e9096-8428-4341-adad-ebd9f708b813\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d77c4b99-z82b2" Jul 06 22:10:06.205701 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.205603 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/681e9096-8428-4341-adad-ebd9f708b813-tmp\") pod \"klusterlet-addon-workmgr-67d77c4b99-z82b2\" (UID: \"681e9096-8428-4341-adad-ebd9f708b813\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d77c4b99-z82b2" Jul 06 22:10:06.258465 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.258389 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-zwpgv"] Jul 06 22:10:06.260671 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.260654 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b546d9cc5-l5xmz"] Jul 06 22:10:06.260803 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.260788 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-zwpgv" Jul 06 22:10:06.262475 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.262456 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" Jul 06 22:10:06.263098 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.263075 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-xsmml\"" Jul 06 22:10:06.263325 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.263308 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 22:10:06.263781 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.263769 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 22:10:06.276306 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.276279 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-zwpgv"] Jul 06 22:10:06.277004 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.276987 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b546d9cc5-l5xmz"] Jul 06 22:10:06.306676 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.306627 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e8287232-21ca-4ea6-9ef0-6343221689ef-registry-certificates\") pod \"image-registry-5b546d9cc5-l5xmz\" (UID: \"e8287232-21ca-4ea6-9ef0-6343221689ef\") " pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" Jul 06 22:10:06.306676 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.306684 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sdz7\" (UniqueName: \"kubernetes.io/projected/e30320e8-b3e5-4f78-bbef-542cedfc1e24-kube-api-access-2sdz7\") pod \"downloads-685bfb5f64-zwpgv\" (UID: \"e30320e8-b3e5-4f78-bbef-542cedfc1e24\") " pod="openshift-console/downloads-685bfb5f64-zwpgv" Jul 06 22:10:06.306910 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.306748 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz6sb\" (UniqueName: \"kubernetes.io/projected/681e9096-8428-4341-adad-ebd9f708b813-kube-api-access-vz6sb\") pod \"klusterlet-addon-workmgr-67d77c4b99-z82b2\" (UID: \"681e9096-8428-4341-adad-ebd9f708b813\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d77c4b99-z82b2" Jul 06 22:10:06.306910 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.306777 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/681e9096-8428-4341-adad-ebd9f708b813-klusterlet-config\") pod \"klusterlet-addon-workmgr-67d77c4b99-z82b2\" (UID: \"681e9096-8428-4341-adad-ebd9f708b813\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d77c4b99-z82b2" Jul 06 22:10:06.306910 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.306796 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/681e9096-8428-4341-adad-ebd9f708b813-tmp\") pod \"klusterlet-addon-workmgr-67d77c4b99-z82b2\" (UID: \"681e9096-8428-4341-adad-ebd9f708b813\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d77c4b99-z82b2" Jul 06 22:10:06.307021 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.306953 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e8287232-21ca-4ea6-9ef0-6343221689ef-installation-pull-secrets\") pod \"image-registry-5b546d9cc5-l5xmz\" (UID: \"e8287232-21ca-4ea6-9ef0-6343221689ef\") " pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" Jul 06 22:10:06.307021 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.307016 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8287232-21ca-4ea6-9ef0-6343221689ef-trusted-ca\") pod \"image-registry-5b546d9cc5-l5xmz\" (UID: \"e8287232-21ca-4ea6-9ef0-6343221689ef\") " pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" Jul 06 22:10:06.307104 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.307037 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8287232-21ca-4ea6-9ef0-6343221689ef-bound-sa-token\") pod \"image-registry-5b546d9cc5-l5xmz\" (UID: \"e8287232-21ca-4ea6-9ef0-6343221689ef\") " pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" Jul 06 22:10:06.307140 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.307101 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5b9p\" (UniqueName: \"kubernetes.io/projected/58c6b79e-0145-4c48-a548-1b0cd145efb4-kube-api-access-b5b9p\") pod \"managed-serviceaccount-addon-agent-6779655bfb-58sqz\" (UID: \"58c6b79e-0145-4c48-a548-1b0cd145efb4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6779655bfb-58sqz" Jul 06 22:10:06.307140 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.307131 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e8287232-21ca-4ea6-9ef0-6343221689ef-image-registry-private-configuration\") pod \"image-registry-5b546d9cc5-l5xmz\" (UID: \"e8287232-21ca-4ea6-9ef0-6343221689ef\") " pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" Jul 06 22:10:06.307263 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.307241 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjchp\" (UniqueName: \"kubernetes.io/projected/e8287232-21ca-4ea6-9ef0-6343221689ef-kube-api-access-rjchp\") pod \"image-registry-5b546d9cc5-l5xmz\" (UID: \"e8287232-21ca-4ea6-9ef0-6343221689ef\") " pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" Jul 06 22:10:06.307301 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.307274 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/681e9096-8428-4341-adad-ebd9f708b813-tmp\") pod \"klusterlet-addon-workmgr-67d77c4b99-z82b2\" (UID: \"681e9096-8428-4341-adad-ebd9f708b813\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d77c4b99-z82b2" Jul 06 22:10:06.307301 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.307293 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8287232-21ca-4ea6-9ef0-6343221689ef-registry-tls\") pod \"image-registry-5b546d9cc5-l5xmz\" (UID: \"e8287232-21ca-4ea6-9ef0-6343221689ef\") " pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" Jul 06 22:10:06.307373 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.307319 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e8287232-21ca-4ea6-9ef0-6343221689ef-ca-trust-extracted\") pod \"image-registry-5b546d9cc5-l5xmz\" (UID: \"e8287232-21ca-4ea6-9ef0-6343221689ef\") " pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" Jul 06 22:10:06.307373 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.307359 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/58c6b79e-0145-4c48-a548-1b0cd145efb4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6779655bfb-58sqz\" (UID: \"58c6b79e-0145-4c48-a548-1b0cd145efb4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6779655bfb-58sqz" Jul 06 22:10:06.309413 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.309387 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/681e9096-8428-4341-adad-ebd9f708b813-klusterlet-config\") pod \"klusterlet-addon-workmgr-67d77c4b99-z82b2\" (UID: \"681e9096-8428-4341-adad-ebd9f708b813\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d77c4b99-z82b2" Jul 06 22:10:06.309670 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.309650 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/58c6b79e-0145-4c48-a548-1b0cd145efb4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6779655bfb-58sqz\" (UID: \"58c6b79e-0145-4c48-a548-1b0cd145efb4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6779655bfb-58sqz" Jul 06 22:10:06.321172 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.321145 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5b9p\" (UniqueName: \"kubernetes.io/projected/58c6b79e-0145-4c48-a548-1b0cd145efb4-kube-api-access-b5b9p\") pod \"managed-serviceaccount-addon-agent-6779655bfb-58sqz\" (UID: \"58c6b79e-0145-4c48-a548-1b0cd145efb4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6779655bfb-58sqz" Jul 06 22:10:06.321172 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.321163 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz6sb\" (UniqueName: \"kubernetes.io/projected/681e9096-8428-4341-adad-ebd9f708b813-kube-api-access-vz6sb\") pod \"klusterlet-addon-workmgr-67d77c4b99-z82b2\" (UID: \"681e9096-8428-4341-adad-ebd9f708b813\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d77c4b99-z82b2" Jul 06 22:10:06.407954 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.407912 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e8287232-21ca-4ea6-9ef0-6343221689ef-installation-pull-secrets\") pod \"image-registry-5b546d9cc5-l5xmz\" (UID: \"e8287232-21ca-4ea6-9ef0-6343221689ef\") " pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" Jul 06 22:10:06.408124 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.407974 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8287232-21ca-4ea6-9ef0-6343221689ef-trusted-ca\") pod \"image-registry-5b546d9cc5-l5xmz\" (UID: \"e8287232-21ca-4ea6-9ef0-6343221689ef\") " pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" Jul 06 22:10:06.408124 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.407999 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8287232-21ca-4ea6-9ef0-6343221689ef-bound-sa-token\") pod \"image-registry-5b546d9cc5-l5xmz\" (UID: \"e8287232-21ca-4ea6-9ef0-6343221689ef\") " pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" Jul 06 22:10:06.408124 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.408027 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e8287232-21ca-4ea6-9ef0-6343221689ef-image-registry-private-configuration\") pod \"image-registry-5b546d9cc5-l5xmz\" (UID: \"e8287232-21ca-4ea6-9ef0-6343221689ef\") " pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" Jul 06 22:10:06.408124 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.408052 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjchp\" (UniqueName: \"kubernetes.io/projected/e8287232-21ca-4ea6-9ef0-6343221689ef-kube-api-access-rjchp\") pod \"image-registry-5b546d9cc5-l5xmz\" (UID: \"e8287232-21ca-4ea6-9ef0-6343221689ef\") " pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" Jul 06 22:10:06.408124 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.408077 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8287232-21ca-4ea6-9ef0-6343221689ef-registry-tls\") pod \"image-registry-5b546d9cc5-l5xmz\" (UID: \"e8287232-21ca-4ea6-9ef0-6343221689ef\") " pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" Jul 06 22:10:06.408124 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.408098 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e8287232-21ca-4ea6-9ef0-6343221689ef-ca-trust-extracted\") pod \"image-registry-5b546d9cc5-l5xmz\" (UID: \"e8287232-21ca-4ea6-9ef0-6343221689ef\") " pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" Jul 06 22:10:06.408451 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.408145 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e8287232-21ca-4ea6-9ef0-6343221689ef-registry-certificates\") pod \"image-registry-5b546d9cc5-l5xmz\" (UID: \"e8287232-21ca-4ea6-9ef0-6343221689ef\") " pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" Jul 06 22:10:06.408451 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.408174 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sdz7\" (UniqueName: \"kubernetes.io/projected/e30320e8-b3e5-4f78-bbef-542cedfc1e24-kube-api-access-2sdz7\") pod \"downloads-685bfb5f64-zwpgv\" (UID: \"e30320e8-b3e5-4f78-bbef-542cedfc1e24\") " pod="openshift-console/downloads-685bfb5f64-zwpgv" Jul 06 22:10:06.408451 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.408259 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca356800-b17f-42ba-adab-dbd69bc554db-metrics-certs\") pod \"network-metrics-daemon-7gbfj\" (UID: \"ca356800-b17f-42ba-adab-dbd69bc554db\") " pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:10:06.409126 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.409097 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8287232-21ca-4ea6-9ef0-6343221689ef-trusted-ca\") pod \"image-registry-5b546d9cc5-l5xmz\" (UID: \"e8287232-21ca-4ea6-9ef0-6343221689ef\") " pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" Jul 06 22:10:06.409254 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.409137 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e8287232-21ca-4ea6-9ef0-6343221689ef-registry-certificates\") pod \"image-registry-5b546d9cc5-l5xmz\" (UID: \"e8287232-21ca-4ea6-9ef0-6343221689ef\") " pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" Jul 06 22:10:06.409323 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.409263 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e8287232-21ca-4ea6-9ef0-6343221689ef-ca-trust-extracted\") pod \"image-registry-5b546d9cc5-l5xmz\" (UID: \"e8287232-21ca-4ea6-9ef0-6343221689ef\") " pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" Jul 06 22:10:06.410409 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.410384 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e8287232-21ca-4ea6-9ef0-6343221689ef-image-registry-private-configuration\") pod \"image-registry-5b546d9cc5-l5xmz\" (UID: \"e8287232-21ca-4ea6-9ef0-6343221689ef\") " pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" Jul 06 22:10:06.410496 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.410442 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e8287232-21ca-4ea6-9ef0-6343221689ef-installation-pull-secrets\") pod \"image-registry-5b546d9cc5-l5xmz\" (UID: \"e8287232-21ca-4ea6-9ef0-6343221689ef\") " pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" Jul 06 22:10:06.410664 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.410648 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8287232-21ca-4ea6-9ef0-6343221689ef-registry-tls\") pod \"image-registry-5b546d9cc5-l5xmz\" (UID: \"e8287232-21ca-4ea6-9ef0-6343221689ef\") " pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" Jul 06 22:10:06.411094 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.411078 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 22:10:06.417469 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.417450 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjchp\" (UniqueName: \"kubernetes.io/projected/e8287232-21ca-4ea6-9ef0-6343221689ef-kube-api-access-rjchp\") pod \"image-registry-5b546d9cc5-l5xmz\" (UID: \"e8287232-21ca-4ea6-9ef0-6343221689ef\") " pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" Jul 06 22:10:06.417717 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.417693 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sdz7\" (UniqueName: \"kubernetes.io/projected/e30320e8-b3e5-4f78-bbef-542cedfc1e24-kube-api-access-2sdz7\") pod \"downloads-685bfb5f64-zwpgv\" (UID: \"e30320e8-b3e5-4f78-bbef-542cedfc1e24\") " pod="openshift-console/downloads-685bfb5f64-zwpgv" Jul 06 22:10:06.417877 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.417863 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8287232-21ca-4ea6-9ef0-6343221689ef-bound-sa-token\") pod \"image-registry-5b546d9cc5-l5xmz\" (UID: \"e8287232-21ca-4ea6-9ef0-6343221689ef\") " pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" Jul 06 22:10:06.420310 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.420296 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca356800-b17f-42ba-adab-dbd69bc554db-metrics-certs\") pod \"network-metrics-daemon-7gbfj\" (UID: \"ca356800-b17f-42ba-adab-dbd69bc554db\") " pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:10:06.456806 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.456783 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dftmz\"" Jul 06 22:10:06.464805 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.464783 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gbfj" Jul 06 22:10:06.481679 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.481655 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6779655bfb-58sqz" Jul 06 22:10:06.487243 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.487221 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d77c4b99-z82b2" Jul 06 22:10:06.509072 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.508982 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5ggm\" (UniqueName: \"kubernetes.io/projected/16197990-fb02-48a4-a024-5b467398b37f-kube-api-access-k5ggm\") pod \"network-check-target-5lz4c\" (UID: \"16197990-fb02-48a4-a024-5b467398b37f\") " pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:10:06.509072 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.509048 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/529d219d-5011-4cd4-8dde-30b659530d16-original-pull-secret\") pod \"global-pull-secret-syncer-jxlqd\" (UID: \"529d219d-5011-4cd4-8dde-30b659530d16\") " pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:10:06.511655 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.511630 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 22:10:06.511854 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.511658 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 22:10:06.522403 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.522370 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 22:10:06.523371 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.523345 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/529d219d-5011-4cd4-8dde-30b659530d16-original-pull-secret\") pod \"global-pull-secret-syncer-jxlqd\" (UID: \"529d219d-5011-4cd4-8dde-30b659530d16\") " pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:10:06.534979 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.534916 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5ggm\" (UniqueName: \"kubernetes.io/projected/16197990-fb02-48a4-a024-5b467398b37f-kube-api-access-k5ggm\") pod \"network-check-target-5lz4c\" (UID: \"16197990-fb02-48a4-a024-5b467398b37f\") " pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:10:06.570529 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.570491 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-zwpgv" Jul 06 22:10:06.576993 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.576970 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kshfh\"" Jul 06 22:10:06.585135 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.585109 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" Jul 06 22:10:06.618924 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.618787 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7gbfj"] Jul 06 22:10:06.653028 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.652994 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6779655bfb-58sqz"] Jul 06 22:10:06.656255 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:10:06.656202 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58c6b79e_0145_4c48_a548_1b0cd145efb4.slice/crio-721629afb2d6324cfb46898a8b2948f4917ccf0e712d1408a9aad9048e1d367e WatchSource:0}: Error finding container 721629afb2d6324cfb46898a8b2948f4917ccf0e712d1408a9aad9048e1d367e: Status 404 returned error can't find the container with id 721629afb2d6324cfb46898a8b2948f4917ccf0e712d1408a9aad9048e1d367e Jul 06 22:10:06.675629 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.675594 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d77c4b99-z82b2"] Jul 06 22:10:06.679681 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:10:06.679642 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod681e9096_8428_4341_adad_ebd9f708b813.slice/crio-5be64db2cb4f0b9a41fba1f1770e38afe08566249445edfcd14d308b827e8548 WatchSource:0}: Error finding container 5be64db2cb4f0b9a41fba1f1770e38afe08566249445edfcd14d308b827e8548: Status 404 returned error can't find the container with id 5be64db2cb4f0b9a41fba1f1770e38afe08566249445edfcd14d308b827e8548 Jul 06 22:10:06.725216 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.725189 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-zwpgv"] Jul 06 22:10:06.726340 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:10:06.726318 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode30320e8_b3e5_4f78_bbef_542cedfc1e24.slice/crio-73a9c33e9216d10093fff46cf65e8c4d26a8d35423941a2e0e5eeda5fe80ee4e WatchSource:0}: Error finding container 73a9c33e9216d10093fff46cf65e8c4d26a8d35423941a2e0e5eeda5fe80ee4e: Status 404 returned error can't find the container with id 73a9c33e9216d10093fff46cf65e8c4d26a8d35423941a2e0e5eeda5fe80ee4e Jul 06 22:10:06.739430 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.739404 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b546d9cc5-l5xmz"] Jul 06 22:10:06.740541 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.740515 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlqd" Jul 06 22:10:06.742786 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:10:06.742752 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8287232_21ca_4ea6_9ef0_6343221689ef.slice/crio-44b18ba5fab39ed31bf33f838162c61d0206bd472388ed05225c37728f41045d WatchSource:0}: Error finding container 44b18ba5fab39ed31bf33f838162c61d0206bd472388ed05225c37728f41045d: Status 404 returned error can't find the container with id 44b18ba5fab39ed31bf33f838162c61d0206bd472388ed05225c37728f41045d Jul 06 22:10:06.750719 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.750698 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pk242\"" Jul 06 22:10:06.758826 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.758793 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:10:06.812473 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.812440 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-tls\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:10:06.815040 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.814982 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-tls\") pod \"image-registry-cf9974c67-z4qd4\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:10:06.901271 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.901237 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jxlqd"] Jul 06 22:10:06.906117 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:10:06.906088 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod529d219d_5011_4cd4_8dde_30b659530d16.slice/crio-d64e28770a935599f3f6266709f111fff4531c4babc65c4f362d249301fe4e07 WatchSource:0}: Error finding container d64e28770a935599f3f6266709f111fff4531c4babc65c4f362d249301fe4e07: Status 404 returned error can't find the container with id d64e28770a935599f3f6266709f111fff4531c4babc65c4f362d249301fe4e07 Jul 06 22:10:06.931029 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:06.930993 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5lz4c"] Jul 06 22:10:06.934911 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:10:06.934881 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16197990_fb02_48a4_a024_5b467398b37f.slice/crio-6e5751b074ddbe28c915987783a82143280d90fbc7a58952a513f64a591cb5bc WatchSource:0}: Error finding container 6e5751b074ddbe28c915987783a82143280d90fbc7a58952a513f64a591cb5bc: Status 404 returned error can't find the container with id 6e5751b074ddbe28c915987783a82143280d90fbc7a58952a513f64a591cb5bc Jul 06 22:10:07.000685 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.000651 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d77c4b99-z82b2" event={"ID":"681e9096-8428-4341-adad-ebd9f708b813","Type":"ContainerStarted","Data":"5be64db2cb4f0b9a41fba1f1770e38afe08566249445edfcd14d308b827e8548"} Jul 06 22:10:07.002074 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.002043 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7gbfj" event={"ID":"ca356800-b17f-42ba-adab-dbd69bc554db","Type":"ContainerStarted","Data":"5776d86c1471915f7511735c5eb77da47641b804193113149469f2b3e56050a4"} Jul 06 22:10:07.004225 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.004193 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f949n" event={"ID":"699501f3-29d3-4e57-b5b9-4f5b4b903097","Type":"ContainerStarted","Data":"82025237f31a6205ab42f40d93264502a83d11df89ecb1f7cc3989ec7c654679"} Jul 06 22:10:07.005376 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.005345 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5lz4c" event={"ID":"16197990-fb02-48a4-a024-5b467398b37f","Type":"ContainerStarted","Data":"6e5751b074ddbe28c915987783a82143280d90fbc7a58952a513f64a591cb5bc"} Jul 06 22:10:07.006482 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.006462 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jxlqd" event={"ID":"529d219d-5011-4cd4-8dde-30b659530d16","Type":"ContainerStarted","Data":"d64e28770a935599f3f6266709f111fff4531c4babc65c4f362d249301fe4e07"} Jul 06 22:10:07.007745 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.007716 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-zwpgv" event={"ID":"e30320e8-b3e5-4f78-bbef-542cedfc1e24","Type":"ContainerStarted","Data":"73a9c33e9216d10093fff46cf65e8c4d26a8d35423941a2e0e5eeda5fe80ee4e"} Jul 06 22:10:07.008823 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.008802 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6779655bfb-58sqz" event={"ID":"58c6b79e-0145-4c48-a548-1b0cd145efb4","Type":"ContainerStarted","Data":"721629afb2d6324cfb46898a8b2948f4917ccf0e712d1408a9aad9048e1d367e"} Jul 06 22:10:07.010442 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.010419 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" event={"ID":"e8287232-21ca-4ea6-9ef0-6343221689ef","Type":"ContainerStarted","Data":"52b348df3ba0b43a3dc343dbbb5bd993104ffaf3b3bc0dccf6a7fc48a4cd32b3"} Jul 06 22:10:07.010531 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.010441 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:10:07.010531 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.010463 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" event={"ID":"e8287232-21ca-4ea6-9ef0-6343221689ef","Type":"ContainerStarted","Data":"44b18ba5fab39ed31bf33f838162c61d0206bd472388ed05225c37728f41045d"} Jul 06 22:10:07.022041 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.021914 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-f949n" podStartSLOduration=17.726846805 podStartE2EDuration="25.021893959s" totalImagesPullingTime="7.295047154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:09:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:10:07.021430729 +0000 UTC m=+66.876396196" watchObservedRunningTime="2026-07-06 22:10:07.021893959 +0000 UTC m=+66.876859427" Jul 06 22:10:07.036019 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.035989 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:10:07.059453 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.059400 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" podStartSLOduration=1.059385642 podStartE2EDuration="1.059385642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:10:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:10:07.057666776 +0000 UTC m=+66.912632253" watchObservedRunningTime="2026-07-06 22:10:07.059385642 +0000 UTC m=+66.914351087" Jul 06 22:10:07.115219 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.115175 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-tls\") pod \"f5bba360-152a-4076-be57-f8ef9a7bf819\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " Jul 06 22:10:07.115837 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.115239 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-certificates\") pod \"f5bba360-152a-4076-be57-f8ef9a7bf819\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " Jul 06 22:10:07.115837 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.115699 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-bound-sa-token\") pod \"f5bba360-152a-4076-be57-f8ef9a7bf819\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " Jul 06 22:10:07.115837 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.115759 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f5bba360-152a-4076-be57-f8ef9a7bf819-trusted-ca\") pod \"f5bba360-152a-4076-be57-f8ef9a7bf819\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " Jul 06 22:10:07.115837 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.115804 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwdsz\" (UniqueName: \"kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-kube-api-access-mwdsz\") pod \"f5bba360-152a-4076-be57-f8ef9a7bf819\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " Jul 06 22:10:07.116110 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.115836 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f5bba360-152a-4076-be57-f8ef9a7bf819-image-registry-private-configuration\") pod \"f5bba360-152a-4076-be57-f8ef9a7bf819\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " Jul 06 22:10:07.116383 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.116149 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5bba360-152a-4076-be57-f8ef9a7bf819-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f5bba360-152a-4076-be57-f8ef9a7bf819" (UID: "f5bba360-152a-4076-be57-f8ef9a7bf819"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:10:07.116383 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.116267 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f5bba360-152a-4076-be57-f8ef9a7bf819" (UID: "f5bba360-152a-4076-be57-f8ef9a7bf819"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:10:07.118986 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.118718 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f5bba360-152a-4076-be57-f8ef9a7bf819" (UID: "f5bba360-152a-4076-be57-f8ef9a7bf819"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:10:07.119342 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.119292 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5bba360-152a-4076-be57-f8ef9a7bf819-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f5bba360-152a-4076-be57-f8ef9a7bf819" (UID: "f5bba360-152a-4076-be57-f8ef9a7bf819"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:10:07.120003 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.115898 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f5bba360-152a-4076-be57-f8ef9a7bf819-ca-trust-extracted\") pod \"f5bba360-152a-4076-be57-f8ef9a7bf819\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " Jul 06 22:10:07.120003 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.119499 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f5bba360-152a-4076-be57-f8ef9a7bf819-installation-pull-secrets\") pod \"f5bba360-152a-4076-be57-f8ef9a7bf819\" (UID: \"f5bba360-152a-4076-be57-f8ef9a7bf819\") " Jul 06 22:10:07.120164 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.120037 2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f5bba360-152a-4076-be57-f8ef9a7bf819-ca-trust-extracted\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:10:07.120164 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.120057 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-tls\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:10:07.120164 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.120073 2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f5bba360-152a-4076-be57-f8ef9a7bf819-registry-certificates\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:10:07.120164 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.120094 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f5bba360-152a-4076-be57-f8ef9a7bf819-trusted-ca\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:10:07.123324 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.122833 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f5bba360-152a-4076-be57-f8ef9a7bf819" (UID: "f5bba360-152a-4076-be57-f8ef9a7bf819"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:10:07.123324 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.122865 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5bba360-152a-4076-be57-f8ef9a7bf819-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f5bba360-152a-4076-be57-f8ef9a7bf819" (UID: "f5bba360-152a-4076-be57-f8ef9a7bf819"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:10:07.123324 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.122882 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-kube-api-access-mwdsz" (OuterVolumeSpecName: "kube-api-access-mwdsz") pod "f5bba360-152a-4076-be57-f8ef9a7bf819" (UID: "f5bba360-152a-4076-be57-f8ef9a7bf819"). InnerVolumeSpecName "kube-api-access-mwdsz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:10:07.123700 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.123569 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5bba360-152a-4076-be57-f8ef9a7bf819-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f5bba360-152a-4076-be57-f8ef9a7bf819" (UID: "f5bba360-152a-4076-be57-f8ef9a7bf819"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:10:07.221111 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.221074 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwdsz\" (UniqueName: \"kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-kube-api-access-mwdsz\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:10:07.221111 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.221106 2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f5bba360-152a-4076-be57-f8ef9a7bf819-image-registry-private-configuration\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:10:07.221111 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.221116 2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f5bba360-152a-4076-be57-f8ef9a7bf819-installation-pull-secrets\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:10:07.221519 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:07.221126 2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f5bba360-152a-4076-be57-f8ef9a7bf819-bound-sa-token\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:10:08.016915 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:08.016888 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" Jul 06 22:10:08.017209 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:08.016970 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cf9974c67-z4qd4" Jul 06 22:10:08.063889 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:08.063754 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cf9974c67-z4qd4"] Jul 06 22:10:08.068793 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:08.068718 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-cf9974c67-z4qd4"] Jul 06 22:10:08.729873 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:08.729560 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5bba360-152a-4076-be57-f8ef9a7bf819" path="/var/lib/kubelet/pods/f5bba360-152a-4076-be57-f8ef9a7bf819/volumes" Jul 06 22:10:09.026548 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:09.026503 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7gbfj" event={"ID":"ca356800-b17f-42ba-adab-dbd69bc554db","Type":"ContainerStarted","Data":"9ff10a496a1be613a5c0e1c7aab5e8427e92eb4d3d396243f42ae6bd2a07aa32"} Jul 06 22:10:10.038788 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:10.038606 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7gbfj" event={"ID":"ca356800-b17f-42ba-adab-dbd69bc554db","Type":"ContainerStarted","Data":"eb9211d31aaf6c060f193ad23054c270b24292bea94c73dbbf210784cd757dab"} Jul 06 22:10:16.066745 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:16.066531 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5lz4c" event={"ID":"16197990-fb02-48a4-a024-5b467398b37f","Type":"ContainerStarted","Data":"74731e50bb0471244ec5c33eb75d10066d394d466f4032afb5fdb3dd4b774870"} Jul 06 22:10:16.066745 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:16.066636 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:10:16.068246 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:16.068212 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jxlqd" event={"ID":"529d219d-5011-4cd4-8dde-30b659530d16","Type":"ContainerStarted","Data":"4d78eace0805aae3f7017a7cdf177b64c2015f4a7e9b9aa1e3e0bcf43a4ea014"} Jul 06 22:10:16.069984 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:16.069944 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6779655bfb-58sqz" event={"ID":"58c6b79e-0145-4c48-a548-1b0cd145efb4","Type":"ContainerStarted","Data":"1b570a3498b522c06bac4e8b3b8b3926b8945781e562421f2a79d867b6cd5730"} Jul 06 22:10:16.071709 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:16.071687 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d77c4b99-z82b2" event={"ID":"681e9096-8428-4341-adad-ebd9f708b813","Type":"ContainerStarted","Data":"e27d8ca081bd7c2cc1f1ebd50b0e7eee1d64d6d3bf85a5f385364c3fdb028c7f"} Jul 06 22:10:16.071904 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:16.071877 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d77c4b99-z82b2" Jul 06 22:10:16.073775 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:16.073753 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d77c4b99-z82b2" Jul 06 22:10:16.084320 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:16.084275 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7gbfj" podStartSLOduration=73.036717913 podStartE2EDuration="1m15.084261504s" totalImagesPullingTime="2.047543591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:10:10.057984399 +0000 UTC m=+69.912949851" watchObservedRunningTime="2026-07-06 22:10:16.084261504 +0000 UTC m=+75.939226971" Jul 06 22:10:16.084661 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:16.084632 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5lz4c" podStartSLOduration=66.410794505 podStartE2EDuration="1m15.084626513s" totalImagesPullingTime="8.673832008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:10:16.083499564 +0000 UTC m=+75.938465030" watchObservedRunningTime="2026-07-06 22:10:16.084626513 +0000 UTC m=+75.939591983" Jul 06 22:10:16.099098 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:16.099051 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6779655bfb-58sqz" podStartSLOduration=1.13766647 podStartE2EDuration="10.099038569s" totalImagesPullingTime="8.961372099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:10:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:10:16.098067487 +0000 UTC m=+75.953032957" watchObservedRunningTime="2026-07-06 22:10:16.099038569 +0000 UTC m=+75.954004035" Jul 06 22:10:16.113353 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:16.113308 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jxlqd" podStartSLOduration=66.395903009 podStartE2EDuration="1m15.113292063s" totalImagesPullingTime="8.717389054s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:10:16.111967006 +0000 UTC m=+75.966932473" watchObservedRunningTime="2026-07-06 22:10:16.113292063 +0000 UTC m=+75.968257529" Jul 06 22:10:16.129061 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:16.129015 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d77c4b99-z82b2" podStartSLOduration=1.180299175 podStartE2EDuration="10.128998183s" totalImagesPullingTime="8.948699008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:10:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:10:16.128127502 +0000 UTC m=+75.983092970" watchObservedRunningTime="2026-07-06 22:10:16.128998183 +0000 UTC m=+75.983963656" Jul 06 22:10:22.678095 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.678059 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9l5pg"] Jul 06 22:10:22.682181 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.682158 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:22.689400 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.689370 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 22:10:22.690512 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.690328 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-g2mfw\"" Jul 06 22:10:22.690512 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.690323 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 22:10:22.690512 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.690355 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 22:10:22.690512 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.690380 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 22:10:22.690997 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.690978 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 22:10:22.691251 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.691236 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 22:10:22.846450 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.846410 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpmc2\" (UniqueName: \"kubernetes.io/projected/c3149ee7-41e1-439e-a2f1-873cf45db23b-kube-api-access-xpmc2\") pod \"node-exporter-9l5pg\" (UID: \"c3149ee7-41e1-439e-a2f1-873cf45db23b\") " pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:22.846642 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.846460 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3149ee7-41e1-439e-a2f1-873cf45db23b-metrics-client-ca\") pod \"node-exporter-9l5pg\" (UID: \"c3149ee7-41e1-439e-a2f1-873cf45db23b\") " pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:22.846642 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.846536 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3149ee7-41e1-439e-a2f1-873cf45db23b-sys\") pod \"node-exporter-9l5pg\" (UID: \"c3149ee7-41e1-439e-a2f1-873cf45db23b\") " pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:22.846642 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.846593 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c3149ee7-41e1-439e-a2f1-873cf45db23b-node-exporter-textfile\") pod \"node-exporter-9l5pg\" (UID: \"c3149ee7-41e1-439e-a2f1-873cf45db23b\") " pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:22.846792 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.846674 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c3149ee7-41e1-439e-a2f1-873cf45db23b-node-exporter-wtmp\") pod \"node-exporter-9l5pg\" (UID: \"c3149ee7-41e1-439e-a2f1-873cf45db23b\") " pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:22.846792 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.846710 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c3149ee7-41e1-439e-a2f1-873cf45db23b-root\") pod \"node-exporter-9l5pg\" (UID: \"c3149ee7-41e1-439e-a2f1-873cf45db23b\") " pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:22.846792 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.846744 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c3149ee7-41e1-439e-a2f1-873cf45db23b-node-exporter-accelerators-collector-config\") pod \"node-exporter-9l5pg\" (UID: \"c3149ee7-41e1-439e-a2f1-873cf45db23b\") " pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:22.846958 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.846829 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3149ee7-41e1-439e-a2f1-873cf45db23b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9l5pg\" (UID: \"c3149ee7-41e1-439e-a2f1-873cf45db23b\") " pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:22.846958 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.846891 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c3149ee7-41e1-439e-a2f1-873cf45db23b-node-exporter-tls\") pod \"node-exporter-9l5pg\" (UID: \"c3149ee7-41e1-439e-a2f1-873cf45db23b\") " pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:22.948203 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.948104 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3149ee7-41e1-439e-a2f1-873cf45db23b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9l5pg\" (UID: \"c3149ee7-41e1-439e-a2f1-873cf45db23b\") " pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:22.948203 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.948154 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c3149ee7-41e1-439e-a2f1-873cf45db23b-node-exporter-tls\") pod \"node-exporter-9l5pg\" (UID: \"c3149ee7-41e1-439e-a2f1-873cf45db23b\") " pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:22.948203 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.948181 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpmc2\" (UniqueName: \"kubernetes.io/projected/c3149ee7-41e1-439e-a2f1-873cf45db23b-kube-api-access-xpmc2\") pod \"node-exporter-9l5pg\" (UID: \"c3149ee7-41e1-439e-a2f1-873cf45db23b\") " pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:22.948482 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.948212 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3149ee7-41e1-439e-a2f1-873cf45db23b-metrics-client-ca\") pod \"node-exporter-9l5pg\" (UID: \"c3149ee7-41e1-439e-a2f1-873cf45db23b\") " pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:22.948482 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.948242 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3149ee7-41e1-439e-a2f1-873cf45db23b-sys\") pod \"node-exporter-9l5pg\" (UID: \"c3149ee7-41e1-439e-a2f1-873cf45db23b\") " pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:22.948482 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.948270 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c3149ee7-41e1-439e-a2f1-873cf45db23b-node-exporter-textfile\") pod \"node-exporter-9l5pg\" (UID: \"c3149ee7-41e1-439e-a2f1-873cf45db23b\") " pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:22.948482 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.948298 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c3149ee7-41e1-439e-a2f1-873cf45db23b-node-exporter-wtmp\") pod \"node-exporter-9l5pg\" (UID: \"c3149ee7-41e1-439e-a2f1-873cf45db23b\") " pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:22.948482 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:10:22.948304 2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 22:10:22.948482 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.948322 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c3149ee7-41e1-439e-a2f1-873cf45db23b-root\") pod \"node-exporter-9l5pg\" (UID: \"c3149ee7-41e1-439e-a2f1-873cf45db23b\") " pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:22.948482 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.948351 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c3149ee7-41e1-439e-a2f1-873cf45db23b-node-exporter-accelerators-collector-config\") pod \"node-exporter-9l5pg\" (UID: \"c3149ee7-41e1-439e-a2f1-873cf45db23b\") " pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:22.948482 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.948364 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3149ee7-41e1-439e-a2f1-873cf45db23b-sys\") pod \"node-exporter-9l5pg\" (UID: \"c3149ee7-41e1-439e-a2f1-873cf45db23b\") " pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:22.948482 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:10:22.948378 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3149ee7-41e1-439e-a2f1-873cf45db23b-node-exporter-tls podName:c3149ee7-41e1-439e-a2f1-873cf45db23b nodeName:}" failed. No retries permitted until 2026-07-06 22:10:23.448354072 +0000 UTC m=+83.303319521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c3149ee7-41e1-439e-a2f1-873cf45db23b-node-exporter-tls") pod "node-exporter-9l5pg" (UID: "c3149ee7-41e1-439e-a2f1-873cf45db23b") : secret "node-exporter-tls" not found Jul 06 22:10:22.948884 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.948568 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c3149ee7-41e1-439e-a2f1-873cf45db23b-root\") pod \"node-exporter-9l5pg\" (UID: \"c3149ee7-41e1-439e-a2f1-873cf45db23b\") " pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:22.948884 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.948576 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c3149ee7-41e1-439e-a2f1-873cf45db23b-node-exporter-wtmp\") pod \"node-exporter-9l5pg\" (UID: \"c3149ee7-41e1-439e-a2f1-873cf45db23b\") " pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:22.948884 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.948804 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c3149ee7-41e1-439e-a2f1-873cf45db23b-node-exporter-textfile\") pod \"node-exporter-9l5pg\" (UID: \"c3149ee7-41e1-439e-a2f1-873cf45db23b\") " pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:22.949039 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.948932 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c3149ee7-41e1-439e-a2f1-873cf45db23b-node-exporter-accelerators-collector-config\") pod \"node-exporter-9l5pg\" (UID: \"c3149ee7-41e1-439e-a2f1-873cf45db23b\") " pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:22.949039 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.948958 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3149ee7-41e1-439e-a2f1-873cf45db23b-metrics-client-ca\") pod \"node-exporter-9l5pg\" (UID: \"c3149ee7-41e1-439e-a2f1-873cf45db23b\") " pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:22.950881 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.950854 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3149ee7-41e1-439e-a2f1-873cf45db23b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9l5pg\" (UID: \"c3149ee7-41e1-439e-a2f1-873cf45db23b\") " pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:22.956702 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:22.956678 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpmc2\" (UniqueName: \"kubernetes.io/projected/c3149ee7-41e1-439e-a2f1-873cf45db23b-kube-api-access-xpmc2\") pod \"node-exporter-9l5pg\" (UID: \"c3149ee7-41e1-439e-a2f1-873cf45db23b\") " pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:23.453558 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:23.453499 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c3149ee7-41e1-439e-a2f1-873cf45db23b-node-exporter-tls\") pod \"node-exporter-9l5pg\" (UID: \"c3149ee7-41e1-439e-a2f1-873cf45db23b\") " pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:23.456305 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:23.456276 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c3149ee7-41e1-439e-a2f1-873cf45db23b-node-exporter-tls\") pod \"node-exporter-9l5pg\" (UID: \"c3149ee7-41e1-439e-a2f1-873cf45db23b\") " pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:23.592905 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:23.592870 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9l5pg" Jul 06 22:10:26.727239 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:10:26.727203 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3149ee7_41e1_439e_a2f1_873cf45db23b.slice/crio-883e1f4962d508a5b58bd2bcae2eb951f09df4ef08a3d565362ba4c6d870c4a8 WatchSource:0}: Error finding container 883e1f4962d508a5b58bd2bcae2eb951f09df4ef08a3d565362ba4c6d870c4a8: Status 404 returned error can't find the container with id 883e1f4962d508a5b58bd2bcae2eb951f09df4ef08a3d565362ba4c6d870c4a8 Jul 06 22:10:27.116399 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:27.116367 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9l5pg" event={"ID":"c3149ee7-41e1-439e-a2f1-873cf45db23b","Type":"ContainerStarted","Data":"883e1f4962d508a5b58bd2bcae2eb951f09df4ef08a3d565362ba4c6d870c4a8"} Jul 06 22:10:28.123092 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:28.123034 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-zwpgv" event={"ID":"e30320e8-b3e5-4f78-bbef-542cedfc1e24","Type":"ContainerStarted","Data":"de9d3bcd008b53f46a2fc4a0989f0a8f3ab15005c6a82e16e166d171d0f5b310"} Jul 06 22:10:28.123551 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:28.123109 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-zwpgv" Jul 06 22:10:28.125074 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:28.125038 2566 generic.go:356] "Generic (PLEG): container finished" podID="c3149ee7-41e1-439e-a2f1-873cf45db23b" containerID="decaeb65d286525f42b3636a454fbb575174de05fa6dc855498c822a9edf961f" exitCode=0 Jul 06 22:10:28.125217 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:28.125100 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9l5pg" event={"ID":"c3149ee7-41e1-439e-a2f1-873cf45db23b","Type":"ContainerDied","Data":"decaeb65d286525f42b3636a454fbb575174de05fa6dc855498c822a9edf961f"} Jul 06 22:10:28.142507 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:28.142484 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-zwpgv" Jul 06 22:10:28.149660 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:28.147954 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-zwpgv" podStartSLOduration=1.7686730750000001 podStartE2EDuration="22.147935716s" totalImagesPullingTime="20.379262641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:10:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:10:28.145709651 +0000 UTC m=+88.000675119" watchObservedRunningTime="2026-07-06 22:10:28.147935716 +0000 UTC m=+88.002901187" Jul 06 22:10:29.032543 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:29.032509 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b546d9cc5-l5xmz" Jul 06 22:10:29.131930 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:29.131880 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9l5pg" event={"ID":"c3149ee7-41e1-439e-a2f1-873cf45db23b","Type":"ContainerStarted","Data":"2ca16e24e781e78d74024ac034133573e97c90769f3d4ea9f7580885a2bc337d"} Jul 06 22:10:29.132414 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:29.131954 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9l5pg" event={"ID":"c3149ee7-41e1-439e-a2f1-873cf45db23b","Type":"ContainerStarted","Data":"c0ed8bb3f608257c8b62677fe39a854884c6547f3da65de926224e5bf7039a19"} Jul 06 22:10:29.167766 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:29.167707 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9l5pg" podStartSLOduration=5.963479538 podStartE2EDuration="7.167686976s" totalImagesPullingTime="1.103210617s" totalInitContainerRuntime="100.996821ms" isStatefulPod=true podCreationTimestamp="2026-07-06 22:10:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:10:29.166197574 +0000 UTC m=+89.021163042" watchObservedRunningTime="2026-07-06 22:10:29.167686976 +0000 UTC m=+89.022652443" Jul 06 22:10:32.843331 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:32.843294 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f76b4459c-47jbq"] Jul 06 22:10:32.876041 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:32.876006 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f76b4459c-47jbq"] Jul 06 22:10:32.876272 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:32.876139 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:10:32.878744 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:32.878689 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 22:10:32.878744 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:32.878713 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 22:10:32.878977 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:32.878752 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wtp2d\"" Jul 06 22:10:32.878977 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:32.878825 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 22:10:32.879185 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:32.879163 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 22:10:32.879296 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:32.879203 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 22:10:32.885097 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:32.885055 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 22:10:32.939157 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:32.939119 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t52v\" (UniqueName: \"kubernetes.io/projected/3acb9ffe-b9de-451a-b4a6-fdade9882617-kube-api-access-7t52v\") pod \"console-7f76b4459c-47jbq\" (UID: \"3acb9ffe-b9de-451a-b4a6-fdade9882617\") " pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:10:32.939338 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:32.939184 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3acb9ffe-b9de-451a-b4a6-fdade9882617-console-oauth-config\") pod \"console-7f76b4459c-47jbq\" (UID: \"3acb9ffe-b9de-451a-b4a6-fdade9882617\") " pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:10:32.939338 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:32.939236 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3acb9ffe-b9de-451a-b4a6-fdade9882617-trusted-ca-bundle\") pod \"console-7f76b4459c-47jbq\" (UID: \"3acb9ffe-b9de-451a-b4a6-fdade9882617\") " pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:10:32.939338 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:32.939265 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3acb9ffe-b9de-451a-b4a6-fdade9882617-service-ca\") pod \"console-7f76b4459c-47jbq\" (UID: \"3acb9ffe-b9de-451a-b4a6-fdade9882617\") " pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:10:32.939338 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:32.939287 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3acb9ffe-b9de-451a-b4a6-fdade9882617-oauth-serving-cert\") pod \"console-7f76b4459c-47jbq\" (UID: \"3acb9ffe-b9de-451a-b4a6-fdade9882617\") " pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:10:32.939338 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:32.939302 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3acb9ffe-b9de-451a-b4a6-fdade9882617-console-config\") pod \"console-7f76b4459c-47jbq\" (UID: \"3acb9ffe-b9de-451a-b4a6-fdade9882617\") " pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:10:32.939338 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:32.939321 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3acb9ffe-b9de-451a-b4a6-fdade9882617-console-serving-cert\") pod \"console-7f76b4459c-47jbq\" (UID: \"3acb9ffe-b9de-451a-b4a6-fdade9882617\") " pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:10:33.040209 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:33.040166 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t52v\" (UniqueName: \"kubernetes.io/projected/3acb9ffe-b9de-451a-b4a6-fdade9882617-kube-api-access-7t52v\") pod \"console-7f76b4459c-47jbq\" (UID: \"3acb9ffe-b9de-451a-b4a6-fdade9882617\") " pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:10:33.040395 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:33.040247 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3acb9ffe-b9de-451a-b4a6-fdade9882617-console-oauth-config\") pod \"console-7f76b4459c-47jbq\" (UID: \"3acb9ffe-b9de-451a-b4a6-fdade9882617\") " pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:10:33.040395 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:33.040273 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3acb9ffe-b9de-451a-b4a6-fdade9882617-trusted-ca-bundle\") pod \"console-7f76b4459c-47jbq\" (UID: \"3acb9ffe-b9de-451a-b4a6-fdade9882617\") " pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:10:33.040395 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:33.040305 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3acb9ffe-b9de-451a-b4a6-fdade9882617-service-ca\") pod \"console-7f76b4459c-47jbq\" (UID: \"3acb9ffe-b9de-451a-b4a6-fdade9882617\") " pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:10:33.040395 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:33.040340 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3acb9ffe-b9de-451a-b4a6-fdade9882617-oauth-serving-cert\") pod \"console-7f76b4459c-47jbq\" (UID: \"3acb9ffe-b9de-451a-b4a6-fdade9882617\") " pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:10:33.040395 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:33.040366 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3acb9ffe-b9de-451a-b4a6-fdade9882617-console-config\") pod \"console-7f76b4459c-47jbq\" (UID: \"3acb9ffe-b9de-451a-b4a6-fdade9882617\") " pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:10:33.040639 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:33.040396 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3acb9ffe-b9de-451a-b4a6-fdade9882617-console-serving-cert\") pod \"console-7f76b4459c-47jbq\" (UID: \"3acb9ffe-b9de-451a-b4a6-fdade9882617\") " pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:10:33.041271 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:33.041242 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3acb9ffe-b9de-451a-b4a6-fdade9882617-oauth-serving-cert\") pod \"console-7f76b4459c-47jbq\" (UID: \"3acb9ffe-b9de-451a-b4a6-fdade9882617\") " pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:10:33.041821 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:33.041284 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3acb9ffe-b9de-451a-b4a6-fdade9882617-service-ca\") pod \"console-7f76b4459c-47jbq\" (UID: \"3acb9ffe-b9de-451a-b4a6-fdade9882617\") " pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:10:33.041821 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:33.041606 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3acb9ffe-b9de-451a-b4a6-fdade9882617-trusted-ca-bundle\") pod \"console-7f76b4459c-47jbq\" (UID: \"3acb9ffe-b9de-451a-b4a6-fdade9882617\") " pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:10:33.041995 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:33.041921 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3acb9ffe-b9de-451a-b4a6-fdade9882617-console-config\") pod \"console-7f76b4459c-47jbq\" (UID: \"3acb9ffe-b9de-451a-b4a6-fdade9882617\") " pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:10:33.043441 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:33.043418 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3acb9ffe-b9de-451a-b4a6-fdade9882617-console-serving-cert\") pod \"console-7f76b4459c-47jbq\" (UID: \"3acb9ffe-b9de-451a-b4a6-fdade9882617\") " pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:10:33.043537 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:33.043428 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3acb9ffe-b9de-451a-b4a6-fdade9882617-console-oauth-config\") pod \"console-7f76b4459c-47jbq\" (UID: \"3acb9ffe-b9de-451a-b4a6-fdade9882617\") " pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:10:33.048529 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:33.048507 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t52v\" (UniqueName: \"kubernetes.io/projected/3acb9ffe-b9de-451a-b4a6-fdade9882617-kube-api-access-7t52v\") pod \"console-7f76b4459c-47jbq\" (UID: \"3acb9ffe-b9de-451a-b4a6-fdade9882617\") " pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:10:33.188450 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:33.188410 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:10:33.373720 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:33.373677 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f76b4459c-47jbq"] Jul 06 22:10:33.377809 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:10:33.377767 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3acb9ffe_b9de_451a_b4a6_fdade9882617.slice/crio-717aa36ea9ce481b58c5c43883df8410434a683b0e0029def598f44c13f5ce2e WatchSource:0}: Error finding container 717aa36ea9ce481b58c5c43883df8410434a683b0e0029def598f44c13f5ce2e: Status 404 returned error can't find the container with id 717aa36ea9ce481b58c5c43883df8410434a683b0e0029def598f44c13f5ce2e Jul 06 22:10:34.156624 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:34.156568 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f76b4459c-47jbq" event={"ID":"3acb9ffe-b9de-451a-b4a6-fdade9882617","Type":"ContainerStarted","Data":"717aa36ea9ce481b58c5c43883df8410434a683b0e0029def598f44c13f5ce2e"} Jul 06 22:10:37.171731 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:37.171697 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f76b4459c-47jbq" event={"ID":"3acb9ffe-b9de-451a-b4a6-fdade9882617","Type":"ContainerStarted","Data":"8892694c588fc26577ae3fb11f57ada2dbe6f812be958909955c46fe62d7bb6b"} Jul 06 22:10:37.189432 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:37.189372 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f76b4459c-47jbq" podStartSLOduration=1.5681612550000001 podStartE2EDuration="5.189355349s" totalImagesPullingTime="3.621194094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:10:37.18856348 +0000 UTC m=+97.043528948" watchObservedRunningTime="2026-07-06 22:10:37.189355349 +0000 UTC m=+97.044320815" Jul 06 22:10:43.189100 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:43.189065 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:10:43.189645 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:43.189131 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:10:43.194244 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:43.194221 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:10:44.201496 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:44.201466 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:10:47.077507 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:10:47.077479 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5lz4c" Jul 06 22:12:02.655186 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:02.655098 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d65bc84b4-5q76d"] Jul 06 22:12:02.657288 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:02.657265 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:12:02.671807 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:02.671779 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d65bc84b4-5q76d"] Jul 06 22:12:02.696306 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:02.696278 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmbdn\" (UniqueName: \"kubernetes.io/projected/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-kube-api-access-wmbdn\") pod \"console-6d65bc84b4-5q76d\" (UID: \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\") " pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:12:02.696456 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:02.696315 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-console-oauth-config\") pod \"console-6d65bc84b4-5q76d\" (UID: \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\") " pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:12:02.696456 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:02.696344 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-console-serving-cert\") pod \"console-6d65bc84b4-5q76d\" (UID: \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\") " pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:12:02.696456 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:02.696368 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-oauth-serving-cert\") pod \"console-6d65bc84b4-5q76d\" (UID: \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\") " pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:12:02.696456 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:02.696401 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-service-ca\") pod \"console-6d65bc84b4-5q76d\" (UID: \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\") " pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:12:02.696456 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:02.696416 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-trusted-ca-bundle\") pod \"console-6d65bc84b4-5q76d\" (UID: \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\") " pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:12:02.696456 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:02.696439 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-console-config\") pod \"console-6d65bc84b4-5q76d\" (UID: \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\") " pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:12:02.797574 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:02.797535 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-service-ca\") pod \"console-6d65bc84b4-5q76d\" (UID: \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\") " pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:12:02.797574 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:02.797569 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-trusted-ca-bundle\") pod \"console-6d65bc84b4-5q76d\" (UID: \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\") " pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:12:02.797806 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:02.797593 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-console-config\") pod \"console-6d65bc84b4-5q76d\" (UID: \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\") " pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:12:02.797806 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:02.797619 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmbdn\" (UniqueName: \"kubernetes.io/projected/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-kube-api-access-wmbdn\") pod \"console-6d65bc84b4-5q76d\" (UID: \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\") " pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:12:02.797806 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:02.797645 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-console-oauth-config\") pod \"console-6d65bc84b4-5q76d\" (UID: \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\") " pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:12:02.797806 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:02.797674 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-console-serving-cert\") pod \"console-6d65bc84b4-5q76d\" (UID: \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\") " pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:12:02.797806 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:02.797694 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-oauth-serving-cert\") pod \"console-6d65bc84b4-5q76d\" (UID: \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\") " pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:12:02.798526 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:02.798496 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-service-ca\") pod \"console-6d65bc84b4-5q76d\" (UID: \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\") " pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:12:02.798657 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:02.798499 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-console-config\") pod \"console-6d65bc84b4-5q76d\" (UID: \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\") " pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:12:02.798657 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:02.798599 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-oauth-serving-cert\") pod \"console-6d65bc84b4-5q76d\" (UID: \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\") " pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:12:02.799007 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:02.798980 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-trusted-ca-bundle\") pod \"console-6d65bc84b4-5q76d\" (UID: \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\") " pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:12:02.800206 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:02.800177 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-console-oauth-config\") pod \"console-6d65bc84b4-5q76d\" (UID: \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\") " pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:12:02.800339 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:02.800323 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-console-serving-cert\") pod \"console-6d65bc84b4-5q76d\" (UID: \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\") " pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:12:02.806683 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:02.806659 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmbdn\" (UniqueName: \"kubernetes.io/projected/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-kube-api-access-wmbdn\") pod \"console-6d65bc84b4-5q76d\" (UID: \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\") " pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:12:02.965667 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:02.965635 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:12:03.089953 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:03.089922 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d65bc84b4-5q76d"] Jul 06 22:12:03.093029 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:12:03.093006 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff5d32ee_740e_4a5b_af8b_48f09e1771ff.slice/crio-7ac3d1bb0e02a7c07d1856ea24ae9f31387190f7d2b9f98a25e714b19140abed WatchSource:0}: Error finding container 7ac3d1bb0e02a7c07d1856ea24ae9f31387190f7d2b9f98a25e714b19140abed: Status 404 returned error can't find the container with id 7ac3d1bb0e02a7c07d1856ea24ae9f31387190f7d2b9f98a25e714b19140abed Jul 06 22:12:03.459684 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:03.459635 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d65bc84b4-5q76d" event={"ID":"ff5d32ee-740e-4a5b-af8b-48f09e1771ff","Type":"ContainerStarted","Data":"555e6f0e202b7208307640ecf4f1ebea9a9bb0e022ca11e6cd4a518ae0921614"} Jul 06 22:12:03.459895 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:03.459697 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d65bc84b4-5q76d" event={"ID":"ff5d32ee-740e-4a5b-af8b-48f09e1771ff","Type":"ContainerStarted","Data":"7ac3d1bb0e02a7c07d1856ea24ae9f31387190f7d2b9f98a25e714b19140abed"} Jul 06 22:12:03.478025 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:03.477966 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d65bc84b4-5q76d" podStartSLOduration=1.477947259 podStartE2EDuration="1.477947259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:12:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:12:03.477381124 +0000 UTC m=+183.332346590" watchObservedRunningTime="2026-07-06 22:12:03.477947259 +0000 UTC m=+183.332912725" Jul 06 22:12:12.966642 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:12.966605 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:12:12.967115 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:12.966687 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:12:12.971267 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:12.971244 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:12:13.498801 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:13.498772 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:12:13.540582 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:13.540548 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f76b4459c-47jbq"] Jul 06 22:12:38.560836 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:38.560774 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7f76b4459c-47jbq" podUID="3acb9ffe-b9de-451a-b4a6-fdade9882617" containerName="console" containerID="cri-o://8892694c588fc26577ae3fb11f57ada2dbe6f812be958909955c46fe62d7bb6b" gracePeriod=15 Jul 06 22:12:38.795294 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:38.795269 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:12:38.841123 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:38.841033 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3acb9ffe-b9de-451a-b4a6-fdade9882617-service-ca\") pod \"3acb9ffe-b9de-451a-b4a6-fdade9882617\" (UID: \"3acb9ffe-b9de-451a-b4a6-fdade9882617\") " Jul 06 22:12:38.841123 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:38.841073 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7t52v\" (UniqueName: \"kubernetes.io/projected/3acb9ffe-b9de-451a-b4a6-fdade9882617-kube-api-access-7t52v\") pod \"3acb9ffe-b9de-451a-b4a6-fdade9882617\" (UID: \"3acb9ffe-b9de-451a-b4a6-fdade9882617\") " Jul 06 22:12:38.841123 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:38.841109 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3acb9ffe-b9de-451a-b4a6-fdade9882617-console-oauth-config\") pod \"3acb9ffe-b9de-451a-b4a6-fdade9882617\" (UID: \"3acb9ffe-b9de-451a-b4a6-fdade9882617\") " Jul 06 22:12:38.841123 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:38.841127 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3acb9ffe-b9de-451a-b4a6-fdade9882617-console-config\") pod \"3acb9ffe-b9de-451a-b4a6-fdade9882617\" (UID: \"3acb9ffe-b9de-451a-b4a6-fdade9882617\") " Jul 06 22:12:38.841441 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:38.841236 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3acb9ffe-b9de-451a-b4a6-fdade9882617-console-serving-cert\") pod \"3acb9ffe-b9de-451a-b4a6-fdade9882617\" (UID: \"3acb9ffe-b9de-451a-b4a6-fdade9882617\") " Jul 06 22:12:38.841441 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:38.841286 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3acb9ffe-b9de-451a-b4a6-fdade9882617-trusted-ca-bundle\") pod \"3acb9ffe-b9de-451a-b4a6-fdade9882617\" (UID: \"3acb9ffe-b9de-451a-b4a6-fdade9882617\") " Jul 06 22:12:38.841441 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:38.841311 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3acb9ffe-b9de-451a-b4a6-fdade9882617-oauth-serving-cert\") pod \"3acb9ffe-b9de-451a-b4a6-fdade9882617\" (UID: \"3acb9ffe-b9de-451a-b4a6-fdade9882617\") " Jul 06 22:12:38.841585 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:38.841479 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3acb9ffe-b9de-451a-b4a6-fdade9882617-service-ca" (OuterVolumeSpecName: "service-ca") pod "3acb9ffe-b9de-451a-b4a6-fdade9882617" (UID: "3acb9ffe-b9de-451a-b4a6-fdade9882617"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:12:38.841585 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:38.841506 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3acb9ffe-b9de-451a-b4a6-fdade9882617-console-config" (OuterVolumeSpecName: "console-config") pod "3acb9ffe-b9de-451a-b4a6-fdade9882617" (UID: "3acb9ffe-b9de-451a-b4a6-fdade9882617"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:12:38.841802 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:38.841768 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3acb9ffe-b9de-451a-b4a6-fdade9882617-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3acb9ffe-b9de-451a-b4a6-fdade9882617" (UID: "3acb9ffe-b9de-451a-b4a6-fdade9882617"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:12:38.841941 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:38.841861 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3acb9ffe-b9de-451a-b4a6-fdade9882617-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3acb9ffe-b9de-451a-b4a6-fdade9882617" (UID: "3acb9ffe-b9de-451a-b4a6-fdade9882617"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:12:38.843369 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:38.843349 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3acb9ffe-b9de-451a-b4a6-fdade9882617-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3acb9ffe-b9de-451a-b4a6-fdade9882617" (UID: "3acb9ffe-b9de-451a-b4a6-fdade9882617"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:12:38.843765 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:38.843740 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3acb9ffe-b9de-451a-b4a6-fdade9882617-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3acb9ffe-b9de-451a-b4a6-fdade9882617" (UID: "3acb9ffe-b9de-451a-b4a6-fdade9882617"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:12:38.843811 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:38.843744 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3acb9ffe-b9de-451a-b4a6-fdade9882617-kube-api-access-7t52v" (OuterVolumeSpecName: "kube-api-access-7t52v") pod "3acb9ffe-b9de-451a-b4a6-fdade9882617" (UID: "3acb9ffe-b9de-451a-b4a6-fdade9882617"). InnerVolumeSpecName "kube-api-access-7t52v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:12:38.942175 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:38.942142 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3acb9ffe-b9de-451a-b4a6-fdade9882617-service-ca\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:12:38.942175 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:38.942169 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7t52v\" (UniqueName: \"kubernetes.io/projected/3acb9ffe-b9de-451a-b4a6-fdade9882617-kube-api-access-7t52v\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:12:38.942175 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:38.942180 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3acb9ffe-b9de-451a-b4a6-fdade9882617-console-oauth-config\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:12:38.942175 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:38.942188 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3acb9ffe-b9de-451a-b4a6-fdade9882617-console-config\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:12:38.942440 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:38.942197 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3acb9ffe-b9de-451a-b4a6-fdade9882617-console-serving-cert\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:12:38.942440 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:38.942204 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3acb9ffe-b9de-451a-b4a6-fdade9882617-trusted-ca-bundle\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:12:38.942440 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:38.942213 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3acb9ffe-b9de-451a-b4a6-fdade9882617-oauth-serving-cert\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:12:39.588946 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:39.588908 2566 generic.go:356] "Generic (PLEG): container finished" podID="3acb9ffe-b9de-451a-b4a6-fdade9882617" containerID="8892694c588fc26577ae3fb11f57ada2dbe6f812be958909955c46fe62d7bb6b" exitCode=0 Jul 06 22:12:39.589339 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:39.588970 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f76b4459c-47jbq" Jul 06 22:12:39.589339 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:39.588989 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f76b4459c-47jbq" event={"ID":"3acb9ffe-b9de-451a-b4a6-fdade9882617","Type":"ContainerDied","Data":"8892694c588fc26577ae3fb11f57ada2dbe6f812be958909955c46fe62d7bb6b"} Jul 06 22:12:39.589339 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:39.589062 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f76b4459c-47jbq" event={"ID":"3acb9ffe-b9de-451a-b4a6-fdade9882617","Type":"ContainerDied","Data":"717aa36ea9ce481b58c5c43883df8410434a683b0e0029def598f44c13f5ce2e"} Jul 06 22:12:39.589339 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:39.589083 2566 scope.go:117] "RemoveContainer" containerID="8892694c588fc26577ae3fb11f57ada2dbe6f812be958909955c46fe62d7bb6b" Jul 06 22:12:39.597421 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:39.597406 2566 scope.go:117] "RemoveContainer" containerID="8892694c588fc26577ae3fb11f57ada2dbe6f812be958909955c46fe62d7bb6b" Jul 06 22:12:39.597676 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:12:39.597656 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8892694c588fc26577ae3fb11f57ada2dbe6f812be958909955c46fe62d7bb6b\": container with ID starting with 8892694c588fc26577ae3fb11f57ada2dbe6f812be958909955c46fe62d7bb6b not found: ID does not exist" containerID="8892694c588fc26577ae3fb11f57ada2dbe6f812be958909955c46fe62d7bb6b" Jul 06 22:12:39.597756 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:39.597688 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8892694c588fc26577ae3fb11f57ada2dbe6f812be958909955c46fe62d7bb6b"} err="failed to get container status \"8892694c588fc26577ae3fb11f57ada2dbe6f812be958909955c46fe62d7bb6b\": rpc error: code = NotFound desc = could not find container \"8892694c588fc26577ae3fb11f57ada2dbe6f812be958909955c46fe62d7bb6b\": container with ID starting with 8892694c588fc26577ae3fb11f57ada2dbe6f812be958909955c46fe62d7bb6b not found: ID does not exist" Jul 06 22:12:39.610690 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:39.610667 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f76b4459c-47jbq"] Jul 06 22:12:39.615470 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:39.615451 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f76b4459c-47jbq"] Jul 06 22:12:40.724896 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:40.724865 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3acb9ffe-b9de-451a-b4a6-fdade9882617" path="/var/lib/kubelet/pods/3acb9ffe-b9de-451a-b4a6-fdade9882617/volumes" Jul 06 22:12:52.391638 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:52.391605 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt"] Jul 06 22:12:52.392144 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:52.391999 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3acb9ffe-b9de-451a-b4a6-fdade9882617" containerName="console" Jul 06 22:12:52.392144 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:52.392017 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3acb9ffe-b9de-451a-b4a6-fdade9882617" containerName="console" Jul 06 22:12:52.392144 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:52.392092 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3acb9ffe-b9de-451a-b4a6-fdade9882617" containerName="console" Jul 06 22:12:52.393969 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:52.393940 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt" Jul 06 22:12:52.396672 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:52.396650 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4mgtj\"" Jul 06 22:12:52.396935 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:52.396921 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 22:12:52.397506 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:52.397485 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 22:12:52.421884 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:52.421858 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt"] Jul 06 22:12:52.428046 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:52.428022 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kclhg\" (UniqueName: \"kubernetes.io/projected/ef5cfc10-bd55-4e12-b560-ca78ce3aec50-kube-api-access-kclhg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt\" (UID: \"ef5cfc10-bd55-4e12-b560-ca78ce3aec50\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt" Jul 06 22:12:52.428143 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:52.428062 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef5cfc10-bd55-4e12-b560-ca78ce3aec50-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt\" (UID: \"ef5cfc10-bd55-4e12-b560-ca78ce3aec50\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt" Jul 06 22:12:52.428143 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:52.428082 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef5cfc10-bd55-4e12-b560-ca78ce3aec50-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt\" (UID: \"ef5cfc10-bd55-4e12-b560-ca78ce3aec50\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt" Jul 06 22:12:52.528784 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:52.528759 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kclhg\" (UniqueName: \"kubernetes.io/projected/ef5cfc10-bd55-4e12-b560-ca78ce3aec50-kube-api-access-kclhg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt\" (UID: \"ef5cfc10-bd55-4e12-b560-ca78ce3aec50\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt" Jul 06 22:12:52.528927 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:52.528798 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef5cfc10-bd55-4e12-b560-ca78ce3aec50-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt\" (UID: \"ef5cfc10-bd55-4e12-b560-ca78ce3aec50\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt" Jul 06 22:12:52.528927 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:52.528821 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef5cfc10-bd55-4e12-b560-ca78ce3aec50-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt\" (UID: \"ef5cfc10-bd55-4e12-b560-ca78ce3aec50\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt" Jul 06 22:12:52.529138 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:52.529123 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef5cfc10-bd55-4e12-b560-ca78ce3aec50-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt\" (UID: \"ef5cfc10-bd55-4e12-b560-ca78ce3aec50\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt" Jul 06 22:12:52.529193 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:52.529174 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef5cfc10-bd55-4e12-b560-ca78ce3aec50-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt\" (UID: \"ef5cfc10-bd55-4e12-b560-ca78ce3aec50\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt" Jul 06 22:12:52.538263 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:52.538239 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kclhg\" (UniqueName: \"kubernetes.io/projected/ef5cfc10-bd55-4e12-b560-ca78ce3aec50-kube-api-access-kclhg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt\" (UID: \"ef5cfc10-bd55-4e12-b560-ca78ce3aec50\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt" Jul 06 22:12:52.702465 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:52.702442 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt" Jul 06 22:12:52.823904 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:52.823873 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt"] Jul 06 22:12:52.826722 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:12:52.826699 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef5cfc10_bd55_4e12_b560_ca78ce3aec50.slice/crio-878effd83c0acb04dc11fa3c961e5d1e1f3b8e3424c924cf8200539e5a8cc037 WatchSource:0}: Error finding container 878effd83c0acb04dc11fa3c961e5d1e1f3b8e3424c924cf8200539e5a8cc037: Status 404 returned error can't find the container with id 878effd83c0acb04dc11fa3c961e5d1e1f3b8e3424c924cf8200539e5a8cc037 Jul 06 22:12:53.637306 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:12:53.637271 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt" event={"ID":"ef5cfc10-bd55-4e12-b560-ca78ce3aec50","Type":"ContainerStarted","Data":"878effd83c0acb04dc11fa3c961e5d1e1f3b8e3424c924cf8200539e5a8cc037"} Jul 06 22:13:03.677221 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:03.677181 2566 generic.go:356] "Generic (PLEG): container finished" podID="ef5cfc10-bd55-4e12-b560-ca78ce3aec50" containerID="de11180edcfbd14c775d36f22d4e80d2a0a8e37ff2721cbca81267a42420888b" exitCode=0 Jul 06 22:13:03.677697 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:03.677259 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt" event={"ID":"ef5cfc10-bd55-4e12-b560-ca78ce3aec50","Type":"ContainerDied","Data":"de11180edcfbd14c775d36f22d4e80d2a0a8e37ff2721cbca81267a42420888b"} Jul 06 22:13:05.686610 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:05.686581 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt" event={"ID":"ef5cfc10-bd55-4e12-b560-ca78ce3aec50","Type":"ContainerStarted","Data":"4e59bdd92f4f319d0876132718d53e6c5e7b14089e31b59eb118c79c47c8f638"} Jul 06 22:13:06.691764 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:06.691732 2566 generic.go:356] "Generic (PLEG): container finished" podID="ef5cfc10-bd55-4e12-b560-ca78ce3aec50" containerID="4e59bdd92f4f319d0876132718d53e6c5e7b14089e31b59eb118c79c47c8f638" exitCode=0 Jul 06 22:13:06.692147 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:06.691817 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt" event={"ID":"ef5cfc10-bd55-4e12-b560-ca78ce3aec50","Type":"ContainerDied","Data":"4e59bdd92f4f319d0876132718d53e6c5e7b14089e31b59eb118c79c47c8f638"} Jul 06 22:13:15.725506 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:15.725471 2566 generic.go:356] "Generic (PLEG): container finished" podID="ef5cfc10-bd55-4e12-b560-ca78ce3aec50" containerID="1ee119c70b0c3a86cea247926ef5f1452f1c1d6ef7e46572d10a4ad8e189fda2" exitCode=0 Jul 06 22:13:15.725903 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:15.725555 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt" event={"ID":"ef5cfc10-bd55-4e12-b560-ca78ce3aec50","Type":"ContainerDied","Data":"1ee119c70b0c3a86cea247926ef5f1452f1c1d6ef7e46572d10a4ad8e189fda2"} Jul 06 22:13:16.849478 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:16.849450 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt" Jul 06 22:13:16.910892 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:16.910858 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef5cfc10-bd55-4e12-b560-ca78ce3aec50-util\") pod \"ef5cfc10-bd55-4e12-b560-ca78ce3aec50\" (UID: \"ef5cfc10-bd55-4e12-b560-ca78ce3aec50\") " Jul 06 22:13:16.911059 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:16.910907 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef5cfc10-bd55-4e12-b560-ca78ce3aec50-bundle\") pod \"ef5cfc10-bd55-4e12-b560-ca78ce3aec50\" (UID: \"ef5cfc10-bd55-4e12-b560-ca78ce3aec50\") " Jul 06 22:13:16.911059 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:16.910945 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kclhg\" (UniqueName: \"kubernetes.io/projected/ef5cfc10-bd55-4e12-b560-ca78ce3aec50-kube-api-access-kclhg\") pod \"ef5cfc10-bd55-4e12-b560-ca78ce3aec50\" (UID: \"ef5cfc10-bd55-4e12-b560-ca78ce3aec50\") " Jul 06 22:13:16.911545 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:16.911524 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef5cfc10-bd55-4e12-b560-ca78ce3aec50-bundle" (OuterVolumeSpecName: "bundle") pod "ef5cfc10-bd55-4e12-b560-ca78ce3aec50" (UID: "ef5cfc10-bd55-4e12-b560-ca78ce3aec50"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:13:16.913030 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:16.913004 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef5cfc10-bd55-4e12-b560-ca78ce3aec50-kube-api-access-kclhg" (OuterVolumeSpecName: "kube-api-access-kclhg") pod "ef5cfc10-bd55-4e12-b560-ca78ce3aec50" (UID: "ef5cfc10-bd55-4e12-b560-ca78ce3aec50"). InnerVolumeSpecName "kube-api-access-kclhg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:13:16.915145 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:16.915123 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef5cfc10-bd55-4e12-b560-ca78ce3aec50-util" (OuterVolumeSpecName: "util") pod "ef5cfc10-bd55-4e12-b560-ca78ce3aec50" (UID: "ef5cfc10-bd55-4e12-b560-ca78ce3aec50"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:13:17.011739 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:17.011636 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef5cfc10-bd55-4e12-b560-ca78ce3aec50-util\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:13:17.011739 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:17.011683 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef5cfc10-bd55-4e12-b560-ca78ce3aec50-bundle\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:13:17.011739 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:17.011695 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kclhg\" (UniqueName: \"kubernetes.io/projected/ef5cfc10-bd55-4e12-b560-ca78ce3aec50-kube-api-access-kclhg\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:13:17.733920 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:17.733883 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt" event={"ID":"ef5cfc10-bd55-4e12-b560-ca78ce3aec50","Type":"ContainerDied","Data":"878effd83c0acb04dc11fa3c961e5d1e1f3b8e3424c924cf8200539e5a8cc037"} Jul 06 22:13:17.733920 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:17.733907 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405pmnt" Jul 06 22:13:17.734118 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:17.733933 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="878effd83c0acb04dc11fa3c961e5d1e1f3b8e3424c924cf8200539e5a8cc037" Jul 06 22:13:25.506422 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:25.506332 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gvc5n"] Jul 06 22:13:25.506942 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:25.506709 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef5cfc10-bd55-4e12-b560-ca78ce3aec50" containerName="extract" Jul 06 22:13:25.506942 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:25.506730 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef5cfc10-bd55-4e12-b560-ca78ce3aec50" containerName="extract" Jul 06 22:13:25.506942 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:25.506742 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef5cfc10-bd55-4e12-b560-ca78ce3aec50" containerName="pull" Jul 06 22:13:25.506942 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:25.506750 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef5cfc10-bd55-4e12-b560-ca78ce3aec50" containerName="pull" Jul 06 22:13:25.506942 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:25.506769 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef5cfc10-bd55-4e12-b560-ca78ce3aec50" containerName="util" Jul 06 22:13:25.506942 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:25.506777 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef5cfc10-bd55-4e12-b560-ca78ce3aec50" containerName="util" Jul 06 22:13:25.506942 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:25.506857 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef5cfc10-bd55-4e12-b560-ca78ce3aec50" containerName="extract" Jul 06 22:13:25.508854 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:25.508817 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gvc5n" Jul 06 22:13:25.526538 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:25.526516 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-zdt4f\"" Jul 06 22:13:25.527368 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:25.527353 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:13:25.527460 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:25.527446 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 06 22:13:25.534608 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:25.534588 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gvc5n"] Jul 06 22:13:25.570682 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:25.570650 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mbtr\" (UniqueName: \"kubernetes.io/projected/53792ef9-1e45-466e-a668-95ec8fadf02d-kube-api-access-6mbtr\") pod \"cert-manager-operator-controller-manager-55c444bf86-gvc5n\" (UID: \"53792ef9-1e45-466e-a668-95ec8fadf02d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gvc5n" Jul 06 22:13:25.570800 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:25.570700 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53792ef9-1e45-466e-a668-95ec8fadf02d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-gvc5n\" (UID: \"53792ef9-1e45-466e-a668-95ec8fadf02d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gvc5n" Jul 06 22:13:25.671365 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:25.671336 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mbtr\" (UniqueName: \"kubernetes.io/projected/53792ef9-1e45-466e-a668-95ec8fadf02d-kube-api-access-6mbtr\") pod \"cert-manager-operator-controller-manager-55c444bf86-gvc5n\" (UID: \"53792ef9-1e45-466e-a668-95ec8fadf02d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gvc5n" Jul 06 22:13:25.671458 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:25.671380 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53792ef9-1e45-466e-a668-95ec8fadf02d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-gvc5n\" (UID: \"53792ef9-1e45-466e-a668-95ec8fadf02d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gvc5n" Jul 06 22:13:25.671769 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:25.671752 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53792ef9-1e45-466e-a668-95ec8fadf02d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-gvc5n\" (UID: \"53792ef9-1e45-466e-a668-95ec8fadf02d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gvc5n" Jul 06 22:13:25.689785 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:25.689756 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mbtr\" (UniqueName: \"kubernetes.io/projected/53792ef9-1e45-466e-a668-95ec8fadf02d-kube-api-access-6mbtr\") pod \"cert-manager-operator-controller-manager-55c444bf86-gvc5n\" (UID: \"53792ef9-1e45-466e-a668-95ec8fadf02d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gvc5n" Jul 06 22:13:25.816945 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:25.816874 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gvc5n" Jul 06 22:13:25.955988 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:25.955965 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gvc5n"] Jul 06 22:13:25.958237 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:13:25.958197 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53792ef9_1e45_466e_a668_95ec8fadf02d.slice/crio-a5dd19b0faf81835eea1378abc3e08ac485339b3e1f862b32a32018cf6ee8cd9 WatchSource:0}: Error finding container a5dd19b0faf81835eea1378abc3e08ac485339b3e1f862b32a32018cf6ee8cd9: Status 404 returned error can't find the container with id a5dd19b0faf81835eea1378abc3e08ac485339b3e1f862b32a32018cf6ee8cd9 Jul 06 22:13:26.766553 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:26.766506 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gvc5n" event={"ID":"53792ef9-1e45-466e-a668-95ec8fadf02d","Type":"ContainerStarted","Data":"a5dd19b0faf81835eea1378abc3e08ac485339b3e1f862b32a32018cf6ee8cd9"} Jul 06 22:13:27.775669 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:27.775635 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gvc5n" event={"ID":"53792ef9-1e45-466e-a668-95ec8fadf02d","Type":"ContainerStarted","Data":"395de90e8f5fd4a955bfbd33fc5fa84e502e6285bf3f6e0f2d94c14dffbb0cc9"} Jul 06 22:13:27.800837 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:27.800741 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gvc5n" podStartSLOduration=1.22972036 podStartE2EDuration="2.800727034s" totalImagesPullingTime="1.571006674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:13:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:13:27.800723996 +0000 UTC m=+267.655689466" watchObservedRunningTime="2026-07-06 22:13:27.800727034 +0000 UTC m=+267.655692500" Jul 06 22:13:29.261387 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:29.261353 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x"] Jul 06 22:13:29.263704 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:29.263687 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x" Jul 06 22:13:29.266915 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:29.266891 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 22:13:29.267017 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:29.266933 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 22:13:29.267753 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:29.267739 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4mgtj\"" Jul 06 22:13:29.277271 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:29.277251 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x"] Jul 06 22:13:29.398208 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:29.398171 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv579\" (UniqueName: \"kubernetes.io/projected/391d3412-ab94-4d41-bb87-0ffd842e365a-kube-api-access-nv579\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x\" (UID: \"391d3412-ab94-4d41-bb87-0ffd842e365a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x" Jul 06 22:13:29.398389 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:29.398236 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/391d3412-ab94-4d41-bb87-0ffd842e365a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x\" (UID: \"391d3412-ab94-4d41-bb87-0ffd842e365a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x" Jul 06 22:13:29.398389 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:29.398265 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/391d3412-ab94-4d41-bb87-0ffd842e365a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x\" (UID: \"391d3412-ab94-4d41-bb87-0ffd842e365a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x" Jul 06 22:13:29.499197 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:29.499156 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv579\" (UniqueName: \"kubernetes.io/projected/391d3412-ab94-4d41-bb87-0ffd842e365a-kube-api-access-nv579\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x\" (UID: \"391d3412-ab94-4d41-bb87-0ffd842e365a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x" Jul 06 22:13:29.499367 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:29.499224 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/391d3412-ab94-4d41-bb87-0ffd842e365a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x\" (UID: \"391d3412-ab94-4d41-bb87-0ffd842e365a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x" Jul 06 22:13:29.499367 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:29.499250 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/391d3412-ab94-4d41-bb87-0ffd842e365a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x\" (UID: \"391d3412-ab94-4d41-bb87-0ffd842e365a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x" Jul 06 22:13:29.499639 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:29.499617 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/391d3412-ab94-4d41-bb87-0ffd842e365a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x\" (UID: \"391d3412-ab94-4d41-bb87-0ffd842e365a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x" Jul 06 22:13:29.499689 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:29.499673 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/391d3412-ab94-4d41-bb87-0ffd842e365a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x\" (UID: \"391d3412-ab94-4d41-bb87-0ffd842e365a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x" Jul 06 22:13:29.508447 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:29.508418 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv579\" (UniqueName: \"kubernetes.io/projected/391d3412-ab94-4d41-bb87-0ffd842e365a-kube-api-access-nv579\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x\" (UID: \"391d3412-ab94-4d41-bb87-0ffd842e365a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x" Jul 06 22:13:29.572622 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:29.572540 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x" Jul 06 22:13:29.698811 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:29.698744 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x"] Jul 06 22:13:29.701328 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:13:29.701302 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod391d3412_ab94_4d41_bb87_0ffd842e365a.slice/crio-8d9a0575f04b4c217a5bc6ed56b1bd21e5ca155e4e80bbc8f7b2d58a4f9b171c WatchSource:0}: Error finding container 8d9a0575f04b4c217a5bc6ed56b1bd21e5ca155e4e80bbc8f7b2d58a4f9b171c: Status 404 returned error can't find the container with id 8d9a0575f04b4c217a5bc6ed56b1bd21e5ca155e4e80bbc8f7b2d58a4f9b171c Jul 06 22:13:29.784912 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:29.784875 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x" event={"ID":"391d3412-ab94-4d41-bb87-0ffd842e365a","Type":"ContainerStarted","Data":"3372a6079a625e60c8bba44ca29388145094e67bee6de4e02d1861a8aa7426cb"} Jul 06 22:13:29.785089 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:29.784923 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x" event={"ID":"391d3412-ab94-4d41-bb87-0ffd842e365a","Type":"ContainerStarted","Data":"8d9a0575f04b4c217a5bc6ed56b1bd21e5ca155e4e80bbc8f7b2d58a4f9b171c"} Jul 06 22:13:30.789752 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:30.789666 2566 generic.go:356] "Generic (PLEG): container finished" podID="391d3412-ab94-4d41-bb87-0ffd842e365a" containerID="3372a6079a625e60c8bba44ca29388145094e67bee6de4e02d1861a8aa7426cb" exitCode=0 Jul 06 22:13:30.789752 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:30.789724 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x" event={"ID":"391d3412-ab94-4d41-bb87-0ffd842e365a","Type":"ContainerDied","Data":"3372a6079a625e60c8bba44ca29388145094e67bee6de4e02d1861a8aa7426cb"} Jul 06 22:13:39.216440 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:39.216401 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tv92p"] Jul 06 22:13:39.220255 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:39.220232 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-tv92p" Jul 06 22:13:39.222892 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:39.222869 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-rbt5w\"" Jul 06 22:13:39.223006 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:39.222986 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 06 22:13:39.223861 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:39.223825 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 06 22:13:39.233648 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:39.233621 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tv92p"] Jul 06 22:13:39.369656 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:39.369615 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnmks\" (UniqueName: \"kubernetes.io/projected/d3821911-8a55-471d-98b5-bee38fb63b6f-kube-api-access-wnmks\") pod \"cert-manager-55b4d954d5-tv92p\" (UID: \"d3821911-8a55-471d-98b5-bee38fb63b6f\") " pod="cert-manager/cert-manager-55b4d954d5-tv92p" Jul 06 22:13:39.369831 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:39.369683 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d3821911-8a55-471d-98b5-bee38fb63b6f-bound-sa-token\") pod \"cert-manager-55b4d954d5-tv92p\" (UID: \"d3821911-8a55-471d-98b5-bee38fb63b6f\") " pod="cert-manager/cert-manager-55b4d954d5-tv92p" Jul 06 22:13:39.470467 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:39.470379 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d3821911-8a55-471d-98b5-bee38fb63b6f-bound-sa-token\") pod \"cert-manager-55b4d954d5-tv92p\" (UID: \"d3821911-8a55-471d-98b5-bee38fb63b6f\") " pod="cert-manager/cert-manager-55b4d954d5-tv92p" Jul 06 22:13:39.470467 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:39.470433 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnmks\" (UniqueName: \"kubernetes.io/projected/d3821911-8a55-471d-98b5-bee38fb63b6f-kube-api-access-wnmks\") pod \"cert-manager-55b4d954d5-tv92p\" (UID: \"d3821911-8a55-471d-98b5-bee38fb63b6f\") " pod="cert-manager/cert-manager-55b4d954d5-tv92p" Jul 06 22:13:39.479089 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:39.479069 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d3821911-8a55-471d-98b5-bee38fb63b6f-bound-sa-token\") pod \"cert-manager-55b4d954d5-tv92p\" (UID: \"d3821911-8a55-471d-98b5-bee38fb63b6f\") " pod="cert-manager/cert-manager-55b4d954d5-tv92p" Jul 06 22:13:39.479682 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:39.479668 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnmks\" (UniqueName: \"kubernetes.io/projected/d3821911-8a55-471d-98b5-bee38fb63b6f-kube-api-access-wnmks\") pod \"cert-manager-55b4d954d5-tv92p\" (UID: \"d3821911-8a55-471d-98b5-bee38fb63b6f\") " pod="cert-manager/cert-manager-55b4d954d5-tv92p" Jul 06 22:13:39.528888 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:39.528855 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-tv92p" Jul 06 22:13:39.652294 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:39.652269 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tv92p"] Jul 06 22:13:39.654872 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:13:39.654829 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3821911_8a55_471d_98b5_bee38fb63b6f.slice/crio-b78f67ab2334a44af108896fcd798b6180ede4ecc90240b84e31b6ce39efdd82 WatchSource:0}: Error finding container b78f67ab2334a44af108896fcd798b6180ede4ecc90240b84e31b6ce39efdd82: Status 404 returned error can't find the container with id b78f67ab2334a44af108896fcd798b6180ede4ecc90240b84e31b6ce39efdd82 Jul 06 22:13:39.821026 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:39.820938 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-tv92p" event={"ID":"d3821911-8a55-471d-98b5-bee38fb63b6f","Type":"ContainerStarted","Data":"b78f67ab2334a44af108896fcd798b6180ede4ecc90240b84e31b6ce39efdd82"} Jul 06 22:13:42.834320 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:42.834281 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-tv92p" event={"ID":"d3821911-8a55-471d-98b5-bee38fb63b6f","Type":"ContainerStarted","Data":"21fb3da965334f8ae5fa6b3dedafefd212bdacbe1e22ce37e8a2e001ce01d1a2"} Jul 06 22:13:42.849306 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:42.849258 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-tv92p" podStartSLOduration=1.462966461 podStartE2EDuration="3.849245475s" totalImagesPullingTime="2.386279014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:13:42.848512424 +0000 UTC m=+282.703477893" watchObservedRunningTime="2026-07-06 22:13:42.849245475 +0000 UTC m=+282.704210942" Jul 06 22:13:45.847999 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:45.847957 2566 generic.go:356] "Generic (PLEG): container finished" podID="391d3412-ab94-4d41-bb87-0ffd842e365a" containerID="708a9f837dda9849433634e356a960f5391dac84f10e75dbe1ffd950a1fd189e" exitCode=0 Jul 06 22:13:45.848352 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:45.848022 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x" event={"ID":"391d3412-ab94-4d41-bb87-0ffd842e365a","Type":"ContainerDied","Data":"708a9f837dda9849433634e356a960f5391dac84f10e75dbe1ffd950a1fd189e"} Jul 06 22:13:46.854017 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:46.853981 2566 generic.go:356] "Generic (PLEG): container finished" podID="391d3412-ab94-4d41-bb87-0ffd842e365a" containerID="f3050eb31b5ca0342d52617149f500c102ee96fbedef33b9e5e0c8f4758510e4" exitCode=0 Jul 06 22:13:46.854464 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:46.854041 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x" event={"ID":"391d3412-ab94-4d41-bb87-0ffd842e365a","Type":"ContainerDied","Data":"f3050eb31b5ca0342d52617149f500c102ee96fbedef33b9e5e0c8f4758510e4"} Jul 06 22:13:47.990002 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:47.989979 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x" Jul 06 22:13:48.136121 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:48.136045 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/391d3412-ab94-4d41-bb87-0ffd842e365a-util\") pod \"391d3412-ab94-4d41-bb87-0ffd842e365a\" (UID: \"391d3412-ab94-4d41-bb87-0ffd842e365a\") " Jul 06 22:13:48.136121 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:48.136091 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nv579\" (UniqueName: \"kubernetes.io/projected/391d3412-ab94-4d41-bb87-0ffd842e365a-kube-api-access-nv579\") pod \"391d3412-ab94-4d41-bb87-0ffd842e365a\" (UID: \"391d3412-ab94-4d41-bb87-0ffd842e365a\") " Jul 06 22:13:48.136300 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:48.136141 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/391d3412-ab94-4d41-bb87-0ffd842e365a-bundle\") pod \"391d3412-ab94-4d41-bb87-0ffd842e365a\" (UID: \"391d3412-ab94-4d41-bb87-0ffd842e365a\") " Jul 06 22:13:48.136539 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:48.136516 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/391d3412-ab94-4d41-bb87-0ffd842e365a-bundle" (OuterVolumeSpecName: "bundle") pod "391d3412-ab94-4d41-bb87-0ffd842e365a" (UID: "391d3412-ab94-4d41-bb87-0ffd842e365a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:13:48.138813 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:48.138790 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/391d3412-ab94-4d41-bb87-0ffd842e365a-kube-api-access-nv579" (OuterVolumeSpecName: "kube-api-access-nv579") pod "391d3412-ab94-4d41-bb87-0ffd842e365a" (UID: "391d3412-ab94-4d41-bb87-0ffd842e365a"). InnerVolumeSpecName "kube-api-access-nv579". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:13:48.140311 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:48.140291 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/391d3412-ab94-4d41-bb87-0ffd842e365a-util" (OuterVolumeSpecName: "util") pod "391d3412-ab94-4d41-bb87-0ffd842e365a" (UID: "391d3412-ab94-4d41-bb87-0ffd842e365a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:13:48.237252 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:48.237225 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/391d3412-ab94-4d41-bb87-0ffd842e365a-bundle\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:13:48.237252 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:48.237248 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/391d3412-ab94-4d41-bb87-0ffd842e365a-util\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:13:48.237387 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:48.237257 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nv579\" (UniqueName: \"kubernetes.io/projected/391d3412-ab94-4d41-bb87-0ffd842e365a-kube-api-access-nv579\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:13:48.863259 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:48.863224 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x" event={"ID":"391d3412-ab94-4d41-bb87-0ffd842e365a","Type":"ContainerDied","Data":"8d9a0575f04b4c217a5bc6ed56b1bd21e5ca155e4e80bbc8f7b2d58a4f9b171c"} Jul 06 22:13:48.863259 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:48.863245 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxxf6x" Jul 06 22:13:48.863446 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:48.863271 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d9a0575f04b4c217a5bc6ed56b1bd21e5ca155e4e80bbc8f7b2d58a4f9b171c" Jul 06 22:13:52.675838 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:52.675805 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkn8b"] Jul 06 22:13:52.676209 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:52.676053 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="391d3412-ab94-4d41-bb87-0ffd842e365a" containerName="util" Jul 06 22:13:52.676209 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:52.676064 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="391d3412-ab94-4d41-bb87-0ffd842e365a" containerName="util" Jul 06 22:13:52.676209 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:52.676072 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="391d3412-ab94-4d41-bb87-0ffd842e365a" containerName="pull" Jul 06 22:13:52.676209 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:52.676077 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="391d3412-ab94-4d41-bb87-0ffd842e365a" containerName="pull" Jul 06 22:13:52.676209 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:52.676090 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="391d3412-ab94-4d41-bb87-0ffd842e365a" containerName="extract" Jul 06 22:13:52.676209 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:52.676096 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="391d3412-ab94-4d41-bb87-0ffd842e365a" containerName="extract" Jul 06 22:13:52.676209 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:52.676142 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="391d3412-ab94-4d41-bb87-0ffd842e365a" containerName="extract" Jul 06 22:13:52.677793 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:52.677777 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkn8b" Jul 06 22:13:52.683203 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:52.683177 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 22:13:52.684090 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:52.684067 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:13:52.684190 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:52.684095 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-2wgvg\"" Jul 06 22:13:52.703493 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:52.703463 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkn8b"] Jul 06 22:13:52.769992 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:52.769970 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76f7c4ef-ea11-4c66-89c4-30602cfe5ea6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pkn8b\" (UID: \"76f7c4ef-ea11-4c66-89c4-30602cfe5ea6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkn8b" Jul 06 22:13:52.770104 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:52.770024 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7cqs\" (UniqueName: \"kubernetes.io/projected/76f7c4ef-ea11-4c66-89c4-30602cfe5ea6-kube-api-access-b7cqs\") pod \"openshift-lws-operator-fd8ccff4c-pkn8b\" (UID: \"76f7c4ef-ea11-4c66-89c4-30602cfe5ea6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkn8b" Jul 06 22:13:52.870641 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:52.870614 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7cqs\" (UniqueName: \"kubernetes.io/projected/76f7c4ef-ea11-4c66-89c4-30602cfe5ea6-kube-api-access-b7cqs\") pod \"openshift-lws-operator-fd8ccff4c-pkn8b\" (UID: \"76f7c4ef-ea11-4c66-89c4-30602cfe5ea6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkn8b" Jul 06 22:13:52.870753 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:52.870664 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76f7c4ef-ea11-4c66-89c4-30602cfe5ea6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pkn8b\" (UID: \"76f7c4ef-ea11-4c66-89c4-30602cfe5ea6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkn8b" Jul 06 22:13:52.871091 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:52.871070 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76f7c4ef-ea11-4c66-89c4-30602cfe5ea6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pkn8b\" (UID: \"76f7c4ef-ea11-4c66-89c4-30602cfe5ea6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkn8b" Jul 06 22:13:52.881187 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:52.881167 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7cqs\" (UniqueName: \"kubernetes.io/projected/76f7c4ef-ea11-4c66-89c4-30602cfe5ea6-kube-api-access-b7cqs\") pod \"openshift-lws-operator-fd8ccff4c-pkn8b\" (UID: \"76f7c4ef-ea11-4c66-89c4-30602cfe5ea6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkn8b" Jul 06 22:13:52.987043 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:52.986983 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkn8b" Jul 06 22:13:53.140508 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:53.140468 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkn8b"] Jul 06 22:13:53.144375 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:13:53.144351 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76f7c4ef_ea11_4c66_89c4_30602cfe5ea6.slice/crio-615f686ce222de064cd544c49701460c37901917fe423c13814988ad5bdb98a1 WatchSource:0}: Error finding container 615f686ce222de064cd544c49701460c37901917fe423c13814988ad5bdb98a1: Status 404 returned error can't find the container with id 615f686ce222de064cd544c49701460c37901917fe423c13814988ad5bdb98a1 Jul 06 22:13:53.882364 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:13:53.882329 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkn8b" event={"ID":"76f7c4ef-ea11-4c66-89c4-30602cfe5ea6","Type":"ContainerStarted","Data":"615f686ce222de064cd544c49701460c37901917fe423c13814988ad5bdb98a1"} Jul 06 22:14:00.589861 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:00.589814 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd89j_b55a9306-a1b1-4824-bacd-cd43906b7951/ovn-acl-logging/0.log" Jul 06 22:14:00.592719 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:00.592690 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd89j_b55a9306-a1b1-4824-bacd-cd43906b7951/ovn-acl-logging/0.log" Jul 06 22:14:00.594714 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:00.594690 2566 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 22:14:04.927996 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:04.927958 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkn8b" event={"ID":"76f7c4ef-ea11-4c66-89c4-30602cfe5ea6","Type":"ContainerStarted","Data":"90681bbdd39f5117f9f54039ba62df7227563fa34bf51016cf817d7b69980397"} Jul 06 22:14:04.944716 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:04.944661 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkn8b" podStartSLOduration=1.532757092 podStartE2EDuration="12.944644426s" totalImagesPullingTime="11.411887334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:13:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:14:04.943695096 +0000 UTC m=+304.798660563" watchObservedRunningTime="2026-07-06 22:14:04.944644426 +0000 UTC m=+304.799609891" Jul 06 22:14:06.640380 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:06.640345 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl"] Jul 06 22:14:06.642537 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:06.642503 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl" Jul 06 22:14:06.645548 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:06.645529 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 22:14:06.645664 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:06.645630 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4mgtj\"" Jul 06 22:14:06.645752 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:06.645736 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 22:14:06.660057 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:06.660037 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl"] Jul 06 22:14:06.769540 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:06.769509 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4821801-f940-468f-ba5f-78edadb95820-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl\" (UID: \"b4821801-f940-468f-ba5f-78edadb95820\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl" Jul 06 22:14:06.769540 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:06.769545 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4821801-f940-468f-ba5f-78edadb95820-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl\" (UID: \"b4821801-f940-468f-ba5f-78edadb95820\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl" Jul 06 22:14:06.769732 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:06.769575 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbdv5\" (UniqueName: \"kubernetes.io/projected/b4821801-f940-468f-ba5f-78edadb95820-kube-api-access-vbdv5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl\" (UID: \"b4821801-f940-468f-ba5f-78edadb95820\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl" Jul 06 22:14:06.870278 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:06.870239 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4821801-f940-468f-ba5f-78edadb95820-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl\" (UID: \"b4821801-f940-468f-ba5f-78edadb95820\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl" Jul 06 22:14:06.870627 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:06.870589 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4821801-f940-468f-ba5f-78edadb95820-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl\" (UID: \"b4821801-f940-468f-ba5f-78edadb95820\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl" Jul 06 22:14:06.870750 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:06.870675 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbdv5\" (UniqueName: \"kubernetes.io/projected/b4821801-f940-468f-ba5f-78edadb95820-kube-api-access-vbdv5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl\" (UID: \"b4821801-f940-468f-ba5f-78edadb95820\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl" Jul 06 22:14:06.870816 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:06.870599 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4821801-f940-468f-ba5f-78edadb95820-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl\" (UID: \"b4821801-f940-468f-ba5f-78edadb95820\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl" Jul 06 22:14:06.870898 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:06.870834 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4821801-f940-468f-ba5f-78edadb95820-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl\" (UID: \"b4821801-f940-468f-ba5f-78edadb95820\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl" Jul 06 22:14:06.881545 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:06.881524 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbdv5\" (UniqueName: \"kubernetes.io/projected/b4821801-f940-468f-ba5f-78edadb95820-kube-api-access-vbdv5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl\" (UID: \"b4821801-f940-468f-ba5f-78edadb95820\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl" Jul 06 22:14:06.951525 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:06.951494 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl" Jul 06 22:14:07.076900 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:07.076832 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl"] Jul 06 22:14:07.079359 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:14:07.079329 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4821801_f940_468f_ba5f_78edadb95820.slice/crio-a2b6c879ad1ee77b73d0ef365b49adaebbfdd661042ab439f9c7d37be281752b WatchSource:0}: Error finding container a2b6c879ad1ee77b73d0ef365b49adaebbfdd661042ab439f9c7d37be281752b: Status 404 returned error can't find the container with id a2b6c879ad1ee77b73d0ef365b49adaebbfdd661042ab439f9c7d37be281752b Jul 06 22:14:07.941231 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:07.941198 2566 generic.go:356] "Generic (PLEG): container finished" podID="b4821801-f940-468f-ba5f-78edadb95820" containerID="3bcf0bf588fc8ff27d14a98bb3ff8ab0938b72a1c1eb887ead6840fa2bd10358" exitCode=0 Jul 06 22:14:07.941608 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:07.941245 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl" event={"ID":"b4821801-f940-468f-ba5f-78edadb95820","Type":"ContainerDied","Data":"3bcf0bf588fc8ff27d14a98bb3ff8ab0938b72a1c1eb887ead6840fa2bd10358"} Jul 06 22:14:07.941608 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:07.941279 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl" event={"ID":"b4821801-f940-468f-ba5f-78edadb95820","Type":"ContainerStarted","Data":"a2b6c879ad1ee77b73d0ef365b49adaebbfdd661042ab439f9c7d37be281752b"} Jul 06 22:14:07.941694 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:07.941675 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 22:14:08.947182 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:08.947150 2566 generic.go:356] "Generic (PLEG): container finished" podID="b4821801-f940-468f-ba5f-78edadb95820" containerID="92498b9989410c6b19cba826744083e61040cf5c05de6a069aa382fa42a03601" exitCode=0 Jul 06 22:14:08.947531 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:08.947220 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl" event={"ID":"b4821801-f940-468f-ba5f-78edadb95820","Type":"ContainerDied","Data":"92498b9989410c6b19cba826744083e61040cf5c05de6a069aa382fa42a03601"} Jul 06 22:14:09.953911 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:09.953871 2566 generic.go:356] "Generic (PLEG): container finished" podID="b4821801-f940-468f-ba5f-78edadb95820" containerID="e8fc29e0f8ebb39830b7c08146be323715e657c81bf8c9119128b52567799472" exitCode=0 Jul 06 22:14:09.954274 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:09.953922 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl" event={"ID":"b4821801-f940-468f-ba5f-78edadb95820","Type":"ContainerDied","Data":"e8fc29e0f8ebb39830b7c08146be323715e657c81bf8c9119128b52567799472"} Jul 06 22:14:11.077424 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:11.077397 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl" Jul 06 22:14:11.099678 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:11.099654 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbdv5\" (UniqueName: \"kubernetes.io/projected/b4821801-f940-468f-ba5f-78edadb95820-kube-api-access-vbdv5\") pod \"b4821801-f940-468f-ba5f-78edadb95820\" (UID: \"b4821801-f940-468f-ba5f-78edadb95820\") " Jul 06 22:14:11.099867 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:11.099714 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4821801-f940-468f-ba5f-78edadb95820-util\") pod \"b4821801-f940-468f-ba5f-78edadb95820\" (UID: \"b4821801-f940-468f-ba5f-78edadb95820\") " Jul 06 22:14:11.101837 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:11.101797 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4821801-f940-468f-ba5f-78edadb95820-kube-api-access-vbdv5" (OuterVolumeSpecName: "kube-api-access-vbdv5") pod "b4821801-f940-468f-ba5f-78edadb95820" (UID: "b4821801-f940-468f-ba5f-78edadb95820"). InnerVolumeSpecName "kube-api-access-vbdv5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:14:11.107472 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:11.107442 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4821801-f940-468f-ba5f-78edadb95820-util" (OuterVolumeSpecName: "util") pod "b4821801-f940-468f-ba5f-78edadb95820" (UID: "b4821801-f940-468f-ba5f-78edadb95820"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:14:11.200157 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:11.200114 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4821801-f940-468f-ba5f-78edadb95820-bundle\") pod \"b4821801-f940-468f-ba5f-78edadb95820\" (UID: \"b4821801-f940-468f-ba5f-78edadb95820\") " Jul 06 22:14:11.200351 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:11.200332 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbdv5\" (UniqueName: \"kubernetes.io/projected/b4821801-f940-468f-ba5f-78edadb95820-kube-api-access-vbdv5\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:14:11.200395 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:11.200359 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4821801-f940-468f-ba5f-78edadb95820-util\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:14:11.200741 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:11.200722 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4821801-f940-468f-ba5f-78edadb95820-bundle" (OuterVolumeSpecName: "bundle") pod "b4821801-f940-468f-ba5f-78edadb95820" (UID: "b4821801-f940-468f-ba5f-78edadb95820"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:14:11.301612 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:11.301525 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4821801-f940-468f-ba5f-78edadb95820-bundle\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:14:11.963698 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:11.963658 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl" event={"ID":"b4821801-f940-468f-ba5f-78edadb95820","Type":"ContainerDied","Data":"a2b6c879ad1ee77b73d0ef365b49adaebbfdd661042ab439f9c7d37be281752b"} Jul 06 22:14:11.963889 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:11.963717 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a2b6c879ad1ee77b73d0ef365b49adaebbfdd661042ab439f9c7d37be281752b" Jul 06 22:14:11.963889 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:11.963674 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzswsl" Jul 06 22:14:18.045239 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.045205 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bcf4db656-zngbw"] Jul 06 22:14:18.045686 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.045472 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4821801-f940-468f-ba5f-78edadb95820" containerName="pull" Jul 06 22:14:18.045686 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.045482 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4821801-f940-468f-ba5f-78edadb95820" containerName="pull" Jul 06 22:14:18.045686 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.045495 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4821801-f940-468f-ba5f-78edadb95820" containerName="util" Jul 06 22:14:18.045686 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.045501 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4821801-f940-468f-ba5f-78edadb95820" containerName="util" Jul 06 22:14:18.045686 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.045507 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4821801-f940-468f-ba5f-78edadb95820" containerName="extract" Jul 06 22:14:18.045686 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.045512 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4821801-f940-468f-ba5f-78edadb95820" containerName="extract" Jul 06 22:14:18.045686 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.045559 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4821801-f940-468f-ba5f-78edadb95820" containerName="extract" Jul 06 22:14:18.052026 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.052010 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7bcf4db656-zngbw" Jul 06 22:14:18.054790 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.054762 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 22:14:18.054920 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.054870 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 22:14:18.055722 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.055696 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bdtzw\"" Jul 06 22:14:18.055826 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.055813 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 22:14:18.060981 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.060959 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bcf4db656-zngbw"] Jul 06 22:14:18.150436 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.150402 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/357dc97c-9d04-43df-af5d-10af9ff466b9-cert\") pod \"lws-controller-manager-7bcf4db656-zngbw\" (UID: \"357dc97c-9d04-43df-af5d-10af9ff466b9\") " pod="openshift-lws-operator/lws-controller-manager-7bcf4db656-zngbw" Jul 06 22:14:18.150615 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.150462 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sccnl\" (UniqueName: \"kubernetes.io/projected/357dc97c-9d04-43df-af5d-10af9ff466b9-kube-api-access-sccnl\") pod \"lws-controller-manager-7bcf4db656-zngbw\" (UID: \"357dc97c-9d04-43df-af5d-10af9ff466b9\") " pod="openshift-lws-operator/lws-controller-manager-7bcf4db656-zngbw" Jul 06 22:14:18.150615 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.150510 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/357dc97c-9d04-43df-af5d-10af9ff466b9-manager-config\") pod \"lws-controller-manager-7bcf4db656-zngbw\" (UID: \"357dc97c-9d04-43df-af5d-10af9ff466b9\") " pod="openshift-lws-operator/lws-controller-manager-7bcf4db656-zngbw" Jul 06 22:14:18.150615 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.150546 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/357dc97c-9d04-43df-af5d-10af9ff466b9-metrics-cert\") pod \"lws-controller-manager-7bcf4db656-zngbw\" (UID: \"357dc97c-9d04-43df-af5d-10af9ff466b9\") " pod="openshift-lws-operator/lws-controller-manager-7bcf4db656-zngbw" Jul 06 22:14:18.251357 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.251319 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/357dc97c-9d04-43df-af5d-10af9ff466b9-metrics-cert\") pod \"lws-controller-manager-7bcf4db656-zngbw\" (UID: \"357dc97c-9d04-43df-af5d-10af9ff466b9\") " pod="openshift-lws-operator/lws-controller-manager-7bcf4db656-zngbw" Jul 06 22:14:18.251578 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.251375 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/357dc97c-9d04-43df-af5d-10af9ff466b9-cert\") pod \"lws-controller-manager-7bcf4db656-zngbw\" (UID: \"357dc97c-9d04-43df-af5d-10af9ff466b9\") " pod="openshift-lws-operator/lws-controller-manager-7bcf4db656-zngbw" Jul 06 22:14:18.251578 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.251425 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sccnl\" (UniqueName: \"kubernetes.io/projected/357dc97c-9d04-43df-af5d-10af9ff466b9-kube-api-access-sccnl\") pod \"lws-controller-manager-7bcf4db656-zngbw\" (UID: \"357dc97c-9d04-43df-af5d-10af9ff466b9\") " pod="openshift-lws-operator/lws-controller-manager-7bcf4db656-zngbw" Jul 06 22:14:18.251578 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.251453 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/357dc97c-9d04-43df-af5d-10af9ff466b9-manager-config\") pod \"lws-controller-manager-7bcf4db656-zngbw\" (UID: \"357dc97c-9d04-43df-af5d-10af9ff466b9\") " pod="openshift-lws-operator/lws-controller-manager-7bcf4db656-zngbw" Jul 06 22:14:18.252110 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.252089 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/357dc97c-9d04-43df-af5d-10af9ff466b9-manager-config\") pod \"lws-controller-manager-7bcf4db656-zngbw\" (UID: \"357dc97c-9d04-43df-af5d-10af9ff466b9\") " pod="openshift-lws-operator/lws-controller-manager-7bcf4db656-zngbw" Jul 06 22:14:18.253799 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.253772 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/357dc97c-9d04-43df-af5d-10af9ff466b9-cert\") pod \"lws-controller-manager-7bcf4db656-zngbw\" (UID: \"357dc97c-9d04-43df-af5d-10af9ff466b9\") " pod="openshift-lws-operator/lws-controller-manager-7bcf4db656-zngbw" Jul 06 22:14:18.253898 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.253881 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/357dc97c-9d04-43df-af5d-10af9ff466b9-metrics-cert\") pod \"lws-controller-manager-7bcf4db656-zngbw\" (UID: \"357dc97c-9d04-43df-af5d-10af9ff466b9\") " pod="openshift-lws-operator/lws-controller-manager-7bcf4db656-zngbw" Jul 06 22:14:18.263031 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.263007 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sccnl\" (UniqueName: \"kubernetes.io/projected/357dc97c-9d04-43df-af5d-10af9ff466b9-kube-api-access-sccnl\") pod \"lws-controller-manager-7bcf4db656-zngbw\" (UID: \"357dc97c-9d04-43df-af5d-10af9ff466b9\") " pod="openshift-lws-operator/lws-controller-manager-7bcf4db656-zngbw" Jul 06 22:14:18.361465 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.361387 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7bcf4db656-zngbw" Jul 06 22:14:18.497680 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.497656 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bcf4db656-zngbw"] Jul 06 22:14:18.500327 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:14:18.500299 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod357dc97c_9d04_43df_af5d_10af9ff466b9.slice/crio-732dc832a348be42630ecfa64753d5dfeece33f32f34af11c4e0f4eb0256ab5b WatchSource:0}: Error finding container 732dc832a348be42630ecfa64753d5dfeece33f32f34af11c4e0f4eb0256ab5b: Status 404 returned error can't find the container with id 732dc832a348be42630ecfa64753d5dfeece33f32f34af11c4e0f4eb0256ab5b Jul 06 22:14:18.991958 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:18.991923 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bcf4db656-zngbw" event={"ID":"357dc97c-9d04-43df-af5d-10af9ff466b9","Type":"ContainerStarted","Data":"732dc832a348be42630ecfa64753d5dfeece33f32f34af11c4e0f4eb0256ab5b"} Jul 06 22:14:21.001728 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:21.001687 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bcf4db656-zngbw" event={"ID":"357dc97c-9d04-43df-af5d-10af9ff466b9","Type":"ContainerStarted","Data":"2b6f8afc139adee7a826d4100705a0ec03506219edab8cd11b8df0a6e3c39727"} Jul 06 22:14:21.002179 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:21.001795 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7bcf4db656-zngbw" Jul 06 22:14:21.022745 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:21.022695 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7bcf4db656-zngbw" podStartSLOduration=1.126634986 podStartE2EDuration="3.022680726s" totalImagesPullingTime="1.89604574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:14:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:14:21.021149426 +0000 UTC m=+320.876114894" watchObservedRunningTime="2026-07-06 22:14:21.022680726 +0000 UTC m=+320.877646193" Jul 06 22:14:23.466528 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:23.466462 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c695b4674-5mst6"] Jul 06 22:14:23.469931 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:23.469903 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c695b4674-5mst6" Jul 06 22:14:23.472856 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:23.472821 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 22:14:23.473024 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:23.473003 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 22:14:23.474009 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:23.473994 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-54jfp\"" Jul 06 22:14:23.474009 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:23.474004 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 22:14:23.474226 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:23.474212 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 22:14:23.491638 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:23.491618 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/674f9f81-83c5-409b-b74e-d0b9292a6aff-tmp\") pod \"opendatahub-operator-controller-manager-5c695b4674-5mst6\" (UID: \"674f9f81-83c5-409b-b74e-d0b9292a6aff\") " pod="opendatahub/opendatahub-operator-controller-manager-5c695b4674-5mst6" Jul 06 22:14:23.491758 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:23.491648 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/674f9f81-83c5-409b-b74e-d0b9292a6aff-manifests\") pod \"opendatahub-operator-controller-manager-5c695b4674-5mst6\" (UID: \"674f9f81-83c5-409b-b74e-d0b9292a6aff\") " pod="opendatahub/opendatahub-operator-controller-manager-5c695b4674-5mst6" Jul 06 22:14:23.491758 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:23.491667 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/674f9f81-83c5-409b-b74e-d0b9292a6aff-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c695b4674-5mst6\" (UID: \"674f9f81-83c5-409b-b74e-d0b9292a6aff\") " pod="opendatahub/opendatahub-operator-controller-manager-5c695b4674-5mst6" Jul 06 22:14:23.491758 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:23.491691 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2msk\" (UniqueName: \"kubernetes.io/projected/674f9f81-83c5-409b-b74e-d0b9292a6aff-kube-api-access-k2msk\") pod \"opendatahub-operator-controller-manager-5c695b4674-5mst6\" (UID: \"674f9f81-83c5-409b-b74e-d0b9292a6aff\") " pod="opendatahub/opendatahub-operator-controller-manager-5c695b4674-5mst6" Jul 06 22:14:23.491758 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:23.491745 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/674f9f81-83c5-409b-b74e-d0b9292a6aff-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c695b4674-5mst6\" (UID: \"674f9f81-83c5-409b-b74e-d0b9292a6aff\") " pod="opendatahub/opendatahub-operator-controller-manager-5c695b4674-5mst6" Jul 06 22:14:23.496570 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:23.496548 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c695b4674-5mst6"] Jul 06 22:14:23.592408 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:23.592378 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2msk\" (UniqueName: \"kubernetes.io/projected/674f9f81-83c5-409b-b74e-d0b9292a6aff-kube-api-access-k2msk\") pod \"opendatahub-operator-controller-manager-5c695b4674-5mst6\" (UID: \"674f9f81-83c5-409b-b74e-d0b9292a6aff\") " pod="opendatahub/opendatahub-operator-controller-manager-5c695b4674-5mst6" Jul 06 22:14:23.592408 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:23.592411 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/674f9f81-83c5-409b-b74e-d0b9292a6aff-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c695b4674-5mst6\" (UID: \"674f9f81-83c5-409b-b74e-d0b9292a6aff\") " pod="opendatahub/opendatahub-operator-controller-manager-5c695b4674-5mst6" Jul 06 22:14:23.592600 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:23.592449 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/674f9f81-83c5-409b-b74e-d0b9292a6aff-tmp\") pod \"opendatahub-operator-controller-manager-5c695b4674-5mst6\" (UID: \"674f9f81-83c5-409b-b74e-d0b9292a6aff\") " pod="opendatahub/opendatahub-operator-controller-manager-5c695b4674-5mst6" Jul 06 22:14:23.592600 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:23.592559 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/674f9f81-83c5-409b-b74e-d0b9292a6aff-manifests\") pod \"opendatahub-operator-controller-manager-5c695b4674-5mst6\" (UID: \"674f9f81-83c5-409b-b74e-d0b9292a6aff\") " pod="opendatahub/opendatahub-operator-controller-manager-5c695b4674-5mst6" Jul 06 22:14:23.592600 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:23.592587 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/674f9f81-83c5-409b-b74e-d0b9292a6aff-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c695b4674-5mst6\" (UID: \"674f9f81-83c5-409b-b74e-d0b9292a6aff\") " pod="opendatahub/opendatahub-operator-controller-manager-5c695b4674-5mst6" Jul 06 22:14:23.592941 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:23.592911 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/674f9f81-83c5-409b-b74e-d0b9292a6aff-manifests\") pod \"opendatahub-operator-controller-manager-5c695b4674-5mst6\" (UID: \"674f9f81-83c5-409b-b74e-d0b9292a6aff\") " pod="opendatahub/opendatahub-operator-controller-manager-5c695b4674-5mst6" Jul 06 22:14:23.594649 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:23.594628 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/674f9f81-83c5-409b-b74e-d0b9292a6aff-tmp\") pod \"opendatahub-operator-controller-manager-5c695b4674-5mst6\" (UID: \"674f9f81-83c5-409b-b74e-d0b9292a6aff\") " pod="opendatahub/opendatahub-operator-controller-manager-5c695b4674-5mst6" Jul 06 22:14:23.594776 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:23.594761 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/674f9f81-83c5-409b-b74e-d0b9292a6aff-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c695b4674-5mst6\" (UID: \"674f9f81-83c5-409b-b74e-d0b9292a6aff\") " pod="opendatahub/opendatahub-operator-controller-manager-5c695b4674-5mst6" Jul 06 22:14:23.594884 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:23.594868 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/674f9f81-83c5-409b-b74e-d0b9292a6aff-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c695b4674-5mst6\" (UID: \"674f9f81-83c5-409b-b74e-d0b9292a6aff\") " pod="opendatahub/opendatahub-operator-controller-manager-5c695b4674-5mst6" Jul 06 22:14:23.600371 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:23.600352 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2msk\" (UniqueName: \"kubernetes.io/projected/674f9f81-83c5-409b-b74e-d0b9292a6aff-kube-api-access-k2msk\") pod \"opendatahub-operator-controller-manager-5c695b4674-5mst6\" (UID: \"674f9f81-83c5-409b-b74e-d0b9292a6aff\") " pod="opendatahub/opendatahub-operator-controller-manager-5c695b4674-5mst6" Jul 06 22:14:23.780412 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:23.780321 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c695b4674-5mst6" Jul 06 22:14:23.915648 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:23.915616 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c695b4674-5mst6"] Jul 06 22:14:23.918154 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:14:23.918124 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod674f9f81_83c5_409b_b74e_d0b9292a6aff.slice/crio-16a412489b549cc728874186cbc8c16ec708b5605c4bf4631fd74f59ec40ca84 WatchSource:0}: Error finding container 16a412489b549cc728874186cbc8c16ec708b5605c4bf4631fd74f59ec40ca84: Status 404 returned error can't find the container with id 16a412489b549cc728874186cbc8c16ec708b5605c4bf4631fd74f59ec40ca84 Jul 06 22:14:24.020981 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:24.020949 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c695b4674-5mst6" event={"ID":"674f9f81-83c5-409b-b74e-d0b9292a6aff","Type":"ContainerStarted","Data":"16a412489b549cc728874186cbc8c16ec708b5605c4bf4631fd74f59ec40ca84"} Jul 06 22:14:27.037367 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:27.037327 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c695b4674-5mst6" event={"ID":"674f9f81-83c5-409b-b74e-d0b9292a6aff","Type":"ContainerStarted","Data":"c9944fbdf3cb3a2093229c8ad929abedd17d07a259645b320ee200ec886c9927"} Jul 06 22:14:28.043009 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:28.042969 2566 generic.go:356] "Generic (PLEG): container finished" podID="674f9f81-83c5-409b-b74e-d0b9292a6aff" containerID="c9944fbdf3cb3a2093229c8ad929abedd17d07a259645b320ee200ec886c9927" exitCode=0 Jul 06 22:14:28.043387 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:28.043051 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c695b4674-5mst6" event={"ID":"674f9f81-83c5-409b-b74e-d0b9292a6aff","Type":"ContainerDied","Data":"c9944fbdf3cb3a2093229c8ad929abedd17d07a259645b320ee200ec886c9927"} Jul 06 22:14:29.049240 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:29.049203 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c695b4674-5mst6" event={"ID":"674f9f81-83c5-409b-b74e-d0b9292a6aff","Type":"ContainerStarted","Data":"26d8b6a391daed913fdd7541a2b1dff9ddb745dbc3f281e7fa934e6ada9e34aa"} Jul 06 22:14:29.049631 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:29.049314 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c695b4674-5mst6" Jul 06 22:14:29.079886 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:29.079808 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c695b4674-5mst6" podStartSLOduration=1.7625689420000001 podStartE2EDuration="6.079791531s" totalImagesPullingTime="3.273624544s" totalInitContainerRuntime="1.043598045s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:14:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:14:29.078192672 +0000 UTC m=+328.933158150" watchObservedRunningTime="2026-07-06 22:14:29.079791531 +0000 UTC m=+328.934756996" Jul 06 22:14:32.008225 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:32.008198 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7bcf4db656-zngbw" Jul 06 22:14:40.055730 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:40.055698 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c695b4674-5mst6" Jul 06 22:14:50.771251 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:50.771221 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk"] Jul 06 22:14:50.779211 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:50.779186 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" Jul 06 22:14:50.783857 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:50.783817 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 22:14:50.783857 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:50.783830 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 22:14:50.784018 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:50.783823 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 22:14:50.784018 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:50.783953 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 22:14:50.784018 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:50.783834 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-q9wdv\"" Jul 06 22:14:50.784018 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:50.783835 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 22:14:50.784194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:50.783819 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 22:14:50.792612 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:50.792590 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk"] Jul 06 22:14:50.907982 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:50.907946 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/da430263-afad-45e4-8053-472823a71ec8-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-v7thk\" (UID: \"da430263-afad-45e4-8053-472823a71ec8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" Jul 06 22:14:50.908150 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:50.908002 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/da430263-afad-45e4-8053-472823a71ec8-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-v7thk\" (UID: \"da430263-afad-45e4-8053-472823a71ec8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" Jul 06 22:14:50.908150 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:50.908062 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/da430263-afad-45e4-8053-472823a71ec8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-v7thk\" (UID: \"da430263-afad-45e4-8053-472823a71ec8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" Jul 06 22:14:50.908150 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:50.908098 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfmb6\" (UniqueName: \"kubernetes.io/projected/da430263-afad-45e4-8053-472823a71ec8-kube-api-access-cfmb6\") pod \"istiod-openshift-gateway-94bb8fbfd-v7thk\" (UID: \"da430263-afad-45e4-8053-472823a71ec8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" Jul 06 22:14:50.908150 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:50.908121 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/da430263-afad-45e4-8053-472823a71ec8-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-v7thk\" (UID: \"da430263-afad-45e4-8053-472823a71ec8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" Jul 06 22:14:50.908150 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:50.908141 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da430263-afad-45e4-8053-472823a71ec8-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-v7thk\" (UID: \"da430263-afad-45e4-8053-472823a71ec8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" Jul 06 22:14:50.908348 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:50.908245 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/da430263-afad-45e4-8053-472823a71ec8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-v7thk\" (UID: \"da430263-afad-45e4-8053-472823a71ec8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" Jul 06 22:14:51.008989 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:51.008953 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/da430263-afad-45e4-8053-472823a71ec8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-v7thk\" (UID: \"da430263-afad-45e4-8053-472823a71ec8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" Jul 06 22:14:51.008989 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:51.008991 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/da430263-afad-45e4-8053-472823a71ec8-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-v7thk\" (UID: \"da430263-afad-45e4-8053-472823a71ec8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" Jul 06 22:14:51.009179 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:51.009020 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/da430263-afad-45e4-8053-472823a71ec8-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-v7thk\" (UID: \"da430263-afad-45e4-8053-472823a71ec8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" Jul 06 22:14:51.009179 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:51.009052 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/da430263-afad-45e4-8053-472823a71ec8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-v7thk\" (UID: \"da430263-afad-45e4-8053-472823a71ec8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" Jul 06 22:14:51.009179 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:51.009070 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfmb6\" (UniqueName: \"kubernetes.io/projected/da430263-afad-45e4-8053-472823a71ec8-kube-api-access-cfmb6\") pod \"istiod-openshift-gateway-94bb8fbfd-v7thk\" (UID: \"da430263-afad-45e4-8053-472823a71ec8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" Jul 06 22:14:51.009179 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:51.009087 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/da430263-afad-45e4-8053-472823a71ec8-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-v7thk\" (UID: \"da430263-afad-45e4-8053-472823a71ec8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" Jul 06 22:14:51.009179 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:51.009105 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da430263-afad-45e4-8053-472823a71ec8-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-v7thk\" (UID: \"da430263-afad-45e4-8053-472823a71ec8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" Jul 06 22:14:51.009637 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:51.009612 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/da430263-afad-45e4-8053-472823a71ec8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-v7thk\" (UID: \"da430263-afad-45e4-8053-472823a71ec8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" Jul 06 22:14:51.011191 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:51.011168 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/da430263-afad-45e4-8053-472823a71ec8-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-v7thk\" (UID: \"da430263-afad-45e4-8053-472823a71ec8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" Jul 06 22:14:51.011366 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:51.011352 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/da430263-afad-45e4-8053-472823a71ec8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-v7thk\" (UID: \"da430263-afad-45e4-8053-472823a71ec8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" Jul 06 22:14:51.011650 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:51.011638 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/da430263-afad-45e4-8053-472823a71ec8-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-v7thk\" (UID: \"da430263-afad-45e4-8053-472823a71ec8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" Jul 06 22:14:51.012150 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:51.012130 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/da430263-afad-45e4-8053-472823a71ec8-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-v7thk\" (UID: \"da430263-afad-45e4-8053-472823a71ec8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" Jul 06 22:14:51.024958 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:51.024902 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfmb6\" (UniqueName: \"kubernetes.io/projected/da430263-afad-45e4-8053-472823a71ec8-kube-api-access-cfmb6\") pod \"istiod-openshift-gateway-94bb8fbfd-v7thk\" (UID: \"da430263-afad-45e4-8053-472823a71ec8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" Jul 06 22:14:51.025143 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:51.025125 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da430263-afad-45e4-8053-472823a71ec8-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-v7thk\" (UID: \"da430263-afad-45e4-8053-472823a71ec8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" Jul 06 22:14:51.087449 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:51.087414 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" Jul 06 22:14:51.222390 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:51.222363 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk"] Jul 06 22:14:51.224569 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:14:51.224545 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda430263_afad_45e4_8053_472823a71ec8.slice/crio-7606edf390effbb23926cf7d8693ff4080b286c1caa7477da6cf1cb094fc6551 WatchSource:0}: Error finding container 7606edf390effbb23926cf7d8693ff4080b286c1caa7477da6cf1cb094fc6551: Status 404 returned error can't find the container with id 7606edf390effbb23926cf7d8693ff4080b286c1caa7477da6cf1cb094fc6551 Jul 06 22:14:52.157111 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:52.157066 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" event={"ID":"da430263-afad-45e4-8053-472823a71ec8","Type":"ContainerStarted","Data":"7606edf390effbb23926cf7d8693ff4080b286c1caa7477da6cf1cb094fc6551"} Jul 06 22:14:53.649589 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:53.649545 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:14:53.649900 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:53.649613 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:14:54.168357 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:54.168310 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" event={"ID":"da430263-afad-45e4-8053-472823a71ec8","Type":"ContainerStarted","Data":"b9942f068b8a6e5bd76c09deec413c5b41a953d240e0b30db08d5eb17a57d238"} Jul 06 22:14:54.168522 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:54.168406 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" Jul 06 22:14:54.169811 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:54.169779 2566 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-v7thk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 22:14:54.169954 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:54.169833 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" podUID="da430263-afad-45e4-8053-472823a71ec8" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 22:14:54.218878 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:54.218070 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" podStartSLOduration=1.795426046 podStartE2EDuration="4.218048142s" totalImagesPullingTime="2.422622096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:14:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:14:54.215539929 +0000 UTC m=+354.070505395" watchObservedRunningTime="2026-07-06 22:14:54.218048142 +0000 UTC m=+354.073013608" Jul 06 22:14:55.172715 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:14:55.172684 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v7thk" Jul 06 22:16:00.147616 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:00.147581 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf"] Jul 06 22:16:00.150919 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:00.150900 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf" Jul 06 22:16:00.153454 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:00.153430 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 22:16:00.154330 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:00.154304 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ppdw5\"" Jul 06 22:16:00.154410 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:00.154351 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 22:16:00.159727 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:00.159704 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf"] Jul 06 22:16:00.238486 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:00.238445 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f4756f8-aa10-47c5-87bb-6d33c447d4f4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf\" (UID: \"1f4756f8-aa10-47c5-87bb-6d33c447d4f4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf" Jul 06 22:16:00.238678 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:00.238524 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f4756f8-aa10-47c5-87bb-6d33c447d4f4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf\" (UID: \"1f4756f8-aa10-47c5-87bb-6d33c447d4f4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf" Jul 06 22:16:00.238678 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:00.238548 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmvsc\" (UniqueName: \"kubernetes.io/projected/1f4756f8-aa10-47c5-87bb-6d33c447d4f4-kube-api-access-fmvsc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf\" (UID: \"1f4756f8-aa10-47c5-87bb-6d33c447d4f4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf" Jul 06 22:16:00.339765 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:00.339713 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f4756f8-aa10-47c5-87bb-6d33c447d4f4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf\" (UID: \"1f4756f8-aa10-47c5-87bb-6d33c447d4f4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf" Jul 06 22:16:00.339975 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:00.339795 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f4756f8-aa10-47c5-87bb-6d33c447d4f4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf\" (UID: \"1f4756f8-aa10-47c5-87bb-6d33c447d4f4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf" Jul 06 22:16:00.339975 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:00.339814 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmvsc\" (UniqueName: \"kubernetes.io/projected/1f4756f8-aa10-47c5-87bb-6d33c447d4f4-kube-api-access-fmvsc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf\" (UID: \"1f4756f8-aa10-47c5-87bb-6d33c447d4f4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf" Jul 06 22:16:00.340211 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:00.340187 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f4756f8-aa10-47c5-87bb-6d33c447d4f4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf\" (UID: \"1f4756f8-aa10-47c5-87bb-6d33c447d4f4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf" Jul 06 22:16:00.340276 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:00.340197 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f4756f8-aa10-47c5-87bb-6d33c447d4f4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf\" (UID: \"1f4756f8-aa10-47c5-87bb-6d33c447d4f4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf" Jul 06 22:16:00.348080 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:00.348055 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmvsc\" (UniqueName: \"kubernetes.io/projected/1f4756f8-aa10-47c5-87bb-6d33c447d4f4-kube-api-access-fmvsc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf\" (UID: \"1f4756f8-aa10-47c5-87bb-6d33c447d4f4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf" Jul 06 22:16:00.461936 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:00.461904 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf" Jul 06 22:16:00.588576 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:00.588544 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf"] Jul 06 22:16:00.591737 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:16:00.591707 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f4756f8_aa10_47c5_87bb_6d33c447d4f4.slice/crio-fd86cac2909d535b83b9b8f844500cfa2743aa86e505327dba7079bfbe57c775 WatchSource:0}: Error finding container fd86cac2909d535b83b9b8f844500cfa2743aa86e505327dba7079bfbe57c775: Status 404 returned error can't find the container with id fd86cac2909d535b83b9b8f844500cfa2743aa86e505327dba7079bfbe57c775 Jul 06 22:16:00.953308 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:00.953277 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t"] Jul 06 22:16:00.956587 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:00.956566 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t" Jul 06 22:16:00.965398 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:00.965374 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t"] Jul 06 22:16:01.047661 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.047620 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7lck\" (UniqueName: \"kubernetes.io/projected/f00d537d-377c-4c35-83aa-ce6c012ffc26-kube-api-access-n7lck\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t\" (UID: \"f00d537d-377c-4c35-83aa-ce6c012ffc26\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t" Jul 06 22:16:01.047661 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.047665 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f00d537d-377c-4c35-83aa-ce6c012ffc26-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t\" (UID: \"f00d537d-377c-4c35-83aa-ce6c012ffc26\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t" Jul 06 22:16:01.047907 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.047734 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f00d537d-377c-4c35-83aa-ce6c012ffc26-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t\" (UID: \"f00d537d-377c-4c35-83aa-ce6c012ffc26\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t" Jul 06 22:16:01.148655 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.148606 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f00d537d-377c-4c35-83aa-ce6c012ffc26-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t\" (UID: \"f00d537d-377c-4c35-83aa-ce6c012ffc26\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t" Jul 06 22:16:01.149163 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.148685 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7lck\" (UniqueName: \"kubernetes.io/projected/f00d537d-377c-4c35-83aa-ce6c012ffc26-kube-api-access-n7lck\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t\" (UID: \"f00d537d-377c-4c35-83aa-ce6c012ffc26\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t" Jul 06 22:16:01.149163 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.148715 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f00d537d-377c-4c35-83aa-ce6c012ffc26-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t\" (UID: \"f00d537d-377c-4c35-83aa-ce6c012ffc26\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t" Jul 06 22:16:01.149163 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.149036 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f00d537d-377c-4c35-83aa-ce6c012ffc26-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t\" (UID: \"f00d537d-377c-4c35-83aa-ce6c012ffc26\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t" Jul 06 22:16:01.149163 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.149116 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f00d537d-377c-4c35-83aa-ce6c012ffc26-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t\" (UID: \"f00d537d-377c-4c35-83aa-ce6c012ffc26\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t" Jul 06 22:16:01.158714 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.158688 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7lck\" (UniqueName: \"kubernetes.io/projected/f00d537d-377c-4c35-83aa-ce6c012ffc26-kube-api-access-n7lck\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t\" (UID: \"f00d537d-377c-4c35-83aa-ce6c012ffc26\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t" Jul 06 22:16:01.265184 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.265100 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t" Jul 06 22:16:01.397237 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.397208 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t"] Jul 06 22:16:01.399743 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:16:01.399714 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf00d537d_377c_4c35_83aa_ce6c012ffc26.slice/crio-40571bcc1703ef844ceb2d2e53ab1d3800364727be9cd1fb9c482fd534142543 WatchSource:0}: Error finding container 40571bcc1703ef844ceb2d2e53ab1d3800364727be9cd1fb9c482fd534142543: Status 404 returned error can't find the container with id 40571bcc1703ef844ceb2d2e53ab1d3800364727be9cd1fb9c482fd534142543 Jul 06 22:16:01.458508 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.458471 2566 generic.go:356] "Generic (PLEG): container finished" podID="1f4756f8-aa10-47c5-87bb-6d33c447d4f4" containerID="8531fa809451048987520cbf0468af1b53c66a2c901a414ba3f5116bc027ed40" exitCode=0 Jul 06 22:16:01.458635 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.458540 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf" event={"ID":"1f4756f8-aa10-47c5-87bb-6d33c447d4f4","Type":"ContainerDied","Data":"8531fa809451048987520cbf0468af1b53c66a2c901a414ba3f5116bc027ed40"} Jul 06 22:16:01.458635 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.458595 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf" event={"ID":"1f4756f8-aa10-47c5-87bb-6d33c447d4f4","Type":"ContainerStarted","Data":"fd86cac2909d535b83b9b8f844500cfa2743aa86e505327dba7079bfbe57c775"} Jul 06 22:16:01.460081 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.460059 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t" event={"ID":"f00d537d-377c-4c35-83aa-ce6c012ffc26","Type":"ContainerStarted","Data":"3e6ec48714c636731f3d5f04910b4fd24c91f5ae93c8b32d9f592e6d790dc57f"} Jul 06 22:16:01.460185 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.460095 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t" event={"ID":"f00d537d-377c-4c35-83aa-ce6c012ffc26","Type":"ContainerStarted","Data":"40571bcc1703ef844ceb2d2e53ab1d3800364727be9cd1fb9c482fd534142543"} Jul 06 22:16:01.541578 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.541499 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr"] Jul 06 22:16:01.544827 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.544806 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr" Jul 06 22:16:01.552717 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.552688 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr"] Jul 06 22:16:01.652865 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.652802 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8108a69-7e05-4ad1-97dc-141426ee73db-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr\" (UID: \"f8108a69-7e05-4ad1-97dc-141426ee73db\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr" Jul 06 22:16:01.653039 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.652925 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8b6g\" (UniqueName: \"kubernetes.io/projected/f8108a69-7e05-4ad1-97dc-141426ee73db-kube-api-access-l8b6g\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr\" (UID: \"f8108a69-7e05-4ad1-97dc-141426ee73db\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr" Jul 06 22:16:01.653039 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.652945 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8108a69-7e05-4ad1-97dc-141426ee73db-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr\" (UID: \"f8108a69-7e05-4ad1-97dc-141426ee73db\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr" Jul 06 22:16:01.754199 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.754157 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8b6g\" (UniqueName: \"kubernetes.io/projected/f8108a69-7e05-4ad1-97dc-141426ee73db-kube-api-access-l8b6g\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr\" (UID: \"f8108a69-7e05-4ad1-97dc-141426ee73db\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr" Jul 06 22:16:01.754199 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.754197 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8108a69-7e05-4ad1-97dc-141426ee73db-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr\" (UID: \"f8108a69-7e05-4ad1-97dc-141426ee73db\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr" Jul 06 22:16:01.754462 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.754217 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8108a69-7e05-4ad1-97dc-141426ee73db-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr\" (UID: \"f8108a69-7e05-4ad1-97dc-141426ee73db\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr" Jul 06 22:16:01.754570 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.754554 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8108a69-7e05-4ad1-97dc-141426ee73db-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr\" (UID: \"f8108a69-7e05-4ad1-97dc-141426ee73db\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr" Jul 06 22:16:01.754662 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.754642 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8108a69-7e05-4ad1-97dc-141426ee73db-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr\" (UID: \"f8108a69-7e05-4ad1-97dc-141426ee73db\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr" Jul 06 22:16:01.764795 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.764759 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8b6g\" (UniqueName: \"kubernetes.io/projected/f8108a69-7e05-4ad1-97dc-141426ee73db-kube-api-access-l8b6g\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr\" (UID: \"f8108a69-7e05-4ad1-97dc-141426ee73db\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr" Jul 06 22:16:01.866602 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.866506 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr" Jul 06 22:16:01.940425 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.940392 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs"] Jul 06 22:16:01.944069 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.944045 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs" Jul 06 22:16:01.954953 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:01.954920 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs"] Jul 06 22:16:02.004040 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:02.003915 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr"] Jul 06 22:16:02.006084 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:16:02.006056 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8108a69_7e05_4ad1_97dc_141426ee73db.slice/crio-80cfbbec2c13aba4b822f3de97bb66c2c6aa11c61a09d4110c857a03a2097f10 WatchSource:0}: Error finding container 80cfbbec2c13aba4b822f3de97bb66c2c6aa11c61a09d4110c857a03a2097f10: Status 404 returned error can't find the container with id 80cfbbec2c13aba4b822f3de97bb66c2c6aa11c61a09d4110c857a03a2097f10 Jul 06 22:16:02.057539 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:02.057516 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs\" (UID: \"febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs" Jul 06 22:16:02.057640 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:02.057555 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-229m8\" (UniqueName: \"kubernetes.io/projected/febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5-kube-api-access-229m8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs\" (UID: \"febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs" Jul 06 22:16:02.057640 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:02.057583 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs\" (UID: \"febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs" Jul 06 22:16:02.158963 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:02.158886 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs\" (UID: \"febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs" Jul 06 22:16:02.158963 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:02.158960 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs\" (UID: \"febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs" Jul 06 22:16:02.159355 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:02.158990 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-229m8\" (UniqueName: \"kubernetes.io/projected/febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5-kube-api-access-229m8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs\" (UID: \"febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs" Jul 06 22:16:02.159355 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:02.159234 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs\" (UID: \"febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs" Jul 06 22:16:02.159355 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:02.159326 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs\" (UID: \"febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs" Jul 06 22:16:02.167726 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:02.167694 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-229m8\" (UniqueName: \"kubernetes.io/projected/febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5-kube-api-access-229m8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs\" (UID: \"febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs" Jul 06 22:16:02.257917 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:02.257891 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs" Jul 06 22:16:02.397021 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:02.396992 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs"] Jul 06 22:16:02.399314 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:16:02.399286 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfebb1d75_6a20_4b5e_9c1b_4f5fac3f17a5.slice/crio-4270752bc1c9469a6d0cb11460cd968ab180d70e7a52dacf2ddef39de753f3a7 WatchSource:0}: Error finding container 4270752bc1c9469a6d0cb11460cd968ab180d70e7a52dacf2ddef39de753f3a7: Status 404 returned error can't find the container with id 4270752bc1c9469a6d0cb11460cd968ab180d70e7a52dacf2ddef39de753f3a7 Jul 06 22:16:02.466200 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:02.466170 2566 generic.go:356] "Generic (PLEG): container finished" podID="1f4756f8-aa10-47c5-87bb-6d33c447d4f4" containerID="3e2df3268be31a502181d88bca66485fd818fb1187947698f52f6bd5dd42bca1" exitCode=0 Jul 06 22:16:02.466320 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:02.466249 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf" event={"ID":"1f4756f8-aa10-47c5-87bb-6d33c447d4f4","Type":"ContainerDied","Data":"3e2df3268be31a502181d88bca66485fd818fb1187947698f52f6bd5dd42bca1"} Jul 06 22:16:02.467905 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:02.467881 2566 generic.go:356] "Generic (PLEG): container finished" podID="f8108a69-7e05-4ad1-97dc-141426ee73db" containerID="315cfc5331d2d735ad8dd61bbc4cabea592f4d5a9fad4af94e24b4934c8a0710" exitCode=0 Jul 06 22:16:02.467996 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:02.467918 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr" event={"ID":"f8108a69-7e05-4ad1-97dc-141426ee73db","Type":"ContainerDied","Data":"315cfc5331d2d735ad8dd61bbc4cabea592f4d5a9fad4af94e24b4934c8a0710"} Jul 06 22:16:02.467996 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:02.467972 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr" event={"ID":"f8108a69-7e05-4ad1-97dc-141426ee73db","Type":"ContainerStarted","Data":"80cfbbec2c13aba4b822f3de97bb66c2c6aa11c61a09d4110c857a03a2097f10"} Jul 06 22:16:02.469624 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:02.469599 2566 generic.go:356] "Generic (PLEG): container finished" podID="f00d537d-377c-4c35-83aa-ce6c012ffc26" containerID="3e6ec48714c636731f3d5f04910b4fd24c91f5ae93c8b32d9f592e6d790dc57f" exitCode=0 Jul 06 22:16:02.469739 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:02.469705 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t" event={"ID":"f00d537d-377c-4c35-83aa-ce6c012ffc26","Type":"ContainerDied","Data":"3e6ec48714c636731f3d5f04910b4fd24c91f5ae93c8b32d9f592e6d790dc57f"} Jul 06 22:16:02.471360 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:02.471338 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs" event={"ID":"febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5","Type":"ContainerStarted","Data":"4270752bc1c9469a6d0cb11460cd968ab180d70e7a52dacf2ddef39de753f3a7"} Jul 06 22:16:03.479433 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:03.479406 2566 generic.go:356] "Generic (PLEG): container finished" podID="febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5" containerID="fcb4bb967fd3143f0b28f5de750fbc9143f3217fbb455bc23f124e4b16cad90f" exitCode=0 Jul 06 22:16:03.479792 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:03.479482 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs" event={"ID":"febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5","Type":"ContainerDied","Data":"fcb4bb967fd3143f0b28f5de750fbc9143f3217fbb455bc23f124e4b16cad90f"} Jul 06 22:16:03.481835 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:03.481773 2566 generic.go:356] "Generic (PLEG): container finished" podID="1f4756f8-aa10-47c5-87bb-6d33c447d4f4" containerID="e4934f647363061230cff36e0d154273826412ef8e4517070d79cca16134675a" exitCode=0 Jul 06 22:16:03.481929 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:03.481908 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf" event={"ID":"1f4756f8-aa10-47c5-87bb-6d33c447d4f4","Type":"ContainerDied","Data":"e4934f647363061230cff36e0d154273826412ef8e4517070d79cca16134675a"} Jul 06 22:16:03.484176 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:03.484140 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr" event={"ID":"f8108a69-7e05-4ad1-97dc-141426ee73db","Type":"ContainerStarted","Data":"588e8fee3a9d946e6aa70384e18e4df7cfa8be87a7c4b8987f53e0e8c0c115ea"} Jul 06 22:16:03.486405 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:03.486382 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t" event={"ID":"f00d537d-377c-4c35-83aa-ce6c012ffc26","Type":"ContainerStarted","Data":"7da1f918b29990fde6d486bd13b30e2d1549636d64c1c0338027e66d9434b70b"} Jul 06 22:16:04.493006 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:04.492910 2566 generic.go:356] "Generic (PLEG): container finished" podID="f8108a69-7e05-4ad1-97dc-141426ee73db" containerID="588e8fee3a9d946e6aa70384e18e4df7cfa8be87a7c4b8987f53e0e8c0c115ea" exitCode=0 Jul 06 22:16:04.493006 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:04.492943 2566 generic.go:356] "Generic (PLEG): container finished" podID="f8108a69-7e05-4ad1-97dc-141426ee73db" containerID="3c2cd94cf21e6510651c7e497ef3a07eaba20cf7b76cace473d49fb1626576b8" exitCode=0 Jul 06 22:16:04.493434 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:04.492997 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr" event={"ID":"f8108a69-7e05-4ad1-97dc-141426ee73db","Type":"ContainerDied","Data":"588e8fee3a9d946e6aa70384e18e4df7cfa8be87a7c4b8987f53e0e8c0c115ea"} Jul 06 22:16:04.493434 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:04.493056 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr" event={"ID":"f8108a69-7e05-4ad1-97dc-141426ee73db","Type":"ContainerDied","Data":"3c2cd94cf21e6510651c7e497ef3a07eaba20cf7b76cace473d49fb1626576b8"} Jul 06 22:16:04.494987 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:04.494964 2566 generic.go:356] "Generic (PLEG): container finished" podID="f00d537d-377c-4c35-83aa-ce6c012ffc26" containerID="7da1f918b29990fde6d486bd13b30e2d1549636d64c1c0338027e66d9434b70b" exitCode=0 Jul 06 22:16:04.494987 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:04.494984 2566 generic.go:356] "Generic (PLEG): container finished" podID="f00d537d-377c-4c35-83aa-ce6c012ffc26" containerID="f904331d5977c31c48459aaf232e208a30dbe28ddaf0fa4e5a41aaa97ac56c2d" exitCode=0 Jul 06 22:16:04.495151 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:04.495049 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t" event={"ID":"f00d537d-377c-4c35-83aa-ce6c012ffc26","Type":"ContainerDied","Data":"7da1f918b29990fde6d486bd13b30e2d1549636d64c1c0338027e66d9434b70b"} Jul 06 22:16:04.495151 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:04.495085 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t" event={"ID":"f00d537d-377c-4c35-83aa-ce6c012ffc26","Type":"ContainerDied","Data":"f904331d5977c31c48459aaf232e208a30dbe28ddaf0fa4e5a41aaa97ac56c2d"} Jul 06 22:16:04.496741 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:04.496722 2566 generic.go:356] "Generic (PLEG): container finished" podID="febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5" containerID="76534211d534e06389c849e9798b4ae38a2926cfd390e495a684b488c6ca5ea0" exitCode=0 Jul 06 22:16:04.496875 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:04.496810 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs" event={"ID":"febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5","Type":"ContainerDied","Data":"76534211d534e06389c849e9798b4ae38a2926cfd390e495a684b488c6ca5ea0"} Jul 06 22:16:04.624952 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:04.624924 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf" Jul 06 22:16:04.782668 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:04.782571 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f4756f8-aa10-47c5-87bb-6d33c447d4f4-bundle\") pod \"1f4756f8-aa10-47c5-87bb-6d33c447d4f4\" (UID: \"1f4756f8-aa10-47c5-87bb-6d33c447d4f4\") " Jul 06 22:16:04.782668 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:04.782633 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmvsc\" (UniqueName: \"kubernetes.io/projected/1f4756f8-aa10-47c5-87bb-6d33c447d4f4-kube-api-access-fmvsc\") pod \"1f4756f8-aa10-47c5-87bb-6d33c447d4f4\" (UID: \"1f4756f8-aa10-47c5-87bb-6d33c447d4f4\") " Jul 06 22:16:04.782668 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:04.782666 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f4756f8-aa10-47c5-87bb-6d33c447d4f4-util\") pod \"1f4756f8-aa10-47c5-87bb-6d33c447d4f4\" (UID: \"1f4756f8-aa10-47c5-87bb-6d33c447d4f4\") " Jul 06 22:16:04.783267 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:04.783235 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f4756f8-aa10-47c5-87bb-6d33c447d4f4-bundle" (OuterVolumeSpecName: "bundle") pod "1f4756f8-aa10-47c5-87bb-6d33c447d4f4" (UID: "1f4756f8-aa10-47c5-87bb-6d33c447d4f4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:16:04.784784 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:04.784761 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f4756f8-aa10-47c5-87bb-6d33c447d4f4-kube-api-access-fmvsc" (OuterVolumeSpecName: "kube-api-access-fmvsc") pod "1f4756f8-aa10-47c5-87bb-6d33c447d4f4" (UID: "1f4756f8-aa10-47c5-87bb-6d33c447d4f4"). InnerVolumeSpecName "kube-api-access-fmvsc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:16:04.787638 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:04.787620 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f4756f8-aa10-47c5-87bb-6d33c447d4f4-util" (OuterVolumeSpecName: "util") pod "1f4756f8-aa10-47c5-87bb-6d33c447d4f4" (UID: "1f4756f8-aa10-47c5-87bb-6d33c447d4f4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:16:04.884035 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:04.883993 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f4756f8-aa10-47c5-87bb-6d33c447d4f4-bundle\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:16:04.884035 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:04.884030 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmvsc\" (UniqueName: \"kubernetes.io/projected/1f4756f8-aa10-47c5-87bb-6d33c447d4f4-kube-api-access-fmvsc\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:16:04.884203 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:04.884047 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f4756f8-aa10-47c5-87bb-6d33c447d4f4-util\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:16:05.503321 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:05.503285 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf" Jul 06 22:16:05.503321 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:05.503315 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf" event={"ID":"1f4756f8-aa10-47c5-87bb-6d33c447d4f4","Type":"ContainerDied","Data":"fd86cac2909d535b83b9b8f844500cfa2743aa86e505327dba7079bfbe57c775"} Jul 06 22:16:05.503855 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:05.503361 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd86cac2909d535b83b9b8f844500cfa2743aa86e505327dba7079bfbe57c775" Jul 06 22:16:05.505494 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:05.505469 2566 generic.go:356] "Generic (PLEG): container finished" podID="febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5" containerID="0f23198b6df3a0d8bad3ff2c06a7987a4e913feb02b4c65f467f5ed18854d455" exitCode=0 Jul 06 22:16:05.505610 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:05.505547 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs" event={"ID":"febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5","Type":"ContainerDied","Data":"0f23198b6df3a0d8bad3ff2c06a7987a4e913feb02b4c65f467f5ed18854d455"} Jul 06 22:16:05.635462 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:05.635404 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t" Jul 06 22:16:05.669341 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:05.669320 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr" Jul 06 22:16:05.791567 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:05.791536 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7lck\" (UniqueName: \"kubernetes.io/projected/f00d537d-377c-4c35-83aa-ce6c012ffc26-kube-api-access-n7lck\") pod \"f00d537d-377c-4c35-83aa-ce6c012ffc26\" (UID: \"f00d537d-377c-4c35-83aa-ce6c012ffc26\") " Jul 06 22:16:05.791730 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:05.791584 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8108a69-7e05-4ad1-97dc-141426ee73db-util\") pod \"f8108a69-7e05-4ad1-97dc-141426ee73db\" (UID: \"f8108a69-7e05-4ad1-97dc-141426ee73db\") " Jul 06 22:16:05.791730 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:05.791649 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8108a69-7e05-4ad1-97dc-141426ee73db-bundle\") pod \"f8108a69-7e05-4ad1-97dc-141426ee73db\" (UID: \"f8108a69-7e05-4ad1-97dc-141426ee73db\") " Jul 06 22:16:05.791730 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:05.791671 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f00d537d-377c-4c35-83aa-ce6c012ffc26-bundle\") pod \"f00d537d-377c-4c35-83aa-ce6c012ffc26\" (UID: \"f00d537d-377c-4c35-83aa-ce6c012ffc26\") " Jul 06 22:16:05.791730 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:05.791687 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f00d537d-377c-4c35-83aa-ce6c012ffc26-util\") pod \"f00d537d-377c-4c35-83aa-ce6c012ffc26\" (UID: \"f00d537d-377c-4c35-83aa-ce6c012ffc26\") " Jul 06 22:16:05.791730 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:05.791702 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8b6g\" (UniqueName: \"kubernetes.io/projected/f8108a69-7e05-4ad1-97dc-141426ee73db-kube-api-access-l8b6g\") pod \"f8108a69-7e05-4ad1-97dc-141426ee73db\" (UID: \"f8108a69-7e05-4ad1-97dc-141426ee73db\") " Jul 06 22:16:05.792172 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:05.792142 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8108a69-7e05-4ad1-97dc-141426ee73db-bundle" (OuterVolumeSpecName: "bundle") pod "f8108a69-7e05-4ad1-97dc-141426ee73db" (UID: "f8108a69-7e05-4ad1-97dc-141426ee73db"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:16:05.792296 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:05.792260 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f00d537d-377c-4c35-83aa-ce6c012ffc26-bundle" (OuterVolumeSpecName: "bundle") pod "f00d537d-377c-4c35-83aa-ce6c012ffc26" (UID: "f00d537d-377c-4c35-83aa-ce6c012ffc26"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:16:05.794137 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:05.794114 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f00d537d-377c-4c35-83aa-ce6c012ffc26-kube-api-access-n7lck" (OuterVolumeSpecName: "kube-api-access-n7lck") pod "f00d537d-377c-4c35-83aa-ce6c012ffc26" (UID: "f00d537d-377c-4c35-83aa-ce6c012ffc26"). InnerVolumeSpecName "kube-api-access-n7lck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:16:05.794230 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:05.794196 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8108a69-7e05-4ad1-97dc-141426ee73db-kube-api-access-l8b6g" (OuterVolumeSpecName: "kube-api-access-l8b6g") pod "f8108a69-7e05-4ad1-97dc-141426ee73db" (UID: "f8108a69-7e05-4ad1-97dc-141426ee73db"). InnerVolumeSpecName "kube-api-access-l8b6g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:16:05.797903 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:05.797869 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8108a69-7e05-4ad1-97dc-141426ee73db-util" (OuterVolumeSpecName: "util") pod "f8108a69-7e05-4ad1-97dc-141426ee73db" (UID: "f8108a69-7e05-4ad1-97dc-141426ee73db"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:16:05.798098 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:05.798080 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f00d537d-377c-4c35-83aa-ce6c012ffc26-util" (OuterVolumeSpecName: "util") pod "f00d537d-377c-4c35-83aa-ce6c012ffc26" (UID: "f00d537d-377c-4c35-83aa-ce6c012ffc26"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:16:05.892286 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:05.892213 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8108a69-7e05-4ad1-97dc-141426ee73db-bundle\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:16:05.892286 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:05.892239 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f00d537d-377c-4c35-83aa-ce6c012ffc26-bundle\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:16:05.892286 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:05.892247 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f00d537d-377c-4c35-83aa-ce6c012ffc26-util\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:16:05.892286 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:05.892255 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8b6g\" (UniqueName: \"kubernetes.io/projected/f8108a69-7e05-4ad1-97dc-141426ee73db-kube-api-access-l8b6g\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:16:05.892286 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:05.892265 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7lck\" (UniqueName: \"kubernetes.io/projected/f00d537d-377c-4c35-83aa-ce6c012ffc26-kube-api-access-n7lck\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:16:05.892286 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:05.892273 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8108a69-7e05-4ad1-97dc-141426ee73db-util\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:16:06.511755 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:06.511727 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr" Jul 06 22:16:06.512214 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:06.511723 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr" event={"ID":"f8108a69-7e05-4ad1-97dc-141426ee73db","Type":"ContainerDied","Data":"80cfbbec2c13aba4b822f3de97bb66c2c6aa11c61a09d4110c857a03a2097f10"} Jul 06 22:16:06.512214 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:06.511877 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80cfbbec2c13aba4b822f3de97bb66c2c6aa11c61a09d4110c857a03a2097f10" Jul 06 22:16:06.513635 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:06.513612 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t" Jul 06 22:16:06.513635 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:06.513614 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t" event={"ID":"f00d537d-377c-4c35-83aa-ce6c012ffc26","Type":"ContainerDied","Data":"40571bcc1703ef844ceb2d2e53ab1d3800364727be9cd1fb9c482fd534142543"} Jul 06 22:16:06.513791 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:06.513664 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40571bcc1703ef844ceb2d2e53ab1d3800364727be9cd1fb9c482fd534142543" Jul 06 22:16:06.643648 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:06.643588 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs" Jul 06 22:16:06.799084 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:06.799050 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5-util\") pod \"febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5\" (UID: \"febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5\") " Jul 06 22:16:06.799276 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:06.799107 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5-bundle\") pod \"febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5\" (UID: \"febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5\") " Jul 06 22:16:06.799276 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:06.799133 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-229m8\" (UniqueName: \"kubernetes.io/projected/febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5-kube-api-access-229m8\") pod \"febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5\" (UID: \"febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5\") " Jul 06 22:16:06.799587 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:06.799563 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5-bundle" (OuterVolumeSpecName: "bundle") pod "febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5" (UID: "febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:16:06.801195 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:06.801166 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5-kube-api-access-229m8" (OuterVolumeSpecName: "kube-api-access-229m8") pod "febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5" (UID: "febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5"). InnerVolumeSpecName "kube-api-access-229m8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:16:06.804540 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:06.804516 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5-util" (OuterVolumeSpecName: "util") pod "febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5" (UID: "febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:16:06.899894 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:06.899789 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5-util\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:16:06.899894 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:06.899818 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5-bundle\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:16:06.899894 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:06.899827 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-229m8\" (UniqueName: \"kubernetes.io/projected/febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5-kube-api-access-229m8\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:16:07.520149 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:07.520117 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs" Jul 06 22:16:07.520149 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:07.520140 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs" event={"ID":"febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5","Type":"ContainerDied","Data":"4270752bc1c9469a6d0cb11460cd968ab180d70e7a52dacf2ddef39de753f3a7"} Jul 06 22:16:07.520620 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:07.520195 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4270752bc1c9469a6d0cb11460cd968ab180d70e7a52dacf2ddef39de753f3a7" Jul 06 22:16:14.511969 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:14.511937 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d65bc84b4-5q76d"] Jul 06 22:16:39.533211 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:39.533100 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6d65bc84b4-5q76d" podUID="ff5d32ee-740e-4a5b-af8b-48f09e1771ff" containerName="console" containerID="cri-o://555e6f0e202b7208307640ecf4f1ebea9a9bb0e022ca11e6cd4a518ae0921614" gracePeriod=15 Jul 06 22:16:39.672516 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:39.672483 2566 generic.go:356] "Generic (PLEG): container finished" podID="ff5d32ee-740e-4a5b-af8b-48f09e1771ff" containerID="555e6f0e202b7208307640ecf4f1ebea9a9bb0e022ca11e6cd4a518ae0921614" exitCode=0 Jul 06 22:16:39.672675 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:39.672557 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d65bc84b4-5q76d" event={"ID":"ff5d32ee-740e-4a5b-af8b-48f09e1771ff","Type":"ContainerDied","Data":"555e6f0e202b7208307640ecf4f1ebea9a9bb0e022ca11e6cd4a518ae0921614"} Jul 06 22:16:39.777282 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:39.777258 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:16:39.868899 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:39.868806 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmbdn\" (UniqueName: \"kubernetes.io/projected/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-kube-api-access-wmbdn\") pod \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\" (UID: \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\") " Jul 06 22:16:39.868899 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:39.868861 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-console-serving-cert\") pod \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\" (UID: \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\") " Jul 06 22:16:39.869110 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:39.868912 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-service-ca\") pod \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\" (UID: \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\") " Jul 06 22:16:39.869110 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:39.868930 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-console-config\") pod \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\" (UID: \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\") " Jul 06 22:16:39.869110 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:39.868961 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-trusted-ca-bundle\") pod \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\" (UID: \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\") " Jul 06 22:16:39.869110 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:39.869002 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-console-oauth-config\") pod \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\" (UID: \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\") " Jul 06 22:16:39.869110 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:39.869055 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-oauth-serving-cert\") pod \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\" (UID: \"ff5d32ee-740e-4a5b-af8b-48f09e1771ff\") " Jul 06 22:16:39.869507 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:39.869454 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ff5d32ee-740e-4a5b-af8b-48f09e1771ff" (UID: "ff5d32ee-740e-4a5b-af8b-48f09e1771ff"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:16:39.869600 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:39.869582 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ff5d32ee-740e-4a5b-af8b-48f09e1771ff" (UID: "ff5d32ee-740e-4a5b-af8b-48f09e1771ff"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:16:39.869646 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:39.869633 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-service-ca" (OuterVolumeSpecName: "service-ca") pod "ff5d32ee-740e-4a5b-af8b-48f09e1771ff" (UID: "ff5d32ee-740e-4a5b-af8b-48f09e1771ff"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:16:39.869688 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:39.869644 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-console-config" (OuterVolumeSpecName: "console-config") pod "ff5d32ee-740e-4a5b-af8b-48f09e1771ff" (UID: "ff5d32ee-740e-4a5b-af8b-48f09e1771ff"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:16:39.871351 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:39.871320 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-kube-api-access-wmbdn" (OuterVolumeSpecName: "kube-api-access-wmbdn") pod "ff5d32ee-740e-4a5b-af8b-48f09e1771ff" (UID: "ff5d32ee-740e-4a5b-af8b-48f09e1771ff"). InnerVolumeSpecName "kube-api-access-wmbdn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:16:39.871471 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:39.871402 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ff5d32ee-740e-4a5b-af8b-48f09e1771ff" (UID: "ff5d32ee-740e-4a5b-af8b-48f09e1771ff"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:16:39.871471 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:39.871452 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ff5d32ee-740e-4a5b-af8b-48f09e1771ff" (UID: "ff5d32ee-740e-4a5b-af8b-48f09e1771ff"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:16:39.970462 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:39.970419 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmbdn\" (UniqueName: \"kubernetes.io/projected/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-kube-api-access-wmbdn\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:16:39.970462 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:39.970452 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-console-serving-cert\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:16:39.970462 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:39.970463 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-service-ca\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:16:39.970462 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:39.970471 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-console-config\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:16:39.970730 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:39.970483 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-trusted-ca-bundle\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:16:39.970730 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:39.970493 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-console-oauth-config\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:16:39.970730 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:39.970502 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff5d32ee-740e-4a5b-af8b-48f09e1771ff-oauth-serving-cert\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:16:40.679472 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:40.679433 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d65bc84b4-5q76d" event={"ID":"ff5d32ee-740e-4a5b-af8b-48f09e1771ff","Type":"ContainerDied","Data":"7ac3d1bb0e02a7c07d1856ea24ae9f31387190f7d2b9f98a25e714b19140abed"} Jul 06 22:16:40.679927 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:40.679493 2566 scope.go:117] "RemoveContainer" containerID="555e6f0e202b7208307640ecf4f1ebea9a9bb0e022ca11e6cd4a518ae0921614" Jul 06 22:16:40.679927 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:40.679445 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d65bc84b4-5q76d" Jul 06 22:16:40.701100 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:40.701076 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d65bc84b4-5q76d"] Jul 06 22:16:40.705881 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:40.705857 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d65bc84b4-5q76d"] Jul 06 22:16:40.727139 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:16:40.727108 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff5d32ee-740e-4a5b-af8b-48f09e1771ff" path="/var/lib/kubelet/pods/ff5d32ee-740e-4a5b-af8b-48f09e1771ff/volumes" Jul 06 22:17:31.668937 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.668900 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669163 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8108a69-7e05-4ad1-97dc-141426ee73db" containerName="util" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669174 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8108a69-7e05-4ad1-97dc-141426ee73db" containerName="util" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669184 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f00d537d-377c-4c35-83aa-ce6c012ffc26" containerName="util" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669190 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f00d537d-377c-4c35-83aa-ce6c012ffc26" containerName="util" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669198 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5" containerName="pull" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669204 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5" containerName="pull" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669213 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8108a69-7e05-4ad1-97dc-141426ee73db" containerName="extract" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669218 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8108a69-7e05-4ad1-97dc-141426ee73db" containerName="extract" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669224 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f4756f8-aa10-47c5-87bb-6d33c447d4f4" containerName="extract" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669230 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f4756f8-aa10-47c5-87bb-6d33c447d4f4" containerName="extract" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669236 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f00d537d-377c-4c35-83aa-ce6c012ffc26" containerName="extract" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669241 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f00d537d-377c-4c35-83aa-ce6c012ffc26" containerName="extract" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669247 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5" containerName="extract" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669252 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5" containerName="extract" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669260 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5" containerName="util" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669264 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5" containerName="util" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669271 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f4756f8-aa10-47c5-87bb-6d33c447d4f4" containerName="util" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669275 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f4756f8-aa10-47c5-87bb-6d33c447d4f4" containerName="util" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669284 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f4756f8-aa10-47c5-87bb-6d33c447d4f4" containerName="pull" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669289 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f4756f8-aa10-47c5-87bb-6d33c447d4f4" containerName="pull" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669295 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8108a69-7e05-4ad1-97dc-141426ee73db" containerName="pull" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669300 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8108a69-7e05-4ad1-97dc-141426ee73db" containerName="pull" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669305 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f00d537d-377c-4c35-83aa-ce6c012ffc26" containerName="pull" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669309 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f00d537d-377c-4c35-83aa-ce6c012ffc26" containerName="pull" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669316 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff5d32ee-740e-4a5b-af8b-48f09e1771ff" containerName="console" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669320 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff5d32ee-740e-4a5b-af8b-48f09e1771ff" containerName="console" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669363 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5" containerName="extract" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669370 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8108a69-7e05-4ad1-97dc-141426ee73db" containerName="extract" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669377 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f4756f8-aa10-47c5-87bb-6d33c447d4f4" containerName="extract" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669384 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff5d32ee-740e-4a5b-af8b-48f09e1771ff" containerName="console" Jul 06 22:17:31.669419 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.669389 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f00d537d-377c-4c35-83aa-ce6c012ffc26" containerName="extract" Jul 06 22:17:31.672188 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.672171 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5w24c" Jul 06 22:17:31.675393 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.675363 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ppdw5\"" Jul 06 22:17:31.675555 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.675489 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 22:17:31.675555 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.675495 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 06 22:17:31.676353 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.676102 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 22:17:31.683154 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.683126 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:17:31.725314 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.725278 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:17:31.767865 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.767802 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj52b\" (UniqueName: \"kubernetes.io/projected/a37b63c9-a35b-46dc-9651-a10ed5b17430-kube-api-access-mj52b\") pod \"limitador-limitador-54d6d988d5-5w24c\" (UID: \"a37b63c9-a35b-46dc-9651-a10ed5b17430\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5w24c" Jul 06 22:17:31.768033 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.767911 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a37b63c9-a35b-46dc-9651-a10ed5b17430-config-file\") pod \"limitador-limitador-54d6d988d5-5w24c\" (UID: \"a37b63c9-a35b-46dc-9651-a10ed5b17430\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5w24c" Jul 06 22:17:31.868531 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.868492 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a37b63c9-a35b-46dc-9651-a10ed5b17430-config-file\") pod \"limitador-limitador-54d6d988d5-5w24c\" (UID: \"a37b63c9-a35b-46dc-9651-a10ed5b17430\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5w24c" Jul 06 22:17:31.868692 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.868567 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj52b\" (UniqueName: \"kubernetes.io/projected/a37b63c9-a35b-46dc-9651-a10ed5b17430-kube-api-access-mj52b\") pod \"limitador-limitador-54d6d988d5-5w24c\" (UID: \"a37b63c9-a35b-46dc-9651-a10ed5b17430\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5w24c" Jul 06 22:17:31.869178 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.869156 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a37b63c9-a35b-46dc-9651-a10ed5b17430-config-file\") pod \"limitador-limitador-54d6d988d5-5w24c\" (UID: \"a37b63c9-a35b-46dc-9651-a10ed5b17430\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5w24c" Jul 06 22:17:31.877980 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.877951 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj52b\" (UniqueName: \"kubernetes.io/projected/a37b63c9-a35b-46dc-9651-a10ed5b17430-kube-api-access-mj52b\") pod \"limitador-limitador-54d6d988d5-5w24c\" (UID: \"a37b63c9-a35b-46dc-9651-a10ed5b17430\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5w24c" Jul 06 22:17:31.984392 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:31.984352 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5w24c" Jul 06 22:17:32.121500 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:32.121336 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:17:32.123640 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:17:32.123604 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda37b63c9_a35b_46dc_9651_a10ed5b17430.slice/crio-e7217cb64415968cee93e322720d3f0fd64187fe74ee4cb1aa74b9a32ae8d07a WatchSource:0}: Error finding container e7217cb64415968cee93e322720d3f0fd64187fe74ee4cb1aa74b9a32ae8d07a: Status 404 returned error can't find the container with id e7217cb64415968cee93e322720d3f0fd64187fe74ee4cb1aa74b9a32ae8d07a Jul 06 22:17:32.916539 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:32.916501 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5w24c" event={"ID":"a37b63c9-a35b-46dc-9651-a10ed5b17430","Type":"ContainerStarted","Data":"e7217cb64415968cee93e322720d3f0fd64187fe74ee4cb1aa74b9a32ae8d07a"} Jul 06 22:17:34.928883 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:34.928836 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5w24c" event={"ID":"a37b63c9-a35b-46dc-9651-a10ed5b17430","Type":"ContainerStarted","Data":"132cef1c4761db3e6700133c4f2ea8b3dba33d7ab8d082a04827742c9342423c"} Jul 06 22:17:34.929260 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:34.928951 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5w24c" Jul 06 22:17:34.946144 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:34.946101 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-5w24c" podStartSLOduration=1.491976521 podStartE2EDuration="3.946087169s" totalImagesPullingTime="2.454110648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:17:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:17:34.945202528 +0000 UTC m=+514.800168032" watchObservedRunningTime="2026-07-06 22:17:34.946087169 +0000 UTC m=+514.801052635" Jul 06 22:17:45.934514 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:17:45.934473 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5w24c" Jul 06 22:18:46.410785 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:18:46.410749 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:19:00.619041 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:00.619006 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd89j_b55a9306-a1b1-4824-bacd-cd43906b7951/ovn-acl-logging/0.log" Jul 06 22:19:00.619464 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:00.619236 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd89j_b55a9306-a1b1-4824-bacd-cd43906b7951/ovn-acl-logging/0.log" Jul 06 22:19:04.885585 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:04.885543 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:19:12.307892 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:12.307857 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:19:23.198616 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:23.198533 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:19:44.617894 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:44.617858 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j"] Jul 06 22:19:44.620893 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:44.620878 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j" Jul 06 22:19:44.632881 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:44.632859 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 22:19:44.633931 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:44.633909 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 06 22:19:44.634018 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:44.633938 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 22:19:44.634018 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:44.633938 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kjlnd\"" Jul 06 22:19:44.642648 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:44.642625 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j"] Jul 06 22:19:44.752140 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:44.752107 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf062f28-cae7-4a11-aeeb-4d87e9c290f6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j\" (UID: \"bf062f28-cae7-4a11-aeeb-4d87e9c290f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j" Jul 06 22:19:44.752140 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:44.752142 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf062f28-cae7-4a11-aeeb-4d87e9c290f6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j\" (UID: \"bf062f28-cae7-4a11-aeeb-4d87e9c290f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j" Jul 06 22:19:44.752340 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:44.752196 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf062f28-cae7-4a11-aeeb-4d87e9c290f6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j\" (UID: \"bf062f28-cae7-4a11-aeeb-4d87e9c290f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j" Jul 06 22:19:44.752340 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:44.752244 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bttb6\" (UniqueName: \"kubernetes.io/projected/bf062f28-cae7-4a11-aeeb-4d87e9c290f6-kube-api-access-bttb6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j\" (UID: \"bf062f28-cae7-4a11-aeeb-4d87e9c290f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j" Jul 06 22:19:44.752340 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:44.752286 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf062f28-cae7-4a11-aeeb-4d87e9c290f6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j\" (UID: \"bf062f28-cae7-4a11-aeeb-4d87e9c290f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j" Jul 06 22:19:44.752340 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:44.752314 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf062f28-cae7-4a11-aeeb-4d87e9c290f6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j\" (UID: \"bf062f28-cae7-4a11-aeeb-4d87e9c290f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j" Jul 06 22:19:44.853124 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:44.853089 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf062f28-cae7-4a11-aeeb-4d87e9c290f6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j\" (UID: \"bf062f28-cae7-4a11-aeeb-4d87e9c290f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j" Jul 06 22:19:44.853124 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:44.853129 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf062f28-cae7-4a11-aeeb-4d87e9c290f6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j\" (UID: \"bf062f28-cae7-4a11-aeeb-4d87e9c290f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j" Jul 06 22:19:44.853361 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:44.853149 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf062f28-cae7-4a11-aeeb-4d87e9c290f6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j\" (UID: \"bf062f28-cae7-4a11-aeeb-4d87e9c290f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j" Jul 06 22:19:44.853361 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:44.853297 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf062f28-cae7-4a11-aeeb-4d87e9c290f6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j\" (UID: \"bf062f28-cae7-4a11-aeeb-4d87e9c290f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j" Jul 06 22:19:44.853482 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:44.853389 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf062f28-cae7-4a11-aeeb-4d87e9c290f6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j\" (UID: \"bf062f28-cae7-4a11-aeeb-4d87e9c290f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j" Jul 06 22:19:44.853482 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:44.853427 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bttb6\" (UniqueName: \"kubernetes.io/projected/bf062f28-cae7-4a11-aeeb-4d87e9c290f6-kube-api-access-bttb6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j\" (UID: \"bf062f28-cae7-4a11-aeeb-4d87e9c290f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j" Jul 06 22:19:44.853641 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:44.853620 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf062f28-cae7-4a11-aeeb-4d87e9c290f6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j\" (UID: \"bf062f28-cae7-4a11-aeeb-4d87e9c290f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j" Jul 06 22:19:44.853716 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:44.853634 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf062f28-cae7-4a11-aeeb-4d87e9c290f6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j\" (UID: \"bf062f28-cae7-4a11-aeeb-4d87e9c290f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j" Jul 06 22:19:44.853771 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:44.853704 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf062f28-cae7-4a11-aeeb-4d87e9c290f6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j\" (UID: \"bf062f28-cae7-4a11-aeeb-4d87e9c290f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j" Jul 06 22:19:44.855380 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:44.855360 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf062f28-cae7-4a11-aeeb-4d87e9c290f6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j\" (UID: \"bf062f28-cae7-4a11-aeeb-4d87e9c290f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j" Jul 06 22:19:44.855716 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:44.855695 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf062f28-cae7-4a11-aeeb-4d87e9c290f6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j\" (UID: \"bf062f28-cae7-4a11-aeeb-4d87e9c290f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j" Jul 06 22:19:44.861867 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:44.861830 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bttb6\" (UniqueName: \"kubernetes.io/projected/bf062f28-cae7-4a11-aeeb-4d87e9c290f6-kube-api-access-bttb6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j\" (UID: \"bf062f28-cae7-4a11-aeeb-4d87e9c290f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j" Jul 06 22:19:44.930789 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:44.930759 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j" Jul 06 22:19:45.060206 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:45.060182 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j"] Jul 06 22:19:45.061833 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:19:45.061808 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf062f28_cae7_4a11_aeeb_4d87e9c290f6.slice/crio-e46bf1f5f548c063713e0f7092d055ce270f8507c5d8acdcef6b73e1d81eb398 WatchSource:0}: Error finding container e46bf1f5f548c063713e0f7092d055ce270f8507c5d8acdcef6b73e1d81eb398: Status 404 returned error can't find the container with id e46bf1f5f548c063713e0f7092d055ce270f8507c5d8acdcef6b73e1d81eb398 Jul 06 22:19:45.063168 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:45.063149 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 22:19:45.518412 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:45.518377 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j" event={"ID":"bf062f28-cae7-4a11-aeeb-4d87e9c290f6","Type":"ContainerStarted","Data":"e46bf1f5f548c063713e0f7092d055ce270f8507c5d8acdcef6b73e1d81eb398"} Jul 06 22:19:46.240385 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:46.240343 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:19:46.524726 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:46.524693 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j" event={"ID":"bf062f28-cae7-4a11-aeeb-4d87e9c290f6","Type":"ContainerStarted","Data":"67eb77a81d749a27fdc3f9be6cbaa54195bf8000e249a3a2936a7354ed36b1f5"} Jul 06 22:19:46.545699 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:46.545650 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j" podStartSLOduration=1.558901906 podStartE2EDuration="2.54563625s" totalImagesPullingTime="986.734344ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:19:46.543696681 +0000 UTC m=+646.398662162" watchObservedRunningTime="2026-07-06 22:19:46.54563625 +0000 UTC m=+646.400601717" Jul 06 22:19:54.931614 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:54.931570 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j" Jul 06 22:19:54.932058 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:54.931637 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j" Jul 06 22:19:54.944033 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:54.944003 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j" Jul 06 22:19:55.576675 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:55.576648 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j" Jul 06 22:19:55.594216 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:19:55.594179 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:20:19.284907 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:19.284872 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2"] Jul 06 22:20:19.290203 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:19.290176 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2" Jul 06 22:20:19.294187 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:19.294161 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 06 22:20:19.301223 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:19.301195 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2"] Jul 06 22:20:19.323509 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:19.323477 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84cc739b-5305-442f-bce7-1e1f09a9ea08-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2\" (UID: \"84cc739b-5305-442f-bce7-1e1f09a9ea08\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2" Jul 06 22:20:19.323509 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:19.323511 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84cc739b-5305-442f-bce7-1e1f09a9ea08-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2\" (UID: \"84cc739b-5305-442f-bce7-1e1f09a9ea08\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2" Jul 06 22:20:19.323741 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:19.323539 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84cc739b-5305-442f-bce7-1e1f09a9ea08-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2\" (UID: \"84cc739b-5305-442f-bce7-1e1f09a9ea08\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2" Jul 06 22:20:19.323741 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:19.323563 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84cc739b-5305-442f-bce7-1e1f09a9ea08-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2\" (UID: \"84cc739b-5305-442f-bce7-1e1f09a9ea08\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2" Jul 06 22:20:19.323741 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:19.323587 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd9c4\" (UniqueName: \"kubernetes.io/projected/84cc739b-5305-442f-bce7-1e1f09a9ea08-kube-api-access-fd9c4\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2\" (UID: \"84cc739b-5305-442f-bce7-1e1f09a9ea08\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2" Jul 06 22:20:19.323741 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:19.323605 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84cc739b-5305-442f-bce7-1e1f09a9ea08-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2\" (UID: \"84cc739b-5305-442f-bce7-1e1f09a9ea08\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2" Jul 06 22:20:19.425039 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:19.424998 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84cc739b-5305-442f-bce7-1e1f09a9ea08-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2\" (UID: \"84cc739b-5305-442f-bce7-1e1f09a9ea08\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2" Jul 06 22:20:19.425233 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:19.425145 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84cc739b-5305-442f-bce7-1e1f09a9ea08-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2\" (UID: \"84cc739b-5305-442f-bce7-1e1f09a9ea08\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2" Jul 06 22:20:19.425233 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:19.425166 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84cc739b-5305-442f-bce7-1e1f09a9ea08-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2\" (UID: \"84cc739b-5305-442f-bce7-1e1f09a9ea08\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2" Jul 06 22:20:19.425233 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:19.425192 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84cc739b-5305-442f-bce7-1e1f09a9ea08-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2\" (UID: \"84cc739b-5305-442f-bce7-1e1f09a9ea08\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2" Jul 06 22:20:19.425233 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:19.425214 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84cc739b-5305-442f-bce7-1e1f09a9ea08-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2\" (UID: \"84cc739b-5305-442f-bce7-1e1f09a9ea08\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2" Jul 06 22:20:19.425477 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:19.425292 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd9c4\" (UniqueName: \"kubernetes.io/projected/84cc739b-5305-442f-bce7-1e1f09a9ea08-kube-api-access-fd9c4\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2\" (UID: \"84cc739b-5305-442f-bce7-1e1f09a9ea08\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2" Jul 06 22:20:19.425564 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:19.425546 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84cc739b-5305-442f-bce7-1e1f09a9ea08-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2\" (UID: \"84cc739b-5305-442f-bce7-1e1f09a9ea08\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2" Jul 06 22:20:19.425636 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:19.425613 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84cc739b-5305-442f-bce7-1e1f09a9ea08-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2\" (UID: \"84cc739b-5305-442f-bce7-1e1f09a9ea08\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2" Jul 06 22:20:19.425681 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:19.425665 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84cc739b-5305-442f-bce7-1e1f09a9ea08-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2\" (UID: \"84cc739b-5305-442f-bce7-1e1f09a9ea08\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2" Jul 06 22:20:19.427301 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:19.427279 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84cc739b-5305-442f-bce7-1e1f09a9ea08-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2\" (UID: \"84cc739b-5305-442f-bce7-1e1f09a9ea08\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2" Jul 06 22:20:19.427550 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:19.427533 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84cc739b-5305-442f-bce7-1e1f09a9ea08-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2\" (UID: \"84cc739b-5305-442f-bce7-1e1f09a9ea08\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2" Jul 06 22:20:19.433563 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:19.433537 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd9c4\" (UniqueName: \"kubernetes.io/projected/84cc739b-5305-442f-bce7-1e1f09a9ea08-kube-api-access-fd9c4\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2\" (UID: \"84cc739b-5305-442f-bce7-1e1f09a9ea08\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2" Jul 06 22:20:19.598960 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:19.598828 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2" Jul 06 22:20:19.736792 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:19.736766 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2"] Jul 06 22:20:19.738321 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:20:19.738294 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84cc739b_5305_442f_bce7_1e1f09a9ea08.slice/crio-d224efedb04aa1d68a6f52e36f43cadd84502f864d6aa4bb97cede9bd6070bd7 WatchSource:0}: Error finding container d224efedb04aa1d68a6f52e36f43cadd84502f864d6aa4bb97cede9bd6070bd7: Status 404 returned error can't find the container with id d224efedb04aa1d68a6f52e36f43cadd84502f864d6aa4bb97cede9bd6070bd7 Jul 06 22:20:20.683206 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:20.683166 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2" event={"ID":"84cc739b-5305-442f-bce7-1e1f09a9ea08","Type":"ContainerStarted","Data":"15e3f4da4333c7c6094049a50e05f3762fbad27ffdc0827a6127c66344277fa3"} Jul 06 22:20:20.683206 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:20.683213 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2" event={"ID":"84cc739b-5305-442f-bce7-1e1f09a9ea08","Type":"ContainerStarted","Data":"d224efedb04aa1d68a6f52e36f43cadd84502f864d6aa4bb97cede9bd6070bd7"} Jul 06 22:20:20.702665 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:20.702619 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2" podStartSLOduration=1.522322769 podStartE2EDuration="1.702603939s" totalImagesPullingTime="180.28117ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:20:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:20:20.701920745 +0000 UTC m=+680.556886209" watchObservedRunningTime="2026-07-06 22:20:20.702603939 +0000 UTC m=+680.557569405" Jul 06 22:20:21.601688 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:21.601656 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:20:29.599590 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:29.599549 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2" Jul 06 22:20:29.599590 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:29.599600 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2" Jul 06 22:20:29.611966 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:29.611939 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2" Jul 06 22:20:29.734712 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:20:29.734682 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2" Jul 06 22:21:46.003775 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:21:46.003727 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:21:55.294317 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:21:55.294278 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:22:06.406538 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:22:06.406501 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:22:15.733660 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:22:15.733622 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:22:26.210268 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:22:26.210180 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:22:56.324095 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:22:56.324057 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:23:07.094496 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:23:07.094460 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:23:41.495757 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:23:41.495721 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:23:48.688512 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:23:48.688484 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:23:58.702207 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:23:58.702175 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:24:00.646979 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:24:00.646954 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd89j_b55a9306-a1b1-4824-bacd-cd43906b7951/ovn-acl-logging/0.log" Jul 06 22:24:00.648125 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:24:00.648102 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd89j_b55a9306-a1b1-4824-bacd-cd43906b7951/ovn-acl-logging/0.log" Jul 06 22:24:04.402670 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:24:04.402632 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:24:15.787194 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:24:15.787156 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:24:24.399445 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:24:24.399409 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:24:36.297488 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:24:36.297445 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:24:45.506079 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:24:45.506043 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:25:08.515306 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:25:08.515268 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:25:19.602449 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:25:19.602417 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:25:43.105449 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:25:43.105363 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:25:52.997065 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:25:52.997026 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:26:10.798358 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:26:10.798323 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:26:19.312376 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:26:19.312336 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:26:28.702922 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:26:28.702883 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:26:38.301650 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:26:38.301616 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:26:48.993176 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:26:48.993137 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:28:36.016997 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:28:36.016921 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:28:47.109576 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:28:47.109540 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:28:55.507992 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:28:55.507955 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:29:00.675236 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:29:00.675204 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd89j_b55a9306-a1b1-4824-bacd-cd43906b7951/ovn-acl-logging/0.log" Jul 06 22:29:00.677746 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:29:00.677723 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd89j_b55a9306-a1b1-4824-bacd-cd43906b7951/ovn-acl-logging/0.log" Jul 06 22:29:05.802355 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:29:05.802313 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:29:16.198496 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:29:16.198460 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:29:27.895580 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:29:27.895544 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:29:36.425560 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:29:36.425518 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:29:47.409571 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:29:47.409532 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:29:58.708533 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:29:58.708433 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:30:07.602071 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:30:07.602034 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:30:17.713116 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:30:17.713083 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:30:42.600152 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:30:42.600111 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:30:49.508245 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:30:49.508201 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:30:58.300899 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:30:58.300861 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:31:08.700059 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:31:08.700027 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:31:27.429911 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:31:27.429791 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:31:37.798897 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:31:37.798855 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:31:46.500763 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:31:46.500722 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:31:57.604365 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:31:57.604329 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:32:06.312929 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:32:06.312893 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:32:15.595933 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:32:15.595902 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:32:29.188723 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:32:29.188687 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:32:38.092767 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:32:38.092728 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:32:47.199196 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:32:47.199163 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:32:58.039803 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:32:58.039704 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:33:09.795280 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:33:09.795244 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:33:16.522836 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:33:16.522801 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:33:30.600615 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:33:30.600580 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:33:41.391980 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:33:41.391949 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:33:50.092435 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:33:50.092400 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:33:57.204283 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:33:57.204241 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:34:00.704264 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:34:00.704233 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd89j_b55a9306-a1b1-4824-bacd-cd43906b7951/ovn-acl-logging/0.log" Jul 06 22:34:00.706520 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:34:00.706497 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd89j_b55a9306-a1b1-4824-bacd-cd43906b7951/ovn-acl-logging/0.log" Jul 06 22:34:09.694870 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:34:09.694821 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:34:23.248662 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:34:23.248569 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:34:33.185993 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:34:33.185956 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:34:45.195092 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:34:45.195060 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:35:05.094661 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:35:05.094625 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:35:16.703943 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:35:16.703906 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:36:34.695651 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:36:34.695608 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:36:42.387727 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:36:42.387692 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:36:50.596831 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:36:50.596787 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:37:01.893871 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:37:01.893828 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:37:13.498635 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:37:13.498597 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:37:38.789724 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:37:38.789643 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:38:03.598750 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:38:03.598709 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:38:25.991753 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:38:25.991715 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:38:40.898344 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:38:40.898312 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:39:00.732490 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:39:00.732460 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd89j_b55a9306-a1b1-4824-bacd-cd43906b7951/ovn-acl-logging/0.log" Jul 06 22:39:00.735662 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:39:00.735642 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd89j_b55a9306-a1b1-4824-bacd-cd43906b7951/ovn-acl-logging/0.log" Jul 06 22:39:20.994242 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:39:20.994189 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:39:34.095732 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:39:34.095693 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:39:42.691273 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:39:42.691239 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:40:30.293400 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:30.293317 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:40:43.595932 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:43.595896 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:40:48.213061 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:48.213029 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78"] Jul 06 22:40:48.216200 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:48.216181 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" Jul 06 22:40:48.220140 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:48.220107 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-17b26a\"/\"default-dockercfg-986jj\"" Jul 06 22:40:48.220277 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:48.220189 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-17b26a\"/\"kube-root-ca.crt\"" Jul 06 22:40:48.220345 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:48.220322 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-17b26a\"/\"test-model-17b26a-kserve-self-signed-certs\"" Jul 06 22:40:48.220401 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:48.220381 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-17b26a\"/\"openshift-service-ca.crt\"" Jul 06 22:40:48.226329 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:48.226300 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78"] Jul 06 22:40:48.311192 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:48.311153 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74f1446e-1fb1-4558-a555-78c1a66350fc-tmp-dir\") pod \"test-model-17b26a-kserve-6477746987-llx78\" (UID: \"74f1446e-1fb1-4558-a555-78c1a66350fc\") " pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" Jul 06 22:40:48.311192 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:48.311195 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74f1446e-1fb1-4558-a555-78c1a66350fc-home\") pod \"test-model-17b26a-kserve-6477746987-llx78\" (UID: \"74f1446e-1fb1-4558-a555-78c1a66350fc\") " pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" Jul 06 22:40:48.311447 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:48.311219 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv2rr\" (UniqueName: \"kubernetes.io/projected/74f1446e-1fb1-4558-a555-78c1a66350fc-kube-api-access-hv2rr\") pod \"test-model-17b26a-kserve-6477746987-llx78\" (UID: \"74f1446e-1fb1-4558-a555-78c1a66350fc\") " pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" Jul 06 22:40:48.311447 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:48.311325 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74f1446e-1fb1-4558-a555-78c1a66350fc-dshm\") pod \"test-model-17b26a-kserve-6477746987-llx78\" (UID: \"74f1446e-1fb1-4558-a555-78c1a66350fc\") " pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" Jul 06 22:40:48.311447 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:48.311368 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74f1446e-1fb1-4558-a555-78c1a66350fc-tls-certs\") pod \"test-model-17b26a-kserve-6477746987-llx78\" (UID: \"74f1446e-1fb1-4558-a555-78c1a66350fc\") " pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" Jul 06 22:40:48.311447 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:48.311434 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74f1446e-1fb1-4558-a555-78c1a66350fc-model-cache\") pod \"test-model-17b26a-kserve-6477746987-llx78\" (UID: \"74f1446e-1fb1-4558-a555-78c1a66350fc\") " pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" Jul 06 22:40:48.412200 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:48.412163 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74f1446e-1fb1-4558-a555-78c1a66350fc-tls-certs\") pod \"test-model-17b26a-kserve-6477746987-llx78\" (UID: \"74f1446e-1fb1-4558-a555-78c1a66350fc\") " pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" Jul 06 22:40:48.412200 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:48.412205 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74f1446e-1fb1-4558-a555-78c1a66350fc-model-cache\") pod \"test-model-17b26a-kserve-6477746987-llx78\" (UID: \"74f1446e-1fb1-4558-a555-78c1a66350fc\") " pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" Jul 06 22:40:48.412414 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:48.412303 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74f1446e-1fb1-4558-a555-78c1a66350fc-tmp-dir\") pod \"test-model-17b26a-kserve-6477746987-llx78\" (UID: \"74f1446e-1fb1-4558-a555-78c1a66350fc\") " pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" Jul 06 22:40:48.412414 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:48.412336 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74f1446e-1fb1-4558-a555-78c1a66350fc-home\") pod \"test-model-17b26a-kserve-6477746987-llx78\" (UID: \"74f1446e-1fb1-4558-a555-78c1a66350fc\") " pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" Jul 06 22:40:48.412414 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:48.412358 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv2rr\" (UniqueName: \"kubernetes.io/projected/74f1446e-1fb1-4558-a555-78c1a66350fc-kube-api-access-hv2rr\") pod \"test-model-17b26a-kserve-6477746987-llx78\" (UID: \"74f1446e-1fb1-4558-a555-78c1a66350fc\") " pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" Jul 06 22:40:48.412556 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:48.412419 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74f1446e-1fb1-4558-a555-78c1a66350fc-dshm\") pod \"test-model-17b26a-kserve-6477746987-llx78\" (UID: \"74f1446e-1fb1-4558-a555-78c1a66350fc\") " pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" Jul 06 22:40:48.412759 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:48.412734 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74f1446e-1fb1-4558-a555-78c1a66350fc-home\") pod \"test-model-17b26a-kserve-6477746987-llx78\" (UID: \"74f1446e-1fb1-4558-a555-78c1a66350fc\") " pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" Jul 06 22:40:48.412759 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:48.412748 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74f1446e-1fb1-4558-a555-78c1a66350fc-tmp-dir\") pod \"test-model-17b26a-kserve-6477746987-llx78\" (UID: \"74f1446e-1fb1-4558-a555-78c1a66350fc\") " pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" Jul 06 22:40:48.412923 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:48.412834 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74f1446e-1fb1-4558-a555-78c1a66350fc-model-cache\") pod \"test-model-17b26a-kserve-6477746987-llx78\" (UID: \"74f1446e-1fb1-4558-a555-78c1a66350fc\") " pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" Jul 06 22:40:48.414475 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:48.414453 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74f1446e-1fb1-4558-a555-78c1a66350fc-dshm\") pod \"test-model-17b26a-kserve-6477746987-llx78\" (UID: \"74f1446e-1fb1-4558-a555-78c1a66350fc\") " pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" Jul 06 22:40:48.414809 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:48.414792 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74f1446e-1fb1-4558-a555-78c1a66350fc-tls-certs\") pod \"test-model-17b26a-kserve-6477746987-llx78\" (UID: \"74f1446e-1fb1-4558-a555-78c1a66350fc\") " pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" Jul 06 22:40:48.421300 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:48.421274 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv2rr\" (UniqueName: \"kubernetes.io/projected/74f1446e-1fb1-4558-a555-78c1a66350fc-kube-api-access-hv2rr\") pod \"test-model-17b26a-kserve-6477746987-llx78\" (UID: \"74f1446e-1fb1-4558-a555-78c1a66350fc\") " pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" Jul 06 22:40:48.526404 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:48.526315 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" Jul 06 22:40:48.654446 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:48.654423 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78"] Jul 06 22:40:48.656173 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:40:48.656148 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74f1446e_1fb1_4558_a555_78c1a66350fc.slice/crio-e4d49d97f0e9a7b2dbbf327ea38fb1ae869b18f0d179b02daa44be1e6657750f WatchSource:0}: Error finding container e4d49d97f0e9a7b2dbbf327ea38fb1ae869b18f0d179b02daa44be1e6657750f: Status 404 returned error can't find the container with id e4d49d97f0e9a7b2dbbf327ea38fb1ae869b18f0d179b02daa44be1e6657750f Jul 06 22:40:49.332027 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:49.331989 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" event={"ID":"74f1446e-1fb1-4558-a555-78c1a66350fc","Type":"ContainerStarted","Data":"01e8356ea24eab0b12143a938115dca531a3a4476fb66f0a45956729696e0b30"} Jul 06 22:40:49.332027 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:49.332031 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" event={"ID":"74f1446e-1fb1-4558-a555-78c1a66350fc","Type":"ContainerStarted","Data":"e4d49d97f0e9a7b2dbbf327ea38fb1ae869b18f0d179b02daa44be1e6657750f"} Jul 06 22:40:49.350911 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:49.350867 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" podStartSLOduration=1.35085296 podStartE2EDuration="1.35085296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:40:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:40:49.34861317 +0000 UTC m=+1909.203578637" watchObservedRunningTime="2026-07-06 22:40:49.35085296 +0000 UTC m=+1909.205818419" Jul 06 22:40:54.089304 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:54.089271 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:40:58.527030 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:58.526998 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" Jul 06 22:40:58.527335 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:58.527049 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" Jul 06 22:40:58.538956 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:58.538930 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" Jul 06 22:40:59.390698 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:40:59.390665 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" Jul 06 22:41:12.983729 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:12.983691 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:41:25.692957 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:25.692919 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:41:33.499243 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:33.499208 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78"] Jul 06 22:41:38.494937 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:38.494901 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:41:48.519379 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:48.519332 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" podUID="74f1446e-1fb1-4558-a555-78c1a66350fc" containerName="main" containerID="cri-o://01e8356ea24eab0b12143a938115dca531a3a4476fb66f0a45956729696e0b30" gracePeriod=45 Jul 06 22:41:48.771809 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:48.771738 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" Jul 06 22:41:48.922274 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:48.922226 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74f1446e-1fb1-4558-a555-78c1a66350fc-home\") pod \"74f1446e-1fb1-4558-a555-78c1a66350fc\" (UID: \"74f1446e-1fb1-4558-a555-78c1a66350fc\") " Jul 06 22:41:48.922478 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:48.922302 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74f1446e-1fb1-4558-a555-78c1a66350fc-model-cache\") pod \"74f1446e-1fb1-4558-a555-78c1a66350fc\" (UID: \"74f1446e-1fb1-4558-a555-78c1a66350fc\") " Jul 06 22:41:48.922478 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:48.922331 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74f1446e-1fb1-4558-a555-78c1a66350fc-tmp-dir\") pod \"74f1446e-1fb1-4558-a555-78c1a66350fc\" (UID: \"74f1446e-1fb1-4558-a555-78c1a66350fc\") " Jul 06 22:41:48.922478 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:48.922367 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hv2rr\" (UniqueName: \"kubernetes.io/projected/74f1446e-1fb1-4558-a555-78c1a66350fc-kube-api-access-hv2rr\") pod \"74f1446e-1fb1-4558-a555-78c1a66350fc\" (UID: \"74f1446e-1fb1-4558-a555-78c1a66350fc\") " Jul 06 22:41:48.922478 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:48.922383 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74f1446e-1fb1-4558-a555-78c1a66350fc-dshm\") pod \"74f1446e-1fb1-4558-a555-78c1a66350fc\" (UID: \"74f1446e-1fb1-4558-a555-78c1a66350fc\") " Jul 06 22:41:48.922478 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:48.922412 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74f1446e-1fb1-4558-a555-78c1a66350fc-tls-certs\") pod \"74f1446e-1fb1-4558-a555-78c1a66350fc\" (UID: \"74f1446e-1fb1-4558-a555-78c1a66350fc\") " Jul 06 22:41:48.922759 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:48.922609 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74f1446e-1fb1-4558-a555-78c1a66350fc-home" (OuterVolumeSpecName: "home") pod "74f1446e-1fb1-4558-a555-78c1a66350fc" (UID: "74f1446e-1fb1-4558-a555-78c1a66350fc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:41:48.922759 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:48.922645 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74f1446e-1fb1-4558-a555-78c1a66350fc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "74f1446e-1fb1-4558-a555-78c1a66350fc" (UID: "74f1446e-1fb1-4558-a555-78c1a66350fc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:41:48.922759 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:48.922686 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74f1446e-1fb1-4558-a555-78c1a66350fc-model-cache" (OuterVolumeSpecName: "model-cache") pod "74f1446e-1fb1-4558-a555-78c1a66350fc" (UID: "74f1446e-1fb1-4558-a555-78c1a66350fc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:41:48.924694 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:48.924670 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74f1446e-1fb1-4558-a555-78c1a66350fc-kube-api-access-hv2rr" (OuterVolumeSpecName: "kube-api-access-hv2rr") pod "74f1446e-1fb1-4558-a555-78c1a66350fc" (UID: "74f1446e-1fb1-4558-a555-78c1a66350fc"). InnerVolumeSpecName "kube-api-access-hv2rr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:41:48.924694 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:48.924683 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74f1446e-1fb1-4558-a555-78c1a66350fc-dshm" (OuterVolumeSpecName: "dshm") pod "74f1446e-1fb1-4558-a555-78c1a66350fc" (UID: "74f1446e-1fb1-4558-a555-78c1a66350fc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:41:48.924868 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:48.924703 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74f1446e-1fb1-4558-a555-78c1a66350fc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "74f1446e-1fb1-4558-a555-78c1a66350fc" (UID: "74f1446e-1fb1-4558-a555-78c1a66350fc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:41:49.023283 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:49.023191 2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74f1446e-1fb1-4558-a555-78c1a66350fc-model-cache\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:41:49.023283 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:49.023223 2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74f1446e-1fb1-4558-a555-78c1a66350fc-tmp-dir\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:41:49.023283 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:49.023234 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hv2rr\" (UniqueName: \"kubernetes.io/projected/74f1446e-1fb1-4558-a555-78c1a66350fc-kube-api-access-hv2rr\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:41:49.023283 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:49.023245 2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74f1446e-1fb1-4558-a555-78c1a66350fc-dshm\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:41:49.023283 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:49.023254 2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74f1446e-1fb1-4558-a555-78c1a66350fc-tls-certs\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:41:49.023283 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:49.023263 2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74f1446e-1fb1-4558-a555-78c1a66350fc-home\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:41:49.619819 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:49.619764 2566 generic.go:356] "Generic (PLEG): container finished" podID="74f1446e-1fb1-4558-a555-78c1a66350fc" containerID="01e8356ea24eab0b12143a938115dca531a3a4476fb66f0a45956729696e0b30" exitCode=0 Jul 06 22:41:49.620328 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:49.619872 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" Jul 06 22:41:49.620328 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:49.619904 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" event={"ID":"74f1446e-1fb1-4558-a555-78c1a66350fc","Type":"ContainerDied","Data":"01e8356ea24eab0b12143a938115dca531a3a4476fb66f0a45956729696e0b30"} Jul 06 22:41:49.620328 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:49.619934 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78" event={"ID":"74f1446e-1fb1-4558-a555-78c1a66350fc","Type":"ContainerDied","Data":"e4d49d97f0e9a7b2dbbf327ea38fb1ae869b18f0d179b02daa44be1e6657750f"} Jul 06 22:41:49.620328 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:49.619950 2566 scope.go:117] "RemoveContainer" containerID="01e8356ea24eab0b12143a938115dca531a3a4476fb66f0a45956729696e0b30" Jul 06 22:41:49.629145 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:49.629124 2566 scope.go:117] "RemoveContainer" containerID="01e8356ea24eab0b12143a938115dca531a3a4476fb66f0a45956729696e0b30" Jul 06 22:41:49.629384 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:41:49.629359 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01e8356ea24eab0b12143a938115dca531a3a4476fb66f0a45956729696e0b30\": container with ID starting with 01e8356ea24eab0b12143a938115dca531a3a4476fb66f0a45956729696e0b30 not found: ID does not exist" containerID="01e8356ea24eab0b12143a938115dca531a3a4476fb66f0a45956729696e0b30" Jul 06 22:41:49.629483 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:49.629388 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e8356ea24eab0b12143a938115dca531a3a4476fb66f0a45956729696e0b30"} err="failed to get container status \"01e8356ea24eab0b12143a938115dca531a3a4476fb66f0a45956729696e0b30\": rpc error: code = NotFound desc = could not find container \"01e8356ea24eab0b12143a938115dca531a3a4476fb66f0a45956729696e0b30\": container with ID starting with 01e8356ea24eab0b12143a938115dca531a3a4476fb66f0a45956729696e0b30 not found: ID does not exist" Jul 06 22:41:49.641554 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:49.641529 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78"] Jul 06 22:41:49.646980 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:49.646955 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-17b26a/test-model-17b26a-kserve-6477746987-llx78"] Jul 06 22:41:50.727344 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:41:50.727310 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74f1446e-1fb1-4558-a555-78c1a66350fc" path="/var/lib/kubelet/pods/74f1446e-1fb1-4558-a555-78c1a66350fc/volumes" Jul 06 22:42:21.101244 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:42:21.101205 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:42:35.795702 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:42:35.795659 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:42:51.188902 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:42:51.188862 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:43:05.588569 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:43:05.588532 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:43:17.797802 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:43:17.797758 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:43:32.687238 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:43:32.687143 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:44:00.762181 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:44:00.762153 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd89j_b55a9306-a1b1-4824-bacd-cd43906b7951/ovn-acl-logging/0.log" Jul 06 22:44:00.766082 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:44:00.766061 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd89j_b55a9306-a1b1-4824-bacd-cd43906b7951/ovn-acl-logging/0.log" Jul 06 22:44:00.988888 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:44:00.988834 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:44:17.884992 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:44:17.884957 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:44:32.093561 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:44:32.093526 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:44:47.688089 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:44:47.688054 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:45:00.132826 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.132787 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722965-9ncm5"] Jul 06 22:45:00.133205 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.133073 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74f1446e-1fb1-4558-a555-78c1a66350fc" containerName="main" Jul 06 22:45:00.133205 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.133084 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="74f1446e-1fb1-4558-a555-78c1a66350fc" containerName="main" Jul 06 22:45:00.133205 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.133149 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="74f1446e-1fb1-4558-a555-78c1a66350fc" containerName="main" Jul 06 22:45:00.136115 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.136091 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722965-9ncm5" Jul 06 22:45:00.137442 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.137408 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-65387d-29722965-mk275"] Jul 06 22:45:00.138468 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.138447 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-kw98h\"" Jul 06 22:45:00.140582 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.140566 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-944f9f-29722965-fpkvl"] Jul 06 22:45:00.140691 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.140674 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-65387d-29722965-mk275" Jul 06 22:45:00.143546 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.143522 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-944f9f-29722965-fpkvl" Jul 06 22:45:00.146446 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.146424 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722965-9ncm5"] Jul 06 22:45:00.149816 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.149793 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-65387d-29722965-mk275"] Jul 06 22:45:00.151866 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.151832 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-944f9f-29722965-fpkvl"] Jul 06 22:45:00.206101 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.206067 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvczx\" (UniqueName: \"kubernetes.io/projected/a75d4bb2-459c-4ffd-92ba-a3a26b7d9e3c-kube-api-access-rvczx\") pod \"maas-api-key-cleanup-29722965-9ncm5\" (UID: \"a75d4bb2-459c-4ffd-92ba-a3a26b7d9e3c\") " pod="opendatahub/maas-api-key-cleanup-29722965-9ncm5" Jul 06 22:45:00.206101 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.206102 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7btx\" (UniqueName: \"kubernetes.io/projected/7f4fe6b2-8bfa-4a51-a2f5-d82f71fdaab1-kube-api-access-l7btx\") pod \"maas-api-key-cleanup-e2e-shared-a-65387d-29722965-mk275\" (UID: \"7f4fe6b2-8bfa-4a51-a2f5-d82f71fdaab1\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-65387d-29722965-mk275" Jul 06 22:45:00.307342 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.307312 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvczx\" (UniqueName: \"kubernetes.io/projected/a75d4bb2-459c-4ffd-92ba-a3a26b7d9e3c-kube-api-access-rvczx\") pod \"maas-api-key-cleanup-29722965-9ncm5\" (UID: \"a75d4bb2-459c-4ffd-92ba-a3a26b7d9e3c\") " pod="opendatahub/maas-api-key-cleanup-29722965-9ncm5" Jul 06 22:45:00.307465 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.307347 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7btx\" (UniqueName: \"kubernetes.io/projected/7f4fe6b2-8bfa-4a51-a2f5-d82f71fdaab1-kube-api-access-l7btx\") pod \"maas-api-key-cleanup-e2e-shared-a-65387d-29722965-mk275\" (UID: \"7f4fe6b2-8bfa-4a51-a2f5-d82f71fdaab1\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-65387d-29722965-mk275" Jul 06 22:45:00.307465 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.307394 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zff5t\" (UniqueName: \"kubernetes.io/projected/76a1d3a6-fe5a-4235-993a-3000cd59621b-kube-api-access-zff5t\") pod \"maas-api-key-cleanup-e2e-shared-b-944f9f-29722965-fpkvl\" (UID: \"76a1d3a6-fe5a-4235-993a-3000cd59621b\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-944f9f-29722965-fpkvl" Jul 06 22:45:00.316037 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.316005 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7btx\" (UniqueName: \"kubernetes.io/projected/7f4fe6b2-8bfa-4a51-a2f5-d82f71fdaab1-kube-api-access-l7btx\") pod \"maas-api-key-cleanup-e2e-shared-a-65387d-29722965-mk275\" (UID: \"7f4fe6b2-8bfa-4a51-a2f5-d82f71fdaab1\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-65387d-29722965-mk275" Jul 06 22:45:00.316219 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.316196 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvczx\" (UniqueName: \"kubernetes.io/projected/a75d4bb2-459c-4ffd-92ba-a3a26b7d9e3c-kube-api-access-rvczx\") pod \"maas-api-key-cleanup-29722965-9ncm5\" (UID: \"a75d4bb2-459c-4ffd-92ba-a3a26b7d9e3c\") " pod="opendatahub/maas-api-key-cleanup-29722965-9ncm5" Jul 06 22:45:00.408243 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.408177 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zff5t\" (UniqueName: \"kubernetes.io/projected/76a1d3a6-fe5a-4235-993a-3000cd59621b-kube-api-access-zff5t\") pod \"maas-api-key-cleanup-e2e-shared-b-944f9f-29722965-fpkvl\" (UID: \"76a1d3a6-fe5a-4235-993a-3000cd59621b\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-944f9f-29722965-fpkvl" Jul 06 22:45:00.415974 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.415956 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zff5t\" (UniqueName: \"kubernetes.io/projected/76a1d3a6-fe5a-4235-993a-3000cd59621b-kube-api-access-zff5t\") pod \"maas-api-key-cleanup-e2e-shared-b-944f9f-29722965-fpkvl\" (UID: \"76a1d3a6-fe5a-4235-993a-3000cd59621b\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-944f9f-29722965-fpkvl" Jul 06 22:45:00.448896 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.448863 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722965-9ncm5" Jul 06 22:45:00.458047 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.457986 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-65387d-29722965-mk275" Jul 06 22:45:00.467834 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.467810 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-944f9f-29722965-fpkvl" Jul 06 22:45:00.602606 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.602573 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722965-9ncm5"] Jul 06 22:45:00.606318 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:45:00.606293 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda75d4bb2_459c_4ffd_92ba_a3a26b7d9e3c.slice/crio-d88e38da4dd36d28ea76b307a6ac136b72ef0c5546f3f532fc9d6c5f65d6061d WatchSource:0}: Error finding container d88e38da4dd36d28ea76b307a6ac136b72ef0c5546f3f532fc9d6c5f65d6061d: Status 404 returned error can't find the container with id d88e38da4dd36d28ea76b307a6ac136b72ef0c5546f3f532fc9d6c5f65d6061d Jul 06 22:45:00.608576 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.608557 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 22:45:00.829961 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.829936 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-944f9f-29722965-fpkvl"] Jul 06 22:45:00.831612 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:45:00.831571 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76a1d3a6_fe5a_4235_993a_3000cd59621b.slice/crio-10fd1f1196449398bdfb68fa946e4c9eb63e6ba7730d87cb4dde7142123d9d05 WatchSource:0}: Error finding container 10fd1f1196449398bdfb68fa946e4c9eb63e6ba7730d87cb4dde7142123d9d05: Status 404 returned error can't find the container with id 10fd1f1196449398bdfb68fa946e4c9eb63e6ba7730d87cb4dde7142123d9d05 Jul 06 22:45:00.832328 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:00.832305 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-65387d-29722965-mk275"] Jul 06 22:45:00.833393 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:45:00.833373 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f4fe6b2_8bfa_4a51_a2f5_d82f71fdaab1.slice/crio-c9764211d305230d4032c77a1968be75067d1a41effcb9e620e11dfb68debdc1 WatchSource:0}: Error finding container c9764211d305230d4032c77a1968be75067d1a41effcb9e620e11dfb68debdc1: Status 404 returned error can't find the container with id c9764211d305230d4032c77a1968be75067d1a41effcb9e620e11dfb68debdc1 Jul 06 22:45:01.000718 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:01.000687 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:45:01.495479 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:01.495437 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-65387d-29722965-mk275" event={"ID":"7f4fe6b2-8bfa-4a51-a2f5-d82f71fdaab1","Type":"ContainerStarted","Data":"c9764211d305230d4032c77a1968be75067d1a41effcb9e620e11dfb68debdc1"} Jul 06 22:45:01.496646 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:01.496627 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-944f9f-29722965-fpkvl" event={"ID":"76a1d3a6-fe5a-4235-993a-3000cd59621b","Type":"ContainerStarted","Data":"10fd1f1196449398bdfb68fa946e4c9eb63e6ba7730d87cb4dde7142123d9d05"} Jul 06 22:45:01.497680 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:01.497657 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722965-9ncm5" event={"ID":"a75d4bb2-459c-4ffd-92ba-a3a26b7d9e3c","Type":"ContainerStarted","Data":"d88e38da4dd36d28ea76b307a6ac136b72ef0c5546f3f532fc9d6c5f65d6061d"} Jul 06 22:45:03.508722 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:03.508683 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-65387d-29722965-mk275" event={"ID":"7f4fe6b2-8bfa-4a51-a2f5-d82f71fdaab1","Type":"ContainerStarted","Data":"00a51527fbff9ee8b499fdccfed642b44335fba816dda66848bdaae4ab0ed9ac"} Jul 06 22:45:03.510157 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:03.510135 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-944f9f-29722965-fpkvl" event={"ID":"76a1d3a6-fe5a-4235-993a-3000cd59621b","Type":"ContainerStarted","Data":"5789c69e7d81c0f713162f7be648300fc8118ff761fa41b65079c46c7e115d04"} Jul 06 22:45:03.523410 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:03.523312 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-65387d-29722965-mk275" podStartSLOduration=1.384683313 podStartE2EDuration="3.523297848s" totalImagesPullingTime="2.138614535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:45:03.52283128 +0000 UTC m=+2163.377796747" watchObservedRunningTime="2026-07-06 22:45:03.523297848 +0000 UTC m=+2163.378263314" Jul 06 22:45:03.543580 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:03.543522 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-944f9f-29722965-fpkvl" podStartSLOduration=1.406611909 podStartE2EDuration="3.543508134s" totalImagesPullingTime="2.136896225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:45:03.542298094 +0000 UTC m=+2163.397263564" watchObservedRunningTime="2026-07-06 22:45:03.543508134 +0000 UTC m=+2163.398473578" Jul 06 22:45:04.516568 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:04.516518 2566 generic.go:356] "Generic (PLEG): container finished" podID="7f4fe6b2-8bfa-4a51-a2f5-d82f71fdaab1" containerID="00a51527fbff9ee8b499fdccfed642b44335fba816dda66848bdaae4ab0ed9ac" exitCode=0 Jul 06 22:45:04.517049 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:04.516574 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-65387d-29722965-mk275" event={"ID":"7f4fe6b2-8bfa-4a51-a2f5-d82f71fdaab1","Type":"ContainerDied","Data":"00a51527fbff9ee8b499fdccfed642b44335fba816dda66848bdaae4ab0ed9ac"} Jul 06 22:45:04.518134 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:04.518105 2566 generic.go:356] "Generic (PLEG): container finished" podID="76a1d3a6-fe5a-4235-993a-3000cd59621b" containerID="5789c69e7d81c0f713162f7be648300fc8118ff761fa41b65079c46c7e115d04" exitCode=0 Jul 06 22:45:04.518251 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:04.518164 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-944f9f-29722965-fpkvl" event={"ID":"76a1d3a6-fe5a-4235-993a-3000cd59621b","Type":"ContainerDied","Data":"5789c69e7d81c0f713162f7be648300fc8118ff761fa41b65079c46c7e115d04"} Jul 06 22:45:05.658323 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:05.658297 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-944f9f-29722965-fpkvl" Jul 06 22:45:05.677238 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:05.677205 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-65387d-29722965-mk275" Jul 06 22:45:05.756039 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:05.755992 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zff5t\" (UniqueName: \"kubernetes.io/projected/76a1d3a6-fe5a-4235-993a-3000cd59621b-kube-api-access-zff5t\") pod \"76a1d3a6-fe5a-4235-993a-3000cd59621b\" (UID: \"76a1d3a6-fe5a-4235-993a-3000cd59621b\") " Jul 06 22:45:05.756238 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:05.756060 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7btx\" (UniqueName: \"kubernetes.io/projected/7f4fe6b2-8bfa-4a51-a2f5-d82f71fdaab1-kube-api-access-l7btx\") pod \"7f4fe6b2-8bfa-4a51-a2f5-d82f71fdaab1\" (UID: \"7f4fe6b2-8bfa-4a51-a2f5-d82f71fdaab1\") " Jul 06 22:45:05.758235 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:05.758207 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76a1d3a6-fe5a-4235-993a-3000cd59621b-kube-api-access-zff5t" (OuterVolumeSpecName: "kube-api-access-zff5t") pod "76a1d3a6-fe5a-4235-993a-3000cd59621b" (UID: "76a1d3a6-fe5a-4235-993a-3000cd59621b"). InnerVolumeSpecName "kube-api-access-zff5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:45:05.758379 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:05.758278 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f4fe6b2-8bfa-4a51-a2f5-d82f71fdaab1-kube-api-access-l7btx" (OuterVolumeSpecName: "kube-api-access-l7btx") pod "7f4fe6b2-8bfa-4a51-a2f5-d82f71fdaab1" (UID: "7f4fe6b2-8bfa-4a51-a2f5-d82f71fdaab1"). InnerVolumeSpecName "kube-api-access-l7btx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:45:05.856993 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:05.856893 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7btx\" (UniqueName: \"kubernetes.io/projected/7f4fe6b2-8bfa-4a51-a2f5-d82f71fdaab1-kube-api-access-l7btx\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:45:05.856993 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:05.856934 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zff5t\" (UniqueName: \"kubernetes.io/projected/76a1d3a6-fe5a-4235-993a-3000cd59621b-kube-api-access-zff5t\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:45:06.528708 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:06.528677 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-944f9f-29722965-fpkvl" Jul 06 22:45:06.528931 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:06.528722 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-944f9f-29722965-fpkvl" event={"ID":"76a1d3a6-fe5a-4235-993a-3000cd59621b","Type":"ContainerDied","Data":"10fd1f1196449398bdfb68fa946e4c9eb63e6ba7730d87cb4dde7142123d9d05"} Jul 06 22:45:06.528931 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:06.528778 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="10fd1f1196449398bdfb68fa946e4c9eb63e6ba7730d87cb4dde7142123d9d05" Jul 06 22:45:06.529994 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:06.529966 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-65387d-29722965-mk275" event={"ID":"7f4fe6b2-8bfa-4a51-a2f5-d82f71fdaab1","Type":"ContainerDied","Data":"c9764211d305230d4032c77a1968be75067d1a41effcb9e620e11dfb68debdc1"} Jul 06 22:45:06.530108 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:06.529997 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-65387d-29722965-mk275" Jul 06 22:45:06.530108 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:06.530015 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9764211d305230d4032c77a1968be75067d1a41effcb9e620e11dfb68debdc1" Jul 06 22:45:08.541073 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:08.541035 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722965-9ncm5" event={"ID":"a75d4bb2-459c-4ffd-92ba-a3a26b7d9e3c","Type":"ContainerStarted","Data":"89eb0c13a376b758292a3afdddd72c81ecefab0b1cfe01744ff932ad83c9a0e5"} Jul 06 22:45:08.557334 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:08.557290 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722965-9ncm5" podStartSLOduration=1.179396179 podStartE2EDuration="8.557274866s" totalImagesPullingTime="7.377878687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:45:08.555477837 +0000 UTC m=+2168.410443317" watchObservedRunningTime="2026-07-06 22:45:08.557274866 +0000 UTC m=+2168.412240332" Jul 06 22:45:09.547119 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:09.547089 2566 generic.go:356] "Generic (PLEG): container finished" podID="a75d4bb2-459c-4ffd-92ba-a3a26b7d9e3c" containerID="89eb0c13a376b758292a3afdddd72c81ecefab0b1cfe01744ff932ad83c9a0e5" exitCode=0 Jul 06 22:45:09.547517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:09.547182 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722965-9ncm5" event={"ID":"a75d4bb2-459c-4ffd-92ba-a3a26b7d9e3c","Type":"ContainerDied","Data":"89eb0c13a376b758292a3afdddd72c81ecefab0b1cfe01744ff932ad83c9a0e5"} Jul 06 22:45:10.679030 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:10.679007 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722965-9ncm5" Jul 06 22:45:10.801678 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:10.801648 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvczx\" (UniqueName: \"kubernetes.io/projected/a75d4bb2-459c-4ffd-92ba-a3a26b7d9e3c-kube-api-access-rvczx\") pod \"a75d4bb2-459c-4ffd-92ba-a3a26b7d9e3c\" (UID: \"a75d4bb2-459c-4ffd-92ba-a3a26b7d9e3c\") " Jul 06 22:45:10.803633 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:10.803572 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a75d4bb2-459c-4ffd-92ba-a3a26b7d9e3c-kube-api-access-rvczx" (OuterVolumeSpecName: "kube-api-access-rvczx") pod "a75d4bb2-459c-4ffd-92ba-a3a26b7d9e3c" (UID: "a75d4bb2-459c-4ffd-92ba-a3a26b7d9e3c"). InnerVolumeSpecName "kube-api-access-rvczx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:45:10.902109 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:10.902078 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvczx\" (UniqueName: \"kubernetes.io/projected/a75d4bb2-459c-4ffd-92ba-a3a26b7d9e3c-kube-api-access-rvczx\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:45:11.557734 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:11.557690 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722965-9ncm5" event={"ID":"a75d4bb2-459c-4ffd-92ba-a3a26b7d9e3c","Type":"ContainerDied","Data":"d88e38da4dd36d28ea76b307a6ac136b72ef0c5546f3f532fc9d6c5f65d6061d"} Jul 06 22:45:11.557734 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:11.557720 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722965-9ncm5" Jul 06 22:45:11.557956 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:11.557755 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d88e38da4dd36d28ea76b307a6ac136b72ef0c5546f3f532fc9d6c5f65d6061d" Jul 06 22:45:18.199686 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:18.199652 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:45:35.587668 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:35.587636 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:45:52.088601 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:52.088568 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:45:58.494341 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.494305 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6"] Jul 06 22:45:58.494793 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.494597 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a75d4bb2-459c-4ffd-92ba-a3a26b7d9e3c" containerName="cleanup" Jul 06 22:45:58.494793 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.494608 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a75d4bb2-459c-4ffd-92ba-a3a26b7d9e3c" containerName="cleanup" Jul 06 22:45:58.494793 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.494625 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76a1d3a6-fe5a-4235-993a-3000cd59621b" containerName="cleanup" Jul 06 22:45:58.494793 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.494630 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="76a1d3a6-fe5a-4235-993a-3000cd59621b" containerName="cleanup" Jul 06 22:45:58.494793 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.494640 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f4fe6b2-8bfa-4a51-a2f5-d82f71fdaab1" containerName="cleanup" Jul 06 22:45:58.494793 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.494646 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f4fe6b2-8bfa-4a51-a2f5-d82f71fdaab1" containerName="cleanup" Jul 06 22:45:58.494793 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.494713 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a75d4bb2-459c-4ffd-92ba-a3a26b7d9e3c" containerName="cleanup" Jul 06 22:45:58.494793 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.494720 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="76a1d3a6-fe5a-4235-993a-3000cd59621b" containerName="cleanup" Jul 06 22:45:58.494793 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.494725 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f4fe6b2-8bfa-4a51-a2f5-d82f71fdaab1" containerName="cleanup" Jul 06 22:45:58.497715 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.497696 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" Jul 06 22:45:58.501306 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.501284 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-65387d\"/\"kube-root-ca.crt\"" Jul 06 22:45:58.501306 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.501296 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-65387d\"/\"sub-test-model-65387d-kserve-self-signed-certs\"" Jul 06 22:45:58.501306 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.501304 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-65387d\"/\"default-dockercfg-6qls2\"" Jul 06 22:45:58.501477 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.501285 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-65387d\"/\"openshift-service-ca.crt\"" Jul 06 22:45:58.508557 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.508537 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6"] Jul 06 22:45:58.575187 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.575163 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-home\") pod \"sub-test-model-65387d-kserve-5556956497-qdbs6\" (UID: \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\") " pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" Jul 06 22:45:58.575297 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.575196 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-tls-certs\") pod \"sub-test-model-65387d-kserve-5556956497-qdbs6\" (UID: \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\") " pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" Jul 06 22:45:58.575297 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.575230 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-dshm\") pod \"sub-test-model-65387d-kserve-5556956497-qdbs6\" (UID: \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\") " pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" Jul 06 22:45:58.575297 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.575283 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8mj9\" (UniqueName: \"kubernetes.io/projected/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-kube-api-access-g8mj9\") pod \"sub-test-model-65387d-kserve-5556956497-qdbs6\" (UID: \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\") " pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" Jul 06 22:45:58.575441 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.575329 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-tmp-dir\") pod \"sub-test-model-65387d-kserve-5556956497-qdbs6\" (UID: \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\") " pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" Jul 06 22:45:58.575441 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.575391 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-model-cache\") pod \"sub-test-model-65387d-kserve-5556956497-qdbs6\" (UID: \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\") " pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" Jul 06 22:45:58.676456 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.676425 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-dshm\") pod \"sub-test-model-65387d-kserve-5556956497-qdbs6\" (UID: \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\") " pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" Jul 06 22:45:58.676591 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.676463 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8mj9\" (UniqueName: \"kubernetes.io/projected/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-kube-api-access-g8mj9\") pod \"sub-test-model-65387d-kserve-5556956497-qdbs6\" (UID: \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\") " pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" Jul 06 22:45:58.676591 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.676488 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-tmp-dir\") pod \"sub-test-model-65387d-kserve-5556956497-qdbs6\" (UID: \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\") " pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" Jul 06 22:45:58.676591 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.676522 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-model-cache\") pod \"sub-test-model-65387d-kserve-5556956497-qdbs6\" (UID: \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\") " pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" Jul 06 22:45:58.676591 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.676545 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-home\") pod \"sub-test-model-65387d-kserve-5556956497-qdbs6\" (UID: \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\") " pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" Jul 06 22:45:58.676591 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.676565 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-tls-certs\") pod \"sub-test-model-65387d-kserve-5556956497-qdbs6\" (UID: \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\") " pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" Jul 06 22:45:58.676942 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.676920 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-tmp-dir\") pod \"sub-test-model-65387d-kserve-5556956497-qdbs6\" (UID: \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\") " pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" Jul 06 22:45:58.677014 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.676959 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-model-cache\") pod \"sub-test-model-65387d-kserve-5556956497-qdbs6\" (UID: \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\") " pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" Jul 06 22:45:58.677014 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.676977 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-home\") pod \"sub-test-model-65387d-kserve-5556956497-qdbs6\" (UID: \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\") " pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" Jul 06 22:45:58.678608 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.678586 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-dshm\") pod \"sub-test-model-65387d-kserve-5556956497-qdbs6\" (UID: \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\") " pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" Jul 06 22:45:58.678872 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.678855 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-tls-certs\") pod \"sub-test-model-65387d-kserve-5556956497-qdbs6\" (UID: \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\") " pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" Jul 06 22:45:58.684206 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.684183 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8mj9\" (UniqueName: \"kubernetes.io/projected/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-kube-api-access-g8mj9\") pod \"sub-test-model-65387d-kserve-5556956497-qdbs6\" (UID: \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\") " pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" Jul 06 22:45:58.806909 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.806798 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" Jul 06 22:45:58.932525 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:58.932501 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6"] Jul 06 22:45:58.934117 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:45:58.934090 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef1ffd2d_9eea_49f6_9e36_e634de1cf76d.slice/crio-f3ebdbf22bef4aad65be82dafa3fedb8562eb49629eb14621fd27eb4813adb64 WatchSource:0}: Error finding container f3ebdbf22bef4aad65be82dafa3fedb8562eb49629eb14621fd27eb4813adb64: Status 404 returned error can't find the container with id f3ebdbf22bef4aad65be82dafa3fedb8562eb49629eb14621fd27eb4813adb64 Jul 06 22:45:59.785883 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:59.785824 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" event={"ID":"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d","Type":"ContainerStarted","Data":"fe25d5c7d55b2b949c86a7622b222aee24507fc2ad8f5f8d0539b0544021689b"} Jul 06 22:45:59.786322 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:59.785892 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" event={"ID":"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d","Type":"ContainerStarted","Data":"f3ebdbf22bef4aad65be82dafa3fedb8562eb49629eb14621fd27eb4813adb64"} Jul 06 22:45:59.801599 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:45:59.801546 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" podStartSLOduration=1.80152801 podStartE2EDuration="1.80152801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:45:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:45:59.800871327 +0000 UTC m=+2219.655836786" watchObservedRunningTime="2026-07-06 22:45:59.80152801 +0000 UTC m=+2219.656493477" Jul 06 22:46:08.807513 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:46:08.807479 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" Jul 06 22:46:08.807933 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:46:08.807531 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" Jul 06 22:46:08.819664 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:46:08.819640 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" Jul 06 22:46:08.842661 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:46:08.842620 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" Jul 06 22:46:10.394792 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:46:10.394755 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:46:25.390762 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:46:25.390678 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:46:58.595200 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:46:58.595164 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:47:15.591021 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:15.590978 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:47:20.907455 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:20.907415 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6"] Jul 06 22:47:32.891763 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:32.891730 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:47:35.927297 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:35.927227 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" podUID="ef1ffd2d-9eea-49f6-9e36-e634de1cf76d" containerName="main" containerID="cri-o://fe25d5c7d55b2b949c86a7622b222aee24507fc2ad8f5f8d0539b0544021689b" gracePeriod=45 Jul 06 22:47:36.177874 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.177800 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" Jul 06 22:47:36.247090 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.247051 2566 generic.go:356] "Generic (PLEG): container finished" podID="ef1ffd2d-9eea-49f6-9e36-e634de1cf76d" containerID="fe25d5c7d55b2b949c86a7622b222aee24507fc2ad8f5f8d0539b0544021689b" exitCode=0 Jul 06 22:47:36.247090 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.247096 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" event={"ID":"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d","Type":"ContainerDied","Data":"fe25d5c7d55b2b949c86a7622b222aee24507fc2ad8f5f8d0539b0544021689b"} Jul 06 22:47:36.247323 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.247106 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" Jul 06 22:47:36.247323 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.247128 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6" event={"ID":"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d","Type":"ContainerDied","Data":"f3ebdbf22bef4aad65be82dafa3fedb8562eb49629eb14621fd27eb4813adb64"} Jul 06 22:47:36.247323 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.247151 2566 scope.go:117] "RemoveContainer" containerID="fe25d5c7d55b2b949c86a7622b222aee24507fc2ad8f5f8d0539b0544021689b" Jul 06 22:47:36.255260 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.255240 2566 scope.go:117] "RemoveContainer" containerID="fe25d5c7d55b2b949c86a7622b222aee24507fc2ad8f5f8d0539b0544021689b" Jul 06 22:47:36.255550 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:47:36.255530 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe25d5c7d55b2b949c86a7622b222aee24507fc2ad8f5f8d0539b0544021689b\": container with ID starting with fe25d5c7d55b2b949c86a7622b222aee24507fc2ad8f5f8d0539b0544021689b not found: ID does not exist" containerID="fe25d5c7d55b2b949c86a7622b222aee24507fc2ad8f5f8d0539b0544021689b" Jul 06 22:47:36.255618 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.255558 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe25d5c7d55b2b949c86a7622b222aee24507fc2ad8f5f8d0539b0544021689b"} err="failed to get container status \"fe25d5c7d55b2b949c86a7622b222aee24507fc2ad8f5f8d0539b0544021689b\": rpc error: code = NotFound desc = could not find container \"fe25d5c7d55b2b949c86a7622b222aee24507fc2ad8f5f8d0539b0544021689b\": container with ID starting with fe25d5c7d55b2b949c86a7622b222aee24507fc2ad8f5f8d0539b0544021689b not found: ID does not exist" Jul 06 22:47:36.269805 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.269783 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-home\") pod \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\" (UID: \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\") " Jul 06 22:47:36.269920 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.269870 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-tls-certs\") pod \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\" (UID: \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\") " Jul 06 22:47:36.269981 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.269919 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-dshm\") pod \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\" (UID: \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\") " Jul 06 22:47:36.270036 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.269982 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-tmp-dir\") pod \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\" (UID: \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\") " Jul 06 22:47:36.270088 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.270029 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-home" (OuterVolumeSpecName: "home") pod "ef1ffd2d-9eea-49f6-9e36-e634de1cf76d" (UID: "ef1ffd2d-9eea-49f6-9e36-e634de1cf76d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:47:36.270088 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.270033 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-model-cache\") pod \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\" (UID: \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\") " Jul 06 22:47:36.270088 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.270083 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8mj9\" (UniqueName: \"kubernetes.io/projected/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-kube-api-access-g8mj9\") pod \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\" (UID: \"ef1ffd2d-9eea-49f6-9e36-e634de1cf76d\") " Jul 06 22:47:36.270283 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.270260 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-model-cache" (OuterVolumeSpecName: "model-cache") pod "ef1ffd2d-9eea-49f6-9e36-e634de1cf76d" (UID: "ef1ffd2d-9eea-49f6-9e36-e634de1cf76d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:47:36.270283 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.270277 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ef1ffd2d-9eea-49f6-9e36-e634de1cf76d" (UID: "ef1ffd2d-9eea-49f6-9e36-e634de1cf76d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:47:36.270448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.270394 2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-tmp-dir\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:47:36.270448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.270406 2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-model-cache\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:47:36.270448 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.270414 2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-home\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:47:36.272057 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.272033 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ef1ffd2d-9eea-49f6-9e36-e634de1cf76d" (UID: "ef1ffd2d-9eea-49f6-9e36-e634de1cf76d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:47:36.272133 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.272036 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-dshm" (OuterVolumeSpecName: "dshm") pod "ef1ffd2d-9eea-49f6-9e36-e634de1cf76d" (UID: "ef1ffd2d-9eea-49f6-9e36-e634de1cf76d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:47:36.272173 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.272138 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-kube-api-access-g8mj9" (OuterVolumeSpecName: "kube-api-access-g8mj9") pod "ef1ffd2d-9eea-49f6-9e36-e634de1cf76d" (UID: "ef1ffd2d-9eea-49f6-9e36-e634de1cf76d"). InnerVolumeSpecName "kube-api-access-g8mj9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:47:36.371641 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.371601 2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-tls-certs\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:47:36.371641 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.371634 2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-dshm\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:47:36.371641 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.371646 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8mj9\" (UniqueName: \"kubernetes.io/projected/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d-kube-api-access-g8mj9\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:47:36.570348 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.570318 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6"] Jul 06 22:47:36.577896 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.577865 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-65387d/sub-test-model-65387d-kserve-5556956497-qdbs6"] Jul 06 22:47:36.728007 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:36.727973 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef1ffd2d-9eea-49f6-9e36-e634de1cf76d" path="/var/lib/kubelet/pods/ef1ffd2d-9eea-49f6-9e36-e634de1cf76d/volumes" Jul 06 22:47:47.103411 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.102687 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5"] Jul 06 22:47:47.104922 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.103958 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef1ffd2d-9eea-49f6-9e36-e634de1cf76d" containerName="main" Jul 06 22:47:47.104922 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.103991 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef1ffd2d-9eea-49f6-9e36-e634de1cf76d" containerName="main" Jul 06 22:47:47.104922 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.104150 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef1ffd2d-9eea-49f6-9e36-e634de1cf76d" containerName="main" Jul 06 22:47:47.108898 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.108870 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" Jul 06 22:47:47.112191 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.112157 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-944f9f\"/\"kube-root-ca.crt\"" Jul 06 22:47:47.112327 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.112283 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-944f9f\"/\"openshift-service-ca.crt\"" Jul 06 22:47:47.113755 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.113732 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-944f9f\"/\"rate-test-model-944f9f-kserve-self-signed-certs\"" Jul 06 22:47:47.113965 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.113745 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-944f9f\"/\"default-dockercfg-8tnxt\"" Jul 06 22:47:47.116437 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.116411 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5"] Jul 06 22:47:47.152554 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.152516 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37afe270-dc28-4915-9622-7fb4957c2570-home\") pod \"rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5\" (UID: \"37afe270-dc28-4915-9622-7fb4957c2570\") " pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" Jul 06 22:47:47.152554 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.152554 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37afe270-dc28-4915-9622-7fb4957c2570-tls-certs\") pod \"rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5\" (UID: \"37afe270-dc28-4915-9622-7fb4957c2570\") " pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" Jul 06 22:47:47.152800 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.152573 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37afe270-dc28-4915-9622-7fb4957c2570-model-cache\") pod \"rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5\" (UID: \"37afe270-dc28-4915-9622-7fb4957c2570\") " pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" Jul 06 22:47:47.152800 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.152594 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bx6v\" (UniqueName: \"kubernetes.io/projected/37afe270-dc28-4915-9622-7fb4957c2570-kube-api-access-7bx6v\") pod \"rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5\" (UID: \"37afe270-dc28-4915-9622-7fb4957c2570\") " pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" Jul 06 22:47:47.152800 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.152640 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37afe270-dc28-4915-9622-7fb4957c2570-tmp-dir\") pod \"rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5\" (UID: \"37afe270-dc28-4915-9622-7fb4957c2570\") " pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" Jul 06 22:47:47.152800 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.152689 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37afe270-dc28-4915-9622-7fb4957c2570-dshm\") pod \"rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5\" (UID: \"37afe270-dc28-4915-9622-7fb4957c2570\") " pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" Jul 06 22:47:47.253876 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.253825 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37afe270-dc28-4915-9622-7fb4957c2570-home\") pod \"rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5\" (UID: \"37afe270-dc28-4915-9622-7fb4957c2570\") " pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" Jul 06 22:47:47.254063 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.253924 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37afe270-dc28-4915-9622-7fb4957c2570-tls-certs\") pod \"rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5\" (UID: \"37afe270-dc28-4915-9622-7fb4957c2570\") " pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" Jul 06 22:47:47.254063 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.253954 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37afe270-dc28-4915-9622-7fb4957c2570-model-cache\") pod \"rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5\" (UID: \"37afe270-dc28-4915-9622-7fb4957c2570\") " pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" Jul 06 22:47:47.254182 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.254116 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bx6v\" (UniqueName: \"kubernetes.io/projected/37afe270-dc28-4915-9622-7fb4957c2570-kube-api-access-7bx6v\") pod \"rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5\" (UID: \"37afe270-dc28-4915-9622-7fb4957c2570\") " pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" Jul 06 22:47:47.254304 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.254281 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37afe270-dc28-4915-9622-7fb4957c2570-home\") pod \"rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5\" (UID: \"37afe270-dc28-4915-9622-7fb4957c2570\") " pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" Jul 06 22:47:47.254400 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.254158 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37afe270-dc28-4915-9622-7fb4957c2570-tmp-dir\") pod \"rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5\" (UID: \"37afe270-dc28-4915-9622-7fb4957c2570\") " pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" Jul 06 22:47:47.254462 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.254396 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37afe270-dc28-4915-9622-7fb4957c2570-model-cache\") pod \"rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5\" (UID: \"37afe270-dc28-4915-9622-7fb4957c2570\") " pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" Jul 06 22:47:47.254525 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.254490 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37afe270-dc28-4915-9622-7fb4957c2570-dshm\") pod \"rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5\" (UID: \"37afe270-dc28-4915-9622-7fb4957c2570\") " pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" Jul 06 22:47:47.254638 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.254618 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37afe270-dc28-4915-9622-7fb4957c2570-tmp-dir\") pod \"rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5\" (UID: \"37afe270-dc28-4915-9622-7fb4957c2570\") " pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" Jul 06 22:47:47.257089 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.257065 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37afe270-dc28-4915-9622-7fb4957c2570-tls-certs\") pod \"rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5\" (UID: \"37afe270-dc28-4915-9622-7fb4957c2570\") " pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" Jul 06 22:47:47.257749 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.257717 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37afe270-dc28-4915-9622-7fb4957c2570-dshm\") pod \"rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5\" (UID: \"37afe270-dc28-4915-9622-7fb4957c2570\") " pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" Jul 06 22:47:47.262831 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.262809 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bx6v\" (UniqueName: \"kubernetes.io/projected/37afe270-dc28-4915-9622-7fb4957c2570-kube-api-access-7bx6v\") pod \"rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5\" (UID: \"37afe270-dc28-4915-9622-7fb4957c2570\") " pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" Jul 06 22:47:47.419714 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.419623 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" Jul 06 22:47:47.548071 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:47.548044 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5"] Jul 06 22:47:47.550427 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:47:47.550395 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37afe270_dc28_4915_9622_7fb4957c2570.slice/crio-afaf0f61446b5e6a498c3d48a814bb651f38aa11cbfe9d47e7c9662824eee8fa WatchSource:0}: Error finding container afaf0f61446b5e6a498c3d48a814bb651f38aa11cbfe9d47e7c9662824eee8fa: Status 404 returned error can't find the container with id afaf0f61446b5e6a498c3d48a814bb651f38aa11cbfe9d47e7c9662824eee8fa Jul 06 22:47:48.308256 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:48.308214 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" event={"ID":"37afe270-dc28-4915-9622-7fb4957c2570","Type":"ContainerStarted","Data":"e14aff74a2e3a11831d5b77245793f7ecd24ea409c3ea2939487851a588ce86d"} Jul 06 22:47:48.308636 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:48.308267 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" event={"ID":"37afe270-dc28-4915-9622-7fb4957c2570","Type":"ContainerStarted","Data":"afaf0f61446b5e6a498c3d48a814bb651f38aa11cbfe9d47e7c9662824eee8fa"} Jul 06 22:47:48.326147 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:48.326099 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" podStartSLOduration=1.326082965 podStartE2EDuration="1.326082965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:47:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:48.325256292 +0000 UTC m=+2328.180221772" watchObservedRunningTime="2026-07-06 22:47:48.326082965 +0000 UTC m=+2328.181048432" Jul 06 22:47:53.983740 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:53.983653 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:47:57.420620 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:57.420581 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" Jul 06 22:47:57.420620 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:57.420627 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" Jul 06 22:47:57.433069 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:57.433046 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" Jul 06 22:47:58.374937 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:47:58.374900 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" Jul 06 22:48:12.802722 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:12.802686 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:48:27.685664 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:27.685626 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:48:35.971649 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:35.971611 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5"] Jul 06 22:48:37.582112 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:37.582078 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-65387d-29722965-mk275"] Jul 06 22:48:37.584488 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:37.584467 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-65387d-29722965-mk275"] Jul 06 22:48:38.726995 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:38.726959 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f4fe6b2-8bfa-4a51-a2f5-d82f71fdaab1" path="/var/lib/kubelet/pods/7f4fe6b2-8bfa-4a51-a2f5-d82f71fdaab1/volumes" Jul 06 22:48:41.091959 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:41.091929 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:48:50.991928 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:50.991868 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" podUID="37afe270-dc28-4915-9622-7fb4957c2570" containerName="main" containerID="cri-o://e14aff74a2e3a11831d5b77245793f7ecd24ea409c3ea2939487851a588ce86d" gracePeriod=45 Jul 06 22:48:51.242904 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:51.242832 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" Jul 06 22:48:51.297383 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:51.297353 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37afe270-dc28-4915-9622-7fb4957c2570-tls-certs\") pod \"37afe270-dc28-4915-9622-7fb4957c2570\" (UID: \"37afe270-dc28-4915-9622-7fb4957c2570\") " Jul 06 22:48:51.297584 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:51.297395 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37afe270-dc28-4915-9622-7fb4957c2570-tmp-dir\") pod \"37afe270-dc28-4915-9622-7fb4957c2570\" (UID: \"37afe270-dc28-4915-9622-7fb4957c2570\") " Jul 06 22:48:51.297584 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:51.297442 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bx6v\" (UniqueName: \"kubernetes.io/projected/37afe270-dc28-4915-9622-7fb4957c2570-kube-api-access-7bx6v\") pod \"37afe270-dc28-4915-9622-7fb4957c2570\" (UID: \"37afe270-dc28-4915-9622-7fb4957c2570\") " Jul 06 22:48:51.297584 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:51.297498 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37afe270-dc28-4915-9622-7fb4957c2570-home\") pod \"37afe270-dc28-4915-9622-7fb4957c2570\" (UID: \"37afe270-dc28-4915-9622-7fb4957c2570\") " Jul 06 22:48:51.297584 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:51.297526 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37afe270-dc28-4915-9622-7fb4957c2570-model-cache\") pod \"37afe270-dc28-4915-9622-7fb4957c2570\" (UID: \"37afe270-dc28-4915-9622-7fb4957c2570\") " Jul 06 22:48:51.297584 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:51.297566 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37afe270-dc28-4915-9622-7fb4957c2570-dshm\") pod \"37afe270-dc28-4915-9622-7fb4957c2570\" (UID: \"37afe270-dc28-4915-9622-7fb4957c2570\") " Jul 06 22:48:51.297812 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:51.297704 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37afe270-dc28-4915-9622-7fb4957c2570-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "37afe270-dc28-4915-9622-7fb4957c2570" (UID: "37afe270-dc28-4915-9622-7fb4957c2570"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:48:51.297879 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:51.297814 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37afe270-dc28-4915-9622-7fb4957c2570-home" (OuterVolumeSpecName: "home") pod "37afe270-dc28-4915-9622-7fb4957c2570" (UID: "37afe270-dc28-4915-9622-7fb4957c2570"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:48:51.297949 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:51.297898 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37afe270-dc28-4915-9622-7fb4957c2570-model-cache" (OuterVolumeSpecName: "model-cache") pod "37afe270-dc28-4915-9622-7fb4957c2570" (UID: "37afe270-dc28-4915-9622-7fb4957c2570"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:48:51.297949 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:51.297918 2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37afe270-dc28-4915-9622-7fb4957c2570-tmp-dir\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:48:51.299717 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:51.299688 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37afe270-dc28-4915-9622-7fb4957c2570-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "37afe270-dc28-4915-9622-7fb4957c2570" (UID: "37afe270-dc28-4915-9622-7fb4957c2570"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:48:51.299717 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:51.299692 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37afe270-dc28-4915-9622-7fb4957c2570-dshm" (OuterVolumeSpecName: "dshm") pod "37afe270-dc28-4915-9622-7fb4957c2570" (UID: "37afe270-dc28-4915-9622-7fb4957c2570"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:48:51.299895 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:51.299728 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37afe270-dc28-4915-9622-7fb4957c2570-kube-api-access-7bx6v" (OuterVolumeSpecName: "kube-api-access-7bx6v") pod "37afe270-dc28-4915-9622-7fb4957c2570" (UID: "37afe270-dc28-4915-9622-7fb4957c2570"). InnerVolumeSpecName "kube-api-access-7bx6v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:48:51.398741 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:51.398703 2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37afe270-dc28-4915-9622-7fb4957c2570-tls-certs\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:48:51.398741 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:51.398738 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bx6v\" (UniqueName: \"kubernetes.io/projected/37afe270-dc28-4915-9622-7fb4957c2570-kube-api-access-7bx6v\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:48:51.398741 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:51.398748 2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37afe270-dc28-4915-9622-7fb4957c2570-home\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:48:51.399000 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:51.398758 2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37afe270-dc28-4915-9622-7fb4957c2570-model-cache\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:48:51.399000 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:51.398767 2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37afe270-dc28-4915-9622-7fb4957c2570-dshm\") on node \"ip-10-0-137-47.ec2.internal\" DevicePath \"\"" Jul 06 22:48:51.623102 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:51.623022 2566 generic.go:356] "Generic (PLEG): container finished" podID="37afe270-dc28-4915-9622-7fb4957c2570" containerID="e14aff74a2e3a11831d5b77245793f7ecd24ea409c3ea2939487851a588ce86d" exitCode=0 Jul 06 22:48:51.623102 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:51.623065 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" Jul 06 22:48:51.623102 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:51.623075 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" event={"ID":"37afe270-dc28-4915-9622-7fb4957c2570","Type":"ContainerDied","Data":"e14aff74a2e3a11831d5b77245793f7ecd24ea409c3ea2939487851a588ce86d"} Jul 06 22:48:51.623327 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:51.623119 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5" event={"ID":"37afe270-dc28-4915-9622-7fb4957c2570","Type":"ContainerDied","Data":"afaf0f61446b5e6a498c3d48a814bb651f38aa11cbfe9d47e7c9662824eee8fa"} Jul 06 22:48:51.623327 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:51.623137 2566 scope.go:117] "RemoveContainer" containerID="e14aff74a2e3a11831d5b77245793f7ecd24ea409c3ea2939487851a588ce86d" Jul 06 22:48:51.632715 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:51.632697 2566 scope.go:117] "RemoveContainer" containerID="e14aff74a2e3a11831d5b77245793f7ecd24ea409c3ea2939487851a588ce86d" Jul 06 22:48:51.633079 ip-10-0-137-47 kubenswrapper[2566]: E0706 22:48:51.633053 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e14aff74a2e3a11831d5b77245793f7ecd24ea409c3ea2939487851a588ce86d\": container with ID starting with e14aff74a2e3a11831d5b77245793f7ecd24ea409c3ea2939487851a588ce86d not found: ID does not exist" containerID="e14aff74a2e3a11831d5b77245793f7ecd24ea409c3ea2939487851a588ce86d" Jul 06 22:48:51.633172 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:51.633082 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e14aff74a2e3a11831d5b77245793f7ecd24ea409c3ea2939487851a588ce86d"} err="failed to get container status \"e14aff74a2e3a11831d5b77245793f7ecd24ea409c3ea2939487851a588ce86d\": rpc error: code = NotFound desc = could not find container \"e14aff74a2e3a11831d5b77245793f7ecd24ea409c3ea2939487851a588ce86d\": container with ID starting with e14aff74a2e3a11831d5b77245793f7ecd24ea409c3ea2939487851a588ce86d not found: ID does not exist" Jul 06 22:48:51.643988 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:51.643958 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5"] Jul 06 22:48:51.647511 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:51.647491 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-944f9f/rate-test-model-944f9f-kserve-c88bcdd9f-4rxl5"] Jul 06 22:48:52.726187 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:48:52.726153 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37afe270-dc28-4915-9622-7fb4957c2570" path="/var/lib/kubelet/pods/37afe270-dc28-4915-9622-7fb4957c2570/volumes" Jul 06 22:49:00.791100 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:00.791070 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd89j_b55a9306-a1b1-4824-bacd-cd43906b7951/ovn-acl-logging/0.log" Jul 06 22:49:00.796405 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:00.796386 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd89j_b55a9306-a1b1-4824-bacd-cd43906b7951/ovn-acl-logging/0.log" Jul 06 22:49:20.399318 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:20.399275 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-944f9f-29722965-fpkvl"] Jul 06 22:49:20.401143 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:20.401120 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-944f9f-29722965-fpkvl"] Jul 06 22:49:20.726637 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:20.726601 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76a1d3a6-fe5a-4235-993a-3000cd59621b" path="/var/lib/kubelet/pods/76a1d3a6-fe5a-4235-993a-3000cd59621b/volumes" Jul 06 22:49:22.588081 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:22.588048 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5w24c"] Jul 06 22:49:32.262035 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:32.261958 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722965-9ncm5_a75d4bb2-459c-4ffd-92ba-a3a26b7d9e3c/cleanup/0.log" Jul 06 22:49:32.719809 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:32.719771 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c695b4674-5mst6_674f9f81-83c5-409b-b74e-d0b9292a6aff/copy-manifests/0.log" Jul 06 22:49:32.731732 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:32.731705 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c695b4674-5mst6_674f9f81-83c5-409b-b74e-d0b9292a6aff/manager/0.log" Jul 06 22:49:33.829028 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:33.828995 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr_f8108a69-7e05-4ad1-97dc-141426ee73db/util/0.log" Jul 06 22:49:33.834500 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:33.834478 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr_f8108a69-7e05-4ad1-97dc-141426ee73db/pull/0.log" Jul 06 22:49:33.840452 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:33.840435 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr_f8108a69-7e05-4ad1-97dc-141426ee73db/extract/0.log" Jul 06 22:49:33.948898 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:33.948867 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs_febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5/util/0.log" Jul 06 22:49:33.955409 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:33.955385 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs_febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5/pull/0.log" Jul 06 22:49:33.961033 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:33.961013 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs_febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5/extract/0.log" Jul 06 22:49:34.070829 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:34.070800 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf_1f4756f8-aa10-47c5-87bb-6d33c447d4f4/pull/0.log" Jul 06 22:49:34.076622 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:34.076601 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf_1f4756f8-aa10-47c5-87bb-6d33c447d4f4/extract/0.log" Jul 06 22:49:34.082225 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:34.082179 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf_1f4756f8-aa10-47c5-87bb-6d33c447d4f4/util/0.log" Jul 06 22:49:34.193293 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:34.193268 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t_f00d537d-377c-4c35-83aa-ce6c012ffc26/pull/0.log" Jul 06 22:49:34.199607 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:34.199589 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t_f00d537d-377c-4c35-83aa-ce6c012ffc26/extract/0.log" Jul 06 22:49:34.205481 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:34.205461 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t_f00d537d-377c-4c35-83aa-ce6c012ffc26/util/0.log" Jul 06 22:49:35.009282 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:35.009259 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5w24c_a37b63c9-a35b-46dc-9651-a10ed5b17430/limitador/0.log" Jul 06 22:49:35.590468 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:35.590436 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-v7thk_da430263-afad-45e4-8053-472823a71ec8/discovery/0.log" Jul 06 22:49:36.993594 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:36.993566 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwq67j_bf062f28-cae7-4a11-aeeb-4d87e9c290f6/main/0.log" Jul 06 22:49:37.216722 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:37.216689 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-9fdv2_84cc739b-5305-442f-bce7-1e1f09a9ea08/main/0.log" Jul 06 22:49:43.694701 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:43.694676 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jxlqd_529d219d-5011-4cd4-8dde-30b659530d16/global-pull-secret-syncer/0.log" Jul 06 22:49:43.861151 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:43.861105 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6qdg8_0d978ee1-0806-48e2-94e8-ebb1864485a4/konnectivity-agent/0.log" Jul 06 22:49:43.967622 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:43.967544 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-47.ec2.internal_3f28b5bc82b8c792024d97a7b33da272/haproxy/0.log" Jul 06 22:49:48.895227 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:48.895199 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr_f8108a69-7e05-4ad1-97dc-141426ee73db/extract/0.log" Jul 06 22:49:48.916314 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:48.916292 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr_f8108a69-7e05-4ad1-97dc-141426ee73db/util/0.log" Jul 06 22:49:48.938223 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:48.938192 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7dvr_f8108a69-7e05-4ad1-97dc-141426ee73db/pull/0.log" Jul 06 22:49:48.964552 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:48.964512 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs_febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5/extract/0.log" Jul 06 22:49:48.990180 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:48.990162 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs_febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5/util/0.log" Jul 06 22:49:49.012388 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:49.012371 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vq4hs_febb1d75-6a20-4b5e-9c1b-4f5fac3f17a5/pull/0.log" Jul 06 22:49:49.041610 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:49.041573 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf_1f4756f8-aa10-47c5-87bb-6d33c447d4f4/extract/0.log" Jul 06 22:49:49.062362 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:49.062342 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf_1f4756f8-aa10-47c5-87bb-6d33c447d4f4/util/0.log" Jul 06 22:49:49.082436 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:49.082414 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vzdf_1f4756f8-aa10-47c5-87bb-6d33c447d4f4/pull/0.log" Jul 06 22:49:49.108476 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:49.108454 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t_f00d537d-377c-4c35-83aa-ce6c012ffc26/extract/0.log" Jul 06 22:49:49.133212 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:49.133190 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t_f00d537d-377c-4c35-83aa-ce6c012ffc26/util/0.log" Jul 06 22:49:49.153595 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:49.153522 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15967t_f00d537d-377c-4c35-83aa-ce6c012ffc26/pull/0.log" Jul 06 22:49:49.995040 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:49.995011 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5w24c_a37b63c9-a35b-46dc-9651-a10ed5b17430/limitador/0.log" Jul 06 22:49:52.023980 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:52.023954 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9l5pg_c3149ee7-41e1-439e-a2f1-873cf45db23b/node-exporter/0.log" Jul 06 22:49:52.043665 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:52.043641 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9l5pg_c3149ee7-41e1-439e-a2f1-873cf45db23b/kube-rbac-proxy/0.log" Jul 06 22:49:52.064304 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:52.064283 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9l5pg_c3149ee7-41e1-439e-a2f1-873cf45db23b/init-textfile/0.log" Jul 06 22:49:53.608861 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:53.608812 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fc7g8/perf-node-gather-daemonset-fv44r"] Jul 06 22:49:53.609335 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:53.609225 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37afe270-dc28-4915-9622-7fb4957c2570" containerName="main" Jul 06 22:49:53.609335 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:53.609242 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="37afe270-dc28-4915-9622-7fb4957c2570" containerName="main" Jul 06 22:49:53.609335 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:53.609335 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="37afe270-dc28-4915-9622-7fb4957c2570" containerName="main" Jul 06 22:49:53.612197 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:53.612175 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fc7g8/perf-node-gather-daemonset-fv44r" Jul 06 22:49:53.614363 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:53.614344 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fc7g8\"/\"openshift-service-ca.crt\"" Jul 06 22:49:53.615069 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:53.615052 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fc7g8\"/\"default-dockercfg-5gjkx\"" Jul 06 22:49:53.615157 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:53.615054 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fc7g8\"/\"kube-root-ca.crt\"" Jul 06 22:49:53.621157 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:53.621136 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fc7g8/perf-node-gather-daemonset-fv44r"] Jul 06 22:49:53.693339 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:53.693306 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2a87db19-fddd-4e7b-9e16-0839e21d3ec1-proc\") pod \"perf-node-gather-daemonset-fv44r\" (UID: \"2a87db19-fddd-4e7b-9e16-0839e21d3ec1\") " pod="openshift-must-gather-fc7g8/perf-node-gather-daemonset-fv44r" Jul 06 22:49:53.693517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:53.693380 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a87db19-fddd-4e7b-9e16-0839e21d3ec1-sys\") pod \"perf-node-gather-daemonset-fv44r\" (UID: \"2a87db19-fddd-4e7b-9e16-0839e21d3ec1\") " pod="openshift-must-gather-fc7g8/perf-node-gather-daemonset-fv44r" Jul 06 22:49:53.693517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:53.693409 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2a87db19-fddd-4e7b-9e16-0839e21d3ec1-podres\") pod \"perf-node-gather-daemonset-fv44r\" (UID: \"2a87db19-fddd-4e7b-9e16-0839e21d3ec1\") " pod="openshift-must-gather-fc7g8/perf-node-gather-daemonset-fv44r" Jul 06 22:49:53.693517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:53.693440 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2a87db19-fddd-4e7b-9e16-0839e21d3ec1-lib-modules\") pod \"perf-node-gather-daemonset-fv44r\" (UID: \"2a87db19-fddd-4e7b-9e16-0839e21d3ec1\") " pod="openshift-must-gather-fc7g8/perf-node-gather-daemonset-fv44r" Jul 06 22:49:53.693517 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:53.693491 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggjmg\" (UniqueName: \"kubernetes.io/projected/2a87db19-fddd-4e7b-9e16-0839e21d3ec1-kube-api-access-ggjmg\") pod \"perf-node-gather-daemonset-fv44r\" (UID: \"2a87db19-fddd-4e7b-9e16-0839e21d3ec1\") " pod="openshift-must-gather-fc7g8/perf-node-gather-daemonset-fv44r" Jul 06 22:49:53.794930 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:53.794895 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a87db19-fddd-4e7b-9e16-0839e21d3ec1-sys\") pod \"perf-node-gather-daemonset-fv44r\" (UID: \"2a87db19-fddd-4e7b-9e16-0839e21d3ec1\") " pod="openshift-must-gather-fc7g8/perf-node-gather-daemonset-fv44r" Jul 06 22:49:53.795083 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:53.794940 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2a87db19-fddd-4e7b-9e16-0839e21d3ec1-podres\") pod \"perf-node-gather-daemonset-fv44r\" (UID: \"2a87db19-fddd-4e7b-9e16-0839e21d3ec1\") " pod="openshift-must-gather-fc7g8/perf-node-gather-daemonset-fv44r" Jul 06 22:49:53.795083 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:53.794982 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2a87db19-fddd-4e7b-9e16-0839e21d3ec1-lib-modules\") pod \"perf-node-gather-daemonset-fv44r\" (UID: \"2a87db19-fddd-4e7b-9e16-0839e21d3ec1\") " pod="openshift-must-gather-fc7g8/perf-node-gather-daemonset-fv44r" Jul 06 22:49:53.795083 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:53.795003 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggjmg\" (UniqueName: \"kubernetes.io/projected/2a87db19-fddd-4e7b-9e16-0839e21d3ec1-kube-api-access-ggjmg\") pod \"perf-node-gather-daemonset-fv44r\" (UID: \"2a87db19-fddd-4e7b-9e16-0839e21d3ec1\") " pod="openshift-must-gather-fc7g8/perf-node-gather-daemonset-fv44r" Jul 06 22:49:53.795083 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:53.795017 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a87db19-fddd-4e7b-9e16-0839e21d3ec1-sys\") pod \"perf-node-gather-daemonset-fv44r\" (UID: \"2a87db19-fddd-4e7b-9e16-0839e21d3ec1\") " pod="openshift-must-gather-fc7g8/perf-node-gather-daemonset-fv44r" Jul 06 22:49:53.795083 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:53.795033 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2a87db19-fddd-4e7b-9e16-0839e21d3ec1-proc\") pod \"perf-node-gather-daemonset-fv44r\" (UID: \"2a87db19-fddd-4e7b-9e16-0839e21d3ec1\") " pod="openshift-must-gather-fc7g8/perf-node-gather-daemonset-fv44r" Jul 06 22:49:53.795308 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:53.795115 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2a87db19-fddd-4e7b-9e16-0839e21d3ec1-podres\") pod \"perf-node-gather-daemonset-fv44r\" (UID: \"2a87db19-fddd-4e7b-9e16-0839e21d3ec1\") " pod="openshift-must-gather-fc7g8/perf-node-gather-daemonset-fv44r" Jul 06 22:49:53.795308 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:53.795132 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2a87db19-fddd-4e7b-9e16-0839e21d3ec1-proc\") pod \"perf-node-gather-daemonset-fv44r\" (UID: \"2a87db19-fddd-4e7b-9e16-0839e21d3ec1\") " pod="openshift-must-gather-fc7g8/perf-node-gather-daemonset-fv44r" Jul 06 22:49:53.795308 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:53.795148 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2a87db19-fddd-4e7b-9e16-0839e21d3ec1-lib-modules\") pod \"perf-node-gather-daemonset-fv44r\" (UID: \"2a87db19-fddd-4e7b-9e16-0839e21d3ec1\") " pod="openshift-must-gather-fc7g8/perf-node-gather-daemonset-fv44r" Jul 06 22:49:53.803183 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:53.803161 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggjmg\" (UniqueName: \"kubernetes.io/projected/2a87db19-fddd-4e7b-9e16-0839e21d3ec1-kube-api-access-ggjmg\") pod \"perf-node-gather-daemonset-fv44r\" (UID: \"2a87db19-fddd-4e7b-9e16-0839e21d3ec1\") " pod="openshift-must-gather-fc7g8/perf-node-gather-daemonset-fv44r" Jul 06 22:49:53.900584 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:53.900520 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-mq67q_4c51a485-699d-45da-9423-832c8c3c86c9/networking-console-plugin/0.log" Jul 06 22:49:53.922662 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:53.922639 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fc7g8/perf-node-gather-daemonset-fv44r" Jul 06 22:49:54.047827 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:54.047800 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fc7g8/perf-node-gather-daemonset-fv44r"] Jul 06 22:49:54.049272 ip-10-0-137-47 kubenswrapper[2566]: W0706 22:49:54.049246 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2a87db19_fddd_4e7b_9e16_0839e21d3ec1.slice/crio-2232be0159f998ffa1ff868d7734d35b13b3d12aeca374a7a2943e09cc8c8974 WatchSource:0}: Error finding container 2232be0159f998ffa1ff868d7734d35b13b3d12aeca374a7a2943e09cc8c8974: Status 404 returned error can't find the container with id 2232be0159f998ffa1ff868d7734d35b13b3d12aeca374a7a2943e09cc8c8974 Jul 06 22:49:54.916087 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:54.916051 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fc7g8/perf-node-gather-daemonset-fv44r" event={"ID":"2a87db19-fddd-4e7b-9e16-0839e21d3ec1","Type":"ContainerStarted","Data":"9d6ebb5f58488f068a5a1801388e9d8df8be57596150b6ddd59f06264dea024e"} Jul 06 22:49:54.916458 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:54.916100 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fc7g8/perf-node-gather-daemonset-fv44r" event={"ID":"2a87db19-fddd-4e7b-9e16-0839e21d3ec1","Type":"ContainerStarted","Data":"2232be0159f998ffa1ff868d7734d35b13b3d12aeca374a7a2943e09cc8c8974"} Jul 06 22:49:54.916458 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:54.916193 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fc7g8/perf-node-gather-daemonset-fv44r" Jul 06 22:49:54.935083 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:54.935034 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fc7g8/perf-node-gather-daemonset-fv44r" podStartSLOduration=1.935022088 podStartE2EDuration="1.935022088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:49:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:49:54.932334439 +0000 UTC m=+2454.787299906" watchObservedRunningTime="2026-07-06 22:49:54.935022088 +0000 UTC m=+2454.789987556" Jul 06 22:49:55.065870 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:55.065829 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-zwpgv_e30320e8-b3e5-4f78-bbef-542cedfc1e24/download-server/0.log" Jul 06 22:49:56.642132 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:56.642092 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9xgnl_208e55fc-7d73-40c3-80e1-079cec2157a4/dns/0.log" Jul 06 22:49:56.663321 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:56.663295 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9xgnl_208e55fc-7d73-40c3-80e1-079cec2157a4/kube-rbac-proxy/0.log" Jul 06 22:49:56.842994 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:56.842965 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lbxng_1566a0b0-dbc3-4448-874e-151da27d7a27/dns-node-resolver/0.log" Jul 06 22:49:57.379735 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:57.379707 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5b546d9cc5-l5xmz_e8287232-21ca-4ea6-9ef0-6343221689ef/registry/0.log" Jul 06 22:49:57.451858 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:57.451812 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fm45f_8e89a94f-c9c4-4b73-bbb1-ea7f02dc8f9b/node-ca/0.log" Jul 06 22:49:58.512207 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:58.512176 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-v7thk_da430263-afad-45e4-8053-472823a71ec8/discovery/0.log" Jul 06 22:49:59.512609 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:49:59.512579 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x2b5k_145334b3-5315-4006-9dac-73c2770182f9/serve-healthcheck-canary/0.log" Jul 06 22:50:00.069880 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:50:00.069856 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f949n_699501f3-29d3-4e57-b5b9-4f5b4b903097/kube-rbac-proxy/0.log" Jul 06 22:50:00.091759 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:50:00.091737 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f949n_699501f3-29d3-4e57-b5b9-4f5b4b903097/exporter/0.log" Jul 06 22:50:00.113083 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:50:00.113061 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f949n_699501f3-29d3-4e57-b5b9-4f5b4b903097/extractor/0.log" Jul 06 22:50:00.930728 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:50:00.930702 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fc7g8/perf-node-gather-daemonset-fv44r" Jul 06 22:50:02.870805 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:50:02.870776 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722965-9ncm5_a75d4bb2-459c-4ffd-92ba-a3a26b7d9e3c/cleanup/0.log" Jul 06 22:50:03.186566 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:50:03.186529 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c695b4674-5mst6_674f9f81-83c5-409b-b74e-d0b9292a6aff/manager/0.log" Jul 06 22:50:03.208096 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:50:03.208070 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c695b4674-5mst6_674f9f81-83c5-409b-b74e-d0b9292a6aff/copy-manifests/0.log" Jul 06 22:50:04.750261 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:50:04.750232 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-v7thk_da430263-afad-45e4-8053-472823a71ec8/discovery/0.log" Jul 06 22:50:04.775401 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:50:04.775332 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7bcf4db656-zngbw_357dc97c-9d04-43df-af5d-10af9ff466b9/manager/0.log" Jul 06 22:50:04.804398 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:50:04.804376 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-pkn8b_76f7c4ef-ea11-4c66-89c4-30602cfe5ea6/openshift-lws-operator/0.log" Jul 06 22:50:06.258045 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:50:06.258016 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-v7thk_da430263-afad-45e4-8053-472823a71ec8/discovery/0.log" Jul 06 22:50:09.810330 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:50:09.810299 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-zxj69_ebf052be-572f-4484-884a-56f9d8c0de0a/migrator/0.log" Jul 06 22:50:09.833110 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:50:09.833085 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-zxj69_ebf052be-572f-4484-884a-56f9d8c0de0a/graceful-termination/0.log" Jul 06 22:50:11.310442 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:50:11.310412 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7pwsx_0d1c5e61-2ad1-421b-a5f6-3595e1e60795/kube-multus-additional-cni-plugins/0.log" Jul 06 22:50:11.331544 ip-10-0-137-47 kubenswrapper[2566]: I0706 22:50:11.331522 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7pwsx_0d1c5e61-2ad1-421b-a5f6-3595e1e60795/egress-router-binary-copy/0.log"