Jul 15 23:46:48.643927 ip-10-0-142-228 systemd[1]: Starting Kubernetes Kubelet... Jul 15 23:46:49.090470 ip-10-0-142-228 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 23:46:49.090470 ip-10-0-142-228 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 15 23:46:49.090470 ip-10-0-142-228 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 23:46:49.090470 ip-10-0-142-228 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 15 23:46:49.090470 ip-10-0-142-228 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 23:46:49.093320 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.093234 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 15 23:46:49.098025 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098009 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 23:46:49.098057 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098027 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 23:46:49.098057 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098035 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 23:46:49.098057 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098039 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 23:46:49.098057 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098042 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 23:46:49.098057 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098045 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 23:46:49.098057 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098048 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 23:46:49.098057 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098051 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 23:46:49.098057 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098054 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 23:46:49.098057 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098056 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 23:46:49.098057 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098061 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 23:46:49.098300 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098064 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 23:46:49.098300 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098067 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 23:46:49.098300 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098070 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 23:46:49.098300 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098074 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 23:46:49.098300 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098076 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 23:46:49.098300 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098079 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 23:46:49.098300 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098082 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 23:46:49.098300 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098085 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 23:46:49.098300 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098088 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 23:46:49.098300 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098090 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 23:46:49.098300 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098093 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 23:46:49.098300 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098096 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 23:46:49.098300 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098098 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 23:46:49.098300 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098102 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 23:46:49.098300 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098104 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 23:46:49.098300 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098107 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 23:46:49.098300 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098110 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 23:46:49.098300 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098112 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 23:46:49.098300 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098114 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 23:46:49.098300 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098117 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 23:46:49.098791 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098120 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 23:46:49.098791 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098123 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 23:46:49.098791 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098126 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 23:46:49.098791 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098129 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 23:46:49.098791 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098131 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 23:46:49.098791 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098134 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 23:46:49.098791 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098137 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 23:46:49.098791 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098139 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 23:46:49.098791 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098142 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 23:46:49.098791 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098144 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 23:46:49.098791 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098148 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 23:46:49.098791 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098150 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 23:46:49.098791 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098153 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 23:46:49.098791 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098156 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 23:46:49.098791 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098159 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 23:46:49.098791 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098162 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 23:46:49.098791 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098164 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 23:46:49.098791 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098167 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 23:46:49.098791 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098170 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 23:46:49.098791 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098173 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 15 23:46:49.099285 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098175 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 23:46:49.099285 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098179 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 23:46:49.099285 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098183 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 23:46:49.099285 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098186 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 23:46:49.099285 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098189 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 23:46:49.099285 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098192 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 23:46:49.099285 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098194 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 23:46:49.099285 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098197 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 23:46:49.099285 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098199 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 23:46:49.099285 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098202 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 23:46:49.099285 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098205 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 23:46:49.099285 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098207 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 23:46:49.099285 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098210 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 23:46:49.099285 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098215 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 23:46:49.099285 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098219 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 23:46:49.099285 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098222 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 23:46:49.099285 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098224 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 23:46:49.099285 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098227 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 23:46:49.099285 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098230 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 23:46:49.099285 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098232 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 23:46:49.099778 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098235 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 23:46:49.099778 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098238 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 23:46:49.099778 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098241 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 23:46:49.099778 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098243 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 23:46:49.099778 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098246 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 23:46:49.099778 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098249 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 23:46:49.099778 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098252 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 23:46:49.099778 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098254 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 23:46:49.099778 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098257 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 23:46:49.099778 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098260 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 23:46:49.099778 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098263 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 23:46:49.099778 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098266 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 23:46:49.099778 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098268 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 23:46:49.099778 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098271 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 23:46:49.099778 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098273 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 23:46:49.099778 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098276 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 23:46:49.099778 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098279 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 23:46:49.099778 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098282 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 23:46:49.099778 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098285 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 23:46:49.100265 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098287 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 23:46:49.100265 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098290 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 23:46:49.100265 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098292 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 23:46:49.100265 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098295 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 23:46:49.100265 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098298 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 23:46:49.100265 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098300 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 23:46:49.100265 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098303 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 23:46:49.100265 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098306 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 23:46:49.100265 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.098309 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 23:46:49.100265 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099029 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 23:46:49.100265 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099036 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 23:46:49.100265 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099038 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 23:46:49.100265 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099041 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 23:46:49.100265 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099044 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 23:46:49.100265 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099047 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 23:46:49.100265 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099050 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 23:46:49.100265 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099053 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 23:46:49.100265 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099055 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 23:46:49.100265 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099059 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 23:46:49.100265 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099061 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 23:46:49.100748 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099064 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 23:46:49.100748 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099067 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 23:46:49.100748 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099069 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 23:46:49.100748 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099072 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 23:46:49.100748 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099074 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 23:46:49.100748 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099077 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 23:46:49.100748 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099080 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 23:46:49.100748 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099082 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 23:46:49.100748 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099086 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 23:46:49.100748 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099088 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 23:46:49.100748 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099091 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 23:46:49.100748 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099093 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 23:46:49.100748 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099096 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 23:46:49.100748 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099098 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 23:46:49.100748 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099101 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 23:46:49.100748 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099103 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 23:46:49.100748 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099106 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 23:46:49.100748 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099108 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 23:46:49.100748 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099111 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 23:46:49.100748 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099113 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 23:46:49.101270 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099117 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 23:46:49.101270 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099119 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 23:46:49.101270 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099122 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 23:46:49.101270 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099124 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 23:46:49.101270 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099127 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 23:46:49.101270 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099129 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 23:46:49.101270 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099132 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 23:46:49.101270 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099134 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 23:46:49.101270 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099136 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 23:46:49.101270 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099140 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 23:46:49.101270 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099146 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 23:46:49.101270 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099150 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 23:46:49.101270 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099152 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 23:46:49.101270 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099155 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 23:46:49.101270 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099158 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 23:46:49.101270 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099160 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 23:46:49.101270 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099163 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 23:46:49.101270 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099165 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 23:46:49.101270 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099168 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 23:46:49.101735 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099170 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 23:46:49.101735 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099173 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 23:46:49.101735 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099176 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 23:46:49.101735 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099178 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 23:46:49.101735 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099181 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 23:46:49.101735 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099183 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 23:46:49.101735 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099186 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 23:46:49.101735 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099188 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 23:46:49.101735 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099191 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 23:46:49.101735 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099193 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 23:46:49.101735 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099196 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 23:46:49.101735 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099198 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 23:46:49.101735 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099201 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 23:46:49.101735 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099203 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 15 23:46:49.101735 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099206 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 23:46:49.101735 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099209 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 23:46:49.101735 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099211 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 23:46:49.101735 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099214 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 23:46:49.101735 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099217 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 23:46:49.101735 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099219 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 23:46:49.102216 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099222 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 23:46:49.102216 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099225 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 23:46:49.102216 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099227 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 23:46:49.102216 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099230 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 23:46:49.102216 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099232 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 23:46:49.102216 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099237 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 23:46:49.102216 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099241 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 23:46:49.102216 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099246 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 23:46:49.102216 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099249 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 23:46:49.102216 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099252 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 23:46:49.102216 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099254 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 23:46:49.102216 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099257 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 23:46:49.102216 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099260 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 23:46:49.102216 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099263 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 23:46:49.102216 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099265 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 23:46:49.102216 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099268 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 23:46:49.102216 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099270 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 23:46:49.102216 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099273 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 23:46:49.102216 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099275 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 23:46:49.102656 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099278 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 23:46:49.102656 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099280 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 23:46:49.102656 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099283 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 23:46:49.102656 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099286 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 23:46:49.102656 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099288 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 23:46:49.102656 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099291 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 23:46:49.102656 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099293 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 23:46:49.102656 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099296 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 23:46:49.102656 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099299 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 23:46:49.102656 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099302 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 23:46:49.102656 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099679 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 23:46:49.102656 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099685 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 23:46:49.102656 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099690 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 23:46:49.102656 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099693 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 23:46:49.102656 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099698 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 23:46:49.102656 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099702 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 23:46:49.102656 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099705 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 23:46:49.102656 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099708 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 23:46:49.102656 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099710 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 23:46:49.102656 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099713 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 23:46:49.103146 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099715 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 15 23:46:49.103146 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099718 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 23:46:49.103146 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099721 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 23:46:49.103146 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099723 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 23:46:49.103146 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099726 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 23:46:49.103146 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099729 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 23:46:49.103146 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099731 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 23:46:49.103146 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099734 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 23:46:49.103146 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099736 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 23:46:49.103146 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099739 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 23:46:49.103146 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099741 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 23:46:49.103146 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099744 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 23:46:49.103146 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099746 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 23:46:49.103146 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099749 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 23:46:49.103146 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099752 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 23:46:49.103146 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099754 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 23:46:49.103146 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099757 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 23:46:49.103146 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099760 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 23:46:49.103146 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099762 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 23:46:49.103146 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099764 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 23:46:49.103623 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099768 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 23:46:49.103623 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099771 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 23:46:49.103623 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099773 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 23:46:49.103623 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099775 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 23:46:49.103623 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099778 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 23:46:49.103623 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099781 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 23:46:49.103623 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099783 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 23:46:49.103623 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099786 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 23:46:49.103623 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099789 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 23:46:49.103623 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099792 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 23:46:49.103623 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099794 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 23:46:49.103623 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099797 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 23:46:49.103623 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099799 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 23:46:49.103623 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099802 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 23:46:49.103623 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099804 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 23:46:49.103623 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099807 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 23:46:49.103623 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099809 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 23:46:49.103623 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099812 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 23:46:49.103623 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099814 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 23:46:49.104088 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099817 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 23:46:49.104088 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099819 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 23:46:49.104088 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099822 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 23:46:49.104088 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099824 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 23:46:49.104088 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099827 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 23:46:49.104088 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099830 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 23:46:49.104088 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099832 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 23:46:49.104088 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099836 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 23:46:49.104088 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099840 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 23:46:49.104088 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099843 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 23:46:49.104088 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099846 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 23:46:49.104088 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099849 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 23:46:49.104088 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099854 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 23:46:49.104088 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099857 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 23:46:49.104088 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099860 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 23:46:49.104088 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099863 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 23:46:49.104088 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099866 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 23:46:49.104088 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099868 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 23:46:49.104088 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099871 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 23:46:49.104536 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099874 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 23:46:49.104536 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099876 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 23:46:49.104536 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099882 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 23:46:49.104536 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099884 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 23:46:49.104536 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099887 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 23:46:49.104536 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099889 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 23:46:49.104536 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099894 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 23:46:49.104536 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099896 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 23:46:49.104536 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099899 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 23:46:49.104536 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099901 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 23:46:49.104536 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099905 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 23:46:49.104536 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099908 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 23:46:49.104536 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099910 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 23:46:49.104536 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099912 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 23:46:49.104536 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099915 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 23:46:49.104536 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099918 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 23:46:49.104536 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099920 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 23:46:49.104536 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099922 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 23:46:49.104536 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099925 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 23:46:49.104536 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099927 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 23:46:49.105065 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099930 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 23:46:49.105065 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099932 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 23:46:49.105065 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099935 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 23:46:49.105065 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099937 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 23:46:49.105065 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099940 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 23:46:49.105065 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099943 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 23:46:49.105065 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099946 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 23:46:49.105065 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099949 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 23:46:49.105065 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099952 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 23:46:49.105065 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099954 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 23:46:49.105065 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.099957 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 23:46:49.105065 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100021 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 15 23:46:49.105065 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100027 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 15 23:46:49.105065 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100034 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 15 23:46:49.105065 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100048 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 15 23:46:49.105065 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100052 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 15 23:46:49.105065 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100055 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 15 23:46:49.105065 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100060 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 15 23:46:49.105065 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100065 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 15 23:46:49.105065 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100068 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 15 23:46:49.105065 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100071 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 15 23:46:49.105579 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100075 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 15 23:46:49.105579 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100079 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 15 23:46:49.105579 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100082 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 15 23:46:49.105579 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100085 2564 flags.go:64] FLAG: --cgroup-root="" Jul 15 23:46:49.105579 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100087 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 15 23:46:49.105579 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100091 2564 flags.go:64] FLAG: --client-ca-file="" Jul 15 23:46:49.105579 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100093 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 15 23:46:49.105579 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100096 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 15 23:46:49.105579 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100101 2564 flags.go:64] FLAG: --cluster-domain="" Jul 15 23:46:49.105579 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100104 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 15 23:46:49.105579 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100107 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 15 23:46:49.105579 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100110 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 15 23:46:49.105579 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100113 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 15 23:46:49.105579 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100117 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 15 23:46:49.105579 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100120 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 15 23:46:49.105579 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100123 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 15 23:46:49.105579 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100126 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 15 23:46:49.105579 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100129 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 15 23:46:49.105579 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100132 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 15 23:46:49.105579 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100136 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 15 23:46:49.105579 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100139 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 15 23:46:49.105579 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100142 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 15 23:46:49.105579 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100146 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 15 23:46:49.105579 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100149 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 15 23:46:49.106214 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100152 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 15 23:46:49.106214 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100156 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 15 23:46:49.106214 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100159 2564 flags.go:64] FLAG: --enable-server="true" Jul 15 23:46:49.106214 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100162 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 15 23:46:49.106214 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100166 2564 flags.go:64] FLAG: --event-burst="100" Jul 15 23:46:49.106214 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100171 2564 flags.go:64] FLAG: --event-qps="50" Jul 15 23:46:49.106214 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100173 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 15 23:46:49.106214 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100177 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 15 23:46:49.106214 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100180 2564 flags.go:64] FLAG: --eviction-hard="" Jul 15 23:46:49.106214 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100183 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 15 23:46:49.106214 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100186 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 15 23:46:49.106214 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100189 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 15 23:46:49.106214 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100192 2564 flags.go:64] FLAG: --eviction-soft="" Jul 15 23:46:49.106214 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100195 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 15 23:46:49.106214 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100198 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 15 23:46:49.106214 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100201 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 15 23:46:49.106214 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100204 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 15 23:46:49.106214 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100206 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 15 23:46:49.106214 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100209 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 15 23:46:49.106214 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100212 2564 flags.go:64] FLAG: --feature-gates="" Jul 15 23:46:49.106214 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100216 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 15 23:46:49.106214 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100219 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 15 23:46:49.106214 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100222 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 15 23:46:49.106214 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100225 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 15 23:46:49.106214 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100228 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 15 23:46:49.106214 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100231 2564 flags.go:64] FLAG: --help="false" Jul 15 23:46:49.106877 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100234 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-142-228.ec2.internal" Jul 15 23:46:49.106877 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100237 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 15 23:46:49.106877 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100240 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 15 23:46:49.106877 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100243 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 15 23:46:49.106877 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100246 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 15 23:46:49.106877 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100249 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 15 23:46:49.106877 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100252 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 15 23:46:49.106877 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100257 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 15 23:46:49.106877 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100259 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 15 23:46:49.106877 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100262 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 15 23:46:49.106877 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100265 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 15 23:46:49.106877 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100269 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 15 23:46:49.106877 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100272 2564 flags.go:64] FLAG: --kube-reserved="" Jul 15 23:46:49.106877 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100275 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 15 23:46:49.106877 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100278 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 15 23:46:49.106877 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100281 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 15 23:46:49.106877 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100284 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 15 23:46:49.106877 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100287 2564 flags.go:64] FLAG: --lock-file="" Jul 15 23:46:49.106877 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100290 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 15 23:46:49.106877 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100293 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 15 23:46:49.106877 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100296 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 15 23:46:49.106877 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100301 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 15 23:46:49.106877 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100304 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 15 23:46:49.107451 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100307 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 15 23:46:49.107451 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100310 2564 flags.go:64] FLAG: --logging-format="text" Jul 15 23:46:49.107451 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100313 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 15 23:46:49.107451 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100316 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 15 23:46:49.107451 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100319 2564 flags.go:64] FLAG: --manifest-url="" Jul 15 23:46:49.107451 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100322 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 15 23:46:49.107451 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100326 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 15 23:46:49.107451 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100329 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 15 23:46:49.107451 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100332 2564 flags.go:64] FLAG: --max-pods="110" Jul 15 23:46:49.107451 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100335 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 15 23:46:49.107451 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100338 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 15 23:46:49.107451 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100341 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 15 23:46:49.107451 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100344 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 15 23:46:49.107451 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100347 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 15 23:46:49.107451 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100350 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 15 23:46:49.107451 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100353 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 15 23:46:49.107451 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100361 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 15 23:46:49.107451 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100364 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 15 23:46:49.107451 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100367 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 15 23:46:49.107451 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100370 2564 flags.go:64] FLAG: --pod-cidr="" Jul 15 23:46:49.107451 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100374 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 15 23:46:49.107451 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100379 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 15 23:46:49.107451 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100382 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 15 23:46:49.107451 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100385 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 15 23:46:49.108056 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100388 2564 flags.go:64] FLAG: --port="10250" Jul 15 23:46:49.108056 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100391 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 15 23:46:49.108056 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100394 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04a1022a53334d75f" Jul 15 23:46:49.108056 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100397 2564 flags.go:64] FLAG: --qos-reserved="" Jul 15 23:46:49.108056 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100400 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 15 23:46:49.108056 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100403 2564 flags.go:64] FLAG: --register-node="true" Jul 15 23:46:49.108056 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100406 2564 flags.go:64] FLAG: --register-with-taints="" Jul 15 23:46:49.108056 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100409 2564 flags.go:64] FLAG: --registry-burst="10" Jul 15 23:46:49.108056 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100412 2564 flags.go:64] FLAG: --registry-qps="5" Jul 15 23:46:49.108056 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100414 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 15 23:46:49.108056 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100417 2564 flags.go:64] FLAG: --reserved-memory="" Jul 15 23:46:49.108056 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100421 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 15 23:46:49.108056 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100424 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 15 23:46:49.108056 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100426 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 15 23:46:49.108056 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100429 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 15 23:46:49.108056 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100432 2564 flags.go:64] FLAG: --runonce="false" Jul 15 23:46:49.108056 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100435 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 15 23:46:49.108056 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100438 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 15 23:46:49.108056 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100441 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 15 23:46:49.108056 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100443 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 15 23:46:49.108056 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100446 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 15 23:46:49.108056 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100449 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 15 23:46:49.108056 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100453 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 15 23:46:49.108056 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100456 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 15 23:46:49.108056 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100458 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 15 23:46:49.108056 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100461 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 15 23:46:49.108999 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100464 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 15 23:46:49.108999 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100467 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 15 23:46:49.108999 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100470 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 15 23:46:49.108999 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100473 2564 flags.go:64] FLAG: --system-cgroups="" Jul 15 23:46:49.108999 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100476 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 15 23:46:49.108999 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100481 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 15 23:46:49.108999 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100484 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 15 23:46:49.108999 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100487 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 15 23:46:49.108999 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100491 2564 flags.go:64] FLAG: --tls-min-version="" Jul 15 23:46:49.108999 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100494 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 15 23:46:49.108999 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100497 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 15 23:46:49.108999 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100500 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 15 23:46:49.108999 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100503 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 15 23:46:49.108999 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100506 2564 flags.go:64] FLAG: --v="2" Jul 15 23:46:49.108999 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100510 2564 flags.go:64] FLAG: --version="false" Jul 15 23:46:49.108999 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100514 2564 flags.go:64] FLAG: --vmodule="" Jul 15 23:46:49.108999 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100517 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 15 23:46:49.108999 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.100521 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 15 23:46:49.108999 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100632 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 23:46:49.108999 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100637 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 23:46:49.108999 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100641 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 23:46:49.108999 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100644 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 23:46:49.108999 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100647 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 23:46:49.109872 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100649 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 23:46:49.109872 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100652 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 23:46:49.109872 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100655 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 23:46:49.109872 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100657 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 23:46:49.109872 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100660 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 23:46:49.109872 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100675 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 23:46:49.109872 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100679 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 23:46:49.109872 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100681 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 15 23:46:49.109872 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100684 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 23:46:49.109872 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100687 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 23:46:49.109872 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100690 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 23:46:49.109872 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100693 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 23:46:49.109872 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100695 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 23:46:49.109872 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100698 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 23:46:49.109872 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100700 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 23:46:49.109872 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100703 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 23:46:49.109872 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100706 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 23:46:49.109872 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100708 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 23:46:49.109872 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100711 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 23:46:49.109872 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100713 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 23:46:49.110376 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100716 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 23:46:49.110376 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100719 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 23:46:49.110376 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100722 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 23:46:49.110376 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100724 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 23:46:49.110376 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100726 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 23:46:49.110376 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100729 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 23:46:49.110376 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100733 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 23:46:49.110376 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100736 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 23:46:49.110376 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100739 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 23:46:49.110376 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100742 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 23:46:49.110376 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100746 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 23:46:49.110376 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100749 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 23:46:49.110376 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100752 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 23:46:49.110376 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100755 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 23:46:49.110376 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100758 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 23:46:49.110376 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100761 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 23:46:49.110376 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100765 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 23:46:49.110376 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100767 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 23:46:49.110376 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100770 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 23:46:49.110376 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100773 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 23:46:49.110880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100776 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 23:46:49.110880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100779 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 23:46:49.110880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100781 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 23:46:49.110880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100784 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 23:46:49.110880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100787 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 23:46:49.110880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100790 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 23:46:49.110880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100793 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 23:46:49.110880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100795 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 23:46:49.110880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100798 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 23:46:49.110880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100801 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 23:46:49.110880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100803 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 23:46:49.110880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100806 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 23:46:49.110880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100809 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 23:46:49.110880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100812 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 23:46:49.110880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100814 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 23:46:49.110880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100818 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 23:46:49.110880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100821 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 23:46:49.110880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100824 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 23:46:49.110880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100833 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 23:46:49.110880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100837 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 23:46:49.111377 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100840 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 23:46:49.111377 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100843 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 23:46:49.111377 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100845 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 23:46:49.111377 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100848 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 23:46:49.111377 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100851 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 23:46:49.111377 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100853 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 23:46:49.111377 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100856 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 23:46:49.111377 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100858 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 23:46:49.111377 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100861 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 23:46:49.111377 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100863 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 23:46:49.111377 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100866 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 23:46:49.111377 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100868 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 23:46:49.111377 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100873 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 23:46:49.111377 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100876 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 23:46:49.111377 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100878 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 23:46:49.111377 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100882 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 23:46:49.111377 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100884 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 23:46:49.111377 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100887 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 23:46:49.111377 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100889 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 23:46:49.111377 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100892 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 23:46:49.111868 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100894 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 23:46:49.111868 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100897 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 23:46:49.111868 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100900 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 23:46:49.111868 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100902 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 23:46:49.111868 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100905 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 23:46:49.111868 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100907 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 23:46:49.111868 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100910 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 23:46:49.111868 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100912 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 23:46:49.111868 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100915 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 23:46:49.111868 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100917 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 23:46:49.111868 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100920 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 23:46:49.111868 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100923 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 23:46:49.111868 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100925 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 23:46:49.111868 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.100928 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 23:46:49.111868 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.101763 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 23:46:49.112240 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.110194 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 15 23:46:49.112240 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.110208 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 15 23:46:49.112240 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.111051 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 15 23:46:49.112240 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.111060 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 15 23:46:49.112240 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111118 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 23:46:49.112240 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111123 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 23:46:49.112240 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111126 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 23:46:49.112240 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111130 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 23:46:49.112240 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111132 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 23:46:49.112240 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111135 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 23:46:49.112240 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111138 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 23:46:49.112240 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111141 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 23:46:49.112240 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111143 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 23:46:49.112240 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111146 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 23:46:49.112240 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111149 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 23:46:49.112240 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111151 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 23:46:49.112240 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111154 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 23:46:49.112240 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111157 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 23:46:49.112240 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111159 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 23:46:49.112708 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111162 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 23:46:49.112708 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111164 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 23:46:49.112708 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111168 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 23:46:49.112708 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111171 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 23:46:49.112708 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111173 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 23:46:49.112708 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111176 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 23:46:49.112708 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111179 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 23:46:49.112708 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111181 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 23:46:49.112708 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111183 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 23:46:49.112708 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111186 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 23:46:49.112708 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111188 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 23:46:49.112708 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111191 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 23:46:49.112708 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111194 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 23:46:49.112708 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111197 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 23:46:49.112708 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111200 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 23:46:49.112708 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111202 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 23:46:49.112708 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111205 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 23:46:49.112708 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111208 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 23:46:49.112708 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111210 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 23:46:49.113192 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111213 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 23:46:49.113192 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111215 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 23:46:49.113192 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111218 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 23:46:49.113192 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111221 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 23:46:49.113192 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111223 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 23:46:49.113192 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111226 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 23:46:49.113192 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111228 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 23:46:49.113192 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111231 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 23:46:49.113192 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111233 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 23:46:49.113192 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111236 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 23:46:49.113192 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111238 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 23:46:49.113192 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111241 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 23:46:49.113192 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111244 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 23:46:49.113192 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111247 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 23:46:49.113192 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111249 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 23:46:49.113192 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111252 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 23:46:49.113192 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111254 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 23:46:49.113192 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111256 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 23:46:49.113192 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111259 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 23:46:49.113192 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111262 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 23:46:49.113192 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111264 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 15 23:46:49.113712 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111267 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 23:46:49.113712 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111269 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 23:46:49.113712 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111272 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 23:46:49.113712 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111274 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 23:46:49.113712 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111276 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 23:46:49.113712 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111280 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 23:46:49.113712 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111283 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 23:46:49.113712 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111285 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 23:46:49.113712 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111288 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 23:46:49.113712 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111290 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 23:46:49.113712 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111294 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 23:46:49.113712 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111298 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 23:46:49.113712 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111301 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 23:46:49.113712 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111304 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 23:46:49.113712 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111306 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 23:46:49.113712 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111309 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 23:46:49.113712 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111311 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 23:46:49.113712 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111314 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 23:46:49.113712 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111316 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 23:46:49.114235 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111320 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 23:46:49.114235 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111324 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 23:46:49.114235 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111328 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 23:46:49.114235 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111331 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 23:46:49.114235 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111334 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 23:46:49.114235 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111337 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 23:46:49.114235 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111340 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 23:46:49.114235 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111342 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 23:46:49.114235 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111345 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 23:46:49.114235 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111347 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 23:46:49.114235 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111350 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 23:46:49.114235 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111352 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 23:46:49.114235 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111355 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 23:46:49.114235 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111357 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 23:46:49.114235 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111360 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 23:46:49.114235 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111362 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 23:46:49.114235 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111365 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 23:46:49.114235 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111368 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 23:46:49.114235 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111371 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 23:46:49.114880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111374 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 23:46:49.114880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111376 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 23:46:49.114880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111379 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 23:46:49.114880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111381 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 23:46:49.114880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111384 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 23:46:49.114880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111387 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 23:46:49.114880 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.111392 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 23:46:49.114880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111517 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 23:46:49.114880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111523 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 23:46:49.114880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111527 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 23:46:49.114880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111531 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 23:46:49.114880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111534 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 23:46:49.114880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111536 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 23:46:49.114880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111539 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 23:46:49.114880 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111542 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 23:46:49.115255 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111544 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 23:46:49.115255 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111547 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 23:46:49.115255 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111549 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 23:46:49.115255 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111552 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 23:46:49.115255 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111555 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 23:46:49.115255 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111558 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 23:46:49.115255 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111560 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 23:46:49.115255 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111563 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 23:46:49.115255 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111565 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 23:46:49.115255 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111568 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 23:46:49.115255 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111571 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 23:46:49.115255 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111573 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 23:46:49.115255 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111576 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 23:46:49.115255 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111578 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 23:46:49.115255 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111582 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 23:46:49.115255 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111585 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 23:46:49.115255 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111588 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 23:46:49.115255 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111591 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 23:46:49.115255 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111594 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 23:46:49.115764 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111597 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 23:46:49.115764 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111600 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 23:46:49.115764 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111602 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 23:46:49.115764 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111605 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 23:46:49.115764 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111608 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 23:46:49.115764 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111610 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 23:46:49.115764 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111612 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 23:46:49.115764 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111615 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 23:46:49.115764 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111617 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 23:46:49.115764 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111620 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 23:46:49.115764 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111622 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 23:46:49.115764 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111625 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 23:46:49.115764 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111627 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 23:46:49.115764 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111630 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 23:46:49.115764 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111632 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 23:46:49.115764 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111634 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 23:46:49.115764 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111636 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 23:46:49.115764 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111639 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 23:46:49.115764 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111642 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 23:46:49.115764 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111644 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 23:46:49.116336 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111647 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 23:46:49.116336 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111649 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 23:46:49.116336 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111652 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 23:46:49.116336 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111654 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 23:46:49.116336 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111657 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 23:46:49.116336 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111659 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 23:46:49.116336 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111676 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 15 23:46:49.116336 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111679 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 23:46:49.116336 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111682 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 23:46:49.116336 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111684 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 23:46:49.116336 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111687 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 23:46:49.116336 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111690 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 23:46:49.116336 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111692 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 23:46:49.116336 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111695 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 23:46:49.116336 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111697 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 23:46:49.116336 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111700 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 23:46:49.116336 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111703 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 23:46:49.116336 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111705 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 23:46:49.116336 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111708 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 23:46:49.116336 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111710 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 23:46:49.116851 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111713 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 23:46:49.116851 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111715 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 23:46:49.116851 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111718 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 23:46:49.116851 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111720 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 23:46:49.116851 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111722 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 23:46:49.116851 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111725 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 23:46:49.116851 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111728 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 23:46:49.116851 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111730 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 23:46:49.116851 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111733 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 23:46:49.116851 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111735 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 23:46:49.116851 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111738 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 23:46:49.116851 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111742 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 23:46:49.116851 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111744 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 23:46:49.116851 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111747 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 23:46:49.116851 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111749 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 23:46:49.116851 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111752 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 23:46:49.116851 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111755 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 23:46:49.116851 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111757 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 23:46:49.116851 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111760 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 23:46:49.116851 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111762 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 23:46:49.117407 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111765 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 23:46:49.117407 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111767 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 23:46:49.117407 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111770 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 23:46:49.117407 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111772 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 23:46:49.117407 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111775 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 23:46:49.117407 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111777 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 23:46:49.117407 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111780 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 23:46:49.117407 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111782 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 23:46:49.117407 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111786 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 23:46:49.117407 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111790 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 23:46:49.117407 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111794 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 23:46:49.117407 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:49.111796 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 23:46:49.117407 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.111802 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 23:46:49.117407 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.111911 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 15 23:46:49.117769 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.114269 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 15 23:46:49.117769 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.115885 2564 server.go:1019] "Starting client certificate rotation" Jul 15 23:46:49.117769 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.116004 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 23:46:49.117769 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.116048 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 23:46:49.118694 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.118660 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 23:46:49.119806 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.119785 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 23:46:49.136006 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.135989 2564 log.go:25] "Validated CRI v1 runtime API" Jul 15 23:46:49.138747 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.138731 2564 log.go:25] "Validated CRI v1 image API" Jul 15 23:46:49.139495 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.139480 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 15 23:46:49.142844 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.142825 2564 fs.go:135] Filesystem UUIDs: map[10deb564-a45f-4dcd-9ef7-8cf0f310a9ef:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 eb3888bb-af30-4e27-8d72-7de5ad40a664:/dev/nvme0n1p4] Jul 15 23:46:49.142902 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.142843 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 15 23:46:49.146570 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.146356 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 23:46:49.149659 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.149546 2564 manager.go:216] Machine: {Timestamp:2026-07-15 23:46:49.148237826 +0000 UTC m=+0.379216563 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3113591 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23d7a5c4bd035cd9baeedec70a0289 SystemUUID:ec23d7a5-c4bd-035c-d9ba-eedec70a0289 BootID:326b81e5-1279-48b1-99f8-223a28ce910a Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:28:da:0e:95:45 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:28:da:0e:95:45 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:ef:76:13:c0:ed Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 15 23:46:49.149659 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.149647 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 15 23:46:49.149793 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.149732 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 15 23:46:49.152294 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.152267 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 15 23:46:49.152422 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.152297 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-228.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 15 23:46:49.153337 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.153327 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 15 23:46:49.153377 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.153339 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 15 23:46:49.153377 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.153346 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 23:46:49.153377 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.153361 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 23:46:49.155176 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.155167 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 15 23:46:49.159504 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.159492 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 15 23:46:49.159609 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.159600 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 15 23:46:49.159640 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.159629 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 15 23:46:49.159640 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.159639 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 15 23:46:49.159711 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.159656 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 15 23:46:49.159711 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.159679 2564 kubelet.go:398] "Adding apiserver pod source" Jul 15 23:46:49.159711 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.159697 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 15 23:46:49.160643 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.160622 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 23:46:49.160717 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.160647 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 23:46:49.162946 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.162928 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 15 23:46:49.165193 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.165180 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 15 23:46:49.165249 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.165209 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 15 23:46:49.165371 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.165361 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 15 23:46:49.165414 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.165375 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 15 23:46:49.165414 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.165381 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 15 23:46:49.165414 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.165386 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 15 23:46:49.165414 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.165394 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 15 23:46:49.165414 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.165399 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 15 23:46:49.166061 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.166051 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 15 23:46:49.166061 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.166060 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 15 23:46:49.166122 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.166067 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 15 23:46:49.166122 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.166073 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 15 23:46:49.166122 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.166081 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 15 23:46:49.166122 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.166089 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 15 23:46:49.166919 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.166911 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 15 23:46:49.166919 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.166919 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 15 23:46:49.170010 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.169997 2564 server.go:1268] "Started kubelet" Jul 15 23:46:49.170098 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.170072 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 15 23:46:49.170606 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:49.170371 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-228.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 15 23:46:49.170606 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.170202 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 15 23:46:49.170606 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.170417 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-228.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 15 23:46:49.170606 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.170457 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 15 23:46:49.170854 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:49.170651 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 15 23:46:49.171002 ip-10-0-142-228 systemd[1]: Started Kubernetes Kubelet. Jul 15 23:46:49.171983 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.171908 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 15 23:46:49.172139 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.172074 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 15 23:46:49.177085 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:49.177054 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 15 23:46:49.179193 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:49.178091 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-228.ec2.internal.18c29b590d51615a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-228.ec2.internal,UID:ip-10-0-142-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-228.ec2.internal,},FirstTimestamp:2026-07-15 23:46:49.169969498 +0000 UTC m=+0.400948236,LastTimestamp:2026-07-15 23:46:49.169969498 +0000 UTC m=+0.400948236,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-228.ec2.internal,}" Jul 15 23:46:49.179830 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.179809 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 15 23:46:49.179830 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.179825 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 15 23:46:49.179968 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:49.179896 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-228.ec2.internal\" not found" Jul 15 23:46:49.180834 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.180576 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 15 23:46:49.180834 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.180579 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 15 23:46:49.180834 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.180603 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 15 23:46:49.180834 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.180782 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 15 23:46:49.180834 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.180792 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 15 23:46:49.181090 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.180970 2564 factory.go:153] Registering CRI-O factory Jul 15 23:46:49.181090 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.180985 2564 factory.go:223] Registration of the crio container factory successfully Jul 15 23:46:49.181090 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.181042 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 15 23:46:49.181090 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.181052 2564 factory.go:55] Registering systemd factory Jul 15 23:46:49.181090 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.181061 2564 factory.go:223] Registration of the systemd container factory successfully Jul 15 23:46:49.181090 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.181085 2564 factory.go:103] Registering Raw factory Jul 15 23:46:49.181327 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.181101 2564 manager.go:1196] Started watching for new ooms in manager Jul 15 23:46:49.182075 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.182056 2564 manager.go:349] Starting recovery of all containers Jul 15 23:46:49.182376 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:49.182355 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 15 23:46:49.182582 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:49.182477 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-228.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 15 23:46:49.190999 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.190977 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cjdgn" Jul 15 23:46:49.195113 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.195096 2564 manager.go:354] Recovery completed Jul 15 23:46:49.198782 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.198768 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cjdgn" Jul 15 23:46:49.199277 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.199267 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 23:46:49.201068 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.201052 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasSufficientMemory" Jul 15 23:46:49.201135 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.201076 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 23:46:49.201135 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.201090 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasSufficientPID" Jul 15 23:46:49.201562 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.201546 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 15 23:46:49.201562 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.201559 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 15 23:46:49.201698 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.201572 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 15 23:46:49.201698 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.201584 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 23:46:49.202256 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.202241 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasSufficientMemory" Jul 15 23:46:49.202329 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.202271 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 23:46:49.202329 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.202285 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasSufficientPID" Jul 15 23:46:49.202807 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:49.202728 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-228.ec2.internal.18c29b590f2be5a2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-228.ec2.internal,UID:ip-10-0-142-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-228.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-228.ec2.internal,},FirstTimestamp:2026-07-15 23:46:49.201067426 +0000 UTC m=+0.432046164,LastTimestamp:2026-07-15 23:46:49.201067426 +0000 UTC m=+0.432046164,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-228.ec2.internal,}" Jul 15 23:46:49.203350 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.203339 2564 policy_none.go:49] "None policy: Start" Jul 15 23:46:49.203404 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.203354 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 15 23:46:49.203404 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.203364 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 15 23:46:49.205288 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.205278 2564 policy_none.go:47] "Start" Jul 15 23:46:49.239374 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.239262 2564 manager.go:337] "Starting Device Plugin manager" Jul 15 23:46:49.265268 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:49.239393 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 15 23:46:49.265268 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.239405 2564 server.go:87] "Starting device plugin registration server" Jul 15 23:46:49.265268 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.239619 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 15 23:46:49.265268 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.239639 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 15 23:46:49.265268 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.239743 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 15 23:46:49.265268 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.239812 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 15 23:46:49.265268 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.239819 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 15 23:46:49.265268 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:49.240248 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 15 23:46:49.265268 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:49.240298 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-228.ec2.internal\" not found" Jul 15 23:46:49.293176 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.293147 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 15 23:46:49.294873 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.294850 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 15 23:46:49.294972 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.294888 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 15 23:46:49.294972 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.294934 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 15 23:46:49.294972 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:49.294968 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 15 23:46:49.297401 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.297384 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 23:46:49.340341 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.340312 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 23:46:49.341276 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.341259 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasSufficientMemory" Jul 15 23:46:49.341381 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.341290 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 23:46:49.341381 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.341301 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasSufficientPID" Jul 15 23:46:49.341381 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.341326 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-228.ec2.internal" Jul 15 23:46:49.350465 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.350448 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-228.ec2.internal" Jul 15 23:46:49.350515 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:49.350469 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-228.ec2.internal\": node \"ip-10-0-142-228.ec2.internal\" not found" Jul 15 23:46:49.377114 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:49.377094 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-228.ec2.internal\" not found" Jul 15 23:46:49.395651 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.395631 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-228.ec2.internal"] Jul 15 23:46:49.395725 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.395704 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 23:46:49.397086 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.397068 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasSufficientMemory" Jul 15 23:46:49.397155 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.397099 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 23:46:49.397155 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.397109 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasSufficientPID" Jul 15 23:46:49.399289 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.399272 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 23:46:49.399400 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.399384 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal" Jul 15 23:46:49.399450 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.399420 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 23:46:49.400038 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.400018 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasSufficientMemory" Jul 15 23:46:49.400121 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.400018 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasSufficientMemory" Jul 15 23:46:49.400121 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.400048 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 23:46:49.400121 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.400064 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 23:46:49.400121 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.400076 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasSufficientPID" Jul 15 23:46:49.400284 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.400076 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasSufficientPID" Jul 15 23:46:49.402892 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.402627 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-228.ec2.internal" Jul 15 23:46:49.402892 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.402759 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 23:46:49.404681 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.403758 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasSufficientMemory" Jul 15 23:46:49.404681 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.403809 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 23:46:49.404681 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.403829 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasSufficientPID" Jul 15 23:46:49.431363 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:49.431337 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-228.ec2.internal\" not found" node="ip-10-0-142-228.ec2.internal" Jul 15 23:46:49.435579 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:49.435564 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-228.ec2.internal\" not found" node="ip-10-0-142-228.ec2.internal" Jul 15 23:46:49.477610 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:49.477583 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-228.ec2.internal\" not found" Jul 15 23:46:49.482961 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.482941 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/58146809344bc600ef4d3117f4b90eae-config\") pod \"kube-apiserver-proxy-ip-10-0-142-228.ec2.internal\" (UID: \"58146809344bc600ef4d3117f4b90eae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-228.ec2.internal" Jul 15 23:46:49.482961 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.482966 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/df9ef33bf17b0a1d5bf1c6e6c0257c40-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal\" (UID: \"df9ef33bf17b0a1d5bf1c6e6c0257c40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal" Jul 15 23:46:49.483111 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.482984 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df9ef33bf17b0a1d5bf1c6e6c0257c40-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal\" (UID: \"df9ef33bf17b0a1d5bf1c6e6c0257c40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal" Jul 15 23:46:49.578556 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:49.578458 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-228.ec2.internal\" not found" Jul 15 23:46:49.583757 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.583738 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/df9ef33bf17b0a1d5bf1c6e6c0257c40-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal\" (UID: \"df9ef33bf17b0a1d5bf1c6e6c0257c40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal" Jul 15 23:46:49.583910 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.583770 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df9ef33bf17b0a1d5bf1c6e6c0257c40-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal\" (UID: \"df9ef33bf17b0a1d5bf1c6e6c0257c40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal" Jul 15 23:46:49.583910 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.583798 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/58146809344bc600ef4d3117f4b90eae-config\") pod \"kube-apiserver-proxy-ip-10-0-142-228.ec2.internal\" (UID: \"58146809344bc600ef4d3117f4b90eae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-228.ec2.internal" Jul 15 23:46:49.583910 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.583845 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/df9ef33bf17b0a1d5bf1c6e6c0257c40-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal\" (UID: \"df9ef33bf17b0a1d5bf1c6e6c0257c40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal" Jul 15 23:46:49.583910 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.583850 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df9ef33bf17b0a1d5bf1c6e6c0257c40-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal\" (UID: \"df9ef33bf17b0a1d5bf1c6e6c0257c40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal" Jul 15 23:46:49.583910 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.583845 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/58146809344bc600ef4d3117f4b90eae-config\") pod \"kube-apiserver-proxy-ip-10-0-142-228.ec2.internal\" (UID: \"58146809344bc600ef4d3117f4b90eae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-228.ec2.internal" Jul 15 23:46:49.679163 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:49.679113 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-228.ec2.internal\" not found" Jul 15 23:46:49.735680 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.735626 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal" Jul 15 23:46:49.737883 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:49.737867 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-228.ec2.internal" Jul 15 23:46:49.780378 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:49.780343 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-228.ec2.internal\" not found" Jul 15 23:46:49.887144 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:49.887047 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-228.ec2.internal\" not found" Jul 15 23:46:49.987863 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:49.987821 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-228.ec2.internal\" not found" Jul 15 23:46:50.088143 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:50.088090 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-228.ec2.internal\" not found" Jul 15 23:46:50.115331 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:50.115298 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 15 23:46:50.115858 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:50.115572 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 23:46:50.188782 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:50.188752 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-228.ec2.internal\" not found" Jul 15 23:46:50.203791 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:50.203752 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 23:41:49 +0000 UTC" deadline="2028-03-28 08:14:04.191700898 +0000 UTC" Jul 15 23:46:50.203791 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:50.203787 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14912h27m13.987917311s" Jul 15 23:46:50.288549 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:50.288516 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf9ef33bf17b0a1d5bf1c6e6c0257c40.slice/crio-c9f34a161e8bfd547ef81bac25628f8c02e34e23ef08d984d705a913d81277f3 WatchSource:0}: Error finding container c9f34a161e8bfd547ef81bac25628f8c02e34e23ef08d984d705a913d81277f3: Status 404 returned error can't find the container with id c9f34a161e8bfd547ef81bac25628f8c02e34e23ef08d984d705a913d81277f3 Jul 15 23:46:50.288890 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:50.288867 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-228.ec2.internal\" not found" Jul 15 23:46:50.289169 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:50.289149 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58146809344bc600ef4d3117f4b90eae.slice/crio-0fc2b5c05d56faa2a5e37a4e120c82b202254a8f885312e302d8b56eb35eee09 WatchSource:0}: Error finding container 0fc2b5c05d56faa2a5e37a4e120c82b202254a8f885312e302d8b56eb35eee09: Status 404 returned error can't find the container with id 0fc2b5c05d56faa2a5e37a4e120c82b202254a8f885312e302d8b56eb35eee09 Jul 15 23:46:50.294051 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:50.294034 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 23:46:50.297966 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:50.297924 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-228.ec2.internal" event={"ID":"58146809344bc600ef4d3117f4b90eae","Type":"ContainerStarted","Data":"0fc2b5c05d56faa2a5e37a4e120c82b202254a8f885312e302d8b56eb35eee09"} Jul 15 23:46:50.298991 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:50.298968 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal" event={"ID":"df9ef33bf17b0a1d5bf1c6e6c0257c40","Type":"ContainerStarted","Data":"c9f34a161e8bfd547ef81bac25628f8c02e34e23ef08d984d705a913d81277f3"} Jul 15 23:46:50.374387 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:50.374358 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 23:46:50.380586 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:50.380557 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-228.ec2.internal" Jul 15 23:46:50.391400 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:50.391373 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 23:46:50.393544 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:50.393530 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal" Jul 15 23:46:50.405247 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:50.405198 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 23:46:50.466319 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:50.466291 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 23:46:50.653462 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:50.653436 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 23:46:51.161883 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.161830 2564 apiserver.go:52] "Watching apiserver" Jul 15 23:46:51.169501 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.169475 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 15 23:46:51.169984 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.169957 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-hjtzh","openshift-multus/multus-ldxg2","openshift-multus/network-metrics-daemon-pp4rq","kube-system/konnectivity-agent-j5p5p","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm","openshift-image-registry/node-ca-r9q5g","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal","openshift-network-diagnostics/network-check-target-5pjjq","openshift-network-operator/iptables-alerter-kxllk","openshift-ovn-kubernetes/ovnkube-node-fp65r","kube-system/global-pull-secret-syncer-tgnmg","kube-system/kube-apiserver-proxy-ip-10-0-142-228.ec2.internal","openshift-cluster-node-tuning-operator/tuned-x9p7s","openshift-dns/node-resolver-cj8th"] Jul 15 23:46:51.172769 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.172750 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.175108 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.175075 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 15 23:46:51.175268 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.175181 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:46:51.175381 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:51.175260 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pjjq" podUID="b98aea50-bfd9-48e4-984e-f5a89ee01212" Jul 15 23:46:51.175627 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.175601 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 15 23:46:51.175753 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.175633 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 15 23:46:51.175753 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.175642 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 15 23:46:51.175753 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.175655 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 15 23:46:51.176082 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.176056 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 15 23:46:51.176176 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.176078 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rnhhl\"" Jul 15 23:46:51.180215 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.178341 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:46:51.180215 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:51.178467 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp4rq" podUID="371e613a-079b-4d90-83bc-8145a0d84fce" Jul 15 23:46:51.180553 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.180434 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 15 23:46:51.182425 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.181662 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j5p5p" Jul 15 23:46:51.184086 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.184045 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9h5mn\"" Jul 15 23:46:51.184192 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.184123 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cj8th" Jul 15 23:46:51.184192 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.184162 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 15 23:46:51.184305 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.184227 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 15 23:46:51.186433 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.186411 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 15 23:46:51.186535 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.186442 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ln2q5\"" Jul 15 23:46:51.186535 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.186519 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 15 23:46:51.186813 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.186795 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r9q5g" Jul 15 23:46:51.189538 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.189517 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 15 23:46:51.189538 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.189531 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8q5mw\"" Jul 15 23:46:51.189686 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.189540 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 15 23:46:51.189686 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.189548 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 15 23:46:51.190067 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.190045 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kxllk" Jul 15 23:46:51.192446 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.192428 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 15 23:46:51.192623 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.192439 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2gsdh\"" Jul 15 23:46:51.192712 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.192633 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.192712 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.192523 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 15 23:46:51.193266 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.193246 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-host-kubelet\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.193408 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.193391 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-run-ovn\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.193549 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.193526 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cknbb\" (UniqueName: \"kubernetes.io/projected/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-kube-api-access-cknbb\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.193661 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.193302 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 15 23:46:51.193661 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.193579 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b613c0ea-4e1e-44b2-a508-90569d8f9d2f-agent-certs\") pod \"konnectivity-agent-j5p5p\" (UID: \"b613c0ea-4e1e-44b2-a508-90569d8f9d2f\") " pod="kube-system/konnectivity-agent-j5p5p" Jul 15 23:46:51.193886 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.193806 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 23:46:51.193999 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.193606 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-host-run-netns\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.194067 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.193999 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-var-lib-openvswitch\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.194067 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.194025 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-node-log\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.194182 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.194093 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-env-overrides\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.194182 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.194119 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-ovn-node-metrics-cert\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.194182 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.194155 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-ovnkube-script-lib\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.194328 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.194248 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/371e613a-079b-4d90-83bc-8145a0d84fce-metrics-certs\") pod \"network-metrics-daemon-pp4rq\" (UID: \"371e613a-079b-4d90-83bc-8145a0d84fce\") " pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:46:51.194328 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.194284 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b613c0ea-4e1e-44b2-a508-90569d8f9d2f-konnectivity-ca\") pod \"konnectivity-agent-j5p5p\" (UID: \"b613c0ea-4e1e-44b2-a508-90569d8f9d2f\") " pod="kube-system/konnectivity-agent-j5p5p" Jul 15 23:46:51.194328 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.194313 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-systemd-units\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.194554 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.194348 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-host-slash\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.194554 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.194375 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-etc-openvswitch\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.194554 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.194398 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-run-openvswitch\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.194554 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.194423 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-host-cni-bin\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.194554 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.194448 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-host-cni-netd\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.194554 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.194523 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24bzw\" (UniqueName: \"kubernetes.io/projected/371e613a-079b-4d90-83bc-8145a0d84fce-kube-api-access-24bzw\") pod \"network-metrics-daemon-pp4rq\" (UID: \"371e613a-079b-4d90-83bc-8145a0d84fce\") " pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:46:51.194972 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.194550 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-run-systemd\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.194972 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.194623 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-log-socket\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.194972 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.194687 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-host-run-ovn-kubernetes\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.194972 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.194714 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.194972 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.194740 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-ovnkube-config\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.194972 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.194766 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fdwc\" (UniqueName: \"kubernetes.io/projected/b98aea50-bfd9-48e4-984e-f5a89ee01212-kube-api-access-7fdwc\") pod \"network-check-target-5pjjq\" (UID: \"b98aea50-bfd9-48e4-984e-f5a89ee01212\") " pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:46:51.195331 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.194999 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-862th\"" Jul 15 23:46:51.195331 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.195035 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 15 23:46:51.195331 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.195242 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 15 23:46:51.195643 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.195623 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.198439 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.197993 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 15 23:46:51.198439 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.198030 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-csp52\"" Jul 15 23:46:51.198439 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.198288 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 15 23:46:51.198439 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.198293 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 15 23:46:51.198439 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.198416 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 15 23:46:51.198785 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.198565 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hjtzh" Jul 15 23:46:51.200993 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.200962 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm" Jul 15 23:46:51.201674 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.201652 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 15 23:46:51.201784 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.201756 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 15 23:46:51.201846 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.201665 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4q4rg\"" Jul 15 23:46:51.203315 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.203293 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 15 23:46:51.203411 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.203344 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 15 23:46:51.203477 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.203418 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 15 23:46:51.203477 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.203299 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x4p8z\"" Jul 15 23:46:51.203965 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.203926 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:46:51.204080 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:51.203988 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgnmg" podUID="ae3abafe-42bb-46fb-8165-4b95893c4b8d" Jul 15 23:46:51.218841 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.218686 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wcrrt" Jul 15 23:46:51.227179 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.227156 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wcrrt" Jul 15 23:46:51.264772 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.264738 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 23:46:51.281540 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.281502 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 15 23:46:51.295156 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.295127 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/371e613a-079b-4d90-83bc-8145a0d84fce-metrics-certs\") pod \"network-metrics-daemon-pp4rq\" (UID: \"371e613a-079b-4d90-83bc-8145a0d84fce\") " pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:46:51.295315 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.295167 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-etc-openvswitch\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.295315 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.295191 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-host-cni-bin\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.295315 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.295219 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk9bf\" (UniqueName: \"kubernetes.io/projected/5917490d-3db7-4d93-aa21-b302f20e9699-kube-api-access-gk9bf\") pod \"node-ca-r9q5g\" (UID: \"5917490d-3db7-4d93-aa21-b302f20e9699\") " pod="openshift-image-registry/node-ca-r9q5g" Jul 15 23:46:51.295315 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.295246 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3250a7da-dbfd-416b-b43b-b6e12d89b167-host-slash\") pod \"iptables-alerter-kxllk\" (UID: \"3250a7da-dbfd-416b-b43b-b6e12d89b167\") " pod="openshift-network-operator/iptables-alerter-kxllk" Jul 15 23:46:51.295315 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.295269 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-etc-kubernetes\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.295315 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.295284 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-host-cni-bin\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.295315 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.295290 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hzb2\" (UniqueName: \"kubernetes.io/projected/663dd66c-f292-455f-8193-aabb4393b346-kube-api-access-5hzb2\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.295610 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.295341 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-host-var-lib-kubelet\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.295610 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.295369 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-log-socket\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.295610 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.295417 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-log-socket\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.295610 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.295413 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-host-run-ovn-kubernetes\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.295610 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.295443 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-host-run-ovn-kubernetes\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.295610 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.295485 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-etc-openvswitch\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.295610 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.295500 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3250a7da-dbfd-416b-b43b-b6e12d89b167-iptables-alerter-script\") pod \"iptables-alerter-kxllk\" (UID: \"3250a7da-dbfd-416b-b43b-b6e12d89b167\") " pod="openshift-network-operator/iptables-alerter-kxllk" Jul 15 23:46:51.295610 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.295562 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01724c1a-84e1-4d42-b3c5-0ef10804e30c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hjtzh\" (UID: \"01724c1a-84e1-4d42-b3c5-0ef10804e30c\") " pod="openshift-multus/multus-additional-cni-plugins-hjtzh" Jul 15 23:46:51.295610 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.295603 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-etc-systemd\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.296054 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.295644 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-system-cni-dir\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.296054 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.295696 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b6691211-f8a7-4727-9f96-7af8e46f22d3-cni-binary-copy\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.296054 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.295736 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwdbp\" (UniqueName: \"kubernetes.io/projected/b6691211-f8a7-4727-9f96-7af8e46f22d3-kube-api-access-gwdbp\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.296054 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.295787 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-host-kubelet\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.296054 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.295828 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-host-kubelet\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.296054 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:51.295846 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 23:46:51.296054 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.295872 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01724c1a-84e1-4d42-b3c5-0ef10804e30c-cnibin\") pod \"multus-additional-cni-plugins-hjtzh\" (UID: \"01724c1a-84e1-4d42-b3c5-0ef10804e30c\") " pod="openshift-multus/multus-additional-cni-plugins-hjtzh" Jul 15 23:46:51.296054 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:51.295947 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/371e613a-079b-4d90-83bc-8145a0d84fce-metrics-certs podName:371e613a-079b-4d90-83bc-8145a0d84fce nodeName:}" failed. No retries permitted until 2026-07-15 23:46:51.7959108 +0000 UTC m=+3.026889532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/371e613a-079b-4d90-83bc-8145a0d84fce-metrics-certs") pod "network-metrics-daemon-pp4rq" (UID: "371e613a-079b-4d90-83bc-8145a0d84fce") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 23:46:51.296054 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.295976 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01724c1a-84e1-4d42-b3c5-0ef10804e30c-cni-binary-copy\") pod \"multus-additional-cni-plugins-hjtzh\" (UID: \"01724c1a-84e1-4d42-b3c5-0ef10804e30c\") " pod="openshift-multus/multus-additional-cni-plugins-hjtzh" Jul 15 23:46:51.296054 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.296011 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-node-log\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.296054 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.296042 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-env-overrides\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.296641 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.296073 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-ovn-node-metrics-cert\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.296641 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.296096 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-node-log\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.296641 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.296101 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01724c1a-84e1-4d42-b3c5-0ef10804e30c-system-cni-dir\") pod \"multus-additional-cni-plugins-hjtzh\" (UID: \"01724c1a-84e1-4d42-b3c5-0ef10804e30c\") " pod="openshift-multus/multus-additional-cni-plugins-hjtzh" Jul 15 23:46:51.296641 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.296234 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-host\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.296641 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.296286 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/663dd66c-f292-455f-8193-aabb4393b346-etc-tuned\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.296641 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.296321 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/58b10fb2-6a2e-4674-8bf3-84797e9fc223-device-dir\") pod \"aws-ebs-csi-driver-node-l26wm\" (UID: \"58b10fb2-6a2e-4674-8bf3-84797e9fc223\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm" Jul 15 23:46:51.296641 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.296360 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b613c0ea-4e1e-44b2-a508-90569d8f9d2f-konnectivity-ca\") pod \"konnectivity-agent-j5p5p\" (UID: \"b613c0ea-4e1e-44b2-a508-90569d8f9d2f\") " pod="kube-system/konnectivity-agent-j5p5p" Jul 15 23:46:51.296641 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.296388 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-systemd-units\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.296641 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.296569 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 15 23:46:51.296641 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.296638 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-systemd-units\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.297169 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.296658 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-env-overrides\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.297169 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.296671 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-host-slash\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.297169 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.296696 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-run-openvswitch\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.297169 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.296770 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-host-cni-netd\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.297169 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.296799 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-lib-modules\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.297169 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.296820 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-os-release\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.297169 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.296839 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-host-run-k8s-cni-cncf-io\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.297169 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.296905 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.297169 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.296925 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvrg6\" (UniqueName: \"kubernetes.io/projected/3250a7da-dbfd-416b-b43b-b6e12d89b167-kube-api-access-gvrg6\") pod \"iptables-alerter-kxllk\" (UID: \"3250a7da-dbfd-416b-b43b-b6e12d89b167\") " pod="openshift-network-operator/iptables-alerter-kxllk" Jul 15 23:46:51.297169 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.296943 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/480440ce-6eb7-434a-8e64-478fc9b19cc5-hosts-file\") pod \"node-resolver-cj8th\" (UID: \"480440ce-6eb7-434a-8e64-478fc9b19cc5\") " pod="openshift-dns/node-resolver-cj8th" Jul 15 23:46:51.297169 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.296982 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b613c0ea-4e1e-44b2-a508-90569d8f9d2f-konnectivity-ca\") pod \"konnectivity-agent-j5p5p\" (UID: \"b613c0ea-4e1e-44b2-a508-90569d8f9d2f\") " pod="kube-system/konnectivity-agent-j5p5p" Jul 15 23:46:51.297169 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297012 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-host-cni-netd\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.297169 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.296983 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-hostroot\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.297169 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297045 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.297169 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297060 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b6691211-f8a7-4727-9f96-7af8e46f22d3-multus-daemon-config\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.297169 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297064 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-host-slash\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.297169 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297025 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-run-openvswitch\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.298042 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297105 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/58b10fb2-6a2e-4674-8bf3-84797e9fc223-sys-fs\") pod \"aws-ebs-csi-driver-node-l26wm\" (UID: \"58b10fb2-6a2e-4674-8bf3-84797e9fc223\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm" Jul 15 23:46:51.298042 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297153 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-run-ovn\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.298042 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297189 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-etc-modprobe-d\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.298042 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297192 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-run-ovn\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.298042 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297215 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-etc-sysconfig\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.298042 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297252 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-etc-sysctl-d\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.298042 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297283 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-host-run-netns\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.298042 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297310 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01724c1a-84e1-4d42-b3c5-0ef10804e30c-os-release\") pod \"multus-additional-cni-plugins-hjtzh\" (UID: \"01724c1a-84e1-4d42-b3c5-0ef10804e30c\") " pod="openshift-multus/multus-additional-cni-plugins-hjtzh" Jul 15 23:46:51.298042 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297343 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01724c1a-84e1-4d42-b3c5-0ef10804e30c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hjtzh\" (UID: \"01724c1a-84e1-4d42-b3c5-0ef10804e30c\") " pod="openshift-multus/multus-additional-cni-plugins-hjtzh" Jul 15 23:46:51.298042 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297371 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-host-run-netns\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.298042 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297371 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01724c1a-84e1-4d42-b3c5-0ef10804e30c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hjtzh\" (UID: \"01724c1a-84e1-4d42-b3c5-0ef10804e30c\") " pod="openshift-multus/multus-additional-cni-plugins-hjtzh" Jul 15 23:46:51.298042 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297444 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae3abafe-42bb-46fb-8165-4b95893c4b8d-dbus\") pod \"global-pull-secret-syncer-tgnmg\" (UID: \"ae3abafe-42bb-46fb-8165-4b95893c4b8d\") " pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:46:51.298042 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297473 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/58b10fb2-6a2e-4674-8bf3-84797e9fc223-registration-dir\") pod \"aws-ebs-csi-driver-node-l26wm\" (UID: \"58b10fb2-6a2e-4674-8bf3-84797e9fc223\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm" Jul 15 23:46:51.298042 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297511 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c744b\" (UniqueName: \"kubernetes.io/projected/58b10fb2-6a2e-4674-8bf3-84797e9fc223-kube-api-access-c744b\") pod \"aws-ebs-csi-driver-node-l26wm\" (UID: \"58b10fb2-6a2e-4674-8bf3-84797e9fc223\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm" Jul 15 23:46:51.298042 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297547 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fdwc\" (UniqueName: \"kubernetes.io/projected/b98aea50-bfd9-48e4-984e-f5a89ee01212-kube-api-access-7fdwc\") pod \"network-check-target-5pjjq\" (UID: \"b98aea50-bfd9-48e4-984e-f5a89ee01212\") " pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:46:51.298042 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297582 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3abafe-42bb-46fb-8165-4b95893c4b8d-original-pull-secret\") pod \"global-pull-secret-syncer-tgnmg\" (UID: \"ae3abafe-42bb-46fb-8165-4b95893c4b8d\") " pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:46:51.298869 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297608 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-multus-cni-dir\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.298869 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297628 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-host-var-lib-cni-bin\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.298869 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297650 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-run-systemd\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.298869 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297670 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5917490d-3db7-4d93-aa21-b302f20e9699-serviceca\") pod \"node-ca-r9q5g\" (UID: \"5917490d-3db7-4d93-aa21-b302f20e9699\") " pod="openshift-image-registry/node-ca-r9q5g" Jul 15 23:46:51.298869 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297709 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae3abafe-42bb-46fb-8165-4b95893c4b8d-kubelet-config\") pod \"global-pull-secret-syncer-tgnmg\" (UID: \"ae3abafe-42bb-46fb-8165-4b95893c4b8d\") " pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:46:51.298869 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297731 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-run-systemd\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.298869 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297734 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/480440ce-6eb7-434a-8e64-478fc9b19cc5-tmp-dir\") pod \"node-resolver-cj8th\" (UID: \"480440ce-6eb7-434a-8e64-478fc9b19cc5\") " pod="openshift-dns/node-resolver-cj8th" Jul 15 23:46:51.298869 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297776 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/58b10fb2-6a2e-4674-8bf3-84797e9fc223-etc-selinux\") pod \"aws-ebs-csi-driver-node-l26wm\" (UID: \"58b10fb2-6a2e-4674-8bf3-84797e9fc223\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm" Jul 15 23:46:51.298869 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297806 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cknbb\" (UniqueName: \"kubernetes.io/projected/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-kube-api-access-cknbb\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.298869 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297847 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ftdx\" (UniqueName: \"kubernetes.io/projected/480440ce-6eb7-434a-8e64-478fc9b19cc5-kube-api-access-9ftdx\") pod \"node-resolver-cj8th\" (UID: \"480440ce-6eb7-434a-8e64-478fc9b19cc5\") " pod="openshift-dns/node-resolver-cj8th" Jul 15 23:46:51.298869 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297872 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-sys\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.298869 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.297981 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-cnibin\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.298869 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.298015 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-host-run-netns\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.298869 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.298053 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-ovnkube-script-lib\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.298869 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.298084 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-etc-sysctl-conf\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.298869 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.298106 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-multus-conf-dir\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.298869 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.298129 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/58b10fb2-6a2e-4674-8bf3-84797e9fc223-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l26wm\" (UID: \"58b10fb2-6a2e-4674-8bf3-84797e9fc223\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm" Jul 15 23:46:51.299718 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.298152 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/58b10fb2-6a2e-4674-8bf3-84797e9fc223-socket-dir\") pod \"aws-ebs-csi-driver-node-l26wm\" (UID: \"58b10fb2-6a2e-4674-8bf3-84797e9fc223\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm" Jul 15 23:46:51.299718 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.298181 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg42b\" (UniqueName: \"kubernetes.io/projected/01724c1a-84e1-4d42-b3c5-0ef10804e30c-kube-api-access-hg42b\") pod \"multus-additional-cni-plugins-hjtzh\" (UID: \"01724c1a-84e1-4d42-b3c5-0ef10804e30c\") " pod="openshift-multus/multus-additional-cni-plugins-hjtzh" Jul 15 23:46:51.299718 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.298208 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/663dd66c-f292-455f-8193-aabb4393b346-tmp\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.299718 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.298234 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24bzw\" (UniqueName: \"kubernetes.io/projected/371e613a-079b-4d90-83bc-8145a0d84fce-kube-api-access-24bzw\") pod \"network-metrics-daemon-pp4rq\" (UID: \"371e613a-079b-4d90-83bc-8145a0d84fce\") " pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:46:51.299718 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.298259 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-ovnkube-config\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.299718 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.298285 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-host-var-lib-cni-multus\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.299718 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.298310 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-host-run-multus-certs\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.299718 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.298336 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-etc-kubernetes\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.299718 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.298361 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5917490d-3db7-4d93-aa21-b302f20e9699-host\") pod \"node-ca-r9q5g\" (UID: \"5917490d-3db7-4d93-aa21-b302f20e9699\") " pod="openshift-image-registry/node-ca-r9q5g" Jul 15 23:46:51.299718 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.298386 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-run\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.299718 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.298443 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-var-lib-kubelet\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.299718 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.298470 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b613c0ea-4e1e-44b2-a508-90569d8f9d2f-agent-certs\") pod \"konnectivity-agent-j5p5p\" (UID: \"b613c0ea-4e1e-44b2-a508-90569d8f9d2f\") " pod="kube-system/konnectivity-agent-j5p5p" Jul 15 23:46:51.299718 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.298496 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-var-lib-openvswitch\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.299718 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.298523 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-multus-socket-dir-parent\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.299718 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.298661 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-ovnkube-script-lib\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.299718 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.298713 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-var-lib-openvswitch\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.299718 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.299125 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-ovnkube-config\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.302258 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.302066 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-ovn-node-metrics-cert\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.302258 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.302133 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b613c0ea-4e1e-44b2-a508-90569d8f9d2f-agent-certs\") pod \"konnectivity-agent-j5p5p\" (UID: \"b613c0ea-4e1e-44b2-a508-90569d8f9d2f\") " pod="kube-system/konnectivity-agent-j5p5p" Jul 15 23:46:51.309609 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:51.309568 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 23:46:51.309609 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:51.309603 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 23:46:51.309867 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:51.309618 2564 projected.go:196] Error preparing data for projected volume kube-api-access-7fdwc for pod openshift-network-diagnostics/network-check-target-5pjjq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 23:46:51.309867 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:51.309682 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b98aea50-bfd9-48e4-984e-f5a89ee01212-kube-api-access-7fdwc podName:b98aea50-bfd9-48e4-984e-f5a89ee01212 nodeName:}" failed. No retries permitted until 2026-07-15 23:46:51.809661661 +0000 UTC m=+3.040640403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7fdwc" (UniqueName: "kubernetes.io/projected/b98aea50-bfd9-48e4-984e-f5a89ee01212-kube-api-access-7fdwc") pod "network-check-target-5pjjq" (UID: "b98aea50-bfd9-48e4-984e-f5a89ee01212") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 23:46:51.311810 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.311783 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cknbb\" (UniqueName: \"kubernetes.io/projected/d05a6a90-8e18-4a88-b6b9-b3a3712ffe07-kube-api-access-cknbb\") pod \"ovnkube-node-fp65r\" (UID: \"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.312454 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.312427 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24bzw\" (UniqueName: \"kubernetes.io/projected/371e613a-079b-4d90-83bc-8145a0d84fce-kube-api-access-24bzw\") pod \"network-metrics-daemon-pp4rq\" (UID: \"371e613a-079b-4d90-83bc-8145a0d84fce\") " pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:46:51.399906 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.399871 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5917490d-3db7-4d93-aa21-b302f20e9699-serviceca\") pod \"node-ca-r9q5g\" (UID: \"5917490d-3db7-4d93-aa21-b302f20e9699\") " pod="openshift-image-registry/node-ca-r9q5g" Jul 15 23:46:51.400103 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.399918 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae3abafe-42bb-46fb-8165-4b95893c4b8d-kubelet-config\") pod \"global-pull-secret-syncer-tgnmg\" (UID: \"ae3abafe-42bb-46fb-8165-4b95893c4b8d\") " pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:46:51.400103 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.399958 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/480440ce-6eb7-434a-8e64-478fc9b19cc5-tmp-dir\") pod \"node-resolver-cj8th\" (UID: \"480440ce-6eb7-434a-8e64-478fc9b19cc5\") " pod="openshift-dns/node-resolver-cj8th" Jul 15 23:46:51.400103 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.399999 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/58b10fb2-6a2e-4674-8bf3-84797e9fc223-etc-selinux\") pod \"aws-ebs-csi-driver-node-l26wm\" (UID: \"58b10fb2-6a2e-4674-8bf3-84797e9fc223\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm" Jul 15 23:46:51.400103 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400029 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ftdx\" (UniqueName: \"kubernetes.io/projected/480440ce-6eb7-434a-8e64-478fc9b19cc5-kube-api-access-9ftdx\") pod \"node-resolver-cj8th\" (UID: \"480440ce-6eb7-434a-8e64-478fc9b19cc5\") " pod="openshift-dns/node-resolver-cj8th" Jul 15 23:46:51.400103 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400084 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae3abafe-42bb-46fb-8165-4b95893c4b8d-kubelet-config\") pod \"global-pull-secret-syncer-tgnmg\" (UID: \"ae3abafe-42bb-46fb-8165-4b95893c4b8d\") " pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:46:51.400317 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400147 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-sys\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.400317 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400174 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-cnibin\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.400317 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400241 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/58b10fb2-6a2e-4674-8bf3-84797e9fc223-etc-selinux\") pod \"aws-ebs-csi-driver-node-l26wm\" (UID: \"58b10fb2-6a2e-4674-8bf3-84797e9fc223\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm" Jul 15 23:46:51.400317 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400240 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-host-run-netns\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.400317 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400290 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-etc-sysctl-conf\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.400546 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400329 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-sys\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.400546 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400342 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-multus-conf-dir\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.400546 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400369 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/58b10fb2-6a2e-4674-8bf3-84797e9fc223-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l26wm\" (UID: \"58b10fb2-6a2e-4674-8bf3-84797e9fc223\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm" Jul 15 23:46:51.400546 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400395 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/58b10fb2-6a2e-4674-8bf3-84797e9fc223-socket-dir\") pod \"aws-ebs-csi-driver-node-l26wm\" (UID: \"58b10fb2-6a2e-4674-8bf3-84797e9fc223\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm" Jul 15 23:46:51.400546 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400405 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-cnibin\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.400546 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400406 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/480440ce-6eb7-434a-8e64-478fc9b19cc5-tmp-dir\") pod \"node-resolver-cj8th\" (UID: \"480440ce-6eb7-434a-8e64-478fc9b19cc5\") " pod="openshift-dns/node-resolver-cj8th" Jul 15 23:46:51.400546 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400454 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg42b\" (UniqueName: \"kubernetes.io/projected/01724c1a-84e1-4d42-b3c5-0ef10804e30c-kube-api-access-hg42b\") pod \"multus-additional-cni-plugins-hjtzh\" (UID: \"01724c1a-84e1-4d42-b3c5-0ef10804e30c\") " pod="openshift-multus/multus-additional-cni-plugins-hjtzh" Jul 15 23:46:51.400546 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400490 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/663dd66c-f292-455f-8193-aabb4393b346-tmp\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.400546 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400505 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5917490d-3db7-4d93-aa21-b302f20e9699-serviceca\") pod \"node-ca-r9q5g\" (UID: \"5917490d-3db7-4d93-aa21-b302f20e9699\") " pod="openshift-image-registry/node-ca-r9q5g" Jul 15 23:46:51.400546 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400520 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-host-run-netns\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.400546 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400513 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-host-var-lib-cni-multus\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.400546 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400547 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-etc-sysctl-conf\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.401244 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400566 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-host-var-lib-cni-multus\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.401244 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400587 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-multus-conf-dir\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.401244 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400572 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-host-run-multus-certs\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.401244 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400625 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-host-run-multus-certs\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.401244 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400632 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/58b10fb2-6a2e-4674-8bf3-84797e9fc223-socket-dir\") pod \"aws-ebs-csi-driver-node-l26wm\" (UID: \"58b10fb2-6a2e-4674-8bf3-84797e9fc223\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm" Jul 15 23:46:51.401244 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400639 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/58b10fb2-6a2e-4674-8bf3-84797e9fc223-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l26wm\" (UID: \"58b10fb2-6a2e-4674-8bf3-84797e9fc223\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm" Jul 15 23:46:51.401244 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400641 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-etc-kubernetes\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.401244 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400671 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-etc-kubernetes\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.401244 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400726 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5917490d-3db7-4d93-aa21-b302f20e9699-host\") pod \"node-ca-r9q5g\" (UID: \"5917490d-3db7-4d93-aa21-b302f20e9699\") " pod="openshift-image-registry/node-ca-r9q5g" Jul 15 23:46:51.401244 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400753 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-run\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.401244 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400795 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-var-lib-kubelet\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.401244 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400855 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-multus-socket-dir-parent\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.401244 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400960 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-var-lib-kubelet\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.401244 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.400985 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-run\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.401244 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401013 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5917490d-3db7-4d93-aa21-b302f20e9699-host\") pod \"node-ca-r9q5g\" (UID: \"5917490d-3db7-4d93-aa21-b302f20e9699\") " pod="openshift-image-registry/node-ca-r9q5g" Jul 15 23:46:51.401244 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401014 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-multus-socket-dir-parent\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.401244 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401040 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk9bf\" (UniqueName: \"kubernetes.io/projected/5917490d-3db7-4d93-aa21-b302f20e9699-kube-api-access-gk9bf\") pod \"node-ca-r9q5g\" (UID: \"5917490d-3db7-4d93-aa21-b302f20e9699\") " pod="openshift-image-registry/node-ca-r9q5g" Jul 15 23:46:51.401244 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401066 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3250a7da-dbfd-416b-b43b-b6e12d89b167-host-slash\") pod \"iptables-alerter-kxllk\" (UID: \"3250a7da-dbfd-416b-b43b-b6e12d89b167\") " pod="openshift-network-operator/iptables-alerter-kxllk" Jul 15 23:46:51.402020 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401091 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-etc-kubernetes\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.402020 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401137 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hzb2\" (UniqueName: \"kubernetes.io/projected/663dd66c-f292-455f-8193-aabb4393b346-kube-api-access-5hzb2\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.402020 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401172 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-host-var-lib-kubelet\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.402020 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401199 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3250a7da-dbfd-416b-b43b-b6e12d89b167-iptables-alerter-script\") pod \"iptables-alerter-kxllk\" (UID: \"3250a7da-dbfd-416b-b43b-b6e12d89b167\") " pod="openshift-network-operator/iptables-alerter-kxllk" Jul 15 23:46:51.402020 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401229 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01724c1a-84e1-4d42-b3c5-0ef10804e30c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hjtzh\" (UID: \"01724c1a-84e1-4d42-b3c5-0ef10804e30c\") " pod="openshift-multus/multus-additional-cni-plugins-hjtzh" Jul 15 23:46:51.402020 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401252 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-etc-systemd\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.402020 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401278 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-system-cni-dir\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.402020 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401305 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b6691211-f8a7-4727-9f96-7af8e46f22d3-cni-binary-copy\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.402020 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401334 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwdbp\" (UniqueName: \"kubernetes.io/projected/b6691211-f8a7-4727-9f96-7af8e46f22d3-kube-api-access-gwdbp\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.402020 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401364 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01724c1a-84e1-4d42-b3c5-0ef10804e30c-cnibin\") pod \"multus-additional-cni-plugins-hjtzh\" (UID: \"01724c1a-84e1-4d42-b3c5-0ef10804e30c\") " pod="openshift-multus/multus-additional-cni-plugins-hjtzh" Jul 15 23:46:51.402020 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401390 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01724c1a-84e1-4d42-b3c5-0ef10804e30c-cni-binary-copy\") pod \"multus-additional-cni-plugins-hjtzh\" (UID: \"01724c1a-84e1-4d42-b3c5-0ef10804e30c\") " pod="openshift-multus/multus-additional-cni-plugins-hjtzh" Jul 15 23:46:51.402020 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401389 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3250a7da-dbfd-416b-b43b-b6e12d89b167-host-slash\") pod \"iptables-alerter-kxllk\" (UID: \"3250a7da-dbfd-416b-b43b-b6e12d89b167\") " pod="openshift-network-operator/iptables-alerter-kxllk" Jul 15 23:46:51.402020 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401420 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01724c1a-84e1-4d42-b3c5-0ef10804e30c-system-cni-dir\") pod \"multus-additional-cni-plugins-hjtzh\" (UID: \"01724c1a-84e1-4d42-b3c5-0ef10804e30c\") " pod="openshift-multus/multus-additional-cni-plugins-hjtzh" Jul 15 23:46:51.402020 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401454 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-etc-kubernetes\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.402020 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401445 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-host\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.402020 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401496 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/663dd66c-f292-455f-8193-aabb4393b346-etc-tuned\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.402020 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401523 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/58b10fb2-6a2e-4674-8bf3-84797e9fc223-device-dir\") pod \"aws-ebs-csi-driver-node-l26wm\" (UID: \"58b10fb2-6a2e-4674-8bf3-84797e9fc223\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm" Jul 15 23:46:51.402894 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401555 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-lib-modules\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.402894 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401579 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-os-release\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.402894 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401605 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-host-run-k8s-cni-cncf-io\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.402894 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401631 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvrg6\" (UniqueName: \"kubernetes.io/projected/3250a7da-dbfd-416b-b43b-b6e12d89b167-kube-api-access-gvrg6\") pod \"iptables-alerter-kxllk\" (UID: \"3250a7da-dbfd-416b-b43b-b6e12d89b167\") " pod="openshift-network-operator/iptables-alerter-kxllk" Jul 15 23:46:51.402894 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401659 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/480440ce-6eb7-434a-8e64-478fc9b19cc5-hosts-file\") pod \"node-resolver-cj8th\" (UID: \"480440ce-6eb7-434a-8e64-478fc9b19cc5\") " pod="openshift-dns/node-resolver-cj8th" Jul 15 23:46:51.402894 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401676 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-host-var-lib-kubelet\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.402894 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401682 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-hostroot\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.402894 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401727 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-hostroot\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.402894 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401746 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b6691211-f8a7-4727-9f96-7af8e46f22d3-multus-daemon-config\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.402894 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401779 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/58b10fb2-6a2e-4674-8bf3-84797e9fc223-sys-fs\") pod \"aws-ebs-csi-driver-node-l26wm\" (UID: \"58b10fb2-6a2e-4674-8bf3-84797e9fc223\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm" Jul 15 23:46:51.402894 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401789 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01724c1a-84e1-4d42-b3c5-0ef10804e30c-system-cni-dir\") pod \"multus-additional-cni-plugins-hjtzh\" (UID: \"01724c1a-84e1-4d42-b3c5-0ef10804e30c\") " pod="openshift-multus/multus-additional-cni-plugins-hjtzh" Jul 15 23:46:51.402894 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401808 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-etc-modprobe-d\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.402894 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401839 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-host\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.402894 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401843 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-etc-sysconfig\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.402894 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401868 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-etc-sysctl-d\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.402894 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.401896 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01724c1a-84e1-4d42-b3c5-0ef10804e30c-os-release\") pod \"multus-additional-cni-plugins-hjtzh\" (UID: \"01724c1a-84e1-4d42-b3c5-0ef10804e30c\") " pod="openshift-multus/multus-additional-cni-plugins-hjtzh" Jul 15 23:46:51.402894 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.402294 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-os-release\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.402894 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.402425 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01724c1a-84e1-4d42-b3c5-0ef10804e30c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hjtzh\" (UID: \"01724c1a-84e1-4d42-b3c5-0ef10804e30c\") " pod="openshift-multus/multus-additional-cni-plugins-hjtzh" Jul 15 23:46:51.403822 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.402485 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-lib-modules\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.403822 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.402503 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01724c1a-84e1-4d42-b3c5-0ef10804e30c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hjtzh\" (UID: \"01724c1a-84e1-4d42-b3c5-0ef10804e30c\") " pod="openshift-multus/multus-additional-cni-plugins-hjtzh" Jul 15 23:46:51.403822 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.402549 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae3abafe-42bb-46fb-8165-4b95893c4b8d-dbus\") pod \"global-pull-secret-syncer-tgnmg\" (UID: \"ae3abafe-42bb-46fb-8165-4b95893c4b8d\") " pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:46:51.403822 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.402590 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/58b10fb2-6a2e-4674-8bf3-84797e9fc223-registration-dir\") pod \"aws-ebs-csi-driver-node-l26wm\" (UID: \"58b10fb2-6a2e-4674-8bf3-84797e9fc223\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm" Jul 15 23:46:51.403822 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.403719 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-host-run-k8s-cni-cncf-io\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.403822 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.403070 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01724c1a-84e1-4d42-b3c5-0ef10804e30c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hjtzh\" (UID: \"01724c1a-84e1-4d42-b3c5-0ef10804e30c\") " pod="openshift-multus/multus-additional-cni-plugins-hjtzh" Jul 15 23:46:51.403822 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.403111 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01724c1a-84e1-4d42-b3c5-0ef10804e30c-cni-binary-copy\") pod \"multus-additional-cni-plugins-hjtzh\" (UID: \"01724c1a-84e1-4d42-b3c5-0ef10804e30c\") " pod="openshift-multus/multus-additional-cni-plugins-hjtzh" Jul 15 23:46:51.403822 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.403260 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01724c1a-84e1-4d42-b3c5-0ef10804e30c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hjtzh\" (UID: \"01724c1a-84e1-4d42-b3c5-0ef10804e30c\") " pod="openshift-multus/multus-additional-cni-plugins-hjtzh" Jul 15 23:46:51.403822 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.403265 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae3abafe-42bb-46fb-8165-4b95893c4b8d-dbus\") pod \"global-pull-secret-syncer-tgnmg\" (UID: \"ae3abafe-42bb-46fb-8165-4b95893c4b8d\") " pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:46:51.403822 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.403333 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-etc-sysconfig\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.403822 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.403348 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-etc-modprobe-d\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.403822 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.403377 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-etc-sysctl-d\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.403822 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.403422 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01724c1a-84e1-4d42-b3c5-0ef10804e30c-os-release\") pod \"multus-additional-cni-plugins-hjtzh\" (UID: \"01724c1a-84e1-4d42-b3c5-0ef10804e30c\") " pod="openshift-multus/multus-additional-cni-plugins-hjtzh" Jul 15 23:46:51.404461 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.403887 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/58b10fb2-6a2e-4674-8bf3-84797e9fc223-registration-dir\") pod \"aws-ebs-csi-driver-node-l26wm\" (UID: \"58b10fb2-6a2e-4674-8bf3-84797e9fc223\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm" Jul 15 23:46:51.404461 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.403932 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/480440ce-6eb7-434a-8e64-478fc9b19cc5-hosts-file\") pod \"node-resolver-cj8th\" (UID: \"480440ce-6eb7-434a-8e64-478fc9b19cc5\") " pod="openshift-dns/node-resolver-cj8th" Jul 15 23:46:51.404461 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.403957 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b6691211-f8a7-4727-9f96-7af8e46f22d3-multus-daemon-config\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.404461 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.403973 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/663dd66c-f292-455f-8193-aabb4393b346-etc-systemd\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.404461 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.404088 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01724c1a-84e1-4d42-b3c5-0ef10804e30c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hjtzh\" (UID: \"01724c1a-84e1-4d42-b3c5-0ef10804e30c\") " pod="openshift-multus/multus-additional-cni-plugins-hjtzh" Jul 15 23:46:51.404461 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.404135 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-system-cni-dir\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.404461 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.404184 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c744b\" (UniqueName: \"kubernetes.io/projected/58b10fb2-6a2e-4674-8bf3-84797e9fc223-kube-api-access-c744b\") pod \"aws-ebs-csi-driver-node-l26wm\" (UID: \"58b10fb2-6a2e-4674-8bf3-84797e9fc223\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm" Jul 15 23:46:51.404461 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.404209 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/58b10fb2-6a2e-4674-8bf3-84797e9fc223-sys-fs\") pod \"aws-ebs-csi-driver-node-l26wm\" (UID: \"58b10fb2-6a2e-4674-8bf3-84797e9fc223\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm" Jul 15 23:46:51.404461 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.402594 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/58b10fb2-6a2e-4674-8bf3-84797e9fc223-device-dir\") pod \"aws-ebs-csi-driver-node-l26wm\" (UID: \"58b10fb2-6a2e-4674-8bf3-84797e9fc223\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm" Jul 15 23:46:51.404461 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.404435 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3abafe-42bb-46fb-8165-4b95893c4b8d-original-pull-secret\") pod \"global-pull-secret-syncer-tgnmg\" (UID: \"ae3abafe-42bb-46fb-8165-4b95893c4b8d\") " pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:46:51.405039 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.404469 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-multus-cni-dir\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.405039 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.404488 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-host-var-lib-cni-bin\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.405039 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.404553 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-host-var-lib-cni-bin\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.405039 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.404626 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6691211-f8a7-4727-9f96-7af8e46f22d3-multus-cni-dir\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.405039 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.404658 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01724c1a-84e1-4d42-b3c5-0ef10804e30c-cnibin\") pod \"multus-additional-cni-plugins-hjtzh\" (UID: \"01724c1a-84e1-4d42-b3c5-0ef10804e30c\") " pod="openshift-multus/multus-additional-cni-plugins-hjtzh" Jul 15 23:46:51.405039 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:51.404667 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 23:46:51.405039 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:51.404790 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae3abafe-42bb-46fb-8165-4b95893c4b8d-original-pull-secret podName:ae3abafe-42bb-46fb-8165-4b95893c4b8d nodeName:}" failed. No retries permitted until 2026-07-15 23:46:51.904717367 +0000 UTC m=+3.135696110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae3abafe-42bb-46fb-8165-4b95893c4b8d-original-pull-secret") pod "global-pull-secret-syncer-tgnmg" (UID: "ae3abafe-42bb-46fb-8165-4b95893c4b8d") : object "kube-system"/"original-pull-secret" not registered Jul 15 23:46:51.405039 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.404826 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3250a7da-dbfd-416b-b43b-b6e12d89b167-iptables-alerter-script\") pod \"iptables-alerter-kxllk\" (UID: \"3250a7da-dbfd-416b-b43b-b6e12d89b167\") " pod="openshift-network-operator/iptables-alerter-kxllk" Jul 15 23:46:51.405443 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.405122 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/663dd66c-f292-455f-8193-aabb4393b346-tmp\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.405443 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.405129 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b6691211-f8a7-4727-9f96-7af8e46f22d3-cni-binary-copy\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.405443 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.405270 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/663dd66c-f292-455f-8193-aabb4393b346-etc-tuned\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.409863 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.409836 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ftdx\" (UniqueName: \"kubernetes.io/projected/480440ce-6eb7-434a-8e64-478fc9b19cc5-kube-api-access-9ftdx\") pod \"node-resolver-cj8th\" (UID: \"480440ce-6eb7-434a-8e64-478fc9b19cc5\") " pod="openshift-dns/node-resolver-cj8th" Jul 15 23:46:51.409974 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.409889 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg42b\" (UniqueName: \"kubernetes.io/projected/01724c1a-84e1-4d42-b3c5-0ef10804e30c-kube-api-access-hg42b\") pod \"multus-additional-cni-plugins-hjtzh\" (UID: \"01724c1a-84e1-4d42-b3c5-0ef10804e30c\") " pod="openshift-multus/multus-additional-cni-plugins-hjtzh" Jul 15 23:46:51.409974 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.409926 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk9bf\" (UniqueName: \"kubernetes.io/projected/5917490d-3db7-4d93-aa21-b302f20e9699-kube-api-access-gk9bf\") pod \"node-ca-r9q5g\" (UID: \"5917490d-3db7-4d93-aa21-b302f20e9699\") " pod="openshift-image-registry/node-ca-r9q5g" Jul 15 23:46:51.410102 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.409983 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hzb2\" (UniqueName: \"kubernetes.io/projected/663dd66c-f292-455f-8193-aabb4393b346-kube-api-access-5hzb2\") pod \"tuned-x9p7s\" (UID: \"663dd66c-f292-455f-8193-aabb4393b346\") " pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.412629 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.412569 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvrg6\" (UniqueName: \"kubernetes.io/projected/3250a7da-dbfd-416b-b43b-b6e12d89b167-kube-api-access-gvrg6\") pod \"iptables-alerter-kxllk\" (UID: \"3250a7da-dbfd-416b-b43b-b6e12d89b167\") " pod="openshift-network-operator/iptables-alerter-kxllk" Jul 15 23:46:51.412971 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.412927 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwdbp\" (UniqueName: \"kubernetes.io/projected/b6691211-f8a7-4727-9f96-7af8e46f22d3-kube-api-access-gwdbp\") pod \"multus-ldxg2\" (UID: \"b6691211-f8a7-4727-9f96-7af8e46f22d3\") " pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.414514 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.414491 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c744b\" (UniqueName: \"kubernetes.io/projected/58b10fb2-6a2e-4674-8bf3-84797e9fc223-kube-api-access-c744b\") pod \"aws-ebs-csi-driver-node-l26wm\" (UID: \"58b10fb2-6a2e-4674-8bf3-84797e9fc223\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm" Jul 15 23:46:51.485731 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.485693 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:46:51.495952 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.495924 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j5p5p" Jul 15 23:46:51.505007 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.504978 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cj8th" Jul 15 23:46:51.510937 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.510912 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r9q5g" Jul 15 23:46:51.520886 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.520859 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kxllk" Jul 15 23:46:51.528856 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.528828 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" Jul 15 23:46:51.539814 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.539791 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ldxg2" Jul 15 23:46:51.547680 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.547657 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hjtzh" Jul 15 23:46:51.554615 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.554594 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm" Jul 15 23:46:51.807935 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.807843 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/371e613a-079b-4d90-83bc-8145a0d84fce-metrics-certs\") pod \"network-metrics-daemon-pp4rq\" (UID: \"371e613a-079b-4d90-83bc-8145a0d84fce\") " pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:46:51.808105 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:51.808006 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 23:46:51.808105 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:51.808084 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/371e613a-079b-4d90-83bc-8145a0d84fce-metrics-certs podName:371e613a-079b-4d90-83bc-8145a0d84fce nodeName:}" failed. No retries permitted until 2026-07-15 23:46:52.808066458 +0000 UTC m=+4.039045188 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/371e613a-079b-4d90-83bc-8145a0d84fce-metrics-certs") pod "network-metrics-daemon-pp4rq" (UID: "371e613a-079b-4d90-83bc-8145a0d84fce") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 23:46:51.909229 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.909181 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fdwc\" (UniqueName: \"kubernetes.io/projected/b98aea50-bfd9-48e4-984e-f5a89ee01212-kube-api-access-7fdwc\") pod \"network-check-target-5pjjq\" (UID: \"b98aea50-bfd9-48e4-984e-f5a89ee01212\") " pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:46:51.909425 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:51.909239 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3abafe-42bb-46fb-8165-4b95893c4b8d-original-pull-secret\") pod \"global-pull-secret-syncer-tgnmg\" (UID: \"ae3abafe-42bb-46fb-8165-4b95893c4b8d\") " pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:46:51.909425 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:51.909392 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 23:46:51.909425 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:51.909427 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 23:46:51.909583 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:51.909442 2564 projected.go:196] Error preparing data for projected volume kube-api-access-7fdwc for pod openshift-network-diagnostics/network-check-target-5pjjq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 23:46:51.909583 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:51.909404 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 23:46:51.909583 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:51.909507 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b98aea50-bfd9-48e4-984e-f5a89ee01212-kube-api-access-7fdwc podName:b98aea50-bfd9-48e4-984e-f5a89ee01212 nodeName:}" failed. No retries permitted until 2026-07-15 23:46:52.909486468 +0000 UTC m=+4.140465222 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7fdwc" (UniqueName: "kubernetes.io/projected/b98aea50-bfd9-48e4-984e-f5a89ee01212-kube-api-access-7fdwc") pod "network-check-target-5pjjq" (UID: "b98aea50-bfd9-48e4-984e-f5a89ee01212") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 23:46:51.909583 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:51.909541 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae3abafe-42bb-46fb-8165-4b95893c4b8d-original-pull-secret podName:ae3abafe-42bb-46fb-8165-4b95893c4b8d nodeName:}" failed. No retries permitted until 2026-07-15 23:46:52.909523557 +0000 UTC m=+4.140502300 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae3abafe-42bb-46fb-8165-4b95893c4b8d-original-pull-secret") pod "global-pull-secret-syncer-tgnmg" (UID: "ae3abafe-42bb-46fb-8165-4b95893c4b8d") : object "kube-system"/"original-pull-secret" not registered Jul 15 23:46:52.230856 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:52.230723 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 23:41:51 +0000 UTC" deadline="2028-01-16 17:40:11.927446315 +0000 UTC" Jul 15 23:46:52.230856 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:52.230795 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13193h53m19.696655566s" Jul 15 23:46:52.399128 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:52.399097 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod480440ce_6eb7_434a_8e64_478fc9b19cc5.slice/crio-fce71342d679fe15eb82be39d2ae51f4960311dc227acf50eafe50ed6a671e0a WatchSource:0}: Error finding container fce71342d679fe15eb82be39d2ae51f4960311dc227acf50eafe50ed6a671e0a: Status 404 returned error can't find the container with id fce71342d679fe15eb82be39d2ae51f4960311dc227acf50eafe50ed6a671e0a Jul 15 23:46:52.400191 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:52.400167 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod663dd66c_f292_455f_8193_aabb4393b346.slice/crio-44a0b4e7bcccd81dbb8683c76434324cb23f12ec7551472963ffa1e3672a19b5 WatchSource:0}: Error finding container 44a0b4e7bcccd81dbb8683c76434324cb23f12ec7551472963ffa1e3672a19b5: Status 404 returned error can't find the container with id 44a0b4e7bcccd81dbb8683c76434324cb23f12ec7551472963ffa1e3672a19b5 Jul 15 23:46:52.400784 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:52.400766 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5917490d_3db7_4d93_aa21_b302f20e9699.slice/crio-e484a50a2b76608621d46eed50270de3068267a9a745d5ff33a37dbfbc6d40d5 WatchSource:0}: Error finding container e484a50a2b76608621d46eed50270de3068267a9a745d5ff33a37dbfbc6d40d5: Status 404 returned error can't find the container with id e484a50a2b76608621d46eed50270de3068267a9a745d5ff33a37dbfbc6d40d5 Jul 15 23:46:52.426689 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:52.426641 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3250a7da_dbfd_416b_b43b_b6e12d89b167.slice/crio-cdcd8333a4b15e4104ac3b1a71593380f07f2748fcfb9751e43f903c395892fe WatchSource:0}: Error finding container cdcd8333a4b15e4104ac3b1a71593380f07f2748fcfb9751e43f903c395892fe: Status 404 returned error can't find the container with id cdcd8333a4b15e4104ac3b1a71593380f07f2748fcfb9751e43f903c395892fe Jul 15 23:46:52.428442 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:52.428418 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6691211_f8a7_4727_9f96_7af8e46f22d3.slice/crio-bd4d0a4bf80d1a4a672c26cd869d6cb627d9c87203e5c759424a43fa7a06b102 WatchSource:0}: Error finding container bd4d0a4bf80d1a4a672c26cd869d6cb627d9c87203e5c759424a43fa7a06b102: Status 404 returned error can't find the container with id bd4d0a4bf80d1a4a672c26cd869d6cb627d9c87203e5c759424a43fa7a06b102 Jul 15 23:46:52.435325 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:46:52.435294 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb613c0ea_4e1e_44b2_a508_90569d8f9d2f.slice/crio-653bb0f4ad1bb3de9a8def66c2eb5d506cf1940eb4bb3d382f3e5716e44e32c4 WatchSource:0}: Error finding container 653bb0f4ad1bb3de9a8def66c2eb5d506cf1940eb4bb3d382f3e5716e44e32c4: Status 404 returned error can't find the container with id 653bb0f4ad1bb3de9a8def66c2eb5d506cf1940eb4bb3d382f3e5716e44e32c4 Jul 15 23:46:52.818876 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:52.818048 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/371e613a-079b-4d90-83bc-8145a0d84fce-metrics-certs\") pod \"network-metrics-daemon-pp4rq\" (UID: \"371e613a-079b-4d90-83bc-8145a0d84fce\") " pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:46:52.818876 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:52.818196 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 23:46:52.818876 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:52.818409 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/371e613a-079b-4d90-83bc-8145a0d84fce-metrics-certs podName:371e613a-079b-4d90-83bc-8145a0d84fce nodeName:}" failed. No retries permitted until 2026-07-15 23:46:54.818385933 +0000 UTC m=+6.049364661 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/371e613a-079b-4d90-83bc-8145a0d84fce-metrics-certs") pod "network-metrics-daemon-pp4rq" (UID: "371e613a-079b-4d90-83bc-8145a0d84fce") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 23:46:52.919257 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:52.919199 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fdwc\" (UniqueName: \"kubernetes.io/projected/b98aea50-bfd9-48e4-984e-f5a89ee01212-kube-api-access-7fdwc\") pod \"network-check-target-5pjjq\" (UID: \"b98aea50-bfd9-48e4-984e-f5a89ee01212\") " pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:46:52.919463 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:52.919291 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3abafe-42bb-46fb-8165-4b95893c4b8d-original-pull-secret\") pod \"global-pull-secret-syncer-tgnmg\" (UID: \"ae3abafe-42bb-46fb-8165-4b95893c4b8d\") " pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:46:52.919553 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:52.919500 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 23:46:52.919634 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:52.919569 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae3abafe-42bb-46fb-8165-4b95893c4b8d-original-pull-secret podName:ae3abafe-42bb-46fb-8165-4b95893c4b8d nodeName:}" failed. No retries permitted until 2026-07-15 23:46:54.919547351 +0000 UTC m=+6.150526079 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae3abafe-42bb-46fb-8165-4b95893c4b8d-original-pull-secret") pod "global-pull-secret-syncer-tgnmg" (UID: "ae3abafe-42bb-46fb-8165-4b95893c4b8d") : object "kube-system"/"original-pull-secret" not registered Jul 15 23:46:52.919926 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:52.919678 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 23:46:52.919926 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:52.919694 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 23:46:52.919926 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:52.919707 2564 projected.go:196] Error preparing data for projected volume kube-api-access-7fdwc for pod openshift-network-diagnostics/network-check-target-5pjjq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 23:46:52.919926 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:52.919762 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b98aea50-bfd9-48e4-984e-f5a89ee01212-kube-api-access-7fdwc podName:b98aea50-bfd9-48e4-984e-f5a89ee01212 nodeName:}" failed. No retries permitted until 2026-07-15 23:46:54.919749083 +0000 UTC m=+6.150727830 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7fdwc" (UniqueName: "kubernetes.io/projected/b98aea50-bfd9-48e4-984e-f5a89ee01212-kube-api-access-7fdwc") pod "network-check-target-5pjjq" (UID: "b98aea50-bfd9-48e4-984e-f5a89ee01212") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 23:46:53.231792 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:53.231692 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 23:41:51 +0000 UTC" deadline="2028-04-28 10:42:08.122524186 +0000 UTC" Jul 15 23:46:53.231792 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:53.231738 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15658h55m14.890791722s" Jul 15 23:46:53.295956 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:53.295920 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:46:53.296139 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:53.296087 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp4rq" podUID="371e613a-079b-4d90-83bc-8145a0d84fce" Jul 15 23:46:53.296569 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:53.296545 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:46:53.296701 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:53.296674 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgnmg" podUID="ae3abafe-42bb-46fb-8165-4b95893c4b8d" Jul 15 23:46:53.296806 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:53.296765 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:46:53.296881 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:53.296841 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pjjq" podUID="b98aea50-bfd9-48e4-984e-f5a89ee01212" Jul 15 23:46:53.317905 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:53.317871 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j5p5p" event={"ID":"b613c0ea-4e1e-44b2-a508-90569d8f9d2f","Type":"ContainerStarted","Data":"653bb0f4ad1bb3de9a8def66c2eb5d506cf1940eb4bb3d382f3e5716e44e32c4"} Jul 15 23:46:53.321190 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:53.321097 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm" event={"ID":"58b10fb2-6a2e-4674-8bf3-84797e9fc223","Type":"ContainerStarted","Data":"6a16b6c142ded6eeb030dd8dbd64a0b044122e5a80ff0c120472d26916d6db83"} Jul 15 23:46:53.324286 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:53.324246 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hjtzh" event={"ID":"01724c1a-84e1-4d42-b3c5-0ef10804e30c","Type":"ContainerStarted","Data":"19ee42f217e60f6c4a85ccbfd87c0c8101e04365b4c95da0359e130321ed408a"} Jul 15 23:46:53.331978 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:53.331948 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ldxg2" event={"ID":"b6691211-f8a7-4727-9f96-7af8e46f22d3","Type":"ContainerStarted","Data":"bd4d0a4bf80d1a4a672c26cd869d6cb627d9c87203e5c759424a43fa7a06b102"} Jul 15 23:46:53.334232 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:53.334207 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r9q5g" event={"ID":"5917490d-3db7-4d93-aa21-b302f20e9699","Type":"ContainerStarted","Data":"e484a50a2b76608621d46eed50270de3068267a9a745d5ff33a37dbfbc6d40d5"} Jul 15 23:46:53.339283 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:53.339256 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" event={"ID":"663dd66c-f292-455f-8193-aabb4393b346","Type":"ContainerStarted","Data":"44a0b4e7bcccd81dbb8683c76434324cb23f12ec7551472963ffa1e3672a19b5"} Jul 15 23:46:53.359600 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:53.358852 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-228.ec2.internal" event={"ID":"58146809344bc600ef4d3117f4b90eae","Type":"ContainerStarted","Data":"39049e50aaa404ec84dbaf16c48510267360076784e0baf17626e7649b386a29"} Jul 15 23:46:53.374221 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:53.374151 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-228.ec2.internal" podStartSLOduration=3.37412991 podStartE2EDuration="3.37412991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:46:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:46:53.374031429 +0000 UTC m=+4.605010207" watchObservedRunningTime="2026-07-15 23:46:53.37412991 +0000 UTC m=+4.605108661" Jul 15 23:46:53.378407 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:53.377520 2564 generic.go:356] "Generic (PLEG): container finished" podID="df9ef33bf17b0a1d5bf1c6e6c0257c40" containerID="404ce8824f5bce0674ea2022475afbd2c9e2b6b175b439f4aa6c259fd187317e" exitCode=0 Jul 15 23:46:53.378407 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:53.377604 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal" event={"ID":"df9ef33bf17b0a1d5bf1c6e6c0257c40","Type":"ContainerDied","Data":"404ce8824f5bce0674ea2022475afbd2c9e2b6b175b439f4aa6c259fd187317e"} Jul 15 23:46:53.402074 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:53.402011 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" event={"ID":"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07","Type":"ContainerStarted","Data":"2068daebeab17507427ca99a861f091a43b75223065e923ef0347679b256c9a5"} Jul 15 23:46:53.412248 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:53.412168 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kxllk" event={"ID":"3250a7da-dbfd-416b-b43b-b6e12d89b167","Type":"ContainerStarted","Data":"cdcd8333a4b15e4104ac3b1a71593380f07f2748fcfb9751e43f903c395892fe"} Jul 15 23:46:53.427372 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:53.427338 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cj8th" event={"ID":"480440ce-6eb7-434a-8e64-478fc9b19cc5","Type":"ContainerStarted","Data":"fce71342d679fe15eb82be39d2ae51f4960311dc227acf50eafe50ed6a671e0a"} Jul 15 23:46:54.440097 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:54.439733 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal" event={"ID":"df9ef33bf17b0a1d5bf1c6e6c0257c40","Type":"ContainerStarted","Data":"c29478b802e480585cc1fb9689482f4b90cdf066c519788860bdc47e4d236900"} Jul 15 23:46:54.454307 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:54.453499 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal" podStartSLOduration=4.453477766 podStartE2EDuration="4.453477766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:46:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:46:54.452985087 +0000 UTC m=+5.683963836" watchObservedRunningTime="2026-07-15 23:46:54.453477766 +0000 UTC m=+5.684456511" Jul 15 23:46:54.836405 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:54.836321 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/371e613a-079b-4d90-83bc-8145a0d84fce-metrics-certs\") pod \"network-metrics-daemon-pp4rq\" (UID: \"371e613a-079b-4d90-83bc-8145a0d84fce\") " pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:46:54.836569 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:54.836535 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 23:46:54.836631 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:54.836597 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/371e613a-079b-4d90-83bc-8145a0d84fce-metrics-certs podName:371e613a-079b-4d90-83bc-8145a0d84fce nodeName:}" failed. No retries permitted until 2026-07-15 23:46:58.836579248 +0000 UTC m=+10.067557976 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/371e613a-079b-4d90-83bc-8145a0d84fce-metrics-certs") pod "network-metrics-daemon-pp4rq" (UID: "371e613a-079b-4d90-83bc-8145a0d84fce") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 23:46:54.937048 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:54.937004 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fdwc\" (UniqueName: \"kubernetes.io/projected/b98aea50-bfd9-48e4-984e-f5a89ee01212-kube-api-access-7fdwc\") pod \"network-check-target-5pjjq\" (UID: \"b98aea50-bfd9-48e4-984e-f5a89ee01212\") " pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:46:54.937224 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:54.937063 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3abafe-42bb-46fb-8165-4b95893c4b8d-original-pull-secret\") pod \"global-pull-secret-syncer-tgnmg\" (UID: \"ae3abafe-42bb-46fb-8165-4b95893c4b8d\") " pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:46:54.937296 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:54.937254 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 23:46:54.937348 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:54.937319 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae3abafe-42bb-46fb-8165-4b95893c4b8d-original-pull-secret podName:ae3abafe-42bb-46fb-8165-4b95893c4b8d nodeName:}" failed. No retries permitted until 2026-07-15 23:46:58.937299694 +0000 UTC m=+10.168278419 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae3abafe-42bb-46fb-8165-4b95893c4b8d-original-pull-secret") pod "global-pull-secret-syncer-tgnmg" (UID: "ae3abafe-42bb-46fb-8165-4b95893c4b8d") : object "kube-system"/"original-pull-secret" not registered Jul 15 23:46:54.937796 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:54.937773 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 23:46:54.937796 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:54.937799 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 23:46:54.937955 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:54.937812 2564 projected.go:196] Error preparing data for projected volume kube-api-access-7fdwc for pod openshift-network-diagnostics/network-check-target-5pjjq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 23:46:54.937955 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:54.937857 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b98aea50-bfd9-48e4-984e-f5a89ee01212-kube-api-access-7fdwc podName:b98aea50-bfd9-48e4-984e-f5a89ee01212 nodeName:}" failed. No retries permitted until 2026-07-15 23:46:58.937842126 +0000 UTC m=+10.168820868 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7fdwc" (UniqueName: "kubernetes.io/projected/b98aea50-bfd9-48e4-984e-f5a89ee01212-kube-api-access-7fdwc") pod "network-check-target-5pjjq" (UID: "b98aea50-bfd9-48e4-984e-f5a89ee01212") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 23:46:55.295823 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:55.295699 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:46:55.295976 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:55.295838 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp4rq" podUID="371e613a-079b-4d90-83bc-8145a0d84fce" Jul 15 23:46:55.298969 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:55.296393 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:46:55.298969 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:55.296494 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgnmg" podUID="ae3abafe-42bb-46fb-8165-4b95893c4b8d" Jul 15 23:46:55.298969 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:55.296557 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:46:55.298969 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:55.296630 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pjjq" podUID="b98aea50-bfd9-48e4-984e-f5a89ee01212" Jul 15 23:46:57.301651 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:57.301005 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:46:57.301651 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:57.301033 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:46:57.301651 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:57.301133 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp4rq" podUID="371e613a-079b-4d90-83bc-8145a0d84fce" Jul 15 23:46:57.301651 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:57.301514 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgnmg" podUID="ae3abafe-42bb-46fb-8165-4b95893c4b8d" Jul 15 23:46:57.301651 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:57.301554 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:46:57.301651 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:57.301620 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pjjq" podUID="b98aea50-bfd9-48e4-984e-f5a89ee01212" Jul 15 23:46:58.869453 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:58.869415 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/371e613a-079b-4d90-83bc-8145a0d84fce-metrics-certs\") pod \"network-metrics-daemon-pp4rq\" (UID: \"371e613a-079b-4d90-83bc-8145a0d84fce\") " pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:46:58.869935 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:58.869583 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 23:46:58.869935 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:58.869659 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/371e613a-079b-4d90-83bc-8145a0d84fce-metrics-certs podName:371e613a-079b-4d90-83bc-8145a0d84fce nodeName:}" failed. No retries permitted until 2026-07-15 23:47:06.869637182 +0000 UTC m=+18.100615910 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/371e613a-079b-4d90-83bc-8145a0d84fce-metrics-certs") pod "network-metrics-daemon-pp4rq" (UID: "371e613a-079b-4d90-83bc-8145a0d84fce") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 23:46:58.970520 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:58.970468 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fdwc\" (UniqueName: \"kubernetes.io/projected/b98aea50-bfd9-48e4-984e-f5a89ee01212-kube-api-access-7fdwc\") pod \"network-check-target-5pjjq\" (UID: \"b98aea50-bfd9-48e4-984e-f5a89ee01212\") " pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:46:58.970520 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:58.970513 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3abafe-42bb-46fb-8165-4b95893c4b8d-original-pull-secret\") pod \"global-pull-secret-syncer-tgnmg\" (UID: \"ae3abafe-42bb-46fb-8165-4b95893c4b8d\") " pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:46:58.970806 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:58.970623 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 23:46:58.970806 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:58.970645 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 23:46:58.970806 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:58.970691 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae3abafe-42bb-46fb-8165-4b95893c4b8d-original-pull-secret podName:ae3abafe-42bb-46fb-8165-4b95893c4b8d nodeName:}" failed. No retries permitted until 2026-07-15 23:47:06.970660316 +0000 UTC m=+18.201639041 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae3abafe-42bb-46fb-8165-4b95893c4b8d-original-pull-secret") pod "global-pull-secret-syncer-tgnmg" (UID: "ae3abafe-42bb-46fb-8165-4b95893c4b8d") : object "kube-system"/"original-pull-secret" not registered Jul 15 23:46:58.970806 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:58.970699 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 23:46:58.970806 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:58.970713 2564 projected.go:196] Error preparing data for projected volume kube-api-access-7fdwc for pod openshift-network-diagnostics/network-check-target-5pjjq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 23:46:58.970806 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:58.970780 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b98aea50-bfd9-48e4-984e-f5a89ee01212-kube-api-access-7fdwc podName:b98aea50-bfd9-48e4-984e-f5a89ee01212 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:06.97076338 +0000 UTC m=+18.201742123 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7fdwc" (UniqueName: "kubernetes.io/projected/b98aea50-bfd9-48e4-984e-f5a89ee01212-kube-api-access-7fdwc") pod "network-check-target-5pjjq" (UID: "b98aea50-bfd9-48e4-984e-f5a89ee01212") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 23:46:59.299204 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:59.299132 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:46:59.299204 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:59.299169 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:46:59.299413 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:46:59.299132 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:46:59.299413 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:59.299253 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgnmg" podUID="ae3abafe-42bb-46fb-8165-4b95893c4b8d" Jul 15 23:46:59.299413 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:59.299375 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp4rq" podUID="371e613a-079b-4d90-83bc-8145a0d84fce" Jul 15 23:46:59.299567 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:46:59.299438 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pjjq" podUID="b98aea50-bfd9-48e4-984e-f5a89ee01212" Jul 15 23:47:01.299742 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:01.299342 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:47:01.299742 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:01.299453 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgnmg" podUID="ae3abafe-42bb-46fb-8165-4b95893c4b8d" Jul 15 23:47:01.299742 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:01.299510 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:47:01.299742 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:01.299573 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pjjq" podUID="b98aea50-bfd9-48e4-984e-f5a89ee01212" Jul 15 23:47:01.299742 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:01.299611 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:47:01.299742 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:01.299711 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp4rq" podUID="371e613a-079b-4d90-83bc-8145a0d84fce" Jul 15 23:47:03.296138 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:03.296106 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:47:03.296534 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:03.296102 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:47:03.296534 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:03.296239 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgnmg" podUID="ae3abafe-42bb-46fb-8165-4b95893c4b8d" Jul 15 23:47:03.296534 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:03.296249 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:47:03.296534 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:03.296372 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp4rq" podUID="371e613a-079b-4d90-83bc-8145a0d84fce" Jul 15 23:47:03.296534 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:03.296453 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pjjq" podUID="b98aea50-bfd9-48e4-984e-f5a89ee01212" Jul 15 23:47:05.299378 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:05.299348 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:47:05.299790 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:05.299450 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:47:05.299790 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:05.299455 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp4rq" podUID="371e613a-079b-4d90-83bc-8145a0d84fce" Jul 15 23:47:05.299790 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:05.299479 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:47:05.299790 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:05.299571 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgnmg" podUID="ae3abafe-42bb-46fb-8165-4b95893c4b8d" Jul 15 23:47:05.299790 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:05.299653 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pjjq" podUID="b98aea50-bfd9-48e4-984e-f5a89ee01212" Jul 15 23:47:06.932555 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:06.932506 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/371e613a-079b-4d90-83bc-8145a0d84fce-metrics-certs\") pod \"network-metrics-daemon-pp4rq\" (UID: \"371e613a-079b-4d90-83bc-8145a0d84fce\") " pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:47:06.932951 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:06.932685 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 23:47:06.932951 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:06.932754 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/371e613a-079b-4d90-83bc-8145a0d84fce-metrics-certs podName:371e613a-079b-4d90-83bc-8145a0d84fce nodeName:}" failed. No retries permitted until 2026-07-15 23:47:22.932738486 +0000 UTC m=+34.163717211 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/371e613a-079b-4d90-83bc-8145a0d84fce-metrics-certs") pod "network-metrics-daemon-pp4rq" (UID: "371e613a-079b-4d90-83bc-8145a0d84fce") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 23:47:07.033744 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:07.033701 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fdwc\" (UniqueName: \"kubernetes.io/projected/b98aea50-bfd9-48e4-984e-f5a89ee01212-kube-api-access-7fdwc\") pod \"network-check-target-5pjjq\" (UID: \"b98aea50-bfd9-48e4-984e-f5a89ee01212\") " pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:47:07.033744 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:07.033751 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3abafe-42bb-46fb-8165-4b95893c4b8d-original-pull-secret\") pod \"global-pull-secret-syncer-tgnmg\" (UID: \"ae3abafe-42bb-46fb-8165-4b95893c4b8d\") " pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:47:07.033991 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:07.033864 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 23:47:07.033991 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:07.033895 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 23:47:07.033991 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:07.033921 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 23:47:07.033991 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:07.033929 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae3abafe-42bb-46fb-8165-4b95893c4b8d-original-pull-secret podName:ae3abafe-42bb-46fb-8165-4b95893c4b8d nodeName:}" failed. No retries permitted until 2026-07-15 23:47:23.033910844 +0000 UTC m=+34.264889569 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae3abafe-42bb-46fb-8165-4b95893c4b8d-original-pull-secret") pod "global-pull-secret-syncer-tgnmg" (UID: "ae3abafe-42bb-46fb-8165-4b95893c4b8d") : object "kube-system"/"original-pull-secret" not registered Jul 15 23:47:07.033991 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:07.033935 2564 projected.go:196] Error preparing data for projected volume kube-api-access-7fdwc for pod openshift-network-diagnostics/network-check-target-5pjjq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 23:47:07.033991 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:07.033987 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b98aea50-bfd9-48e4-984e-f5a89ee01212-kube-api-access-7fdwc podName:b98aea50-bfd9-48e4-984e-f5a89ee01212 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:23.033971502 +0000 UTC m=+34.264950249 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7fdwc" (UniqueName: "kubernetes.io/projected/b98aea50-bfd9-48e4-984e-f5a89ee01212-kube-api-access-7fdwc") pod "network-check-target-5pjjq" (UID: "b98aea50-bfd9-48e4-984e-f5a89ee01212") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 23:47:07.295955 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:07.295874 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:47:07.296112 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:07.295874 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:47:07.296112 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:07.296013 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:47:07.296112 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:07.296006 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgnmg" podUID="ae3abafe-42bb-46fb-8165-4b95893c4b8d" Jul 15 23:47:07.296280 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:07.296111 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pjjq" podUID="b98aea50-bfd9-48e4-984e-f5a89ee01212" Jul 15 23:47:07.296280 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:07.296203 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp4rq" podUID="371e613a-079b-4d90-83bc-8145a0d84fce" Jul 15 23:47:09.296302 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:09.296265 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:47:09.296783 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:09.296383 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgnmg" podUID="ae3abafe-42bb-46fb-8165-4b95893c4b8d" Jul 15 23:47:09.296783 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:09.296461 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:47:09.296783 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:09.296564 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pjjq" podUID="b98aea50-bfd9-48e4-984e-f5a89ee01212" Jul 15 23:47:09.296783 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:09.296592 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:47:09.296783 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:09.296685 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp4rq" podUID="371e613a-079b-4d90-83bc-8145a0d84fce" Jul 15 23:47:11.295732 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:11.295542 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:47:11.296212 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:11.295542 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:47:11.296212 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:11.295626 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:47:11.296212 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:11.295905 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp4rq" podUID="371e613a-079b-4d90-83bc-8145a0d84fce" Jul 15 23:47:11.296212 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:11.295946 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgnmg" podUID="ae3abafe-42bb-46fb-8165-4b95893c4b8d" Jul 15 23:47:11.296212 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:11.295988 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pjjq" podUID="b98aea50-bfd9-48e4-984e-f5a89ee01212" Jul 15 23:47:11.475406 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:11.475260 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" event={"ID":"663dd66c-f292-455f-8193-aabb4393b346","Type":"ContainerStarted","Data":"9109d51269d646bdabb3b024edee1dff5c8f252baf3b69f2950b94e2f5f1efc9"} Jul 15 23:47:11.477193 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:11.477174 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fp65r_d05a6a90-8e18-4a88-b6b9-b3a3712ffe07/ovn-acl-logging/0.log" Jul 15 23:47:11.477482 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:11.477459 2564 generic.go:356] "Generic (PLEG): container finished" podID="d05a6a90-8e18-4a88-b6b9-b3a3712ffe07" containerID="adecfe3c6d11b278a40c57fcd29cb6b8a59ea58626c4bc286e679c851aebc41c" exitCode=1 Jul 15 23:47:11.477561 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:11.477516 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" event={"ID":"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07","Type":"ContainerStarted","Data":"e62ed9e68064f0db2ead38c38a873289557214a39801fbbe6d92bbc94ccd6e0d"} Jul 15 23:47:11.477620 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:11.477583 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" event={"ID":"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07","Type":"ContainerStarted","Data":"a4a2c78ad01d555e32c9765e22b13744153df7f5727268ee910215787ab44af1"} Jul 15 23:47:11.477620 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:11.477613 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" event={"ID":"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07","Type":"ContainerDied","Data":"adecfe3c6d11b278a40c57fcd29cb6b8a59ea58626c4bc286e679c851aebc41c"} Jul 15 23:47:11.477736 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:11.477658 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" event={"ID":"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07","Type":"ContainerStarted","Data":"a9e8f8979bd1cbe9920173bbb3a28d569ed83d1675674c41419607f446c70d79"} Jul 15 23:47:11.478851 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:11.478833 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cj8th" event={"ID":"480440ce-6eb7-434a-8e64-478fc9b19cc5","Type":"ContainerStarted","Data":"7e4dd30fba8083cbb5728f644000a86308a0761abbd25f3b5f69b77cefab2d84"} Jul 15 23:47:11.480080 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:11.480060 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j5p5p" event={"ID":"b613c0ea-4e1e-44b2-a508-90569d8f9d2f","Type":"ContainerStarted","Data":"9d24b971b15ecbc5ceb4ecd497fff4a4e313af0cf09e7576631ba8220e5c5ead"} Jul 15 23:47:11.481315 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:11.481293 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm" event={"ID":"58b10fb2-6a2e-4674-8bf3-84797e9fc223","Type":"ContainerStarted","Data":"0dedd5f9c3c74f5c629c00360bd0e05e34629deb7ba908769e7ea3e034ff0376"} Jul 15 23:47:11.482802 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:11.482781 2564 generic.go:356] "Generic (PLEG): container finished" podID="01724c1a-84e1-4d42-b3c5-0ef10804e30c" containerID="56a36999deda4b1fe2b8fc60201f87dd7cb6e55b040b87d0691a399dec35a2a5" exitCode=0 Jul 15 23:47:11.482884 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:11.482854 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hjtzh" event={"ID":"01724c1a-84e1-4d42-b3c5-0ef10804e30c","Type":"ContainerDied","Data":"56a36999deda4b1fe2b8fc60201f87dd7cb6e55b040b87d0691a399dec35a2a5"} Jul 15 23:47:11.484337 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:11.484216 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ldxg2" event={"ID":"b6691211-f8a7-4727-9f96-7af8e46f22d3","Type":"ContainerStarted","Data":"885cb775350f710a306663d1b328873da0ccf089dcc5b5774481bebbf432d97a"} Jul 15 23:47:11.485813 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:11.485795 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r9q5g" event={"ID":"5917490d-3db7-4d93-aa21-b302f20e9699","Type":"ContainerStarted","Data":"49ee8dbebd282aaaa9464459a69bc48d6843128f85adad7020756a35fff463a1"} Jul 15 23:47:11.500452 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:11.500325 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x9p7s" podStartSLOduration=3.899889523 podStartE2EDuration="22.500290965s" totalImagesPullingTime="18.600401442s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:46:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:11.500144683 +0000 UTC m=+22.731123422" watchObservedRunningTime="2026-07-15 23:47:11.500290965 +0000 UTC m=+22.731269712" Jul 15 23:47:11.514536 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:11.514458 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-j5p5p" podStartSLOduration=3.928734756 podStartE2EDuration="22.514447072s" totalImagesPullingTime="18.585712316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:46:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:11.514225748 +0000 UTC m=+22.745204513" watchObservedRunningTime="2026-07-15 23:47:11.514447072 +0000 UTC m=+22.745425820" Jul 15 23:47:11.532994 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:11.532961 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cj8th" podStartSLOduration=3.924453395 podStartE2EDuration="22.532952046s" totalImagesPullingTime="18.608498651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:46:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:11.532834195 +0000 UTC m=+22.763812942" watchObservedRunningTime="2026-07-15 23:47:11.532952046 +0000 UTC m=+22.763930793" Jul 15 23:47:11.551930 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:11.551898 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-r9q5g" podStartSLOduration=3.951525314 podStartE2EDuration="22.551888459s" totalImagesPullingTime="18.600363145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:46:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:11.551729058 +0000 UTC m=+22.782707817" watchObservedRunningTime="2026-07-15 23:47:11.551888459 +0000 UTC m=+22.782867213" Jul 15 23:47:11.569502 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:11.569458 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ldxg2" podStartSLOduration=3.914427611 podStartE2EDuration="22.569440714s" totalImagesPullingTime="18.655013103s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:46:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:11.569243811 +0000 UTC m=+22.800222560" watchObservedRunningTime="2026-07-15 23:47:11.569440714 +0000 UTC m=+22.800419463" Jul 15 23:47:12.366564 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:12.366543 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 15 23:47:12.490584 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:12.490510 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm" event={"ID":"58b10fb2-6a2e-4674-8bf3-84797e9fc223","Type":"ContainerStarted","Data":"ee30631b0759e0dec3ea7c832e8f516ada1603475c2d2bbd5856fbacf10eeb09"} Jul 15 23:47:12.493596 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:12.493575 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fp65r_d05a6a90-8e18-4a88-b6b9-b3a3712ffe07/ovn-acl-logging/0.log" Jul 15 23:47:12.494009 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:12.493984 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" event={"ID":"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07","Type":"ContainerStarted","Data":"7da6e324488a6f8f7de71ce74700210488097e84f20b9012eae266bba91485b1"} Jul 15 23:47:12.494076 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:12.494054 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" event={"ID":"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07","Type":"ContainerStarted","Data":"80d172859e0bab51cd7d0d1a11f871a3610d444f6d5a33f9ca69214bfce5ddc3"} Jul 15 23:47:12.495549 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:12.495497 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kxllk" event={"ID":"3250a7da-dbfd-416b-b43b-b6e12d89b167","Type":"ContainerStarted","Data":"cf8b802b5624593579c844d6f355538a3859b9b1901382d5d7e1c20a6a156d94"} Jul 15 23:47:12.509719 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:12.509654 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kxllk" podStartSLOduration=4.914560736 podStartE2EDuration="23.509638399s" totalImagesPullingTime="18.595077663s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:46:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:12.509131608 +0000 UTC m=+23.740110356" watchObservedRunningTime="2026-07-15 23:47:12.509638399 +0000 UTC m=+23.740617146" Jul 15 23:47:13.253653 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:13.253550 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T23:47:12.366559847Z","UUID":"a1b07ade-482d-406e-add0-b6fde8f828bc","Handler":null,"Name":"","Endpoint":""} Jul 15 23:47:13.255892 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:13.255869 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 15 23:47:13.256042 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:13.255999 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 15 23:47:13.295562 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:13.295525 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:47:13.295761 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:13.295525 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:47:13.295761 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:13.295684 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgnmg" podUID="ae3abafe-42bb-46fb-8165-4b95893c4b8d" Jul 15 23:47:13.295761 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:13.295749 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp4rq" podUID="371e613a-079b-4d90-83bc-8145a0d84fce" Jul 15 23:47:13.295921 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:13.295533 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:47:13.295921 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:13.295849 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pjjq" podUID="b98aea50-bfd9-48e4-984e-f5a89ee01212" Jul 15 23:47:13.500886 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:13.500855 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm" event={"ID":"58b10fb2-6a2e-4674-8bf3-84797e9fc223","Type":"ContainerStarted","Data":"5011d3348d7db51f6db9e7e49c07ee33025fca72e4cac0464be425f1d926ee9e"} Jul 15 23:47:13.516919 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:13.516825 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26wm" podStartSLOduration=2.935212668 podStartE2EDuration="23.516810781s" totalImagesPullingTime="20.581598113s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:46:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:13.5163891 +0000 UTC m=+24.747367847" watchObservedRunningTime="2026-07-15 23:47:13.516810781 +0000 UTC m=+24.747789528" Jul 15 23:47:14.211774 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:14.211704 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-j5p5p" Jul 15 23:47:14.212307 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:14.212291 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-j5p5p" Jul 15 23:47:14.505919 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:14.505847 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fp65r_d05a6a90-8e18-4a88-b6b9-b3a3712ffe07/ovn-acl-logging/0.log" Jul 15 23:47:14.506342 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:14.506274 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" event={"ID":"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07","Type":"ContainerStarted","Data":"e60f2e8e5ad41ca2ca6dbb1b5e9365ef8053c8b8b59f36f19b949de9294b1982"} Jul 15 23:47:14.506582 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:14.506562 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-j5p5p" Jul 15 23:47:14.507145 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:14.507125 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-j5p5p" Jul 15 23:47:15.296074 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:15.295869 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:47:15.296253 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:15.295869 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:47:15.296253 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:15.296169 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgnmg" podUID="ae3abafe-42bb-46fb-8165-4b95893c4b8d" Jul 15 23:47:15.296253 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:15.296216 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pjjq" podUID="b98aea50-bfd9-48e4-984e-f5a89ee01212" Jul 15 23:47:15.296253 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:15.295900 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:47:15.296405 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:15.296311 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp4rq" podUID="371e613a-079b-4d90-83bc-8145a0d84fce" Jul 15 23:47:16.512996 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:16.512809 2564 generic.go:356] "Generic (PLEG): container finished" podID="01724c1a-84e1-4d42-b3c5-0ef10804e30c" containerID="b7eff7242a1461b4815b5576fd1b013094065d1d339d5f05c090e83232c4312e" exitCode=0 Jul 15 23:47:16.513772 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:16.512888 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hjtzh" event={"ID":"01724c1a-84e1-4d42-b3c5-0ef10804e30c","Type":"ContainerDied","Data":"b7eff7242a1461b4815b5576fd1b013094065d1d339d5f05c090e83232c4312e"} Jul 15 23:47:16.516472 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:16.516454 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fp65r_d05a6a90-8e18-4a88-b6b9-b3a3712ffe07/ovn-acl-logging/0.log" Jul 15 23:47:16.516846 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:16.516823 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" event={"ID":"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07","Type":"ContainerStarted","Data":"f9eff158b2a620778bf8a2c8f56b8219f744f167a8f5183e7c6941363e7eaf92"} Jul 15 23:47:16.517124 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:16.517105 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:47:16.517197 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:16.517172 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:47:16.517245 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:16.517230 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:47:16.517292 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:16.517242 2564 scope.go:117] "RemoveContainer" containerID="adecfe3c6d11b278a40c57fcd29cb6b8a59ea58626c4bc286e679c851aebc41c" Jul 15 23:47:16.533439 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:16.533420 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:47:16.533586 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:16.533565 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:47:17.295917 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:17.295886 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:47:17.296254 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:17.295887 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:47:17.296254 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:17.296001 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgnmg" podUID="ae3abafe-42bb-46fb-8165-4b95893c4b8d" Jul 15 23:47:17.296254 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:17.295886 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:47:17.296254 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:17.296092 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pjjq" podUID="b98aea50-bfd9-48e4-984e-f5a89ee01212" Jul 15 23:47:17.296254 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:17.296205 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp4rq" podUID="371e613a-079b-4d90-83bc-8145a0d84fce" Jul 15 23:47:17.525581 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:17.525553 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fp65r_d05a6a90-8e18-4a88-b6b9-b3a3712ffe07/ovn-acl-logging/0.log" Jul 15 23:47:17.526067 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:17.525947 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" event={"ID":"d05a6a90-8e18-4a88-b6b9-b3a3712ffe07","Type":"ContainerStarted","Data":"ad62b3039b2759ab666ebda7caaa106703e7dadc468fb16f430a9b24c11c009c"} Jul 15 23:47:17.569743 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:17.569687 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" podStartSLOduration=9.908607714 podStartE2EDuration="28.569647717s" totalImagesPullingTime="18.661040003s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:46:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:17.567477251 +0000 UTC m=+28.798456018" watchObservedRunningTime="2026-07-15 23:47:17.569647717 +0000 UTC m=+28.800626465" Jul 15 23:47:18.001967 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:18.001899 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5pjjq"] Jul 15 23:47:18.002197 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:18.002004 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:47:18.002197 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:18.002106 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pjjq" podUID="b98aea50-bfd9-48e4-984e-f5a89ee01212" Jul 15 23:47:18.004590 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:18.004552 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pp4rq"] Jul 15 23:47:18.004721 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:18.004695 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:47:18.004831 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:18.004807 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp4rq" podUID="371e613a-079b-4d90-83bc-8145a0d84fce" Jul 15 23:47:18.005187 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:18.005169 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tgnmg"] Jul 15 23:47:18.005288 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:18.005243 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:47:18.005332 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:18.005315 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgnmg" podUID="ae3abafe-42bb-46fb-8165-4b95893c4b8d" Jul 15 23:47:18.529737 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:18.529695 2564 generic.go:356] "Generic (PLEG): container finished" podID="01724c1a-84e1-4d42-b3c5-0ef10804e30c" containerID="c9603157cc040754ed8273631559c1700dbb1ce883b422c06289e81965710fe7" exitCode=0 Jul 15 23:47:18.530232 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:18.529782 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hjtzh" event={"ID":"01724c1a-84e1-4d42-b3c5-0ef10804e30c","Type":"ContainerDied","Data":"c9603157cc040754ed8273631559c1700dbb1ce883b422c06289e81965710fe7"} Jul 15 23:47:19.296214 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:19.296181 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:47:19.296379 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:19.296269 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp4rq" podUID="371e613a-079b-4d90-83bc-8145a0d84fce" Jul 15 23:47:19.296379 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:19.296348 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:47:19.296460 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:19.296429 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pjjq" podUID="b98aea50-bfd9-48e4-984e-f5a89ee01212" Jul 15 23:47:20.295822 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:20.295647 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:47:20.296190 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:20.295890 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgnmg" podUID="ae3abafe-42bb-46fb-8165-4b95893c4b8d" Jul 15 23:47:20.537660 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:20.537583 2564 generic.go:356] "Generic (PLEG): container finished" podID="01724c1a-84e1-4d42-b3c5-0ef10804e30c" containerID="7c8f2803600621aecb320fff8c434c8083709162d9151a9602ebcf4b48f90890" exitCode=0 Jul 15 23:47:20.537660 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:20.537632 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hjtzh" event={"ID":"01724c1a-84e1-4d42-b3c5-0ef10804e30c","Type":"ContainerDied","Data":"7c8f2803600621aecb320fff8c434c8083709162d9151a9602ebcf4b48f90890"} Jul 15 23:47:21.296176 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:21.296097 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:47:21.296791 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:21.296105 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:47:21.296791 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:21.296224 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pjjq" podUID="b98aea50-bfd9-48e4-984e-f5a89ee01212" Jul 15 23:47:21.296791 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:21.296300 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp4rq" podUID="371e613a-079b-4d90-83bc-8145a0d84fce" Jul 15 23:47:22.296219 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:22.296184 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:47:22.296611 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:22.296317 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgnmg" podUID="ae3abafe-42bb-46fb-8165-4b95893c4b8d" Jul 15 23:47:22.952626 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:22.952598 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/371e613a-079b-4d90-83bc-8145a0d84fce-metrics-certs\") pod \"network-metrics-daemon-pp4rq\" (UID: \"371e613a-079b-4d90-83bc-8145a0d84fce\") " pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:47:22.952809 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:22.952733 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 23:47:22.952809 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:22.952790 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/371e613a-079b-4d90-83bc-8145a0d84fce-metrics-certs podName:371e613a-079b-4d90-83bc-8145a0d84fce nodeName:}" failed. No retries permitted until 2026-07-15 23:47:54.952775686 +0000 UTC m=+66.183754415 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/371e613a-079b-4d90-83bc-8145a0d84fce-metrics-certs") pod "network-metrics-daemon-pp4rq" (UID: "371e613a-079b-4d90-83bc-8145a0d84fce") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 23:47:23.053646 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:23.053565 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fdwc\" (UniqueName: \"kubernetes.io/projected/b98aea50-bfd9-48e4-984e-f5a89ee01212-kube-api-access-7fdwc\") pod \"network-check-target-5pjjq\" (UID: \"b98aea50-bfd9-48e4-984e-f5a89ee01212\") " pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:47:23.053646 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:23.053602 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3abafe-42bb-46fb-8165-4b95893c4b8d-original-pull-secret\") pod \"global-pull-secret-syncer-tgnmg\" (UID: \"ae3abafe-42bb-46fb-8165-4b95893c4b8d\") " pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:47:23.053865 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:23.053751 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 23:47:23.053865 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:23.053806 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae3abafe-42bb-46fb-8165-4b95893c4b8d-original-pull-secret podName:ae3abafe-42bb-46fb-8165-4b95893c4b8d nodeName:}" failed. No retries permitted until 2026-07-15 23:47:55.05379293 +0000 UTC m=+66.284771656 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae3abafe-42bb-46fb-8165-4b95893c4b8d-original-pull-secret") pod "global-pull-secret-syncer-tgnmg" (UID: "ae3abafe-42bb-46fb-8165-4b95893c4b8d") : object "kube-system"/"original-pull-secret" not registered Jul 15 23:47:23.053865 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:23.053753 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 23:47:23.053865 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:23.053848 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 23:47:23.053865 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:23.053860 2564 projected.go:196] Error preparing data for projected volume kube-api-access-7fdwc for pod openshift-network-diagnostics/network-check-target-5pjjq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 23:47:23.054131 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:23.053907 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b98aea50-bfd9-48e4-984e-f5a89ee01212-kube-api-access-7fdwc podName:b98aea50-bfd9-48e4-984e-f5a89ee01212 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:55.053891381 +0000 UTC m=+66.284870122 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7fdwc" (UniqueName: "kubernetes.io/projected/b98aea50-bfd9-48e4-984e-f5a89ee01212-kube-api-access-7fdwc") pod "network-check-target-5pjjq" (UID: "b98aea50-bfd9-48e4-984e-f5a89ee01212") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 23:47:23.295380 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:23.295346 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:47:23.295561 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:23.295390 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:47:23.295561 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:23.295486 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pjjq" podUID="b98aea50-bfd9-48e4-984e-f5a89ee01212" Jul 15 23:47:23.295686 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:23.295630 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pp4rq" podUID="371e613a-079b-4d90-83bc-8145a0d84fce" Jul 15 23:47:24.296022 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:24.295963 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:47:24.296528 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:24.296120 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgnmg" podUID="ae3abafe-42bb-46fb-8165-4b95893c4b8d" Jul 15 23:47:25.061885 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.061855 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeReady" Jul 15 23:47:25.062067 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.062000 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 15 23:47:25.094436 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.094400 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-597f796589-4tx26"] Jul 15 23:47:25.096180 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.096166 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:25.099225 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.099100 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 15 23:47:25.099225 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.099100 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 15 23:47:25.099452 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.099246 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 15 23:47:25.100026 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.099891 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z98bm"] Jul 15 23:47:25.101255 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.100833 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cf9dq\"" Jul 15 23:47:25.107545 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.107518 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-98v79"] Jul 15 23:47:25.107891 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.107869 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z98bm" Jul 15 23:47:25.108872 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.108852 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 15 23:47:25.109911 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.109894 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jf8jd"] Jul 15 23:47:25.110021 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.110003 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-98v79" Jul 15 23:47:25.110877 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.110864 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-b8xv7\"" Jul 15 23:47:25.111229 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.111210 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 15 23:47:25.111340 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.111275 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 15 23:47:25.111436 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.111400 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-mkxvc"] Jul 15 23:47:25.111535 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.111514 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jf8jd" Jul 15 23:47:25.112409 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.112392 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 15 23:47:25.112851 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.112830 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 15 23:47:25.113005 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.112948 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8hxlp"] Jul 15 23:47:25.113070 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.113032 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 15 23:47:25.113070 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.113055 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7kvvm\"" Jul 15 23:47:25.113174 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.113102 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-mkxvc" Jul 15 23:47:25.113257 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.113241 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 15 23:47:25.114779 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.114758 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 15 23:47:25.115698 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.114952 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-7g2gx"] Jul 15 23:47:25.115698 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.115033 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8hxlp" Jul 15 23:47:25.116360 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.116201 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 15 23:47:25.116456 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.116439 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-7nmcl\"" Jul 15 23:47:25.116576 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.116558 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 15 23:47:25.116730 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.116567 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5f5546b47d-9whv9"] Jul 15 23:47:25.116807 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.116737 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 15 23:47:25.117012 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.116965 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-7g2gx" Jul 15 23:47:25.118568 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.118542 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 15 23:47:25.118678 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.118606 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-ctm8d\"" Jul 15 23:47:25.118862 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.118845 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7fm9v"] Jul 15 23:47:25.118991 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.118971 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qcnr9\"" Jul 15 23:47:25.119054 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.118993 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 15 23:47:25.119184 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.119166 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 15 23:47:25.119323 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.118909 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 15 23:47:25.119544 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.119526 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:25.120847 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.118902 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 15 23:47:25.120847 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.120615 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 15 23:47:25.120847 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.120826 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 15 23:47:25.122081 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.121927 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-597f796589-4tx26"] Jul 15 23:47:25.122081 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.121969 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-98v79"] Jul 15 23:47:25.122081 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.121990 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z98bm"] Jul 15 23:47:25.122081 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.122008 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jf8jd"] Jul 15 23:47:25.122081 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.122026 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8hxlp"] Jul 15 23:47:25.122350 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.122101 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7fm9v" Jul 15 23:47:25.122733 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.122708 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jwfwf"] Jul 15 23:47:25.123030 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.123010 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 15 23:47:25.123175 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.122823 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 15 23:47:25.123442 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.123422 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 15 23:47:25.123695 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.122765 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 15 23:47:25.123923 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.123905 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-b9bt2\"" Jul 15 23:47:25.127176 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.125812 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 15 23:47:25.127176 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.125926 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 15 23:47:25.127176 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.125965 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 15 23:47:25.127176 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.126227 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 15 23:47:25.127176 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.127157 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 15 23:47:25.127557 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.127140 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5l9w5"] Jul 15 23:47:25.127557 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.127376 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 15 23:47:25.127945 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.127926 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8rw7r\"" Jul 15 23:47:25.130850 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.128422 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 15 23:47:25.130850 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.128823 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 15 23:47:25.131626 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.131603 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-ftx8k"] Jul 15 23:47:25.132547 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.132532 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jwfwf" Jul 15 23:47:25.132843 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.132828 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5l9w5" Jul 15 23:47:25.135687 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.135649 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 15 23:47:25.136088 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.136059 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 15 23:47:25.136088 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.136076 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 15 23:47:25.136404 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.136379 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 15 23:47:25.136614 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.136597 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jq9d4\"" Jul 15 23:47:25.137414 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.137395 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 15 23:47:25.137684 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.137653 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-fmsfn"] Jul 15 23:47:25.138375 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.137657 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 15 23:47:25.138877 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.138861 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-ftx8k" Jul 15 23:47:25.139373 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.137755 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-72cf6\"" Jul 15 23:47:25.139562 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.137817 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 15 23:47:25.140543 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.140519 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 15 23:47:25.140646 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.137565 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-2kmqg\"" Jul 15 23:47:25.141965 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.141651 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 15 23:47:25.142218 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.142199 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-mkxvc"] Jul 15 23:47:25.142305 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.142257 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-7g2gx"] Jul 15 23:47:25.142305 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.142290 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-fmsfn"] Jul 15 23:47:25.143038 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.143020 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-fmsfn" Jul 15 23:47:25.143971 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.143638 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 15 23:47:25.143971 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.143789 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vtkd9\"" Jul 15 23:47:25.145474 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.145455 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 15 23:47:25.145797 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.145775 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-n4n89\"" Jul 15 23:47:25.145887 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.145805 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 23:47:25.145973 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.145957 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 23:47:25.146033 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.145958 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5f5546b47d-9whv9"] Jul 15 23:47:25.146084 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.146044 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-ftx8k"] Jul 15 23:47:25.146793 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.146773 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5l9w5"] Jul 15 23:47:25.147513 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.147496 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jwfwf"] Jul 15 23:47:25.148195 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.148176 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7fm9v"] Jul 15 23:47:25.270004 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.269974 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bf55176-1282-44d4-9c63-345a50ab4d01-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-mkxvc\" (UID: \"0bf55176-1282-44d4-9c63-345a50ab4d01\") " pod="openshift-insights/insights-operator-68d9dd94cf-mkxvc" Jul 15 23:47:25.270004 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270004 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-z98bm\" (UID: \"b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z98bm" Jul 15 23:47:25.270226 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270024 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kpgp\" (UniqueName: \"kubernetes.io/projected/745e0d0a-e9fc-490f-994f-634357fcf39a-kube-api-access-5kpgp\") pod \"volume-data-source-validator-78495597f6-98v79\" (UID: \"745e0d0a-e9fc-490f-994f-634357fcf39a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-98v79" Jul 15 23:47:25.270226 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270045 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfr5c\" (UniqueName: \"kubernetes.io/projected/b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b-kube-api-access-zfr5c\") pod \"cluster-monitoring-operator-5f7f494dd4-z98bm\" (UID: \"b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z98bm" Jul 15 23:47:25.270226 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270064 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88s9j\" (UniqueName: \"kubernetes.io/projected/2b04f591-5391-4cd9-a495-a01bb0e49ce2-kube-api-access-88s9j\") pod \"router-default-5f5546b47d-9whv9\" (UID: \"2b04f591-5391-4cd9-a495-a01bb0e49ce2\") " pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:25.270226 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270085 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0f1c9d30-fe51-493e-9b47-84d63b56fa8f-trusted-ca\") pod \"console-operator-7866497494-7g2gx\" (UID: \"0f1c9d30-fe51-493e-9b47-84d63b56fa8f\") " pod="openshift-console-operator/console-operator-7866497494-7g2gx" Jul 15 23:47:25.270226 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270143 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59mxh\" (UniqueName: \"kubernetes.io/projected/2aa8c822-fd65-415a-9846-7f0f553df96a-kube-api-access-59mxh\") pod \"network-check-source-869dcfcdcd-fmsfn\" (UID: \"2aa8c822-fd65-415a-9846-7f0f553df96a\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-fmsfn" Jul 15 23:47:25.270226 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270171 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8d25ea1-819e-46d2-854d-29b4be8e184f-cert\") pod \"ingress-canary-5l9w5\" (UID: \"c8d25ea1-819e-46d2-854d-29b4be8e184f\") " pod="openshift-ingress-canary/ingress-canary-5l9w5" Jul 15 23:47:25.270226 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270188 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b45a97fe-1c83-40e9-b190-8231a1b07291-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-ftx8k\" (UID: \"b45a97fe-1c83-40e9-b190-8231a1b07291\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-ftx8k" Jul 15 23:47:25.270226 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270205 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch49l\" (UniqueName: \"kubernetes.io/projected/0f1c9d30-fe51-493e-9b47-84d63b56fa8f-kube-api-access-ch49l\") pod \"console-operator-7866497494-7g2gx\" (UID: \"0f1c9d30-fe51-493e-9b47-84d63b56fa8f\") " pod="openshift-console-operator/console-operator-7866497494-7g2gx" Jul 15 23:47:25.270226 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270226 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0bf55176-1282-44d4-9c63-345a50ab4d01-snapshots\") pod \"insights-operator-68d9dd94cf-mkxvc\" (UID: \"0bf55176-1282-44d4-9c63-345a50ab4d01\") " pod="openshift-insights/insights-operator-68d9dd94cf-mkxvc" Jul 15 23:47:25.270589 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270243 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/331d2302-c007-4a2e-a3aa-781bcb64ff9d-image-registry-private-configuration\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:25.270589 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270257 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-tls\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:25.270589 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270272 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-bound-sa-token\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:25.270589 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270287 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f1c9d30-fe51-493e-9b47-84d63b56fa8f-config\") pod \"console-operator-7866497494-7g2gx\" (UID: \"0f1c9d30-fe51-493e-9b47-84d63b56fa8f\") " pod="openshift-console-operator/console-operator-7866497494-7g2gx" Jul 15 23:47:25.270589 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270337 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0bf55176-1282-44d4-9c63-345a50ab4d01-tmp\") pod \"insights-operator-68d9dd94cf-mkxvc\" (UID: \"0bf55176-1282-44d4-9c63-345a50ab4d01\") " pod="openshift-insights/insights-operator-68d9dd94cf-mkxvc" Jul 15 23:47:25.270589 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270377 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-tmp-dir\") pod \"dns-default-jwfwf\" (UID: \"d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9\") " pod="openshift-dns/dns-default-jwfwf" Jul 15 23:47:25.270589 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270399 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/362c7d00-de2e-4c56-81f9-1088ce28347e-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-jf8jd\" (UID: \"362c7d00-de2e-4c56-81f9-1088ce28347e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jf8jd" Jul 15 23:47:25.270589 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270419 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/331d2302-c007-4a2e-a3aa-781bcb64ff9d-installation-pull-secrets\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:25.270589 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270440 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhm44\" (UniqueName: \"kubernetes.io/projected/c8d25ea1-819e-46d2-854d-29b4be8e184f-kube-api-access-bhm44\") pod \"ingress-canary-5l9w5\" (UID: \"c8d25ea1-819e-46d2-854d-29b4be8e184f\") " pod="openshift-ingress-canary/ingress-canary-5l9w5" Jul 15 23:47:25.270589 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270476 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f1c9d30-fe51-493e-9b47-84d63b56fa8f-serving-cert\") pod \"console-operator-7866497494-7g2gx\" (UID: \"0f1c9d30-fe51-493e-9b47-84d63b56fa8f\") " pod="openshift-console-operator/console-operator-7866497494-7g2gx" Jul 15 23:47:25.270589 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270519 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2b04f591-5391-4cd9-a495-a01bb0e49ce2-default-certificate\") pod \"router-default-5f5546b47d-9whv9\" (UID: \"2b04f591-5391-4cd9-a495-a01bb0e49ce2\") " pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:25.270589 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270585 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-certificates\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:25.271076 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270607 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11b45ddc-d3c9-4bc0-9ddc-3be34f33f0de-serving-cert\") pod \"service-ca-operator-7695fc6c8c-7fm9v\" (UID: \"11b45ddc-d3c9-4bc0-9ddc-3be34f33f0de\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7fm9v" Jul 15 23:47:25.271076 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270642 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfkk8\" (UniqueName: \"kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-kube-api-access-dfkk8\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:25.271076 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270731 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b04f591-5391-4cd9-a495-a01bb0e49ce2-metrics-certs\") pod \"router-default-5f5546b47d-9whv9\" (UID: \"2b04f591-5391-4cd9-a495-a01bb0e49ce2\") " pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:25.271076 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270781 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq8qq\" (UniqueName: \"kubernetes.io/projected/c2e75f0c-6a7f-42ec-a6ec-60018d26d211-kube-api-access-pq8qq\") pod \"cluster-samples-operator-65db858894-8hxlp\" (UID: \"c2e75f0c-6a7f-42ec-a6ec-60018d26d211\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8hxlp" Jul 15 23:47:25.271076 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270798 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-metrics-tls\") pod \"dns-default-jwfwf\" (UID: \"d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9\") " pod="openshift-dns/dns-default-jwfwf" Jul 15 23:47:25.271076 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270818 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-z98bm\" (UID: \"b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z98bm" Jul 15 23:47:25.271076 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270835 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b45a97fe-1c83-40e9-b190-8231a1b07291-nginx-conf\") pod \"networking-console-plugin-6cf856758c-ftx8k\" (UID: \"b45a97fe-1c83-40e9-b190-8231a1b07291\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-ftx8k" Jul 15 23:47:25.271076 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270881 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2b04f591-5391-4cd9-a495-a01bb0e49ce2-stats-auth\") pod \"router-default-5f5546b47d-9whv9\" (UID: \"2b04f591-5391-4cd9-a495-a01bb0e49ce2\") " pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:25.271076 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270910 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/362c7d00-de2e-4c56-81f9-1088ce28347e-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-jf8jd\" (UID: \"362c7d00-de2e-4c56-81f9-1088ce28347e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jf8jd" Jul 15 23:47:25.271076 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270933 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/331d2302-c007-4a2e-a3aa-781bcb64ff9d-ca-trust-extracted\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:25.271076 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270956 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c2e75f0c-6a7f-42ec-a6ec-60018d26d211-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8hxlp\" (UID: \"c2e75f0c-6a7f-42ec-a6ec-60018d26d211\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8hxlp" Jul 15 23:47:25.271076 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.270980 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4hpm\" (UniqueName: \"kubernetes.io/projected/362c7d00-de2e-4c56-81f9-1088ce28347e-kube-api-access-t4hpm\") pod \"kube-storage-version-migrator-operator-799cb7f958-jf8jd\" (UID: \"362c7d00-de2e-4c56-81f9-1088ce28347e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jf8jd" Jul 15 23:47:25.271076 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.271003 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bf55176-1282-44d4-9c63-345a50ab4d01-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-mkxvc\" (UID: \"0bf55176-1282-44d4-9c63-345a50ab4d01\") " pod="openshift-insights/insights-operator-68d9dd94cf-mkxvc" Jul 15 23:47:25.271076 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.271024 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/331d2302-c007-4a2e-a3aa-781bcb64ff9d-trusted-ca\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:25.271076 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.271069 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9pmq\" (UniqueName: \"kubernetes.io/projected/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-kube-api-access-k9pmq\") pod \"dns-default-jwfwf\" (UID: \"d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9\") " pod="openshift-dns/dns-default-jwfwf" Jul 15 23:47:25.271571 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.271104 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/11b45ddc-d3c9-4bc0-9ddc-3be34f33f0de-config\") pod \"service-ca-operator-7695fc6c8c-7fm9v\" (UID: \"11b45ddc-d3c9-4bc0-9ddc-3be34f33f0de\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7fm9v" Jul 15 23:47:25.271571 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.271120 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5kdh\" (UniqueName: \"kubernetes.io/projected/11b45ddc-d3c9-4bc0-9ddc-3be34f33f0de-kube-api-access-q5kdh\") pod \"service-ca-operator-7695fc6c8c-7fm9v\" (UID: \"11b45ddc-d3c9-4bc0-9ddc-3be34f33f0de\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7fm9v" Jul 15 23:47:25.271571 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.271156 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0bf55176-1282-44d4-9c63-345a50ab4d01-serving-cert\") pod \"insights-operator-68d9dd94cf-mkxvc\" (UID: \"0bf55176-1282-44d4-9c63-345a50ab4d01\") " pod="openshift-insights/insights-operator-68d9dd94cf-mkxvc" Jul 15 23:47:25.271571 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.271199 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2k6q\" (UniqueName: \"kubernetes.io/projected/0bf55176-1282-44d4-9c63-345a50ab4d01-kube-api-access-q2k6q\") pod \"insights-operator-68d9dd94cf-mkxvc\" (UID: \"0bf55176-1282-44d4-9c63-345a50ab4d01\") " pod="openshift-insights/insights-operator-68d9dd94cf-mkxvc" Jul 15 23:47:25.271571 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.271224 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-config-volume\") pod \"dns-default-jwfwf\" (UID: \"d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9\") " pod="openshift-dns/dns-default-jwfwf" Jul 15 23:47:25.271571 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.271270 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b04f591-5391-4cd9-a495-a01bb0e49ce2-service-ca-bundle\") pod \"router-default-5f5546b47d-9whv9\" (UID: \"2b04f591-5391-4cd9-a495-a01bb0e49ce2\") " pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:25.299310 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.299271 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:47:25.299852 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.299455 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:47:25.301506 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.301488 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 23:47:25.301610 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.301594 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fwsxh\"" Jul 15 23:47:25.301699 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.301601 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m2fgm\"" Jul 15 23:47:25.372052 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.371975 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kpgp\" (UniqueName: \"kubernetes.io/projected/745e0d0a-e9fc-490f-994f-634357fcf39a-kube-api-access-5kpgp\") pod \"volume-data-source-validator-78495597f6-98v79\" (UID: \"745e0d0a-e9fc-490f-994f-634357fcf39a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-98v79" Jul 15 23:47:25.372052 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.372010 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfr5c\" (UniqueName: \"kubernetes.io/projected/b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b-kube-api-access-zfr5c\") pod \"cluster-monitoring-operator-5f7f494dd4-z98bm\" (UID: \"b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z98bm" Jul 15 23:47:25.372052 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.372029 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88s9j\" (UniqueName: \"kubernetes.io/projected/2b04f591-5391-4cd9-a495-a01bb0e49ce2-kube-api-access-88s9j\") pod \"router-default-5f5546b47d-9whv9\" (UID: \"2b04f591-5391-4cd9-a495-a01bb0e49ce2\") " pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:25.372052 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.372051 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0f1c9d30-fe51-493e-9b47-84d63b56fa8f-trusted-ca\") pod \"console-operator-7866497494-7g2gx\" (UID: \"0f1c9d30-fe51-493e-9b47-84d63b56fa8f\") " pod="openshift-console-operator/console-operator-7866497494-7g2gx" Jul 15 23:47:25.372328 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.372074 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59mxh\" (UniqueName: \"kubernetes.io/projected/2aa8c822-fd65-415a-9846-7f0f553df96a-kube-api-access-59mxh\") pod \"network-check-source-869dcfcdcd-fmsfn\" (UID: \"2aa8c822-fd65-415a-9846-7f0f553df96a\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-fmsfn" Jul 15 23:47:25.372328 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.372093 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8d25ea1-819e-46d2-854d-29b4be8e184f-cert\") pod \"ingress-canary-5l9w5\" (UID: \"c8d25ea1-819e-46d2-854d-29b4be8e184f\") " pod="openshift-ingress-canary/ingress-canary-5l9w5" Jul 15 23:47:25.372328 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.372237 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b45a97fe-1c83-40e9-b190-8231a1b07291-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-ftx8k\" (UID: \"b45a97fe-1c83-40e9-b190-8231a1b07291\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-ftx8k" Jul 15 23:47:25.372328 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.372295 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch49l\" (UniqueName: \"kubernetes.io/projected/0f1c9d30-fe51-493e-9b47-84d63b56fa8f-kube-api-access-ch49l\") pod \"console-operator-7866497494-7g2gx\" (UID: \"0f1c9d30-fe51-493e-9b47-84d63b56fa8f\") " pod="openshift-console-operator/console-operator-7866497494-7g2gx" Jul 15 23:47:25.372504 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.372340 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0bf55176-1282-44d4-9c63-345a50ab4d01-snapshots\") pod \"insights-operator-68d9dd94cf-mkxvc\" (UID: \"0bf55176-1282-44d4-9c63-345a50ab4d01\") " pod="openshift-insights/insights-operator-68d9dd94cf-mkxvc" Jul 15 23:47:25.372504 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:25.372363 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 23:47:25.372504 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.372364 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/331d2302-c007-4a2e-a3aa-781bcb64ff9d-image-registry-private-configuration\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:25.372504 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:25.372453 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b45a97fe-1c83-40e9-b190-8231a1b07291-networking-console-plugin-cert podName:b45a97fe-1c83-40e9-b190-8231a1b07291 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:25.872432431 +0000 UTC m=+37.103411159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b45a97fe-1c83-40e9-b190-8231a1b07291-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-ftx8k" (UID: "b45a97fe-1c83-40e9-b190-8231a1b07291") : secret "networking-console-plugin-cert" not found Jul 15 23:47:25.372504 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.372493 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-tls\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:25.372838 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.372519 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-bound-sa-token\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:25.372838 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.372541 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f1c9d30-fe51-493e-9b47-84d63b56fa8f-config\") pod \"console-operator-7866497494-7g2gx\" (UID: \"0f1c9d30-fe51-493e-9b47-84d63b56fa8f\") " pod="openshift-console-operator/console-operator-7866497494-7g2gx" Jul 15 23:47:25.372838 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.372735 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0bf55176-1282-44d4-9c63-345a50ab4d01-tmp\") pod \"insights-operator-68d9dd94cf-mkxvc\" (UID: \"0bf55176-1282-44d4-9c63-345a50ab4d01\") " pod="openshift-insights/insights-operator-68d9dd94cf-mkxvc" Jul 15 23:47:25.372838 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.372777 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-tmp-dir\") pod \"dns-default-jwfwf\" (UID: \"d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9\") " pod="openshift-dns/dns-default-jwfwf" Jul 15 23:47:25.372838 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.372800 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/362c7d00-de2e-4c56-81f9-1088ce28347e-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-jf8jd\" (UID: \"362c7d00-de2e-4c56-81f9-1088ce28347e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jf8jd" Jul 15 23:47:25.372838 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.372820 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/331d2302-c007-4a2e-a3aa-781bcb64ff9d-installation-pull-secrets\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:25.372838 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.372835 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhm44\" (UniqueName: \"kubernetes.io/projected/c8d25ea1-819e-46d2-854d-29b4be8e184f-kube-api-access-bhm44\") pod \"ingress-canary-5l9w5\" (UID: \"c8d25ea1-819e-46d2-854d-29b4be8e184f\") " pod="openshift-ingress-canary/ingress-canary-5l9w5" Jul 15 23:47:25.373123 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.372857 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f1c9d30-fe51-493e-9b47-84d63b56fa8f-serving-cert\") pod \"console-operator-7866497494-7g2gx\" (UID: \"0f1c9d30-fe51-493e-9b47-84d63b56fa8f\") " pod="openshift-console-operator/console-operator-7866497494-7g2gx" Jul 15 23:47:25.373123 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.372884 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2b04f591-5391-4cd9-a495-a01bb0e49ce2-default-certificate\") pod \"router-default-5f5546b47d-9whv9\" (UID: \"2b04f591-5391-4cd9-a495-a01bb0e49ce2\") " pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:25.373274 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.373248 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f1c9d30-fe51-493e-9b47-84d63b56fa8f-config\") pod \"console-operator-7866497494-7g2gx\" (UID: \"0f1c9d30-fe51-493e-9b47-84d63b56fa8f\") " pod="openshift-console-operator/console-operator-7866497494-7g2gx" Jul 15 23:47:25.373708 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.373261 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0bf55176-1282-44d4-9c63-345a50ab4d01-snapshots\") pod \"insights-operator-68d9dd94cf-mkxvc\" (UID: \"0bf55176-1282-44d4-9c63-345a50ab4d01\") " pod="openshift-insights/insights-operator-68d9dd94cf-mkxvc" Jul 15 23:47:25.373850 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:25.373359 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 23:47:25.373967 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:25.373949 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-597f796589-4tx26: secret "image-registry-tls" not found Jul 15 23:47:25.374090 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.373366 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-certificates\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:25.374090 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.374026 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11b45ddc-d3c9-4bc0-9ddc-3be34f33f0de-serving-cert\") pod \"service-ca-operator-7695fc6c8c-7fm9v\" (UID: \"11b45ddc-d3c9-4bc0-9ddc-3be34f33f0de\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7fm9v" Jul 15 23:47:25.374090 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.373638 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0bf55176-1282-44d4-9c63-345a50ab4d01-tmp\") pod \"insights-operator-68d9dd94cf-mkxvc\" (UID: \"0bf55176-1282-44d4-9c63-345a50ab4d01\") " pod="openshift-insights/insights-operator-68d9dd94cf-mkxvc" Jul 15 23:47:25.374090 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.373852 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-tmp-dir\") pod \"dns-default-jwfwf\" (UID: \"d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9\") " pod="openshift-dns/dns-default-jwfwf" Jul 15 23:47:25.374823 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.374773 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-certificates\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:25.374921 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:25.374849 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-tls podName:331d2302-c007-4a2e-a3aa-781bcb64ff9d nodeName:}" failed. No retries permitted until 2026-07-15 23:47:25.874830281 +0000 UTC m=+37.105809027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-tls") pod "image-registry-597f796589-4tx26" (UID: "331d2302-c007-4a2e-a3aa-781bcb64ff9d") : secret "image-registry-tls" not found Jul 15 23:47:25.374921 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.373785 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/362c7d00-de2e-4c56-81f9-1088ce28347e-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-jf8jd\" (UID: \"362c7d00-de2e-4c56-81f9-1088ce28347e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jf8jd" Jul 15 23:47:25.374921 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.373648 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0f1c9d30-fe51-493e-9b47-84d63b56fa8f-trusted-ca\") pod \"console-operator-7866497494-7g2gx\" (UID: \"0f1c9d30-fe51-493e-9b47-84d63b56fa8f\") " pod="openshift-console-operator/console-operator-7866497494-7g2gx" Jul 15 23:47:25.377576 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.377552 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/331d2302-c007-4a2e-a3aa-781bcb64ff9d-installation-pull-secrets\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:25.377653 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.377622 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2b04f591-5391-4cd9-a495-a01bb0e49ce2-default-certificate\") pod \"router-default-5f5546b47d-9whv9\" (UID: \"2b04f591-5391-4cd9-a495-a01bb0e49ce2\") " pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:25.377749 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.377686 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f1c9d30-fe51-493e-9b47-84d63b56fa8f-serving-cert\") pod \"console-operator-7866497494-7g2gx\" (UID: \"0f1c9d30-fe51-493e-9b47-84d63b56fa8f\") " pod="openshift-console-operator/console-operator-7866497494-7g2gx" Jul 15 23:47:25.377996 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.377979 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8d25ea1-819e-46d2-854d-29b4be8e184f-cert\") pod \"ingress-canary-5l9w5\" (UID: \"c8d25ea1-819e-46d2-854d-29b4be8e184f\") " pod="openshift-ingress-canary/ingress-canary-5l9w5" Jul 15 23:47:25.379182 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.378061 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/331d2302-c007-4a2e-a3aa-781bcb64ff9d-image-registry-private-configuration\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:25.379327 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.379306 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfkk8\" (UniqueName: \"kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-kube-api-access-dfkk8\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:25.379515 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.379478 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11b45ddc-d3c9-4bc0-9ddc-3be34f33f0de-serving-cert\") pod \"service-ca-operator-7695fc6c8c-7fm9v\" (UID: \"11b45ddc-d3c9-4bc0-9ddc-3be34f33f0de\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7fm9v" Jul 15 23:47:25.379611 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.379475 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b04f591-5391-4cd9-a495-a01bb0e49ce2-metrics-certs\") pod \"router-default-5f5546b47d-9whv9\" (UID: \"2b04f591-5391-4cd9-a495-a01bb0e49ce2\") " pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:25.381634 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.380682 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq8qq\" (UniqueName: \"kubernetes.io/projected/c2e75f0c-6a7f-42ec-a6ec-60018d26d211-kube-api-access-pq8qq\") pod \"cluster-samples-operator-65db858894-8hxlp\" (UID: \"c2e75f0c-6a7f-42ec-a6ec-60018d26d211\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8hxlp" Jul 15 23:47:25.381634 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.380728 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-metrics-tls\") pod \"dns-default-jwfwf\" (UID: \"d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9\") " pod="openshift-dns/dns-default-jwfwf" Jul 15 23:47:25.381634 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.380765 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-z98bm\" (UID: \"b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z98bm" Jul 15 23:47:25.381634 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.380800 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b45a97fe-1c83-40e9-b190-8231a1b07291-nginx-conf\") pod \"networking-console-plugin-6cf856758c-ftx8k\" (UID: \"b45a97fe-1c83-40e9-b190-8231a1b07291\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-ftx8k" Jul 15 23:47:25.381634 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.380825 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2b04f591-5391-4cd9-a495-a01bb0e49ce2-stats-auth\") pod \"router-default-5f5546b47d-9whv9\" (UID: \"2b04f591-5391-4cd9-a495-a01bb0e49ce2\") " pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:25.381634 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.380858 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/362c7d00-de2e-4c56-81f9-1088ce28347e-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-jf8jd\" (UID: \"362c7d00-de2e-4c56-81f9-1088ce28347e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jf8jd" Jul 15 23:47:25.381634 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.380887 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/331d2302-c007-4a2e-a3aa-781bcb64ff9d-ca-trust-extracted\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:25.381634 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.380921 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c2e75f0c-6a7f-42ec-a6ec-60018d26d211-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8hxlp\" (UID: \"c2e75f0c-6a7f-42ec-a6ec-60018d26d211\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8hxlp" Jul 15 23:47:25.381634 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.380957 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4hpm\" (UniqueName: \"kubernetes.io/projected/362c7d00-de2e-4c56-81f9-1088ce28347e-kube-api-access-t4hpm\") pod \"kube-storage-version-migrator-operator-799cb7f958-jf8jd\" (UID: \"362c7d00-de2e-4c56-81f9-1088ce28347e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jf8jd" Jul 15 23:47:25.381634 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.380987 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bf55176-1282-44d4-9c63-345a50ab4d01-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-mkxvc\" (UID: \"0bf55176-1282-44d4-9c63-345a50ab4d01\") " pod="openshift-insights/insights-operator-68d9dd94cf-mkxvc" Jul 15 23:47:25.381634 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.381019 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/331d2302-c007-4a2e-a3aa-781bcb64ff9d-trusted-ca\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:25.381634 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:25.379971 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 23:47:25.381634 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.381058 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9pmq\" (UniqueName: \"kubernetes.io/projected/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-kube-api-access-k9pmq\") pod \"dns-default-jwfwf\" (UID: \"d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9\") " pod="openshift-dns/dns-default-jwfwf" Jul 15 23:47:25.381634 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:25.381099 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b04f591-5391-4cd9-a495-a01bb0e49ce2-metrics-certs podName:2b04f591-5391-4cd9-a495-a01bb0e49ce2 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:25.881073228 +0000 UTC m=+37.112051962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b04f591-5391-4cd9-a495-a01bb0e49ce2-metrics-certs") pod "router-default-5f5546b47d-9whv9" (UID: "2b04f591-5391-4cd9-a495-a01bb0e49ce2") : secret "router-metrics-certs-default" not found Jul 15 23:47:25.381634 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.381152 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/11b45ddc-d3c9-4bc0-9ddc-3be34f33f0de-config\") pod \"service-ca-operator-7695fc6c8c-7fm9v\" (UID: \"11b45ddc-d3c9-4bc0-9ddc-3be34f33f0de\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7fm9v" Jul 15 23:47:25.382430 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.381182 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5kdh\" (UniqueName: \"kubernetes.io/projected/11b45ddc-d3c9-4bc0-9ddc-3be34f33f0de-kube-api-access-q5kdh\") pod \"service-ca-operator-7695fc6c8c-7fm9v\" (UID: \"11b45ddc-d3c9-4bc0-9ddc-3be34f33f0de\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7fm9v" Jul 15 23:47:25.382430 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.381211 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0bf55176-1282-44d4-9c63-345a50ab4d01-serving-cert\") pod \"insights-operator-68d9dd94cf-mkxvc\" (UID: \"0bf55176-1282-44d4-9c63-345a50ab4d01\") " pod="openshift-insights/insights-operator-68d9dd94cf-mkxvc" Jul 15 23:47:25.382430 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.381252 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2k6q\" (UniqueName: \"kubernetes.io/projected/0bf55176-1282-44d4-9c63-345a50ab4d01-kube-api-access-q2k6q\") pod \"insights-operator-68d9dd94cf-mkxvc\" (UID: \"0bf55176-1282-44d4-9c63-345a50ab4d01\") " pod="openshift-insights/insights-operator-68d9dd94cf-mkxvc" Jul 15 23:47:25.382430 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.381278 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-config-volume\") pod \"dns-default-jwfwf\" (UID: \"d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9\") " pod="openshift-dns/dns-default-jwfwf" Jul 15 23:47:25.382430 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.381325 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b04f591-5391-4cd9-a495-a01bb0e49ce2-service-ca-bundle\") pod \"router-default-5f5546b47d-9whv9\" (UID: \"2b04f591-5391-4cd9-a495-a01bb0e49ce2\") " pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:25.382430 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.381364 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bf55176-1282-44d4-9c63-345a50ab4d01-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-mkxvc\" (UID: \"0bf55176-1282-44d4-9c63-345a50ab4d01\") " pod="openshift-insights/insights-operator-68d9dd94cf-mkxvc" Jul 15 23:47:25.382430 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.381403 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-z98bm\" (UID: \"b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z98bm" Jul 15 23:47:25.382430 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:25.381597 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 23:47:25.382430 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:25.381655 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b-cluster-monitoring-operator-tls podName:b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b nodeName:}" failed. No retries permitted until 2026-07-15 23:47:25.881632616 +0000 UTC m=+37.112611340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-z98bm" (UID: "b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b") : secret "cluster-monitoring-operator-tls" not found Jul 15 23:47:25.382430 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:25.381984 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 23:47:25.382430 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:25.382036 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-metrics-tls podName:d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:25.882020563 +0000 UTC m=+37.112999289 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-metrics-tls") pod "dns-default-jwfwf" (UID: "d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9") : secret "dns-default-metrics-tls" not found Jul 15 23:47:25.383445 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.383420 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59mxh\" (UniqueName: \"kubernetes.io/projected/2aa8c822-fd65-415a-9846-7f0f553df96a-kube-api-access-59mxh\") pod \"network-check-source-869dcfcdcd-fmsfn\" (UID: \"2aa8c822-fd65-415a-9846-7f0f553df96a\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-fmsfn" Jul 15 23:47:25.383592 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.383566 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhm44\" (UniqueName: \"kubernetes.io/projected/c8d25ea1-819e-46d2-854d-29b4be8e184f-kube-api-access-bhm44\") pod \"ingress-canary-5l9w5\" (UID: \"c8d25ea1-819e-46d2-854d-29b4be8e184f\") " pod="openshift-ingress-canary/ingress-canary-5l9w5" Jul 15 23:47:25.383862 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.383577 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-config-volume\") pod \"dns-default-jwfwf\" (UID: \"d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9\") " pod="openshift-dns/dns-default-jwfwf" Jul 15 23:47:25.384013 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.383992 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-bound-sa-token\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:25.384152 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.384131 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kpgp\" (UniqueName: \"kubernetes.io/projected/745e0d0a-e9fc-490f-994f-634357fcf39a-kube-api-access-5kpgp\") pod \"volume-data-source-validator-78495597f6-98v79\" (UID: \"745e0d0a-e9fc-490f-994f-634357fcf39a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-98v79" Jul 15 23:47:25.384208 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:25.384149 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b04f591-5391-4cd9-a495-a01bb0e49ce2-service-ca-bundle podName:2b04f591-5391-4cd9-a495-a01bb0e49ce2 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:25.884132782 +0000 UTC m=+37.115111527 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b04f591-5391-4cd9-a495-a01bb0e49ce2-service-ca-bundle") pod "router-default-5f5546b47d-9whv9" (UID: "2b04f591-5391-4cd9-a495-a01bb0e49ce2") : configmap references non-existent config key: service-ca.crt Jul 15 23:47:25.384391 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.384360 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/11b45ddc-d3c9-4bc0-9ddc-3be34f33f0de-config\") pod \"service-ca-operator-7695fc6c8c-7fm9v\" (UID: \"11b45ddc-d3c9-4bc0-9ddc-3be34f33f0de\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7fm9v" Jul 15 23:47:25.385057 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.384696 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bf55176-1282-44d4-9c63-345a50ab4d01-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-mkxvc\" (UID: \"0bf55176-1282-44d4-9c63-345a50ab4d01\") " pod="openshift-insights/insights-operator-68d9dd94cf-mkxvc" Jul 15 23:47:25.385057 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.384746 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/331d2302-c007-4a2e-a3aa-781bcb64ff9d-ca-trust-extracted\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:25.385057 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.384995 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-z98bm\" (UID: \"b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z98bm" Jul 15 23:47:25.385244 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:25.385135 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 23:47:25.385244 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:25.385212 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2e75f0c-6a7f-42ec-a6ec-60018d26d211-samples-operator-tls podName:c2e75f0c-6a7f-42ec-a6ec-60018d26d211 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:25.885187686 +0000 UTC m=+37.116166424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c2e75f0c-6a7f-42ec-a6ec-60018d26d211-samples-operator-tls") pod "cluster-samples-operator-65db858894-8hxlp" (UID: "c2e75f0c-6a7f-42ec-a6ec-60018d26d211") : secret "samples-operator-tls" not found Jul 15 23:47:25.385862 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.385552 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0bf55176-1282-44d4-9c63-345a50ab4d01-serving-cert\") pod \"insights-operator-68d9dd94cf-mkxvc\" (UID: \"0bf55176-1282-44d4-9c63-345a50ab4d01\") " pod="openshift-insights/insights-operator-68d9dd94cf-mkxvc" Jul 15 23:47:25.385862 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.385839 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b45a97fe-1c83-40e9-b190-8231a1b07291-nginx-conf\") pod \"networking-console-plugin-6cf856758c-ftx8k\" (UID: \"b45a97fe-1c83-40e9-b190-8231a1b07291\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-ftx8k" Jul 15 23:47:25.385997 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.385974 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/331d2302-c007-4a2e-a3aa-781bcb64ff9d-trusted-ca\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:25.386544 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.386491 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bf55176-1282-44d4-9c63-345a50ab4d01-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-mkxvc\" (UID: \"0bf55176-1282-44d4-9c63-345a50ab4d01\") " pod="openshift-insights/insights-operator-68d9dd94cf-mkxvc" Jul 15 23:47:25.386637 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.386612 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfr5c\" (UniqueName: \"kubernetes.io/projected/b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b-kube-api-access-zfr5c\") pod \"cluster-monitoring-operator-5f7f494dd4-z98bm\" (UID: \"b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z98bm" Jul 15 23:47:25.386747 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.386703 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfkk8\" (UniqueName: \"kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-kube-api-access-dfkk8\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:25.386826 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.386806 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch49l\" (UniqueName: \"kubernetes.io/projected/0f1c9d30-fe51-493e-9b47-84d63b56fa8f-kube-api-access-ch49l\") pod \"console-operator-7866497494-7g2gx\" (UID: \"0f1c9d30-fe51-493e-9b47-84d63b56fa8f\") " pod="openshift-console-operator/console-operator-7866497494-7g2gx" Jul 15 23:47:25.387265 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.387241 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88s9j\" (UniqueName: \"kubernetes.io/projected/2b04f591-5391-4cd9-a495-a01bb0e49ce2-kube-api-access-88s9j\") pod \"router-default-5f5546b47d-9whv9\" (UID: \"2b04f591-5391-4cd9-a495-a01bb0e49ce2\") " pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:25.387489 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.387365 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/362c7d00-de2e-4c56-81f9-1088ce28347e-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-jf8jd\" (UID: \"362c7d00-de2e-4c56-81f9-1088ce28347e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jf8jd" Jul 15 23:47:25.388083 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.388065 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2b04f591-5391-4cd9-a495-a01bb0e49ce2-stats-auth\") pod \"router-default-5f5546b47d-9whv9\" (UID: \"2b04f591-5391-4cd9-a495-a01bb0e49ce2\") " pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:25.392905 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.392881 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5kdh\" (UniqueName: \"kubernetes.io/projected/11b45ddc-d3c9-4bc0-9ddc-3be34f33f0de-kube-api-access-q5kdh\") pod \"service-ca-operator-7695fc6c8c-7fm9v\" (UID: \"11b45ddc-d3c9-4bc0-9ddc-3be34f33f0de\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7fm9v" Jul 15 23:47:25.393000 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.392940 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4hpm\" (UniqueName: \"kubernetes.io/projected/362c7d00-de2e-4c56-81f9-1088ce28347e-kube-api-access-t4hpm\") pod \"kube-storage-version-migrator-operator-799cb7f958-jf8jd\" (UID: \"362c7d00-de2e-4c56-81f9-1088ce28347e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jf8jd" Jul 15 23:47:25.393000 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.392987 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9pmq\" (UniqueName: \"kubernetes.io/projected/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-kube-api-access-k9pmq\") pod \"dns-default-jwfwf\" (UID: \"d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9\") " pod="openshift-dns/dns-default-jwfwf" Jul 15 23:47:25.393115 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.393001 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq8qq\" (UniqueName: \"kubernetes.io/projected/c2e75f0c-6a7f-42ec-a6ec-60018d26d211-kube-api-access-pq8qq\") pod \"cluster-samples-operator-65db858894-8hxlp\" (UID: \"c2e75f0c-6a7f-42ec-a6ec-60018d26d211\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8hxlp" Jul 15 23:47:25.393352 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.393333 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2k6q\" (UniqueName: \"kubernetes.io/projected/0bf55176-1282-44d4-9c63-345a50ab4d01-kube-api-access-q2k6q\") pod \"insights-operator-68d9dd94cf-mkxvc\" (UID: \"0bf55176-1282-44d4-9c63-345a50ab4d01\") " pod="openshift-insights/insights-operator-68d9dd94cf-mkxvc" Jul 15 23:47:25.436104 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.436086 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-98v79" Jul 15 23:47:25.448001 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.447977 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jf8jd" Jul 15 23:47:25.454400 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.454379 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-mkxvc" Jul 15 23:47:25.466977 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.466956 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-7g2gx" Jul 15 23:47:25.477167 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.477123 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7fm9v" Jul 15 23:47:25.483057 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.482896 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5l9w5" Jul 15 23:47:25.502626 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.501752 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-fmsfn" Jul 15 23:47:25.557056 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.556974 2564 generic.go:356] "Generic (PLEG): container finished" podID="01724c1a-84e1-4d42-b3c5-0ef10804e30c" containerID="59336cf0b7065da0fc56159b3b7963f604fe049ff06ef5aef3f471a621c18a4b" exitCode=0 Jul 15 23:47:25.557367 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.557025 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hjtzh" event={"ID":"01724c1a-84e1-4d42-b3c5-0ef10804e30c","Type":"ContainerDied","Data":"59336cf0b7065da0fc56159b3b7963f604fe049ff06ef5aef3f471a621c18a4b"} Jul 15 23:47:25.691257 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.690464 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-98v79"] Jul 15 23:47:25.699287 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.699229 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jf8jd"] Jul 15 23:47:25.711710 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:47:25.711129 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod362c7d00_de2e_4c56_81f9_1088ce28347e.slice/crio-4b562d01fe286a6fa2021333375354667451d53dcead789eb496b44cd9c28c86 WatchSource:0}: Error finding container 4b562d01fe286a6fa2021333375354667451d53dcead789eb496b44cd9c28c86: Status 404 returned error can't find the container with id 4b562d01fe286a6fa2021333375354667451d53dcead789eb496b44cd9c28c86 Jul 15 23:47:25.716692 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.716607 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-mkxvc"] Jul 15 23:47:25.720379 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:47:25.720348 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bf55176_1282_44d4_9c63_345a50ab4d01.slice/crio-3f1bb16f01af6825f4f7acb289556db2bc32f82bb789f04c4cf18616a129f0d5 WatchSource:0}: Error finding container 3f1bb16f01af6825f4f7acb289556db2bc32f82bb789f04c4cf18616a129f0d5: Status 404 returned error can't find the container with id 3f1bb16f01af6825f4f7acb289556db2bc32f82bb789f04c4cf18616a129f0d5 Jul 15 23:47:25.736556 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.736480 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-7g2gx"] Jul 15 23:47:25.740938 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:47:25.740912 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f1c9d30_fe51_493e_9b47_84d63b56fa8f.slice/crio-73676d635a9da25eb59bd4e5acc29fbc52b6ea657d573b38c40fe2559f4b2992 WatchSource:0}: Error finding container 73676d635a9da25eb59bd4e5acc29fbc52b6ea657d573b38c40fe2559f4b2992: Status 404 returned error can't find the container with id 73676d635a9da25eb59bd4e5acc29fbc52b6ea657d573b38c40fe2559f4b2992 Jul 15 23:47:25.752346 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.752323 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7fm9v"] Jul 15 23:47:25.757031 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.757009 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5l9w5"] Jul 15 23:47:25.764546 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.764529 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-fmsfn"] Jul 15 23:47:25.809438 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:47:25.809411 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8d25ea1_819e_46d2_854d_29b4be8e184f.slice/crio-741eb0416f4edf9136e563e7acac2344d72ea180cc565cba9fba4293ee0bd2ba WatchSource:0}: Error finding container 741eb0416f4edf9136e563e7acac2344d72ea180cc565cba9fba4293ee0bd2ba: Status 404 returned error can't find the container with id 741eb0416f4edf9136e563e7acac2344d72ea180cc565cba9fba4293ee0bd2ba Jul 15 23:47:25.809740 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:47:25.809720 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aa8c822_fd65_415a_9846_7f0f553df96a.slice/crio-ddb16263f5bc6b873bc377d6a74a8169aee53f6659f315792a23f799d38ef591 WatchSource:0}: Error finding container ddb16263f5bc6b873bc377d6a74a8169aee53f6659f315792a23f799d38ef591: Status 404 returned error can't find the container with id ddb16263f5bc6b873bc377d6a74a8169aee53f6659f315792a23f799d38ef591 Jul 15 23:47:25.809957 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:47:25.809934 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11b45ddc_d3c9_4bc0_9ddc_3be34f33f0de.slice/crio-8e6494ff275de16624cd400488b64cf11fd77c8bac4ff7de29420e3626f3d7ba WatchSource:0}: Error finding container 8e6494ff275de16624cd400488b64cf11fd77c8bac4ff7de29420e3626f3d7ba: Status 404 returned error can't find the container with id 8e6494ff275de16624cd400488b64cf11fd77c8bac4ff7de29420e3626f3d7ba Jul 15 23:47:25.888019 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.887946 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-tls\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:25.888019 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.887998 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b04f591-5391-4cd9-a495-a01bb0e49ce2-metrics-certs\") pod \"router-default-5f5546b47d-9whv9\" (UID: \"2b04f591-5391-4cd9-a495-a01bb0e49ce2\") " pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:25.888174 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.888023 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-metrics-tls\") pod \"dns-default-jwfwf\" (UID: \"d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9\") " pod="openshift-dns/dns-default-jwfwf" Jul 15 23:47:25.888174 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.888043 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c2e75f0c-6a7f-42ec-a6ec-60018d26d211-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8hxlp\" (UID: \"c2e75f0c-6a7f-42ec-a6ec-60018d26d211\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8hxlp" Jul 15 23:47:25.888174 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.888093 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b04f591-5391-4cd9-a495-a01bb0e49ce2-service-ca-bundle\") pod \"router-default-5f5546b47d-9whv9\" (UID: \"2b04f591-5391-4cd9-a495-a01bb0e49ce2\") " pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:25.888174 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:25.888121 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 23:47:25.888174 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:25.888150 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-597f796589-4tx26: secret "image-registry-tls" not found Jul 15 23:47:25.888174 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:25.888154 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 23:47:25.888174 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:25.888162 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 23:47:25.888402 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:25.888183 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b04f591-5391-4cd9-a495-a01bb0e49ce2-service-ca-bundle podName:2b04f591-5391-4cd9-a495-a01bb0e49ce2 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:26.888165642 +0000 UTC m=+38.119144382 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b04f591-5391-4cd9-a495-a01bb0e49ce2-service-ca-bundle") pod "router-default-5f5546b47d-9whv9" (UID: "2b04f591-5391-4cd9-a495-a01bb0e49ce2") : configmap references non-existent config key: service-ca.crt Jul 15 23:47:25.888402 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:25.888206 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-metrics-tls podName:d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:26.888189463 +0000 UTC m=+38.119168192 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-metrics-tls") pod "dns-default-jwfwf" (UID: "d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9") : secret "dns-default-metrics-tls" not found Jul 15 23:47:25.888402 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.888226 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-z98bm\" (UID: \"b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z98bm" Jul 15 23:47:25.888402 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:25.888167 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 23:47:25.888402 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:25.888275 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2e75f0c-6a7f-42ec-a6ec-60018d26d211-samples-operator-tls podName:c2e75f0c-6a7f-42ec-a6ec-60018d26d211 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:26.888263993 +0000 UTC m=+38.119242718 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c2e75f0c-6a7f-42ec-a6ec-60018d26d211-samples-operator-tls") pod "cluster-samples-operator-65db858894-8hxlp" (UID: "c2e75f0c-6a7f-42ec-a6ec-60018d26d211") : secret "samples-operator-tls" not found Jul 15 23:47:25.888402 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:25.888291 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b45a97fe-1c83-40e9-b190-8231a1b07291-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-ftx8k\" (UID: \"b45a97fe-1c83-40e9-b190-8231a1b07291\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-ftx8k" Jul 15 23:47:25.888402 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:25.888308 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 23:47:25.888402 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:25.888328 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 23:47:25.888402 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:25.888336 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b04f591-5391-4cd9-a495-a01bb0e49ce2-metrics-certs podName:2b04f591-5391-4cd9-a495-a01bb0e49ce2 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:26.888329065 +0000 UTC m=+38.119307790 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b04f591-5391-4cd9-a495-a01bb0e49ce2-metrics-certs") pod "router-default-5f5546b47d-9whv9" (UID: "2b04f591-5391-4cd9-a495-a01bb0e49ce2") : secret "router-metrics-certs-default" not found Jul 15 23:47:25.888402 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:25.888347 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-tls podName:331d2302-c007-4a2e-a3aa-781bcb64ff9d nodeName:}" failed. No retries permitted until 2026-07-15 23:47:26.888341311 +0000 UTC m=+38.119320036 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-tls") pod "image-registry-597f796589-4tx26" (UID: "331d2302-c007-4a2e-a3aa-781bcb64ff9d") : secret "image-registry-tls" not found Jul 15 23:47:25.888402 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:25.888356 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b-cluster-monitoring-operator-tls podName:b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b nodeName:}" failed. No retries permitted until 2026-07-15 23:47:26.888351471 +0000 UTC m=+38.119330196 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-z98bm" (UID: "b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b") : secret "cluster-monitoring-operator-tls" not found Jul 15 23:47:25.888402 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:25.888366 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b45a97fe-1c83-40e9-b190-8231a1b07291-networking-console-plugin-cert podName:b45a97fe-1c83-40e9-b190-8231a1b07291 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:26.888360928 +0000 UTC m=+38.119339652 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b45a97fe-1c83-40e9-b190-8231a1b07291-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-ftx8k" (UID: "b45a97fe-1c83-40e9-b190-8231a1b07291") : secret "networking-console-plugin-cert" not found Jul 15 23:47:26.001996 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:26.001964 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:26.087158 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:26.087129 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:26.181410 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:26.181322 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:26.295436 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:26.295403 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:47:26.298349 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:26.298136 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 23:47:26.427548 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:26.427513 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:26.532018 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:26.531964 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:26.562630 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:26.562545 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-fmsfn" event={"ID":"2aa8c822-fd65-415a-9846-7f0f553df96a","Type":"ContainerStarted","Data":"ddb16263f5bc6b873bc377d6a74a8169aee53f6659f315792a23f799d38ef591"} Jul 15 23:47:26.565226 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:26.565176 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7fm9v" event={"ID":"11b45ddc-d3c9-4bc0-9ddc-3be34f33f0de","Type":"ContainerStarted","Data":"8e6494ff275de16624cd400488b64cf11fd77c8bac4ff7de29420e3626f3d7ba"} Jul 15 23:47:26.568296 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:26.568229 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-mkxvc" event={"ID":"0bf55176-1282-44d4-9c63-345a50ab4d01","Type":"ContainerStarted","Data":"3f1bb16f01af6825f4f7acb289556db2bc32f82bb789f04c4cf18616a129f0d5"} Jul 15 23:47:26.575866 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:26.575325 2564 generic.go:356] "Generic (PLEG): container finished" podID="01724c1a-84e1-4d42-b3c5-0ef10804e30c" containerID="e25a4044f6c70683d8a8545c85bea978b52aea1cae0e892143ab6136f9d2cc90" exitCode=0 Jul 15 23:47:26.575866 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:26.575401 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hjtzh" event={"ID":"01724c1a-84e1-4d42-b3c5-0ef10804e30c","Type":"ContainerDied","Data":"e25a4044f6c70683d8a8545c85bea978b52aea1cae0e892143ab6136f9d2cc90"} Jul 15 23:47:26.579310 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:26.579135 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5l9w5" event={"ID":"c8d25ea1-819e-46d2-854d-29b4be8e184f","Type":"ContainerStarted","Data":"741eb0416f4edf9136e563e7acac2344d72ea180cc565cba9fba4293ee0bd2ba"} Jul 15 23:47:26.582734 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:26.582632 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jf8jd" event={"ID":"362c7d00-de2e-4c56-81f9-1088ce28347e","Type":"ContainerStarted","Data":"4b562d01fe286a6fa2021333375354667451d53dcead789eb496b44cd9c28c86"} Jul 15 23:47:26.586503 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:26.586450 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-98v79" event={"ID":"745e0d0a-e9fc-490f-994f-634357fcf39a","Type":"ContainerStarted","Data":"e0ef2f2fa75d1be7f325122cac0661ee696f7a37af5334c97adf77114da05b9d"} Jul 15 23:47:26.595416 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:26.595098 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-7g2gx" event={"ID":"0f1c9d30-fe51-493e-9b47-84d63b56fa8f","Type":"ContainerStarted","Data":"73676d635a9da25eb59bd4e5acc29fbc52b6ea657d573b38c40fe2559f4b2992"} Jul 15 23:47:26.833883 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:26.833740 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:26.889897 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:26.889830 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:26.901095 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:26.899826 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b04f591-5391-4cd9-a495-a01bb0e49ce2-service-ca-bundle podName:2b04f591-5391-4cd9-a495-a01bb0e49ce2 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:28.899802646 +0000 UTC m=+40.130781374 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b04f591-5391-4cd9-a495-a01bb0e49ce2-service-ca-bundle") pod "router-default-5f5546b47d-9whv9" (UID: "2b04f591-5391-4cd9-a495-a01bb0e49ce2") : configmap references non-existent config key: service-ca.crt Jul 15 23:47:26.901095 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:26.900152 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b04f591-5391-4cd9-a495-a01bb0e49ce2-service-ca-bundle\") pod \"router-default-5f5546b47d-9whv9\" (UID: \"2b04f591-5391-4cd9-a495-a01bb0e49ce2\") " pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:26.901095 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:26.900204 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-z98bm\" (UID: \"b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z98bm" Jul 15 23:47:26.901095 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:26.900264 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b45a97fe-1c83-40e9-b190-8231a1b07291-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-ftx8k\" (UID: \"b45a97fe-1c83-40e9-b190-8231a1b07291\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-ftx8k" Jul 15 23:47:26.901095 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:26.900296 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-tls\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:26.901095 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:26.900362 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b04f591-5391-4cd9-a495-a01bb0e49ce2-metrics-certs\") pod \"router-default-5f5546b47d-9whv9\" (UID: \"2b04f591-5391-4cd9-a495-a01bb0e49ce2\") " pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:26.901095 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:26.900390 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-metrics-tls\") pod \"dns-default-jwfwf\" (UID: \"d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9\") " pod="openshift-dns/dns-default-jwfwf" Jul 15 23:47:26.901095 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:26.900425 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c2e75f0c-6a7f-42ec-a6ec-60018d26d211-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8hxlp\" (UID: \"c2e75f0c-6a7f-42ec-a6ec-60018d26d211\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8hxlp" Jul 15 23:47:26.901095 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:26.900573 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 23:47:26.901095 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:26.900617 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2e75f0c-6a7f-42ec-a6ec-60018d26d211-samples-operator-tls podName:c2e75f0c-6a7f-42ec-a6ec-60018d26d211 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:28.900603312 +0000 UTC m=+40.131582039 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c2e75f0c-6a7f-42ec-a6ec-60018d26d211-samples-operator-tls") pod "cluster-samples-operator-65db858894-8hxlp" (UID: "c2e75f0c-6a7f-42ec-a6ec-60018d26d211") : secret "samples-operator-tls" not found Jul 15 23:47:26.901095 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:26.900693 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 23:47:26.901095 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:26.900729 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b-cluster-monitoring-operator-tls podName:b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b nodeName:}" failed. No retries permitted until 2026-07-15 23:47:28.900717208 +0000 UTC m=+40.131695933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-z98bm" (UID: "b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b") : secret "cluster-monitoring-operator-tls" not found Jul 15 23:47:26.901095 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:26.900781 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 23:47:26.901095 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:26.900811 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b45a97fe-1c83-40e9-b190-8231a1b07291-networking-console-plugin-cert podName:b45a97fe-1c83-40e9-b190-8231a1b07291 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:28.900801331 +0000 UTC m=+40.131780059 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b45a97fe-1c83-40e9-b190-8231a1b07291-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-ftx8k" (UID: "b45a97fe-1c83-40e9-b190-8231a1b07291") : secret "networking-console-plugin-cert" not found Jul 15 23:47:26.901095 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:26.900873 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 23:47:26.901948 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:26.900883 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-597f796589-4tx26: secret "image-registry-tls" not found Jul 15 23:47:26.901948 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:26.900912 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-tls podName:331d2302-c007-4a2e-a3aa-781bcb64ff9d nodeName:}" failed. No retries permitted until 2026-07-15 23:47:28.900901926 +0000 UTC m=+40.131880692 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-tls") pod "image-registry-597f796589-4tx26" (UID: "331d2302-c007-4a2e-a3aa-781bcb64ff9d") : secret "image-registry-tls" not found Jul 15 23:47:26.901948 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:26.900966 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 23:47:26.901948 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:26.900994 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b04f591-5391-4cd9-a495-a01bb0e49ce2-metrics-certs podName:2b04f591-5391-4cd9-a495-a01bb0e49ce2 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:28.900984484 +0000 UTC m=+40.131963218 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b04f591-5391-4cd9-a495-a01bb0e49ce2-metrics-certs") pod "router-default-5f5546b47d-9whv9" (UID: "2b04f591-5391-4cd9-a495-a01bb0e49ce2") : secret "router-metrics-certs-default" not found Jul 15 23:47:26.901948 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:26.901048 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 23:47:26.901948 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:26.901076 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-metrics-tls podName:d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:28.901066521 +0000 UTC m=+40.132045250 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-metrics-tls") pod "dns-default-jwfwf" (UID: "d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9") : secret "dns-default-metrics-tls" not found Jul 15 23:47:27.610332 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:27.610235 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hjtzh" event={"ID":"01724c1a-84e1-4d42-b3c5-0ef10804e30c","Type":"ContainerStarted","Data":"a2e94b2e75301eed8cb589a2bd17c4826a2245094b896c7e320b63dc940f86e8"} Jul 15 23:47:27.612479 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:27.612452 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-98v79" event={"ID":"745e0d0a-e9fc-490f-994f-634357fcf39a","Type":"ContainerStarted","Data":"ba8123c33f51728d16bc809dd3e839237a8578e3dfd8521da79f90c25fdc2dbe"} Jul 15 23:47:27.637859 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:27.637357 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hjtzh" podStartSLOduration=9.461548678 podStartE2EDuration="38.637337494s" totalImagesPullingTime="29.175788816s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:46:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:27.634581391 +0000 UTC m=+38.865560140" watchObservedRunningTime="2026-07-15 23:47:27.637337494 +0000 UTC m=+38.868316242" Jul 15 23:47:27.730911 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:27.730871 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:27.793245 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:27.793213 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:28.030206 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:28.030110 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:28.088484 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:28.088448 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:28.922382 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:28.922352 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b45a97fe-1c83-40e9-b190-8231a1b07291-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-ftx8k\" (UID: \"b45a97fe-1c83-40e9-b190-8231a1b07291\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-ftx8k" Jul 15 23:47:28.922950 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:28.922394 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-tls\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:28.922950 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:28.922450 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b04f591-5391-4cd9-a495-a01bb0e49ce2-metrics-certs\") pod \"router-default-5f5546b47d-9whv9\" (UID: \"2b04f591-5391-4cd9-a495-a01bb0e49ce2\") " pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:28.922950 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:28.922479 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-metrics-tls\") pod \"dns-default-jwfwf\" (UID: \"d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9\") " pod="openshift-dns/dns-default-jwfwf" Jul 15 23:47:28.922950 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:28.922511 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c2e75f0c-6a7f-42ec-a6ec-60018d26d211-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8hxlp\" (UID: \"c2e75f0c-6a7f-42ec-a6ec-60018d26d211\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8hxlp" Jul 15 23:47:28.922950 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:28.922513 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 23:47:28.922950 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:28.922572 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 23:47:28.922950 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:28.922592 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b45a97fe-1c83-40e9-b190-8231a1b07291-networking-console-plugin-cert podName:b45a97fe-1c83-40e9-b190-8231a1b07291 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:32.922574541 +0000 UTC m=+44.153553266 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b45a97fe-1c83-40e9-b190-8231a1b07291-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-ftx8k" (UID: "b45a97fe-1c83-40e9-b190-8231a1b07291") : secret "networking-console-plugin-cert" not found Jul 15 23:47:28.922950 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:28.922611 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b04f591-5391-4cd9-a495-a01bb0e49ce2-metrics-certs podName:2b04f591-5391-4cd9-a495-a01bb0e49ce2 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:32.922601116 +0000 UTC m=+44.153579849 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b04f591-5391-4cd9-a495-a01bb0e49ce2-metrics-certs") pod "router-default-5f5546b47d-9whv9" (UID: "2b04f591-5391-4cd9-a495-a01bb0e49ce2") : secret "router-metrics-certs-default" not found Jul 15 23:47:28.922950 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:28.922621 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 23:47:28.922950 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:28.922643 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-597f796589-4tx26: secret "image-registry-tls" not found Jul 15 23:47:28.922950 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:28.922690 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b04f591-5391-4cd9-a495-a01bb0e49ce2-service-ca-bundle\") pod \"router-default-5f5546b47d-9whv9\" (UID: \"2b04f591-5391-4cd9-a495-a01bb0e49ce2\") " pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:28.922950 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:28.922705 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-tls podName:331d2302-c007-4a2e-a3aa-781bcb64ff9d nodeName:}" failed. No retries permitted until 2026-07-15 23:47:32.922689387 +0000 UTC m=+44.153668127 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-tls") pod "image-registry-597f796589-4tx26" (UID: "331d2302-c007-4a2e-a3aa-781bcb64ff9d") : secret "image-registry-tls" not found Jul 15 23:47:28.922950 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:28.922765 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b04f591-5391-4cd9-a495-a01bb0e49ce2-service-ca-bundle podName:2b04f591-5391-4cd9-a495-a01bb0e49ce2 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:32.922754594 +0000 UTC m=+44.153733325 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b04f591-5391-4cd9-a495-a01bb0e49ce2-service-ca-bundle") pod "router-default-5f5546b47d-9whv9" (UID: "2b04f591-5391-4cd9-a495-a01bb0e49ce2") : configmap references non-existent config key: service-ca.crt Jul 15 23:47:28.922950 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:28.922759 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-z98bm\" (UID: \"b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z98bm" Jul 15 23:47:28.922950 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:28.922827 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 23:47:28.923459 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:28.922857 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2e75f0c-6a7f-42ec-a6ec-60018d26d211-samples-operator-tls podName:c2e75f0c-6a7f-42ec-a6ec-60018d26d211 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:32.92284798 +0000 UTC m=+44.153826704 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c2e75f0c-6a7f-42ec-a6ec-60018d26d211-samples-operator-tls") pod "cluster-samples-operator-65db858894-8hxlp" (UID: "c2e75f0c-6a7f-42ec-a6ec-60018d26d211") : secret "samples-operator-tls" not found Jul 15 23:47:28.923459 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:28.922873 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 23:47:28.923459 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:28.922906 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 23:47:28.923459 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:28.922910 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b-cluster-monitoring-operator-tls podName:b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b nodeName:}" failed. No retries permitted until 2026-07-15 23:47:32.9228989 +0000 UTC m=+44.153877638 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-z98bm" (UID: "b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b") : secret "cluster-monitoring-operator-tls" not found Jul 15 23:47:28.923459 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:28.922932 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-metrics-tls podName:d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:32.922923302 +0000 UTC m=+44.153902027 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-metrics-tls") pod "dns-default-jwfwf" (UID: "d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9") : secret "dns-default-metrics-tls" not found Jul 15 23:47:29.025283 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:29.025248 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:29.379337 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:29.379298 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:29.480459 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:29.480416 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:32.955856 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:32.955821 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-tls\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:32.956195 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:32.955879 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b04f591-5391-4cd9-a495-a01bb0e49ce2-metrics-certs\") pod \"router-default-5f5546b47d-9whv9\" (UID: \"2b04f591-5391-4cd9-a495-a01bb0e49ce2\") " pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:32.956195 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:32.955898 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-metrics-tls\") pod \"dns-default-jwfwf\" (UID: \"d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9\") " pod="openshift-dns/dns-default-jwfwf" Jul 15 23:47:32.956195 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:32.955920 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c2e75f0c-6a7f-42ec-a6ec-60018d26d211-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8hxlp\" (UID: \"c2e75f0c-6a7f-42ec-a6ec-60018d26d211\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8hxlp" Jul 15 23:47:32.956195 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:32.955968 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 23:47:32.956195 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:32.955991 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-597f796589-4tx26: secret "image-registry-tls" not found Jul 15 23:47:32.956195 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:32.956034 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 23:47:32.956195 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:32.956043 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 23:47:32.956195 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:32.956060 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 23:47:32.956195 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:32.955969 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b04f591-5391-4cd9-a495-a01bb0e49ce2-service-ca-bundle\") pod \"router-default-5f5546b47d-9whv9\" (UID: \"2b04f591-5391-4cd9-a495-a01bb0e49ce2\") " pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:32.956195 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:32.956052 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-tls podName:331d2302-c007-4a2e-a3aa-781bcb64ff9d nodeName:}" failed. No retries permitted until 2026-07-15 23:47:40.956033628 +0000 UTC m=+52.187012376 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-tls") pod "image-registry-597f796589-4tx26" (UID: "331d2302-c007-4a2e-a3aa-781bcb64ff9d") : secret "image-registry-tls" not found Jul 15 23:47:32.956195 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:32.956103 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b04f591-5391-4cd9-a495-a01bb0e49ce2-service-ca-bundle podName:2b04f591-5391-4cd9-a495-a01bb0e49ce2 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:40.956089561 +0000 UTC m=+52.187068290 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b04f591-5391-4cd9-a495-a01bb0e49ce2-service-ca-bundle") pod "router-default-5f5546b47d-9whv9" (UID: "2b04f591-5391-4cd9-a495-a01bb0e49ce2") : configmap references non-existent config key: service-ca.crt Jul 15 23:47:32.956195 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:32.956118 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b04f591-5391-4cd9-a495-a01bb0e49ce2-metrics-certs podName:2b04f591-5391-4cd9-a495-a01bb0e49ce2 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:40.956111446 +0000 UTC m=+52.187090170 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b04f591-5391-4cd9-a495-a01bb0e49ce2-metrics-certs") pod "router-default-5f5546b47d-9whv9" (UID: "2b04f591-5391-4cd9-a495-a01bb0e49ce2") : secret "router-metrics-certs-default" not found Jul 15 23:47:32.956195 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:32.956135 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-metrics-tls podName:d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:40.956129542 +0000 UTC m=+52.187108267 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-metrics-tls") pod "dns-default-jwfwf" (UID: "d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9") : secret "dns-default-metrics-tls" not found Jul 15 23:47:32.956195 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:32.956149 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2e75f0c-6a7f-42ec-a6ec-60018d26d211-samples-operator-tls podName:c2e75f0c-6a7f-42ec-a6ec-60018d26d211 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:40.956144194 +0000 UTC m=+52.187122918 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c2e75f0c-6a7f-42ec-a6ec-60018d26d211-samples-operator-tls") pod "cluster-samples-operator-65db858894-8hxlp" (UID: "c2e75f0c-6a7f-42ec-a6ec-60018d26d211") : secret "samples-operator-tls" not found Jul 15 23:47:32.956195 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:32.956181 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-z98bm\" (UID: \"b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z98bm" Jul 15 23:47:32.956696 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:32.956219 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b45a97fe-1c83-40e9-b190-8231a1b07291-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-ftx8k\" (UID: \"b45a97fe-1c83-40e9-b190-8231a1b07291\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-ftx8k" Jul 15 23:47:32.956696 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:32.956289 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 23:47:32.956696 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:32.956312 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 23:47:32.956696 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:32.956318 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b-cluster-monitoring-operator-tls podName:b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b nodeName:}" failed. No retries permitted until 2026-07-15 23:47:40.956308982 +0000 UTC m=+52.187287707 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-z98bm" (UID: "b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b") : secret "cluster-monitoring-operator-tls" not found Jul 15 23:47:32.956696 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:32.956338 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b45a97fe-1c83-40e9-b190-8231a1b07291-networking-console-plugin-cert podName:b45a97fe-1c83-40e9-b190-8231a1b07291 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:40.956331486 +0000 UTC m=+52.187310211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b45a97fe-1c83-40e9-b190-8231a1b07291-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-ftx8k" (UID: "b45a97fe-1c83-40e9-b190-8231a1b07291") : secret "networking-console-plugin-cert" not found Jul 15 23:47:33.634091 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:33.634047 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-fmsfn" event={"ID":"2aa8c822-fd65-415a-9846-7f0f553df96a","Type":"ContainerStarted","Data":"5f0ca9b55e3aa1a30ab6bfde70f0d2cbf635d30b6c03c2bdaa1e3d47afa700ac"} Jul 15 23:47:33.636164 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:33.635957 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7fm9v" event={"ID":"11b45ddc-d3c9-4bc0-9ddc-3be34f33f0de","Type":"ContainerStarted","Data":"a55c9125c82572c804bc4d97a5bd65ea94f81aed08f51b3ed8253808680d56e7"} Jul 15 23:47:33.637592 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:33.637567 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-mkxvc" event={"ID":"0bf55176-1282-44d4-9c63-345a50ab4d01","Type":"ContainerStarted","Data":"f2fbe3aa75c5c8f40dcf2ea53fd705d916bff737a1eae7f6c3c2555e77d53b41"} Jul 15 23:47:33.639557 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:33.639536 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5l9w5" event={"ID":"c8d25ea1-819e-46d2-854d-29b4be8e184f","Type":"ContainerStarted","Data":"7b9c36502539604ab776ba9344d297eda59c5b03f01f3b4921ba9c3e9deb3e1d"} Jul 15 23:47:33.641118 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:33.641089 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jf8jd" event={"ID":"362c7d00-de2e-4c56-81f9-1088ce28347e","Type":"ContainerStarted","Data":"9921c7ad59d0afff5725a6d96472a9141636fcaa5a2a6979c8fba300350d2c51"} Jul 15 23:47:33.643240 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:33.643220 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-7g2gx_0f1c9d30-fe51-493e-9b47-84d63b56fa8f/console-operator/0.log" Jul 15 23:47:33.643336 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:33.643259 2564 generic.go:356] "Generic (PLEG): container finished" podID="0f1c9d30-fe51-493e-9b47-84d63b56fa8f" containerID="e7a765fb3bac84a85ebfcbb15abbd7f41aeb1847041e041155adfb342983c9bf" exitCode=255 Jul 15 23:47:33.643336 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:33.643293 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-7g2gx" event={"ID":"0f1c9d30-fe51-493e-9b47-84d63b56fa8f","Type":"ContainerDied","Data":"e7a765fb3bac84a85ebfcbb15abbd7f41aeb1847041e041155adfb342983c9bf"} Jul 15 23:47:33.643571 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:33.643557 2564 scope.go:117] "RemoveContainer" containerID="e7a765fb3bac84a85ebfcbb15abbd7f41aeb1847041e041155adfb342983c9bf" Jul 15 23:47:33.648488 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:33.648367 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-98v79" podStartSLOduration=38.992894285 podStartE2EDuration="40.648351016s" totalImagesPullingTime="1.655456731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:46:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:27.652692612 +0000 UTC m=+38.883671360" watchObservedRunningTime="2026-07-15 23:47:33.648351016 +0000 UTC m=+44.879329764" Jul 15 23:47:33.665755 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:33.665212 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-fmsfn" podStartSLOduration=30.205744049 podStartE2EDuration="37.665195331s" totalImagesPullingTime="7.459451282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:33.648555429 +0000 UTC m=+44.879534178" watchObservedRunningTime="2026-07-15 23:47:33.665195331 +0000 UTC m=+44.896174076" Jul 15 23:47:33.665755 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:33.665596 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jf8jd" podStartSLOduration=33.116934699 podStartE2EDuration="40.665583485s" totalImagesPullingTime="7.548648786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:46:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:33.664368416 +0000 UTC m=+44.895347189" watchObservedRunningTime="2026-07-15 23:47:33.665583485 +0000 UTC m=+44.896562233" Jul 15 23:47:33.680807 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:33.680721 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-mkxvc" podStartSLOduration=33.142876214 podStartE2EDuration="40.680700533s" totalImagesPullingTime="7.537824319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:46:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:33.679595314 +0000 UTC m=+44.910574062" watchObservedRunningTime="2026-07-15 23:47:33.680700533 +0000 UTC m=+44.911679281" Jul 15 23:47:33.695214 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:33.695149 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7fm9v" podStartSLOduration=31.245429776 podStartE2EDuration="38.695128723s" totalImagesPullingTime="7.449698947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:46:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:33.694466086 +0000 UTC m=+44.925444836" watchObservedRunningTime="2026-07-15 23:47:33.695128723 +0000 UTC m=+44.926107469" Jul 15 23:47:33.728601 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:33.728512 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5l9w5" podStartSLOduration=1.278066762 podStartE2EDuration="8.728490164s" totalImagesPullingTime="7.450423402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:33.710040265 +0000 UTC m=+44.941019013" watchObservedRunningTime="2026-07-15 23:47:33.728490164 +0000 UTC m=+44.959468912" Jul 15 23:47:34.256158 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.256120 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:34.357627 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.357591 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:34.457390 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.457354 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:34.562451 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.562369 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:34.585888 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.585850 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9xf75"] Jul 15 23:47:34.601857 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.601829 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9xf75"] Jul 15 23:47:34.602021 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.601892 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9xf75" Jul 15 23:47:34.604133 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.604111 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 15 23:47:34.604273 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.604110 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 15 23:47:34.604338 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.604128 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q4vkt\"" Jul 15 23:47:34.623850 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.623816 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:34.649049 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.649031 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-7g2gx_0f1c9d30-fe51-493e-9b47-84d63b56fa8f/console-operator/1.log" Jul 15 23:47:34.649474 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.649458 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-7g2gx_0f1c9d30-fe51-493e-9b47-84d63b56fa8f/console-operator/0.log" Jul 15 23:47:34.649539 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.649498 2564 generic.go:356] "Generic (PLEG): container finished" podID="0f1c9d30-fe51-493e-9b47-84d63b56fa8f" containerID="27601c509a4b3a1e36e017797373e149055ceb80129806aae93cf88282c2facb" exitCode=255 Jul 15 23:47:34.649593 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.649529 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-7g2gx" event={"ID":"0f1c9d30-fe51-493e-9b47-84d63b56fa8f","Type":"ContainerDied","Data":"27601c509a4b3a1e36e017797373e149055ceb80129806aae93cf88282c2facb"} Jul 15 23:47:34.649593 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.649588 2564 scope.go:117] "RemoveContainer" containerID="e7a765fb3bac84a85ebfcbb15abbd7f41aeb1847041e041155adfb342983c9bf" Jul 15 23:47:34.650321 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.650304 2564 scope.go:117] "RemoveContainer" containerID="27601c509a4b3a1e36e017797373e149055ceb80129806aae93cf88282c2facb" Jul 15 23:47:34.650481 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:34.650455 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-7g2gx_openshift-console-operator(0f1c9d30-fe51-493e-9b47-84d63b56fa8f)\"" pod="openshift-console-operator/console-operator-7866497494-7g2gx" podUID="0f1c9d30-fe51-493e-9b47-84d63b56fa8f" Jul 15 23:47:34.675291 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.675172 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a98e13d5-bfc4-4f77-b7be-6926d366292e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xf75\" (UID: \"a98e13d5-bfc4-4f77-b7be-6926d366292e\") " pod="openshift-insights/insights-runtime-extractor-9xf75" Jul 15 23:47:34.675647 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.675613 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a98e13d5-bfc4-4f77-b7be-6926d366292e-crio-socket\") pod \"insights-runtime-extractor-9xf75\" (UID: \"a98e13d5-bfc4-4f77-b7be-6926d366292e\") " pod="openshift-insights/insights-runtime-extractor-9xf75" Jul 15 23:47:34.675840 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.675818 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a98e13d5-bfc4-4f77-b7be-6926d366292e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9xf75\" (UID: \"a98e13d5-bfc4-4f77-b7be-6926d366292e\") " pod="openshift-insights/insights-runtime-extractor-9xf75" Jul 15 23:47:34.676595 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.675937 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a98e13d5-bfc4-4f77-b7be-6926d366292e-data-volume\") pod \"insights-runtime-extractor-9xf75\" (UID: \"a98e13d5-bfc4-4f77-b7be-6926d366292e\") " pod="openshift-insights/insights-runtime-extractor-9xf75" Jul 15 23:47:34.676595 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.676121 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fjk7\" (UniqueName: \"kubernetes.io/projected/a98e13d5-bfc4-4f77-b7be-6926d366292e-kube-api-access-9fjk7\") pod \"insights-runtime-extractor-9xf75\" (UID: \"a98e13d5-bfc4-4f77-b7be-6926d366292e\") " pod="openshift-insights/insights-runtime-extractor-9xf75" Jul 15 23:47:34.777100 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.777066 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a98e13d5-bfc4-4f77-b7be-6926d366292e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xf75\" (UID: \"a98e13d5-bfc4-4f77-b7be-6926d366292e\") " pod="openshift-insights/insights-runtime-extractor-9xf75" Jul 15 23:47:34.777100 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.777107 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a98e13d5-bfc4-4f77-b7be-6926d366292e-crio-socket\") pod \"insights-runtime-extractor-9xf75\" (UID: \"a98e13d5-bfc4-4f77-b7be-6926d366292e\") " pod="openshift-insights/insights-runtime-extractor-9xf75" Jul 15 23:47:34.777340 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:34.777223 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 23:47:34.777340 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:34.777291 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a98e13d5-bfc4-4f77-b7be-6926d366292e-insights-runtime-extractor-tls podName:a98e13d5-bfc4-4f77-b7be-6926d366292e nodeName:}" failed. No retries permitted until 2026-07-15 23:47:35.277272348 +0000 UTC m=+46.508251073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a98e13d5-bfc4-4f77-b7be-6926d366292e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9xf75" (UID: "a98e13d5-bfc4-4f77-b7be-6926d366292e") : secret "insights-runtime-extractor-tls" not found Jul 15 23:47:34.777340 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.777300 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a98e13d5-bfc4-4f77-b7be-6926d366292e-crio-socket\") pod \"insights-runtime-extractor-9xf75\" (UID: \"a98e13d5-bfc4-4f77-b7be-6926d366292e\") " pod="openshift-insights/insights-runtime-extractor-9xf75" Jul 15 23:47:34.777340 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.777327 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a98e13d5-bfc4-4f77-b7be-6926d366292e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9xf75\" (UID: \"a98e13d5-bfc4-4f77-b7be-6926d366292e\") " pod="openshift-insights/insights-runtime-extractor-9xf75" Jul 15 23:47:34.777521 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.777357 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a98e13d5-bfc4-4f77-b7be-6926d366292e-data-volume\") pod \"insights-runtime-extractor-9xf75\" (UID: \"a98e13d5-bfc4-4f77-b7be-6926d366292e\") " pod="openshift-insights/insights-runtime-extractor-9xf75" Jul 15 23:47:34.777521 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.777407 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fjk7\" (UniqueName: \"kubernetes.io/projected/a98e13d5-bfc4-4f77-b7be-6926d366292e-kube-api-access-9fjk7\") pod \"insights-runtime-extractor-9xf75\" (UID: \"a98e13d5-bfc4-4f77-b7be-6926d366292e\") " pod="openshift-insights/insights-runtime-extractor-9xf75" Jul 15 23:47:34.777521 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:34.777454 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 23:47:34.777661 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:34.777526 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a98e13d5-bfc4-4f77-b7be-6926d366292e-kube-rbac-proxy-cm podName:a98e13d5-bfc4-4f77-b7be-6926d366292e nodeName:}" failed. No retries permitted until 2026-07-15 23:47:35.277507523 +0000 UTC m=+46.508486251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a98e13d5-bfc4-4f77-b7be-6926d366292e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9xf75" (UID: "a98e13d5-bfc4-4f77-b7be-6926d366292e") : configmap "kube-rbac-proxy" not found Jul 15 23:47:34.777804 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.777787 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a98e13d5-bfc4-4f77-b7be-6926d366292e-data-volume\") pod \"insights-runtime-extractor-9xf75\" (UID: \"a98e13d5-bfc4-4f77-b7be-6926d366292e\") " pod="openshift-insights/insights-runtime-extractor-9xf75" Jul 15 23:47:34.788835 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:34.788815 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fjk7\" (UniqueName: \"kubernetes.io/projected/a98e13d5-bfc4-4f77-b7be-6926d366292e-kube-api-access-9fjk7\") pod \"insights-runtime-extractor-9xf75\" (UID: \"a98e13d5-bfc4-4f77-b7be-6926d366292e\") " pod="openshift-insights/insights-runtime-extractor-9xf75" Jul 15 23:47:35.009624 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:35.009497 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:35.038836 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:35.038804 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-v9ch7"] Jul 15 23:47:35.082785 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:35.082751 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-v9ch7"] Jul 15 23:47:35.082923 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:35.082872 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-v9ch7" Jul 15 23:47:35.085540 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:35.085517 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 15 23:47:35.085540 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:35.085534 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-l5wvv\"" Jul 15 23:47:35.085728 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:35.085629 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 15 23:47:35.101254 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:35.101230 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:35.160059 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:35.160025 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:35.181383 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:35.181357 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qblx7\" (UniqueName: \"kubernetes.io/projected/5253c532-534e-4c36-a572-efa63cfc7d48-kube-api-access-qblx7\") pod \"migrator-7f59b54f6c-v9ch7\" (UID: \"5253c532-534e-4c36-a572-efa63cfc7d48\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-v9ch7" Jul 15 23:47:35.282512 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:35.282441 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a98e13d5-bfc4-4f77-b7be-6926d366292e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xf75\" (UID: \"a98e13d5-bfc4-4f77-b7be-6926d366292e\") " pod="openshift-insights/insights-runtime-extractor-9xf75" Jul 15 23:47:35.282932 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:35.282535 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qblx7\" (UniqueName: \"kubernetes.io/projected/5253c532-534e-4c36-a572-efa63cfc7d48-kube-api-access-qblx7\") pod \"migrator-7f59b54f6c-v9ch7\" (UID: \"5253c532-534e-4c36-a572-efa63cfc7d48\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-v9ch7" Jul 15 23:47:35.282932 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:35.282558 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a98e13d5-bfc4-4f77-b7be-6926d366292e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9xf75\" (UID: \"a98e13d5-bfc4-4f77-b7be-6926d366292e\") " pod="openshift-insights/insights-runtime-extractor-9xf75" Jul 15 23:47:35.282932 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:35.282581 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 23:47:35.282932 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:35.282645 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a98e13d5-bfc4-4f77-b7be-6926d366292e-insights-runtime-extractor-tls podName:a98e13d5-bfc4-4f77-b7be-6926d366292e nodeName:}" failed. No retries permitted until 2026-07-15 23:47:36.282629681 +0000 UTC m=+47.513608407 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a98e13d5-bfc4-4f77-b7be-6926d366292e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9xf75" (UID: "a98e13d5-bfc4-4f77-b7be-6926d366292e") : secret "insights-runtime-extractor-tls" not found Jul 15 23:47:35.282932 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:35.282710 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 23:47:35.282932 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:35.282785 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a98e13d5-bfc4-4f77-b7be-6926d366292e-kube-rbac-proxy-cm podName:a98e13d5-bfc4-4f77-b7be-6926d366292e nodeName:}" failed. No retries permitted until 2026-07-15 23:47:36.282769332 +0000 UTC m=+47.513748062 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a98e13d5-bfc4-4f77-b7be-6926d366292e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9xf75" (UID: "a98e13d5-bfc4-4f77-b7be-6926d366292e") : configmap "kube-rbac-proxy" not found Jul 15 23:47:35.290496 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:35.290468 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qblx7\" (UniqueName: \"kubernetes.io/projected/5253c532-534e-4c36-a572-efa63cfc7d48-kube-api-access-qblx7\") pod \"migrator-7f59b54f6c-v9ch7\" (UID: \"5253c532-534e-4c36-a572-efa63cfc7d48\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-v9ch7" Jul 15 23:47:35.392735 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:35.392709 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-v9ch7" Jul 15 23:47:35.467412 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:35.467330 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-7g2gx" Jul 15 23:47:35.467611 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:35.467590 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-7g2gx" Jul 15 23:47:35.531499 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:35.531453 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-v9ch7"] Jul 15 23:47:35.533889 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:47:35.533819 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5253c532_534e_4c36_a572_efa63cfc7d48.slice/crio-c19442336aa4497da55b392d94e9a6cce815a80868af5b2096f4c82a9a133dce WatchSource:0}: Error finding container c19442336aa4497da55b392d94e9a6cce815a80868af5b2096f4c82a9a133dce: Status 404 returned error can't find the container with id c19442336aa4497da55b392d94e9a6cce815a80868af5b2096f4c82a9a133dce Jul 15 23:47:35.654357 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:35.654332 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-7g2gx_0f1c9d30-fe51-493e-9b47-84d63b56fa8f/console-operator/1.log" Jul 15 23:47:35.654707 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:35.654689 2564 scope.go:117] "RemoveContainer" containerID="27601c509a4b3a1e36e017797373e149055ceb80129806aae93cf88282c2facb" Jul 15 23:47:35.654898 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:35.654878 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-7g2gx_openshift-console-operator(0f1c9d30-fe51-493e-9b47-84d63b56fa8f)\"" pod="openshift-console-operator/console-operator-7866497494-7g2gx" podUID="0f1c9d30-fe51-493e-9b47-84d63b56fa8f" Jul 15 23:47:35.655633 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:35.655610 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-v9ch7" event={"ID":"5253c532-534e-4c36-a572-efa63cfc7d48","Type":"ContainerStarted","Data":"c19442336aa4497da55b392d94e9a6cce815a80868af5b2096f4c82a9a133dce"} Jul 15 23:47:35.783140 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:35.783114 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cj8th_480440ce-6eb7-434a-8e64-478fc9b19cc5/dns-node-resolver/0.log" Jul 15 23:47:36.292567 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:36.292523 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a98e13d5-bfc4-4f77-b7be-6926d366292e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xf75\" (UID: \"a98e13d5-bfc4-4f77-b7be-6926d366292e\") " pod="openshift-insights/insights-runtime-extractor-9xf75" Jul 15 23:47:36.293021 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:36.292631 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a98e13d5-bfc4-4f77-b7be-6926d366292e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9xf75\" (UID: \"a98e13d5-bfc4-4f77-b7be-6926d366292e\") " pod="openshift-insights/insights-runtime-extractor-9xf75" Jul 15 23:47:36.293021 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:36.292707 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 23:47:36.293021 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:36.292760 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 23:47:36.293021 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:36.292797 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a98e13d5-bfc4-4f77-b7be-6926d366292e-insights-runtime-extractor-tls podName:a98e13d5-bfc4-4f77-b7be-6926d366292e nodeName:}" failed. No retries permitted until 2026-07-15 23:47:38.292774621 +0000 UTC m=+49.523753353 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a98e13d5-bfc4-4f77-b7be-6926d366292e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9xf75" (UID: "a98e13d5-bfc4-4f77-b7be-6926d366292e") : secret "insights-runtime-extractor-tls" not found Jul 15 23:47:36.293021 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:36.292815 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a98e13d5-bfc4-4f77-b7be-6926d366292e-kube-rbac-proxy-cm podName:a98e13d5-bfc4-4f77-b7be-6926d366292e nodeName:}" failed. No retries permitted until 2026-07-15 23:47:38.292808089 +0000 UTC m=+49.523786814 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a98e13d5-bfc4-4f77-b7be-6926d366292e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9xf75" (UID: "a98e13d5-bfc4-4f77-b7be-6926d366292e") : configmap "kube-rbac-proxy" not found Jul 15 23:47:36.659760 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:36.659681 2564 scope.go:117] "RemoveContainer" containerID="27601c509a4b3a1e36e017797373e149055ceb80129806aae93cf88282c2facb" Jul 15 23:47:36.659929 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:36.659882 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-7g2gx_openshift-console-operator(0f1c9d30-fe51-493e-9b47-84d63b56fa8f)\"" pod="openshift-console-operator/console-operator-7866497494-7g2gx" podUID="0f1c9d30-fe51-493e-9b47-84d63b56fa8f" Jul 15 23:47:36.732012 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:36.731976 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-tvnbr"] Jul 15 23:47:36.762250 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:36.762198 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-tvnbr"] Jul 15 23:47:36.762400 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:36.762308 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-tvnbr" Jul 15 23:47:36.764644 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:36.764619 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-986nc\"" Jul 15 23:47:36.764961 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:36.764939 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 15 23:47:36.765515 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:36.765492 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 15 23:47:36.765623 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:36.765492 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 15 23:47:36.765623 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:36.765544 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 15 23:47:36.772406 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:36.772350 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:36.783335 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:36.783316 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r9q5g_5917490d-3db7-4d93-aa21-b302f20e9699/node-ca/0.log" Jul 15 23:47:36.797896 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:36.797871 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7270578b-cdeb-494c-a5e7-278cf09a2086-signing-key\") pod \"service-ca-79f68b9f4f-tvnbr\" (UID: \"7270578b-cdeb-494c-a5e7-278cf09a2086\") " pod="openshift-service-ca/service-ca-79f68b9f4f-tvnbr" Jul 15 23:47:36.798019 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:36.797913 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7270578b-cdeb-494c-a5e7-278cf09a2086-signing-cabundle\") pod \"service-ca-79f68b9f4f-tvnbr\" (UID: \"7270578b-cdeb-494c-a5e7-278cf09a2086\") " pod="openshift-service-ca/service-ca-79f68b9f4f-tvnbr" Jul 15 23:47:36.798081 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:36.798032 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6d92\" (UniqueName: \"kubernetes.io/projected/7270578b-cdeb-494c-a5e7-278cf09a2086-kube-api-access-c6d92\") pod \"service-ca-79f68b9f4f-tvnbr\" (UID: \"7270578b-cdeb-494c-a5e7-278cf09a2086\") " pod="openshift-service-ca/service-ca-79f68b9f4f-tvnbr" Jul 15 23:47:36.875859 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:36.875821 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:36.899518 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:36.899499 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6d92\" (UniqueName: \"kubernetes.io/projected/7270578b-cdeb-494c-a5e7-278cf09a2086-kube-api-access-c6d92\") pod \"service-ca-79f68b9f4f-tvnbr\" (UID: \"7270578b-cdeb-494c-a5e7-278cf09a2086\") " pod="openshift-service-ca/service-ca-79f68b9f4f-tvnbr" Jul 15 23:47:36.899618 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:36.899605 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7270578b-cdeb-494c-a5e7-278cf09a2086-signing-key\") pod \"service-ca-79f68b9f4f-tvnbr\" (UID: \"7270578b-cdeb-494c-a5e7-278cf09a2086\") " pod="openshift-service-ca/service-ca-79f68b9f4f-tvnbr" Jul 15 23:47:36.899719 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:36.899626 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7270578b-cdeb-494c-a5e7-278cf09a2086-signing-cabundle\") pod \"service-ca-79f68b9f4f-tvnbr\" (UID: \"7270578b-cdeb-494c-a5e7-278cf09a2086\") " pod="openshift-service-ca/service-ca-79f68b9f4f-tvnbr" Jul 15 23:47:36.900166 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:36.900149 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7270578b-cdeb-494c-a5e7-278cf09a2086-signing-cabundle\") pod \"service-ca-79f68b9f4f-tvnbr\" (UID: \"7270578b-cdeb-494c-a5e7-278cf09a2086\") " pod="openshift-service-ca/service-ca-79f68b9f4f-tvnbr" Jul 15 23:47:36.901979 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:36.901958 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7270578b-cdeb-494c-a5e7-278cf09a2086-signing-key\") pod \"service-ca-79f68b9f4f-tvnbr\" (UID: \"7270578b-cdeb-494c-a5e7-278cf09a2086\") " pod="openshift-service-ca/service-ca-79f68b9f4f-tvnbr" Jul 15 23:47:36.907071 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:36.907051 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6d92\" (UniqueName: \"kubernetes.io/projected/7270578b-cdeb-494c-a5e7-278cf09a2086-kube-api-access-c6d92\") pod \"service-ca-79f68b9f4f-tvnbr\" (UID: \"7270578b-cdeb-494c-a5e7-278cf09a2086\") " pod="openshift-service-ca/service-ca-79f68b9f4f-tvnbr" Jul 15 23:47:37.073718 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:37.073691 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-tvnbr" Jul 15 23:47:37.325930 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:37.325870 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-tvnbr"] Jul 15 23:47:37.328679 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:47:37.328640 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7270578b_cdeb_494c_a5e7_278cf09a2086.slice/crio-d9ee4312cd45b1bcd472c7527c844aa8d0b9863cb7a4722c79f9ac139fd6e21c WatchSource:0}: Error finding container d9ee4312cd45b1bcd472c7527c844aa8d0b9863cb7a4722c79f9ac139fd6e21c: Status 404 returned error can't find the container with id d9ee4312cd45b1bcd472c7527c844aa8d0b9863cb7a4722c79f9ac139fd6e21c Jul 15 23:47:37.387145 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:37.387124 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5l9w5_c8d25ea1-819e-46d2-854d-29b4be8e184f/serve-healthcheck-canary/0.log" Jul 15 23:47:37.664082 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:37.663995 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-v9ch7" event={"ID":"5253c532-534e-4c36-a572-efa63cfc7d48","Type":"ContainerStarted","Data":"ea3ca6f15372ac36b67ce4229f3b97ff05c2137742c94e7cbf1e2fe5af326452"} Jul 15 23:47:37.664082 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:37.664054 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-v9ch7" event={"ID":"5253c532-534e-4c36-a572-efa63cfc7d48","Type":"ContainerStarted","Data":"8d9c145425908ed211b2bbbf04b7beaaacd98209d051dcbf3de27c73e06ab53d"} Jul 15 23:47:37.665592 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:37.665522 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-tvnbr" event={"ID":"7270578b-cdeb-494c-a5e7-278cf09a2086","Type":"ContainerStarted","Data":"0a7dd4a00068b58a0b5306f16ec15400cf75373d3b9bfdd7e5aba2e26b53a8a7"} Jul 15 23:47:37.665592 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:37.665568 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-tvnbr" event={"ID":"7270578b-cdeb-494c-a5e7-278cf09a2086","Type":"ContainerStarted","Data":"d9ee4312cd45b1bcd472c7527c844aa8d0b9863cb7a4722c79f9ac139fd6e21c"} Jul 15 23:47:37.665592 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:37.665583 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:37.682980 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:37.682935 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-v9ch7" podStartSLOduration=1.009416208 podStartE2EDuration="2.682921041s" totalImagesPullingTime="1.673504833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:47:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:37.681351939 +0000 UTC m=+48.912330687" watchObservedRunningTime="2026-07-15 23:47:37.682921041 +0000 UTC m=+48.913899861" Jul 15 23:47:37.699591 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:37.699546 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-tvnbr" podStartSLOduration=1.699532206 podStartE2EDuration="1.699532206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:47:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:37.699269333 +0000 UTC m=+48.930248108" watchObservedRunningTime="2026-07-15 23:47:37.699532206 +0000 UTC m=+48.930510954" Jul 15 23:47:38.312515 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:38.312476 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a98e13d5-bfc4-4f77-b7be-6926d366292e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xf75\" (UID: \"a98e13d5-bfc4-4f77-b7be-6926d366292e\") " pod="openshift-insights/insights-runtime-extractor-9xf75" Jul 15 23:47:38.312703 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:38.312553 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a98e13d5-bfc4-4f77-b7be-6926d366292e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9xf75\" (UID: \"a98e13d5-bfc4-4f77-b7be-6926d366292e\") " pod="openshift-insights/insights-runtime-extractor-9xf75" Jul 15 23:47:38.312703 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:38.312632 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 23:47:38.312836 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:38.312703 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 23:47:38.312836 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:38.312712 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a98e13d5-bfc4-4f77-b7be-6926d366292e-insights-runtime-extractor-tls podName:a98e13d5-bfc4-4f77-b7be-6926d366292e nodeName:}" failed. No retries permitted until 2026-07-15 23:47:42.312696682 +0000 UTC m=+53.543675407 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a98e13d5-bfc4-4f77-b7be-6926d366292e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9xf75" (UID: "a98e13d5-bfc4-4f77-b7be-6926d366292e") : secret "insights-runtime-extractor-tls" not found Jul 15 23:47:38.312836 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:38.312775 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a98e13d5-bfc4-4f77-b7be-6926d366292e-kube-rbac-proxy-cm podName:a98e13d5-bfc4-4f77-b7be-6926d366292e nodeName:}" failed. No retries permitted until 2026-07-15 23:47:42.312758292 +0000 UTC m=+53.543737024 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a98e13d5-bfc4-4f77-b7be-6926d366292e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9xf75" (UID: "a98e13d5-bfc4-4f77-b7be-6926d366292e") : configmap "kube-rbac-proxy" not found Jul 15 23:47:38.903093 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:38.903059 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:39.068127 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:39.068091 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:39.119643 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:39.119575 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:39.203460 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:39.203371 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:39.307178 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:39.307139 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:39.408469 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:39.408427 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:39.607283 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:39.607240 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" limit=1024 Jul 15 23:47:41.036569 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:41.036540 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b45a97fe-1c83-40e9-b190-8231a1b07291-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-ftx8k\" (UID: \"b45a97fe-1c83-40e9-b190-8231a1b07291\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-ftx8k" Jul 15 23:47:41.037046 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:41.036576 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-tls\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:41.037046 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:41.036623 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b04f591-5391-4cd9-a495-a01bb0e49ce2-metrics-certs\") pod \"router-default-5f5546b47d-9whv9\" (UID: \"2b04f591-5391-4cd9-a495-a01bb0e49ce2\") " pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:41.037046 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:41.036650 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-metrics-tls\") pod \"dns-default-jwfwf\" (UID: \"d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9\") " pod="openshift-dns/dns-default-jwfwf" Jul 15 23:47:41.037046 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:41.036702 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c2e75f0c-6a7f-42ec-a6ec-60018d26d211-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8hxlp\" (UID: \"c2e75f0c-6a7f-42ec-a6ec-60018d26d211\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8hxlp" Jul 15 23:47:41.037046 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:41.036730 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 23:47:41.037046 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:41.036787 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 23:47:41.037046 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:41.036735 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 23:47:41.037046 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:41.036828 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b45a97fe-1c83-40e9-b190-8231a1b07291-networking-console-plugin-cert podName:b45a97fe-1c83-40e9-b190-8231a1b07291 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:57.036808813 +0000 UTC m=+68.267787538 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b45a97fe-1c83-40e9-b190-8231a1b07291-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-ftx8k" (UID: "b45a97fe-1c83-40e9-b190-8231a1b07291") : secret "networking-console-plugin-cert" not found Jul 15 23:47:41.037046 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:41.036833 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-597f796589-4tx26: secret "image-registry-tls" not found Jul 15 23:47:41.037046 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:41.036866 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 23:47:41.037046 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:41.036909 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b04f591-5391-4cd9-a495-a01bb0e49ce2-metrics-certs podName:2b04f591-5391-4cd9-a495-a01bb0e49ce2 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:57.036890459 +0000 UTC m=+68.267869191 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b04f591-5391-4cd9-a495-a01bb0e49ce2-metrics-certs") pod "router-default-5f5546b47d-9whv9" (UID: "2b04f591-5391-4cd9-a495-a01bb0e49ce2") : secret "router-metrics-certs-default" not found Jul 15 23:47:41.037046 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:41.036940 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-tls podName:331d2302-c007-4a2e-a3aa-781bcb64ff9d nodeName:}" failed. No retries permitted until 2026-07-15 23:47:57.036930474 +0000 UTC m=+68.267909200 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-tls") pod "image-registry-597f796589-4tx26" (UID: "331d2302-c007-4a2e-a3aa-781bcb64ff9d") : secret "image-registry-tls" not found Jul 15 23:47:41.037046 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:41.036959 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-metrics-tls podName:d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:57.036949023 +0000 UTC m=+68.267927748 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-metrics-tls") pod "dns-default-jwfwf" (UID: "d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9") : secret "dns-default-metrics-tls" not found Jul 15 23:47:41.037046 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:41.037032 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b04f591-5391-4cd9-a495-a01bb0e49ce2-service-ca-bundle\") pod \"router-default-5f5546b47d-9whv9\" (UID: \"2b04f591-5391-4cd9-a495-a01bb0e49ce2\") " pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:41.037533 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:41.037068 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-z98bm\" (UID: \"b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z98bm" Jul 15 23:47:41.037533 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:41.037154 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b04f591-5391-4cd9-a495-a01bb0e49ce2-service-ca-bundle podName:2b04f591-5391-4cd9-a495-a01bb0e49ce2 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:57.037142842 +0000 UTC m=+68.268121570 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b04f591-5391-4cd9-a495-a01bb0e49ce2-service-ca-bundle") pod "router-default-5f5546b47d-9whv9" (UID: "2b04f591-5391-4cd9-a495-a01bb0e49ce2") : configmap references non-existent config key: service-ca.crt Jul 15 23:47:41.037533 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:41.037181 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 23:47:41.037533 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:41.037218 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b-cluster-monitoring-operator-tls podName:b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b nodeName:}" failed. No retries permitted until 2026-07-15 23:47:57.037210675 +0000 UTC m=+68.268189404 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-z98bm" (UID: "b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b") : secret "cluster-monitoring-operator-tls" not found Jul 15 23:47:41.039170 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:41.039148 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c2e75f0c-6a7f-42ec-a6ec-60018d26d211-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8hxlp\" (UID: \"c2e75f0c-6a7f-42ec-a6ec-60018d26d211\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8hxlp" Jul 15 23:47:41.060538 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:41.060519 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8hxlp" Jul 15 23:47:41.206354 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:41.206324 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8hxlp"] Jul 15 23:47:41.679163 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:41.679132 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8hxlp" event={"ID":"c2e75f0c-6a7f-42ec-a6ec-60018d26d211","Type":"ContainerStarted","Data":"f9cd4c0ae3648dc0868864ea1e663c18302fdb34acaed3abbbf88a1034b5418b"} Jul 15 23:47:42.348566 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:42.348534 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a98e13d5-bfc4-4f77-b7be-6926d366292e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9xf75\" (UID: \"a98e13d5-bfc4-4f77-b7be-6926d366292e\") " pod="openshift-insights/insights-runtime-extractor-9xf75" Jul 15 23:47:42.348981 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:42.348688 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a98e13d5-bfc4-4f77-b7be-6926d366292e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xf75\" (UID: \"a98e13d5-bfc4-4f77-b7be-6926d366292e\") " pod="openshift-insights/insights-runtime-extractor-9xf75" Jul 15 23:47:42.348981 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:42.348831 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 23:47:42.348981 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:47:42.348894 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a98e13d5-bfc4-4f77-b7be-6926d366292e-insights-runtime-extractor-tls podName:a98e13d5-bfc4-4f77-b7be-6926d366292e nodeName:}" failed. No retries permitted until 2026-07-15 23:47:50.348878377 +0000 UTC m=+61.579857102 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a98e13d5-bfc4-4f77-b7be-6926d366292e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9xf75" (UID: "a98e13d5-bfc4-4f77-b7be-6926d366292e") : secret "insights-runtime-extractor-tls" not found Jul 15 23:47:42.349095 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:42.349074 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a98e13d5-bfc4-4f77-b7be-6926d366292e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9xf75\" (UID: \"a98e13d5-bfc4-4f77-b7be-6926d366292e\") " pod="openshift-insights/insights-runtime-extractor-9xf75" Jul 15 23:47:43.686584 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:43.686494 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8hxlp" event={"ID":"c2e75f0c-6a7f-42ec-a6ec-60018d26d211","Type":"ContainerStarted","Data":"d644c8ae4698b893e820dc6224be770b56207a624e549c0525efcfc5642a458e"} Jul 15 23:47:43.686584 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:43.686553 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8hxlp" event={"ID":"c2e75f0c-6a7f-42ec-a6ec-60018d26d211","Type":"ContainerStarted","Data":"fd400904f673d0ec6e755e461eba960fbebfc631c361d11cff0c3e49085b2c29"} Jul 15 23:47:43.702948 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:43.702907 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8hxlp" podStartSLOduration=48.709728053 podStartE2EDuration="50.702892096s" totalImagesPullingTime="1.993164043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:46:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:43.701913675 +0000 UTC m=+54.932892422" watchObservedRunningTime="2026-07-15 23:47:43.702892096 +0000 UTC m=+54.933870842" Jul 15 23:47:48.295609 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:48.295577 2564 scope.go:117] "RemoveContainer" containerID="27601c509a4b3a1e36e017797373e149055ceb80129806aae93cf88282c2facb" Jul 15 23:47:48.545194 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:48.545166 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fp65r" Jul 15 23:47:48.703753 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:48.703735 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-7g2gx_0f1c9d30-fe51-493e-9b47-84d63b56fa8f/console-operator/1.log" Jul 15 23:47:48.703894 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:48.703797 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-7g2gx" event={"ID":"0f1c9d30-fe51-493e-9b47-84d63b56fa8f","Type":"ContainerStarted","Data":"a06e0bb8b052cc498eb619b9a1bf4efb1457187f2dfbb51c43ada9acee5e57de"} Jul 15 23:47:48.704100 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:48.704071 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-7g2gx" Jul 15 23:47:48.719981 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:48.719924 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-7g2gx" podStartSLOduration=48.200845725 podStartE2EDuration="55.719905659s" totalImagesPullingTime="7.519059934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:46:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:48.71934533 +0000 UTC m=+59.950324097" watchObservedRunningTime="2026-07-15 23:47:48.719905659 +0000 UTC m=+59.950884407" Jul 15 23:47:48.837148 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:48.837119 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-7g2gx" Jul 15 23:47:50.426070 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:50.425556 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a98e13d5-bfc4-4f77-b7be-6926d366292e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xf75\" (UID: \"a98e13d5-bfc4-4f77-b7be-6926d366292e\") " pod="openshift-insights/insights-runtime-extractor-9xf75" Jul 15 23:47:50.430312 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:50.430286 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a98e13d5-bfc4-4f77-b7be-6926d366292e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xf75\" (UID: \"a98e13d5-bfc4-4f77-b7be-6926d366292e\") " pod="openshift-insights/insights-runtime-extractor-9xf75" Jul 15 23:47:50.514933 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:50.514902 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q4vkt\"" Jul 15 23:47:50.523851 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:50.523833 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9xf75" Jul 15 23:47:50.642931 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:50.642899 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9xf75"] Jul 15 23:47:50.645788 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:47:50.645763 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda98e13d5_bfc4_4f77_b7be_6926d366292e.slice/crio-6ec2f6eaf1cc2959f503dec540cc0e2778ccdbc66bb67c80342dc10f129f936c WatchSource:0}: Error finding container 6ec2f6eaf1cc2959f503dec540cc0e2778ccdbc66bb67c80342dc10f129f936c: Status 404 returned error can't find the container with id 6ec2f6eaf1cc2959f503dec540cc0e2778ccdbc66bb67c80342dc10f129f936c Jul 15 23:47:50.711537 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:50.711512 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9xf75" event={"ID":"a98e13d5-bfc4-4f77-b7be-6926d366292e","Type":"ContainerStarted","Data":"6ec2f6eaf1cc2959f503dec540cc0e2778ccdbc66bb67c80342dc10f129f936c"} Jul 15 23:47:54.972660 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:54.972612 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/371e613a-079b-4d90-83bc-8145a0d84fce-metrics-certs\") pod \"network-metrics-daemon-pp4rq\" (UID: \"371e613a-079b-4d90-83bc-8145a0d84fce\") " pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:47:54.974989 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:54.974963 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 23:47:54.986010 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:54.985986 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/371e613a-079b-4d90-83bc-8145a0d84fce-metrics-certs\") pod \"network-metrics-daemon-pp4rq\" (UID: \"371e613a-079b-4d90-83bc-8145a0d84fce\") " pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:47:55.011277 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:55.011257 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m2fgm\"" Jul 15 23:47:55.019337 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:55.019313 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pp4rq" Jul 15 23:47:55.073754 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:55.073722 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3abafe-42bb-46fb-8165-4b95893c4b8d-original-pull-secret\") pod \"global-pull-secret-syncer-tgnmg\" (UID: \"ae3abafe-42bb-46fb-8165-4b95893c4b8d\") " pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:47:55.073913 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:55.073791 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fdwc\" (UniqueName: \"kubernetes.io/projected/b98aea50-bfd9-48e4-984e-f5a89ee01212-kube-api-access-7fdwc\") pod \"network-check-target-5pjjq\" (UID: \"b98aea50-bfd9-48e4-984e-f5a89ee01212\") " pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:47:55.076016 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:55.075994 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fdwc\" (UniqueName: \"kubernetes.io/projected/b98aea50-bfd9-48e4-984e-f5a89ee01212-kube-api-access-7fdwc\") pod \"network-check-target-5pjjq\" (UID: \"b98aea50-bfd9-48e4-984e-f5a89ee01212\") " pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:47:55.076194 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:55.076175 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 23:47:55.086268 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:55.086248 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3abafe-42bb-46fb-8165-4b95893c4b8d-original-pull-secret\") pod \"global-pull-secret-syncer-tgnmg\" (UID: \"ae3abafe-42bb-46fb-8165-4b95893c4b8d\") " pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:47:55.108347 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:55.108322 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgnmg" Jul 15 23:47:55.316588 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:55.316506 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fwsxh\"" Jul 15 23:47:55.324516 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:55.324487 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:47:55.544356 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:55.544299 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5pjjq"] Jul 15 23:47:55.547720 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:47:55.547683 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb98aea50_bfd9_48e4_984e_f5a89ee01212.slice/crio-e33266af1d2d5f3c8b1d1b42da8680c4f4b37fa997c891774a7d0f95c3e038bb WatchSource:0}: Error finding container e33266af1d2d5f3c8b1d1b42da8680c4f4b37fa997c891774a7d0f95c3e038bb: Status 404 returned error can't find the container with id e33266af1d2d5f3c8b1d1b42da8680c4f4b37fa997c891774a7d0f95c3e038bb Jul 15 23:47:55.732169 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:55.732135 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9xf75" event={"ID":"a98e13d5-bfc4-4f77-b7be-6926d366292e","Type":"ContainerStarted","Data":"49049606622efe38f6225bc82350c7bdda7e3555e36b623dd3f06e56a4213781"} Jul 15 23:47:55.733538 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:55.733513 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5pjjq" event={"ID":"b98aea50-bfd9-48e4-984e-f5a89ee01212","Type":"ContainerStarted","Data":"42e48fa8782d0e7e0e6ee9cb63475875afa36d8a79741e92c31786f443eede3a"} Jul 15 23:47:55.733656 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:55.733552 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5pjjq" event={"ID":"b98aea50-bfd9-48e4-984e-f5a89ee01212","Type":"ContainerStarted","Data":"e33266af1d2d5f3c8b1d1b42da8680c4f4b37fa997c891774a7d0f95c3e038bb"} Jul 15 23:47:55.733726 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:55.733690 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:47:55.752576 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:55.752533 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5pjjq" podStartSLOduration=66.752518318 podStartE2EDuration="1m6.752518318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:46:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:55.750930593 +0000 UTC m=+66.981909342" watchObservedRunningTime="2026-07-15 23:47:55.752518318 +0000 UTC m=+66.983497065" Jul 15 23:47:55.770642 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:55.770620 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tgnmg"] Jul 15 23:47:55.772919 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:55.771792 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pp4rq"] Jul 15 23:47:55.774800 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:47:55.774769 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod371e613a_079b_4d90_83bc_8145a0d84fce.slice/crio-168b300efc96995795ed579d91e2fb69b72d2bc52f6b3edbe248146d972c129e WatchSource:0}: Error finding container 168b300efc96995795ed579d91e2fb69b72d2bc52f6b3edbe248146d972c129e: Status 404 returned error can't find the container with id 168b300efc96995795ed579d91e2fb69b72d2bc52f6b3edbe248146d972c129e Jul 15 23:47:55.775333 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:47:55.775314 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae3abafe_42bb_46fb_8165_4b95893c4b8d.slice/crio-d183707a811600cfd46eb4f7a008bc793877d33b582a031d5cb30672e0fc42a0 WatchSource:0}: Error finding container d183707a811600cfd46eb4f7a008bc793877d33b582a031d5cb30672e0fc42a0: Status 404 returned error can't find the container with id d183707a811600cfd46eb4f7a008bc793877d33b582a031d5cb30672e0fc42a0 Jul 15 23:47:56.713891 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.713857 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-864d4fbd66-qcwg9"] Jul 15 23:47:56.730125 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.730093 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d6db44d56-kftvw"] Jul 15 23:47:56.730281 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.730249 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-864d4fbd66-qcwg9" Jul 15 23:47:56.732823 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.732794 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 15 23:47:56.732823 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.732815 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 15 23:47:56.734085 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.733898 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-qfjrr\"" Jul 15 23:47:56.734085 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.734000 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 15 23:47:56.734320 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.734253 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 15 23:47:56.742704 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.742368 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b4674d44-7txlv"] Jul 15 23:47:56.742704 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.742468 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d6db44d56-kftvw" Jul 15 23:47:56.745082 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.745054 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 15 23:47:56.765995 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.765147 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tgnmg" event={"ID":"ae3abafe-42bb-46fb-8165-4b95893c4b8d","Type":"ContainerStarted","Data":"d183707a811600cfd46eb4f7a008bc793877d33b582a031d5cb30672e0fc42a0"} Jul 15 23:47:56.765995 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.765198 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pp4rq" event={"ID":"371e613a-079b-4d90-83bc-8145a0d84fce","Type":"ContainerStarted","Data":"168b300efc96995795ed579d91e2fb69b72d2bc52f6b3edbe248146d972c129e"} Jul 15 23:47:56.765995 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.765234 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-864d4fbd66-qcwg9"] Jul 15 23:47:56.765995 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.765255 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d6db44d56-kftvw"] Jul 15 23:47:56.765995 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.765277 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b4674d44-7txlv"] Jul 15 23:47:56.765995 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.765305 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-g2lfs"] Jul 15 23:47:56.767067 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.766545 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b4674d44-7txlv" Jul 15 23:47:56.769303 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.769161 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 15 23:47:56.769399 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.769383 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 15 23:47:56.769850 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.769823 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 15 23:47:56.770006 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.769944 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 15 23:47:56.787451 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.787430 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-g2lfs"] Jul 15 23:47:56.787555 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.787544 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-g2lfs" Jul 15 23:47:56.789975 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.789952 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-h2t4x\"" Jul 15 23:47:56.790892 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.790845 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 15 23:47:56.791771 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.791718 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 15 23:47:56.890054 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.890018 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klslm\" (UniqueName: \"kubernetes.io/projected/44805faf-16a8-4f10-9b51-ed693198fc3b-kube-api-access-klslm\") pod \"cluster-proxy-proxy-agent-9b4674d44-7txlv\" (UID: \"44805faf-16a8-4f10-9b51-ed693198fc3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b4674d44-7txlv" Jul 15 23:47:56.890239 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.890079 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tx7l\" (UniqueName: \"kubernetes.io/projected/0b46cd6f-1373-491d-a772-acd15f0b246f-kube-api-access-4tx7l\") pod \"klusterlet-addon-workmgr-7d6db44d56-kftvw\" (UID: \"0b46cd6f-1373-491d-a772-acd15f0b246f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d6db44d56-kftvw" Jul 15 23:47:56.890239 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.890175 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cr5r\" (UniqueName: \"kubernetes.io/projected/5376309f-1f18-4fe3-b175-97fa9abedc9c-kube-api-access-6cr5r\") pod \"managed-serviceaccount-addon-agent-864d4fbd66-qcwg9\" (UID: \"5376309f-1f18-4fe3-b175-97fa9abedc9c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-864d4fbd66-qcwg9" Jul 15 23:47:56.890239 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.890232 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbl4j\" (UniqueName: \"kubernetes.io/projected/1d5f05be-c572-4a00-baa7-09554f6124ec-kube-api-access-cbl4j\") pod \"downloads-68c9cbb497-g2lfs\" (UID: \"1d5f05be-c572-4a00-baa7-09554f6124ec\") " pod="openshift-console/downloads-68c9cbb497-g2lfs" Jul 15 23:47:56.890412 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.890301 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0b46cd6f-1373-491d-a772-acd15f0b246f-klusterlet-config\") pod \"klusterlet-addon-workmgr-7d6db44d56-kftvw\" (UID: \"0b46cd6f-1373-491d-a772-acd15f0b246f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d6db44d56-kftvw" Jul 15 23:47:56.890412 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.890346 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/44805faf-16a8-4f10-9b51-ed693198fc3b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-9b4674d44-7txlv\" (UID: \"44805faf-16a8-4f10-9b51-ed693198fc3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b4674d44-7txlv" Jul 15 23:47:56.890412 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.890395 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/44805faf-16a8-4f10-9b51-ed693198fc3b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-9b4674d44-7txlv\" (UID: \"44805faf-16a8-4f10-9b51-ed693198fc3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b4674d44-7txlv" Jul 15 23:47:56.890605 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.890422 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b46cd6f-1373-491d-a772-acd15f0b246f-tmp\") pod \"klusterlet-addon-workmgr-7d6db44d56-kftvw\" (UID: \"0b46cd6f-1373-491d-a772-acd15f0b246f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d6db44d56-kftvw" Jul 15 23:47:56.890605 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.890445 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/44805faf-16a8-4f10-9b51-ed693198fc3b-hub\") pod \"cluster-proxy-proxy-agent-9b4674d44-7txlv\" (UID: \"44805faf-16a8-4f10-9b51-ed693198fc3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b4674d44-7txlv" Jul 15 23:47:56.890605 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.890471 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/44805faf-16a8-4f10-9b51-ed693198fc3b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-9b4674d44-7txlv\" (UID: \"44805faf-16a8-4f10-9b51-ed693198fc3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b4674d44-7txlv" Jul 15 23:47:56.890605 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.890539 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/44805faf-16a8-4f10-9b51-ed693198fc3b-ca\") pod \"cluster-proxy-proxy-agent-9b4674d44-7txlv\" (UID: \"44805faf-16a8-4f10-9b51-ed693198fc3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b4674d44-7txlv" Jul 15 23:47:56.890881 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.890676 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5376309f-1f18-4fe3-b175-97fa9abedc9c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-864d4fbd66-qcwg9\" (UID: \"5376309f-1f18-4fe3-b175-97fa9abedc9c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-864d4fbd66-qcwg9" Jul 15 23:47:56.992071 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.991983 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tx7l\" (UniqueName: \"kubernetes.io/projected/0b46cd6f-1373-491d-a772-acd15f0b246f-kube-api-access-4tx7l\") pod \"klusterlet-addon-workmgr-7d6db44d56-kftvw\" (UID: \"0b46cd6f-1373-491d-a772-acd15f0b246f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d6db44d56-kftvw" Jul 15 23:47:56.992228 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.992087 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cr5r\" (UniqueName: \"kubernetes.io/projected/5376309f-1f18-4fe3-b175-97fa9abedc9c-kube-api-access-6cr5r\") pod \"managed-serviceaccount-addon-agent-864d4fbd66-qcwg9\" (UID: \"5376309f-1f18-4fe3-b175-97fa9abedc9c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-864d4fbd66-qcwg9" Jul 15 23:47:56.992228 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.992191 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbl4j\" (UniqueName: \"kubernetes.io/projected/1d5f05be-c572-4a00-baa7-09554f6124ec-kube-api-access-cbl4j\") pod \"downloads-68c9cbb497-g2lfs\" (UID: \"1d5f05be-c572-4a00-baa7-09554f6124ec\") " pod="openshift-console/downloads-68c9cbb497-g2lfs" Jul 15 23:47:56.992338 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.992231 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0b46cd6f-1373-491d-a772-acd15f0b246f-klusterlet-config\") pod \"klusterlet-addon-workmgr-7d6db44d56-kftvw\" (UID: \"0b46cd6f-1373-491d-a772-acd15f0b246f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d6db44d56-kftvw" Jul 15 23:47:56.992338 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.992253 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/44805faf-16a8-4f10-9b51-ed693198fc3b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-9b4674d44-7txlv\" (UID: \"44805faf-16a8-4f10-9b51-ed693198fc3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b4674d44-7txlv" Jul 15 23:47:56.992338 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.992287 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/44805faf-16a8-4f10-9b51-ed693198fc3b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-9b4674d44-7txlv\" (UID: \"44805faf-16a8-4f10-9b51-ed693198fc3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b4674d44-7txlv" Jul 15 23:47:56.992338 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.992311 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b46cd6f-1373-491d-a772-acd15f0b246f-tmp\") pod \"klusterlet-addon-workmgr-7d6db44d56-kftvw\" (UID: \"0b46cd6f-1373-491d-a772-acd15f0b246f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d6db44d56-kftvw" Jul 15 23:47:56.992537 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.992335 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/44805faf-16a8-4f10-9b51-ed693198fc3b-hub\") pod \"cluster-proxy-proxy-agent-9b4674d44-7txlv\" (UID: \"44805faf-16a8-4f10-9b51-ed693198fc3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b4674d44-7txlv" Jul 15 23:47:56.992537 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.992401 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/44805faf-16a8-4f10-9b51-ed693198fc3b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-9b4674d44-7txlv\" (UID: \"44805faf-16a8-4f10-9b51-ed693198fc3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b4674d44-7txlv" Jul 15 23:47:56.992537 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.992459 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/44805faf-16a8-4f10-9b51-ed693198fc3b-ca\") pod \"cluster-proxy-proxy-agent-9b4674d44-7txlv\" (UID: \"44805faf-16a8-4f10-9b51-ed693198fc3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b4674d44-7txlv" Jul 15 23:47:56.992537 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.992505 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5376309f-1f18-4fe3-b175-97fa9abedc9c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-864d4fbd66-qcwg9\" (UID: \"5376309f-1f18-4fe3-b175-97fa9abedc9c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-864d4fbd66-qcwg9" Jul 15 23:47:56.993590 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.992544 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klslm\" (UniqueName: \"kubernetes.io/projected/44805faf-16a8-4f10-9b51-ed693198fc3b-kube-api-access-klslm\") pod \"cluster-proxy-proxy-agent-9b4674d44-7txlv\" (UID: \"44805faf-16a8-4f10-9b51-ed693198fc3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b4674d44-7txlv" Jul 15 23:47:56.993590 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.993167 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b46cd6f-1373-491d-a772-acd15f0b246f-tmp\") pod \"klusterlet-addon-workmgr-7d6db44d56-kftvw\" (UID: \"0b46cd6f-1373-491d-a772-acd15f0b246f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d6db44d56-kftvw" Jul 15 23:47:56.993590 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.993384 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/44805faf-16a8-4f10-9b51-ed693198fc3b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-9b4674d44-7txlv\" (UID: \"44805faf-16a8-4f10-9b51-ed693198fc3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b4674d44-7txlv" Jul 15 23:47:56.996927 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.996883 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5376309f-1f18-4fe3-b175-97fa9abedc9c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-864d4fbd66-qcwg9\" (UID: \"5376309f-1f18-4fe3-b175-97fa9abedc9c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-864d4fbd66-qcwg9" Jul 15 23:47:56.998853 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.998810 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/44805faf-16a8-4f10-9b51-ed693198fc3b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-9b4674d44-7txlv\" (UID: \"44805faf-16a8-4f10-9b51-ed693198fc3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b4674d44-7txlv" Jul 15 23:47:56.999448 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:56.999385 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0b46cd6f-1373-491d-a772-acd15f0b246f-klusterlet-config\") pod \"klusterlet-addon-workmgr-7d6db44d56-kftvw\" (UID: \"0b46cd6f-1373-491d-a772-acd15f0b246f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d6db44d56-kftvw" Jul 15 23:47:57.000059 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.000020 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/44805faf-16a8-4f10-9b51-ed693198fc3b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-9b4674d44-7txlv\" (UID: \"44805faf-16a8-4f10-9b51-ed693198fc3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b4674d44-7txlv" Jul 15 23:47:57.000537 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.000503 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/44805faf-16a8-4f10-9b51-ed693198fc3b-ca\") pod \"cluster-proxy-proxy-agent-9b4674d44-7txlv\" (UID: \"44805faf-16a8-4f10-9b51-ed693198fc3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b4674d44-7txlv" Jul 15 23:47:57.006091 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.004261 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbl4j\" (UniqueName: \"kubernetes.io/projected/1d5f05be-c572-4a00-baa7-09554f6124ec-kube-api-access-cbl4j\") pod \"downloads-68c9cbb497-g2lfs\" (UID: \"1d5f05be-c572-4a00-baa7-09554f6124ec\") " pod="openshift-console/downloads-68c9cbb497-g2lfs" Jul 15 23:47:57.006091 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.004439 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tx7l\" (UniqueName: \"kubernetes.io/projected/0b46cd6f-1373-491d-a772-acd15f0b246f-kube-api-access-4tx7l\") pod \"klusterlet-addon-workmgr-7d6db44d56-kftvw\" (UID: \"0b46cd6f-1373-491d-a772-acd15f0b246f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d6db44d56-kftvw" Jul 15 23:47:57.006091 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.006026 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/44805faf-16a8-4f10-9b51-ed693198fc3b-hub\") pod \"cluster-proxy-proxy-agent-9b4674d44-7txlv\" (UID: \"44805faf-16a8-4f10-9b51-ed693198fc3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b4674d44-7txlv" Jul 15 23:47:57.006304 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.006248 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cr5r\" (UniqueName: \"kubernetes.io/projected/5376309f-1f18-4fe3-b175-97fa9abedc9c-kube-api-access-6cr5r\") pod \"managed-serviceaccount-addon-agent-864d4fbd66-qcwg9\" (UID: \"5376309f-1f18-4fe3-b175-97fa9abedc9c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-864d4fbd66-qcwg9" Jul 15 23:47:57.006641 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.006614 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klslm\" (UniqueName: \"kubernetes.io/projected/44805faf-16a8-4f10-9b51-ed693198fc3b-kube-api-access-klslm\") pod \"cluster-proxy-proxy-agent-9b4674d44-7txlv\" (UID: \"44805faf-16a8-4f10-9b51-ed693198fc3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b4674d44-7txlv" Jul 15 23:47:57.052078 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.052049 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-864d4fbd66-qcwg9" Jul 15 23:47:57.064618 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.064549 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d6db44d56-kftvw" Jul 15 23:47:57.078357 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.078331 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b4674d44-7txlv" Jul 15 23:47:57.094882 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.094229 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b04f591-5391-4cd9-a495-a01bb0e49ce2-service-ca-bundle\") pod \"router-default-5f5546b47d-9whv9\" (UID: \"2b04f591-5391-4cd9-a495-a01bb0e49ce2\") " pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:57.094882 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.094276 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-z98bm\" (UID: \"b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z98bm" Jul 15 23:47:57.094882 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.094339 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b45a97fe-1c83-40e9-b190-8231a1b07291-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-ftx8k\" (UID: \"b45a97fe-1c83-40e9-b190-8231a1b07291\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-ftx8k" Jul 15 23:47:57.094882 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.094373 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-tls\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:57.094882 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.094427 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b04f591-5391-4cd9-a495-a01bb0e49ce2-metrics-certs\") pod \"router-default-5f5546b47d-9whv9\" (UID: \"2b04f591-5391-4cd9-a495-a01bb0e49ce2\") " pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:57.094882 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.094459 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-metrics-tls\") pod \"dns-default-jwfwf\" (UID: \"d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9\") " pod="openshift-dns/dns-default-jwfwf" Jul 15 23:47:57.096112 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.096085 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b04f591-5391-4cd9-a495-a01bb0e49ce2-service-ca-bundle\") pod \"router-default-5f5546b47d-9whv9\" (UID: \"2b04f591-5391-4cd9-a495-a01bb0e49ce2\") " pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:57.098186 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.098136 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9-metrics-tls\") pod \"dns-default-jwfwf\" (UID: \"d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9\") " pod="openshift-dns/dns-default-jwfwf" Jul 15 23:47:57.099152 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.099126 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b45a97fe-1c83-40e9-b190-8231a1b07291-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-ftx8k\" (UID: \"b45a97fe-1c83-40e9-b190-8231a1b07291\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-ftx8k" Jul 15 23:47:57.099621 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.099596 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-tls\") pod \"image-registry-597f796589-4tx26\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:57.100827 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.100784 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b04f591-5391-4cd9-a495-a01bb0e49ce2-metrics-certs\") pod \"router-default-5f5546b47d-9whv9\" (UID: \"2b04f591-5391-4cd9-a495-a01bb0e49ce2\") " pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:57.102242 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.102071 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-z98bm\" (UID: \"b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z98bm" Jul 15 23:47:57.104925 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.104858 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-g2lfs" Jul 15 23:47:57.230258 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.229986 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cf9dq\"" Jul 15 23:47:57.230258 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.230012 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:47:57.234116 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.233933 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-b8xv7\"" Jul 15 23:47:57.240897 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.240841 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z98bm" Jul 15 23:47:57.254335 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.254285 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-864d4fbd66-qcwg9"] Jul 15 23:47:57.275548 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.275510 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8rw7r\"" Jul 15 23:47:57.281494 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.281316 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:47:57.290798 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.290775 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-72cf6\"" Jul 15 23:47:57.296887 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.296839 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vtkd9\"" Jul 15 23:47:57.298755 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.298732 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jwfwf" Jul 15 23:47:57.305081 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.305055 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-ftx8k" Jul 15 23:47:57.319180 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.319058 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d6db44d56-kftvw"] Jul 15 23:47:57.521249 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:47:57.521164 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5376309f_1f18_4fe3_b175_97fa9abedc9c.slice/crio-b9f069613362fb792ac9ce8731613e26ab389dc9ac7c6f8424a97c1e627a5d95 WatchSource:0}: Error finding container b9f069613362fb792ac9ce8731613e26ab389dc9ac7c6f8424a97c1e627a5d95: Status 404 returned error can't find the container with id b9f069613362fb792ac9ce8731613e26ab389dc9ac7c6f8424a97c1e627a5d95 Jul 15 23:47:57.522004 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:47:57.521973 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b46cd6f_1373_491d_a772_acd15f0b246f.slice/crio-22853bb5c80d3dc947ca5f39420f2410b977b8e5f45cc9ffe150f3f9a7246eea WatchSource:0}: Error finding container 22853bb5c80d3dc947ca5f39420f2410b977b8e5f45cc9ffe150f3f9a7246eea: Status 404 returned error can't find the container with id 22853bb5c80d3dc947ca5f39420f2410b977b8e5f45cc9ffe150f3f9a7246eea Jul 15 23:47:57.748496 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.748447 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d6db44d56-kftvw" event={"ID":"0b46cd6f-1373-491d-a772-acd15f0b246f","Type":"ContainerStarted","Data":"22853bb5c80d3dc947ca5f39420f2410b977b8e5f45cc9ffe150f3f9a7246eea"} Jul 15 23:47:57.749818 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:57.749787 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-864d4fbd66-qcwg9" event={"ID":"5376309f-1f18-4fe3-b175-97fa9abedc9c","Type":"ContainerStarted","Data":"b9f069613362fb792ac9ce8731613e26ab389dc9ac7c6f8424a97c1e627a5d95"} Jul 15 23:47:59.215379 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:47:59.215318 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-g2lfs"] Jul 15 23:48:00.184462 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:48:00.184424 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d5f05be_c572_4a00_baa7_09554f6124ec.slice/crio-e00a054fdeda30d5de3e0294d2cb278c71e8ad124c34efaf15213e44de2fb270 WatchSource:0}: Error finding container e00a054fdeda30d5de3e0294d2cb278c71e8ad124c34efaf15213e44de2fb270: Status 404 returned error can't find the container with id e00a054fdeda30d5de3e0294d2cb278c71e8ad124c34efaf15213e44de2fb270 Jul 15 23:48:00.765893 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:00.765847 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-g2lfs" event={"ID":"1d5f05be-c572-4a00-baa7-09554f6124ec","Type":"ContainerStarted","Data":"e00a054fdeda30d5de3e0294d2cb278c71e8ad124c34efaf15213e44de2fb270"} Jul 15 23:48:02.014190 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:02.014157 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b4674d44-7txlv"] Jul 15 23:48:02.655137 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:48:02.654819 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44805faf_16a8_4f10_9b51_ed693198fc3b.slice/crio-da4ba22c125a1376a5a51dd5444e31bb4d3ca24293e82a9be3d4d96e1da895cb WatchSource:0}: Error finding container da4ba22c125a1376a5a51dd5444e31bb4d3ca24293e82a9be3d4d96e1da895cb: Status 404 returned error can't find the container with id da4ba22c125a1376a5a51dd5444e31bb4d3ca24293e82a9be3d4d96e1da895cb Jul 15 23:48:02.775994 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:02.775906 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b4674d44-7txlv" event={"ID":"44805faf-16a8-4f10-9b51-ed693198fc3b","Type":"ContainerStarted","Data":"da4ba22c125a1376a5a51dd5444e31bb4d3ca24293e82a9be3d4d96e1da895cb"} Jul 15 23:48:02.835039 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:02.834009 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z98bm"] Jul 15 23:48:02.879837 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:02.879802 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-ftx8k"] Jul 15 23:48:02.906648 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:02.906572 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-597f796589-4tx26"] Jul 15 23:48:03.048747 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:03.048719 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jwfwf"] Jul 15 23:48:03.051241 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:03.051212 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5f5546b47d-9whv9"] Jul 15 23:48:03.166095 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:48:03.166019 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb45a97fe_1c83_40e9_b190_8231a1b07291.slice/crio-31e62545a974d186ecf63d0265cf06814f2fdc7ed2494660f073fb9a678d1f60 WatchSource:0}: Error finding container 31e62545a974d186ecf63d0265cf06814f2fdc7ed2494660f073fb9a678d1f60: Status 404 returned error can't find the container with id 31e62545a974d186ecf63d0265cf06814f2fdc7ed2494660f073fb9a678d1f60 Jul 15 23:48:03.166500 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:48:03.166477 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5d573b8_fa44_4cc5_aad2_b88e6d5dd69b.slice/crio-c2e13075d552eba8dd6f1eb29a4542e8812484da265ee708f9535ad990b6b9b8 WatchSource:0}: Error finding container c2e13075d552eba8dd6f1eb29a4542e8812484da265ee708f9535ad990b6b9b8: Status 404 returned error can't find the container with id c2e13075d552eba8dd6f1eb29a4542e8812484da265ee708f9535ad990b6b9b8 Jul 15 23:48:03.168321 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:48:03.168298 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3f498ea_4092_4cf8_bcdf_601ad1a6cbb9.slice/crio-6f83afd39fcbfc1021ce312766e708a2465d8dfd47dd18696cd8060d69d5bab8 WatchSource:0}: Error finding container 6f83afd39fcbfc1021ce312766e708a2465d8dfd47dd18696cd8060d69d5bab8: Status 404 returned error can't find the container with id 6f83afd39fcbfc1021ce312766e708a2465d8dfd47dd18696cd8060d69d5bab8 Jul 15 23:48:03.169782 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:48:03.169631 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod331d2302_c007_4a2e_a3aa_781bcb64ff9d.slice/crio-11e481112f95ae118c7c0f68b8f4b338a066e625a7d921894679be8f46e2b368 WatchSource:0}: Error finding container 11e481112f95ae118c7c0f68b8f4b338a066e625a7d921894679be8f46e2b368: Status 404 returned error can't find the container with id 11e481112f95ae118c7c0f68b8f4b338a066e625a7d921894679be8f46e2b368 Jul 15 23:48:03.782495 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:03.782422 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5f5546b47d-9whv9" event={"ID":"2b04f591-5391-4cd9-a495-a01bb0e49ce2","Type":"ContainerStarted","Data":"a191a235ad6d69e85582e64cd7410ad2cc5eee68be3b0d0d99783514abea1a96"} Jul 15 23:48:03.784086 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:03.784054 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-ftx8k" event={"ID":"b45a97fe-1c83-40e9-b190-8231a1b07291","Type":"ContainerStarted","Data":"31e62545a974d186ecf63d0265cf06814f2fdc7ed2494660f073fb9a678d1f60"} Jul 15 23:48:03.785495 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:03.785467 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z98bm" event={"ID":"b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b","Type":"ContainerStarted","Data":"c2e13075d552eba8dd6f1eb29a4542e8812484da265ee708f9535ad990b6b9b8"} Jul 15 23:48:03.786821 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:03.786765 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jwfwf" event={"ID":"d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9","Type":"ContainerStarted","Data":"6f83afd39fcbfc1021ce312766e708a2465d8dfd47dd18696cd8060d69d5bab8"} Jul 15 23:48:03.788021 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:03.787976 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-597f796589-4tx26" event={"ID":"331d2302-c007-4a2e-a3aa-781bcb64ff9d","Type":"ContainerStarted","Data":"11e481112f95ae118c7c0f68b8f4b338a066e625a7d921894679be8f46e2b368"} Jul 15 23:48:05.801775 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:05.801734 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d6db44d56-kftvw" event={"ID":"0b46cd6f-1373-491d-a772-acd15f0b246f","Type":"ContainerStarted","Data":"319807a063ff604c3726d478326d079a13959534ab7c8dcf024a417fa176875a"} Jul 15 23:48:05.804641 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:05.804189 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d6db44d56-kftvw" Jul 15 23:48:05.806450 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:05.804971 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d6db44d56-kftvw" Jul 15 23:48:05.808022 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:05.807571 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tgnmg" event={"ID":"ae3abafe-42bb-46fb-8165-4b95893c4b8d","Type":"ContainerStarted","Data":"75b3ffa26d1fdd834b558cf75e08a466d0eeb90c00759e4ff427319d1d8a6c1f"} Jul 15 23:48:05.811378 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:05.811150 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pp4rq" event={"ID":"371e613a-079b-4d90-83bc-8145a0d84fce","Type":"ContainerStarted","Data":"d76e556042547cffb507a2367d7887a2f0609f5a7f8e0b50adfa7ab1b6de8cc6"} Jul 15 23:48:05.811378 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:05.811195 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pp4rq" event={"ID":"371e613a-079b-4d90-83bc-8145a0d84fce","Type":"ContainerStarted","Data":"571cf29968b47409a500ea09066fa09b969d58719aeac6ba4f183df555a8efcc"} Jul 15 23:48:05.814469 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:05.814436 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9xf75" event={"ID":"a98e13d5-bfc4-4f77-b7be-6926d366292e","Type":"ContainerStarted","Data":"513324aac38cf3656d7fd454743d94c334ffde6545fc20787b755a89fd37b015"} Jul 15 23:48:05.817314 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:05.817259 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-864d4fbd66-qcwg9" event={"ID":"5376309f-1f18-4fe3-b175-97fa9abedc9c","Type":"ContainerStarted","Data":"8b5e90a29693c0fd811381b03df4ae5a196d010451e16f043c21c4a1a4cb2c00"} Jul 15 23:48:05.820392 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:05.819889 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d6db44d56-kftvw" podStartSLOduration=2.184864615 podStartE2EDuration="9.819877079s" totalImagesPullingTime="7.635012464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:47:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:48:05.819435884 +0000 UTC m=+77.050414632" watchObservedRunningTime="2026-07-15 23:48:05.819877079 +0000 UTC m=+77.050855804" Jul 15 23:48:05.823381 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:05.822108 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-597f796589-4tx26" event={"ID":"331d2302-c007-4a2e-a3aa-781bcb64ff9d","Type":"ContainerStarted","Data":"3058d378ab8fa24e4f601dc5cb218e310f49fc0e8a99e42c2a1d240927d6ee57"} Jul 15 23:48:05.823381 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:05.822748 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:48:05.826242 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:05.826221 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5f5546b47d-9whv9" event={"ID":"2b04f591-5391-4cd9-a495-a01bb0e49ce2","Type":"ContainerStarted","Data":"c2cc4b01a860689e2f991e8ecd36dd41248d9b759c43d81c9a119b3d3dca2c6f"} Jul 15 23:48:05.837650 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:05.836341 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-864d4fbd66-qcwg9" podStartSLOduration=2.229476481 podStartE2EDuration="9.836323585s" totalImagesPullingTime="7.606847104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:47:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:48:05.835738108 +0000 UTC m=+77.066716854" watchObservedRunningTime="2026-07-15 23:48:05.836323585 +0000 UTC m=+77.067302334" Jul 15 23:48:05.878142 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:05.876504 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pp4rq" podStartSLOduration=70.770646615 podStartE2EDuration="1m16.876484138s" totalImagesPullingTime="6.105837523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:46:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:48:05.856871315 +0000 UTC m=+77.087850065" watchObservedRunningTime="2026-07-15 23:48:05.876484138 +0000 UTC m=+77.107462886" Jul 15 23:48:05.891718 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:05.890080 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tgnmg" podStartSLOduration=66.559257518 podStartE2EDuration="1m15.890061126s" totalImagesPullingTime="9.330803608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:48:05.889897313 +0000 UTC m=+77.120876086" watchObservedRunningTime="2026-07-15 23:48:05.890061126 +0000 UTC m=+77.121039880" Jul 15 23:48:05.920139 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:05.916768 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5f5546b47d-9whv9" podStartSLOduration=72.916748169 podStartE2EDuration="1m12.916748169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:46:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:48:05.916386727 +0000 UTC m=+77.147365474" watchObservedRunningTime="2026-07-15 23:48:05.916748169 +0000 UTC m=+77.147726917" Jul 15 23:48:06.282458 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:06.282427 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:48:06.285753 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:06.285729 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:48:06.308283 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:06.308234 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-597f796589-4tx26" podStartSLOduration=76.308214088 podStartE2EDuration="1m16.308214088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:46:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:48:05.941183217 +0000 UTC m=+77.172161984" watchObservedRunningTime="2026-07-15 23:48:06.308214088 +0000 UTC m=+77.539192836" Jul 15 23:48:06.835883 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:06.835851 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:48:06.837649 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:06.837444 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5f5546b47d-9whv9" Jul 15 23:48:12.864460 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:12.864413 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-ftx8k" event={"ID":"b45a97fe-1c83-40e9-b190-8231a1b07291","Type":"ContainerStarted","Data":"404cdd095c267dd6609083a3e6a530d0a44fd6c25839a9dafe809e26a02ae46d"} Jul 15 23:48:12.866738 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:12.866705 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b4674d44-7txlv" event={"ID":"44805faf-16a8-4f10-9b51-ed693198fc3b","Type":"ContainerStarted","Data":"235a040f9825fce911db87437bbdbbbeb1d80c116d81b93b25edb37845800c46"} Jul 15 23:48:12.866862 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:12.866746 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b4674d44-7txlv" event={"ID":"44805faf-16a8-4f10-9b51-ed693198fc3b","Type":"ContainerStarted","Data":"5843cc923f60fdfcc9029e1401efb486105bda5208630140cdb35d2d2eb24500"} Jul 15 23:48:12.866862 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:12.866765 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b4674d44-7txlv" event={"ID":"44805faf-16a8-4f10-9b51-ed693198fc3b","Type":"ContainerStarted","Data":"72f64a6717e022715f7f4e90b8bcb0067724b99a333462c9403769d4fc07d9a5"} Jul 15 23:48:12.868458 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:12.868426 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z98bm" event={"ID":"b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b","Type":"ContainerStarted","Data":"578cdd52793ca456f7f82d01240578cc1a2c600cf900e7bcbd3592ff74954fa6"} Jul 15 23:48:12.870706 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:12.870660 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9xf75" event={"ID":"a98e13d5-bfc4-4f77-b7be-6926d366292e","Type":"ContainerStarted","Data":"ea3b468a5bbd9f8239ab881df14a9f35d093935db6844f2f5d3d722ee8ec908f"} Jul 15 23:48:12.872487 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:12.872459 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jwfwf" event={"ID":"d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9","Type":"ContainerStarted","Data":"031e5b4b927b664132a0a505d037d018a3f26580230b2dc9c78be8d45dd6b9c9"} Jul 15 23:48:12.872573 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:12.872498 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jwfwf" event={"ID":"d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9","Type":"ContainerStarted","Data":"ebdb70453542c4edaab66d60694f57d759fff18f4b29801732651160342b53e2"} Jul 15 23:48:12.872626 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:12.872598 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jwfwf" Jul 15 23:48:12.879256 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:12.879219 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-ftx8k" podStartSLOduration=43.038104948 podStartE2EDuration="49.879206094s" totalImagesPullingTime="6.841101146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:48:12.87809084 +0000 UTC m=+84.109069588" watchObservedRunningTime="2026-07-15 23:48:12.879206094 +0000 UTC m=+84.110184840" Jul 15 23:48:12.895785 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:12.895734 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b4674d44-7txlv" podStartSLOduration=7.53444229 podStartE2EDuration="16.895719899s" totalImagesPullingTime="9.361277609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:47:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:48:12.894738954 +0000 UTC m=+84.125717701" watchObservedRunningTime="2026-07-15 23:48:12.895719899 +0000 UTC m=+84.126698646" Jul 15 23:48:12.930327 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:12.930163 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jwfwf" podStartSLOduration=41.085842195 podStartE2EDuration="47.930145107s" totalImagesPullingTime="6.844302912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:48:12.929725146 +0000 UTC m=+84.160703897" watchObservedRunningTime="2026-07-15 23:48:12.930145107 +0000 UTC m=+84.161123856" Jul 15 23:48:12.930764 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:12.930719 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z98bm" podStartSLOduration=72.137932037 podStartE2EDuration="1m20.930704584s" totalImagesPullingTime="8.792772547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:48:12.914585551 +0000 UTC m=+84.145564298" watchObservedRunningTime="2026-07-15 23:48:12.930704584 +0000 UTC m=+84.161683332" Jul 15 23:48:12.947768 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:12.947719 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9xf75" podStartSLOduration=18.463053104 podStartE2EDuration="38.947702451s" totalImagesPullingTime="20.484649347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:47:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:48:12.945961083 +0000 UTC m=+84.176939832" watchObservedRunningTime="2026-07-15 23:48:12.947702451 +0000 UTC m=+84.178681199" Jul 15 23:48:17.236721 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:17.236661 2564 patch_prober.go:28] interesting pod/image-registry-597f796589-4tx26 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 15 23:48:17.237138 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:17.236751 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-597f796589-4tx26" podUID="331d2302-c007-4a2e-a3aa-781bcb64ff9d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 23:48:20.913744 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:20.913707 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-g2lfs" event={"ID":"1d5f05be-c572-4a00-baa7-09554f6124ec","Type":"ContainerStarted","Data":"6dfce96eec0a54398cca59cbcf87d14a9e13872b3ea89febd206b0bee9c8157e"} Jul 15 23:48:21.019615 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.019580 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kwg52"] Jul 15 23:48:21.032346 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.032321 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.034448 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.034425 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 15 23:48:21.034581 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.034558 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fvd28\"" Jul 15 23:48:21.034656 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.034576 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 15 23:48:21.035261 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.035241 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 15 23:48:21.035375 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.035277 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 15 23:48:21.123276 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.123244 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4f557024-5b84-41bf-8d9a-97309ab7bbd1-root\") pod \"node-exporter-kwg52\" (UID: \"4f557024-5b84-41bf-8d9a-97309ab7bbd1\") " pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.123483 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.123286 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f557024-5b84-41bf-8d9a-97309ab7bbd1-node-exporter-tls\") pod \"node-exporter-kwg52\" (UID: \"4f557024-5b84-41bf-8d9a-97309ab7bbd1\") " pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.123483 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.123312 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4f557024-5b84-41bf-8d9a-97309ab7bbd1-node-exporter-accelerators-collector-config\") pod \"node-exporter-kwg52\" (UID: \"4f557024-5b84-41bf-8d9a-97309ab7bbd1\") " pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.123483 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.123353 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f557024-5b84-41bf-8d9a-97309ab7bbd1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kwg52\" (UID: \"4f557024-5b84-41bf-8d9a-97309ab7bbd1\") " pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.123483 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.123375 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq5dw\" (UniqueName: \"kubernetes.io/projected/4f557024-5b84-41bf-8d9a-97309ab7bbd1-kube-api-access-cq5dw\") pod \"node-exporter-kwg52\" (UID: \"4f557024-5b84-41bf-8d9a-97309ab7bbd1\") " pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.123886 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.123486 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4f557024-5b84-41bf-8d9a-97309ab7bbd1-node-exporter-wtmp\") pod \"node-exporter-kwg52\" (UID: \"4f557024-5b84-41bf-8d9a-97309ab7bbd1\") " pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.123886 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.123536 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f557024-5b84-41bf-8d9a-97309ab7bbd1-sys\") pod \"node-exporter-kwg52\" (UID: \"4f557024-5b84-41bf-8d9a-97309ab7bbd1\") " pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.123886 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.123607 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4f557024-5b84-41bf-8d9a-97309ab7bbd1-node-exporter-textfile\") pod \"node-exporter-kwg52\" (UID: \"4f557024-5b84-41bf-8d9a-97309ab7bbd1\") " pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.123886 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.123648 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f557024-5b84-41bf-8d9a-97309ab7bbd1-metrics-client-ca\") pod \"node-exporter-kwg52\" (UID: \"4f557024-5b84-41bf-8d9a-97309ab7bbd1\") " pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.224622 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.224567 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4f557024-5b84-41bf-8d9a-97309ab7bbd1-node-exporter-wtmp\") pod \"node-exporter-kwg52\" (UID: \"4f557024-5b84-41bf-8d9a-97309ab7bbd1\") " pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.224809 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.224711 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f557024-5b84-41bf-8d9a-97309ab7bbd1-sys\") pod \"node-exporter-kwg52\" (UID: \"4f557024-5b84-41bf-8d9a-97309ab7bbd1\") " pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.224809 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.224747 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4f557024-5b84-41bf-8d9a-97309ab7bbd1-node-exporter-textfile\") pod \"node-exporter-kwg52\" (UID: \"4f557024-5b84-41bf-8d9a-97309ab7bbd1\") " pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.224809 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.224778 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4f557024-5b84-41bf-8d9a-97309ab7bbd1-node-exporter-wtmp\") pod \"node-exporter-kwg52\" (UID: \"4f557024-5b84-41bf-8d9a-97309ab7bbd1\") " pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.224809 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.224791 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f557024-5b84-41bf-8d9a-97309ab7bbd1-metrics-client-ca\") pod \"node-exporter-kwg52\" (UID: \"4f557024-5b84-41bf-8d9a-97309ab7bbd1\") " pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.224809 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.224803 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f557024-5b84-41bf-8d9a-97309ab7bbd1-sys\") pod \"node-exporter-kwg52\" (UID: \"4f557024-5b84-41bf-8d9a-97309ab7bbd1\") " pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.225059 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.224856 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4f557024-5b84-41bf-8d9a-97309ab7bbd1-root\") pod \"node-exporter-kwg52\" (UID: \"4f557024-5b84-41bf-8d9a-97309ab7bbd1\") " pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.225059 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.224881 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f557024-5b84-41bf-8d9a-97309ab7bbd1-node-exporter-tls\") pod \"node-exporter-kwg52\" (UID: \"4f557024-5b84-41bf-8d9a-97309ab7bbd1\") " pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.225059 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.224904 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4f557024-5b84-41bf-8d9a-97309ab7bbd1-node-exporter-accelerators-collector-config\") pod \"node-exporter-kwg52\" (UID: \"4f557024-5b84-41bf-8d9a-97309ab7bbd1\") " pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.225059 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.224944 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f557024-5b84-41bf-8d9a-97309ab7bbd1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kwg52\" (UID: \"4f557024-5b84-41bf-8d9a-97309ab7bbd1\") " pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.225059 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.224952 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4f557024-5b84-41bf-8d9a-97309ab7bbd1-root\") pod \"node-exporter-kwg52\" (UID: \"4f557024-5b84-41bf-8d9a-97309ab7bbd1\") " pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.225059 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.224975 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq5dw\" (UniqueName: \"kubernetes.io/projected/4f557024-5b84-41bf-8d9a-97309ab7bbd1-kube-api-access-cq5dw\") pod \"node-exporter-kwg52\" (UID: \"4f557024-5b84-41bf-8d9a-97309ab7bbd1\") " pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.225352 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.225282 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4f557024-5b84-41bf-8d9a-97309ab7bbd1-node-exporter-textfile\") pod \"node-exporter-kwg52\" (UID: \"4f557024-5b84-41bf-8d9a-97309ab7bbd1\") " pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.225409 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.225380 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4f557024-5b84-41bf-8d9a-97309ab7bbd1-node-exporter-accelerators-collector-config\") pod \"node-exporter-kwg52\" (UID: \"4f557024-5b84-41bf-8d9a-97309ab7bbd1\") " pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.225485 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.225462 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f557024-5b84-41bf-8d9a-97309ab7bbd1-metrics-client-ca\") pod \"node-exporter-kwg52\" (UID: \"4f557024-5b84-41bf-8d9a-97309ab7bbd1\") " pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.228271 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.228218 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f557024-5b84-41bf-8d9a-97309ab7bbd1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kwg52\" (UID: \"4f557024-5b84-41bf-8d9a-97309ab7bbd1\") " pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.228851 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.228808 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f557024-5b84-41bf-8d9a-97309ab7bbd1-node-exporter-tls\") pod \"node-exporter-kwg52\" (UID: \"4f557024-5b84-41bf-8d9a-97309ab7bbd1\") " pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.233910 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.233867 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq5dw\" (UniqueName: \"kubernetes.io/projected/4f557024-5b84-41bf-8d9a-97309ab7bbd1-kube-api-access-cq5dw\") pod \"node-exporter-kwg52\" (UID: \"4f557024-5b84-41bf-8d9a-97309ab7bbd1\") " pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.344920 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.344827 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kwg52" Jul 15 23:48:21.371538 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:48:21.371504 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f557024_5b84_41bf_8d9a_97309ab7bbd1.slice/crio-3cc352638daed8990003949b59a31edd7a4de5346eaa5902ed4491cba3135814 WatchSource:0}: Error finding container 3cc352638daed8990003949b59a31edd7a4de5346eaa5902ed4491cba3135814: Status 404 returned error can't find the container with id 3cc352638daed8990003949b59a31edd7a4de5346eaa5902ed4491cba3135814 Jul 15 23:48:21.920347 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.920304 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kwg52" event={"ID":"4f557024-5b84-41bf-8d9a-97309ab7bbd1","Type":"ContainerStarted","Data":"3cc352638daed8990003949b59a31edd7a4de5346eaa5902ed4491cba3135814"} Jul 15 23:48:21.920837 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.920569 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-g2lfs" Jul 15 23:48:21.934032 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.934006 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-g2lfs" Jul 15 23:48:21.943161 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:21.943108 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-g2lfs" podStartSLOduration=5.340646073 podStartE2EDuration="25.943088287s" totalImagesPullingTime="20.602442214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:47:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:48:21.940920436 +0000 UTC m=+93.171899184" watchObservedRunningTime="2026-07-15 23:48:21.943088287 +0000 UTC m=+93.174067048" Jul 15 23:48:22.882411 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:22.882372 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jwfwf" Jul 15 23:48:23.933140 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:23.933098 2564 generic.go:356] "Generic (PLEG): container finished" podID="4f557024-5b84-41bf-8d9a-97309ab7bbd1" containerID="e4ec864673769fdf092fb4d7c460d57dee4b7585d0cd965902f897059a4a8212" exitCode=0 Jul 15 23:48:23.934150 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:23.933264 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kwg52" event={"ID":"4f557024-5b84-41bf-8d9a-97309ab7bbd1","Type":"ContainerDied","Data":"e4ec864673769fdf092fb4d7c460d57dee4b7585d0cd965902f897059a4a8212"} Jul 15 23:48:24.497963 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:24.497930 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-597f796589-4tx26"] Jul 15 23:48:24.503133 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:24.503102 2564 patch_prober.go:28] interesting pod/image-registry-597f796589-4tx26 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 15 23:48:24.503296 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:24.503168 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-597f796589-4tx26" podUID="331d2302-c007-4a2e-a3aa-781bcb64ff9d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 23:48:24.941269 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:24.941183 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kwg52" event={"ID":"4f557024-5b84-41bf-8d9a-97309ab7bbd1","Type":"ContainerStarted","Data":"184e10943d1a8aeee10293043fee98295b5d6e16f775d150e26c4a257a9b887a"} Jul 15 23:48:24.941269 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:24.941255 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kwg52" event={"ID":"4f557024-5b84-41bf-8d9a-97309ab7bbd1","Type":"ContainerStarted","Data":"f13058d02e27d1a0c566d4fdcc89b59701fee8891120fc40471a4d087b0ace2e"} Jul 15 23:48:24.961143 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:24.961083 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kwg52" podStartSLOduration=3.028001868 podStartE2EDuration="4.961063089s" totalImagesPullingTime="1.818610346s" totalInitContainerRuntime="114.450875ms" isStatefulPod=true podCreationTimestamp="2026-07-15 23:48:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:48:24.95983397 +0000 UTC m=+96.190812740" watchObservedRunningTime="2026-07-15 23:48:24.961063089 +0000 UTC m=+96.192041837" Jul 15 23:48:26.745275 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:26.745237 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5pjjq" Jul 15 23:48:34.502680 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:34.502647 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:48:45.023839 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:45.023802 2564 generic.go:356] "Generic (PLEG): container finished" podID="11b45ddc-d3c9-4bc0-9ddc-3be34f33f0de" containerID="a55c9125c82572c804bc4d97a5bd65ea94f81aed08f51b3ed8253808680d56e7" exitCode=0 Jul 15 23:48:45.024231 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:45.023870 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7fm9v" event={"ID":"11b45ddc-d3c9-4bc0-9ddc-3be34f33f0de","Type":"ContainerDied","Data":"a55c9125c82572c804bc4d97a5bd65ea94f81aed08f51b3ed8253808680d56e7"} Jul 15 23:48:45.024231 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:45.024226 2564 scope.go:117] "RemoveContainer" containerID="a55c9125c82572c804bc4d97a5bd65ea94f81aed08f51b3ed8253808680d56e7" Jul 15 23:48:46.030280 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:46.030247 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7fm9v" event={"ID":"11b45ddc-d3c9-4bc0-9ddc-3be34f33f0de","Type":"ContainerStarted","Data":"0451cf9ea50b68afb7cf5e62cba83e5cce23bac1a1554a6119685365ddbca9cf"} Jul 15 23:48:49.522895 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:49.522826 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-597f796589-4tx26" podUID="331d2302-c007-4a2e-a3aa-781bcb64ff9d" containerName="registry" containerID="cri-o://3058d378ab8fa24e4f601dc5cb218e310f49fc0e8a99e42c2a1d240927d6ee57" gracePeriod=30 Jul 15 23:48:49.767328 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:49.767304 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:48:49.875811 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:49.875731 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/331d2302-c007-4a2e-a3aa-781bcb64ff9d-installation-pull-secrets\") pod \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " Jul 15 23:48:49.875811 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:49.875779 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-bound-sa-token\") pod \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " Jul 15 23:48:49.875811 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:49.875808 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfkk8\" (UniqueName: \"kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-kube-api-access-dfkk8\") pod \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " Jul 15 23:48:49.876077 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:49.875825 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/331d2302-c007-4a2e-a3aa-781bcb64ff9d-trusted-ca\") pod \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " Jul 15 23:48:49.876077 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:49.875848 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/331d2302-c007-4a2e-a3aa-781bcb64ff9d-ca-trust-extracted\") pod \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " Jul 15 23:48:49.876077 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:49.875877 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-tls\") pod \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " Jul 15 23:48:49.876077 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:49.875896 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/331d2302-c007-4a2e-a3aa-781bcb64ff9d-image-registry-private-configuration\") pod \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " Jul 15 23:48:49.876077 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:49.875959 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-certificates\") pod \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\" (UID: \"331d2302-c007-4a2e-a3aa-781bcb64ff9d\") " Jul 15 23:48:49.876450 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:49.876409 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/331d2302-c007-4a2e-a3aa-781bcb64ff9d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "331d2302-c007-4a2e-a3aa-781bcb64ff9d" (UID: "331d2302-c007-4a2e-a3aa-781bcb64ff9d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 23:48:49.876578 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:49.876554 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "331d2302-c007-4a2e-a3aa-781bcb64ff9d" (UID: "331d2302-c007-4a2e-a3aa-781bcb64ff9d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 23:48:49.878299 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:49.878268 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "331d2302-c007-4a2e-a3aa-781bcb64ff9d" (UID: "331d2302-c007-4a2e-a3aa-781bcb64ff9d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:48:49.878418 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:49.878392 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/331d2302-c007-4a2e-a3aa-781bcb64ff9d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "331d2302-c007-4a2e-a3aa-781bcb64ff9d" (UID: "331d2302-c007-4a2e-a3aa-781bcb64ff9d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 23:48:49.878475 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:49.878417 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-kube-api-access-dfkk8" (OuterVolumeSpecName: "kube-api-access-dfkk8") pod "331d2302-c007-4a2e-a3aa-781bcb64ff9d" (UID: "331d2302-c007-4a2e-a3aa-781bcb64ff9d"). InnerVolumeSpecName "kube-api-access-dfkk8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:48:49.878692 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:49.878652 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "331d2302-c007-4a2e-a3aa-781bcb64ff9d" (UID: "331d2302-c007-4a2e-a3aa-781bcb64ff9d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:48:49.878802 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:49.878702 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/331d2302-c007-4a2e-a3aa-781bcb64ff9d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "331d2302-c007-4a2e-a3aa-781bcb64ff9d" (UID: "331d2302-c007-4a2e-a3aa-781bcb64ff9d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 23:48:49.884451 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:49.884428 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/331d2302-c007-4a2e-a3aa-781bcb64ff9d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "331d2302-c007-4a2e-a3aa-781bcb64ff9d" (UID: "331d2302-c007-4a2e-a3aa-781bcb64ff9d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:48:49.976770 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:49.976745 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-certificates\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\"" Jul 15 23:48:49.976770 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:49.976767 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/331d2302-c007-4a2e-a3aa-781bcb64ff9d-installation-pull-secrets\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\"" Jul 15 23:48:49.976911 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:49.976777 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-bound-sa-token\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\"" Jul 15 23:48:49.976911 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:49.976785 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfkk8\" (UniqueName: \"kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-kube-api-access-dfkk8\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\"" Jul 15 23:48:49.976911 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:49.976794 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/331d2302-c007-4a2e-a3aa-781bcb64ff9d-trusted-ca\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\"" Jul 15 23:48:49.976911 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:49.976802 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/331d2302-c007-4a2e-a3aa-781bcb64ff9d-ca-trust-extracted\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\"" Jul 15 23:48:49.976911 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:49.976812 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/331d2302-c007-4a2e-a3aa-781bcb64ff9d-registry-tls\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\"" Jul 15 23:48:49.976911 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:49.976820 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/331d2302-c007-4a2e-a3aa-781bcb64ff9d-image-registry-private-configuration\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\"" Jul 15 23:48:50.050554 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:50.050523 2564 generic.go:356] "Generic (PLEG): container finished" podID="331d2302-c007-4a2e-a3aa-781bcb64ff9d" containerID="3058d378ab8fa24e4f601dc5cb218e310f49fc0e8a99e42c2a1d240927d6ee57" exitCode=0 Jul 15 23:48:50.050731 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:50.050567 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-597f796589-4tx26" Jul 15 23:48:50.050731 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:50.050618 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-597f796589-4tx26" event={"ID":"331d2302-c007-4a2e-a3aa-781bcb64ff9d","Type":"ContainerDied","Data":"3058d378ab8fa24e4f601dc5cb218e310f49fc0e8a99e42c2a1d240927d6ee57"} Jul 15 23:48:50.050731 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:50.050693 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-597f796589-4tx26" event={"ID":"331d2302-c007-4a2e-a3aa-781bcb64ff9d","Type":"ContainerDied","Data":"11e481112f95ae118c7c0f68b8f4b338a066e625a7d921894679be8f46e2b368"} Jul 15 23:48:50.050731 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:50.050722 2564 scope.go:117] "RemoveContainer" containerID="3058d378ab8fa24e4f601dc5cb218e310f49fc0e8a99e42c2a1d240927d6ee57" Jul 15 23:48:50.060067 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:50.060052 2564 scope.go:117] "RemoveContainer" containerID="3058d378ab8fa24e4f601dc5cb218e310f49fc0e8a99e42c2a1d240927d6ee57" Jul 15 23:48:50.060310 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:48:50.060291 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3058d378ab8fa24e4f601dc5cb218e310f49fc0e8a99e42c2a1d240927d6ee57\": container with ID starting with 3058d378ab8fa24e4f601dc5cb218e310f49fc0e8a99e42c2a1d240927d6ee57 not found: ID does not exist" containerID="3058d378ab8fa24e4f601dc5cb218e310f49fc0e8a99e42c2a1d240927d6ee57" Jul 15 23:48:50.060365 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:50.060319 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3058d378ab8fa24e4f601dc5cb218e310f49fc0e8a99e42c2a1d240927d6ee57"} err="failed to get container status \"3058d378ab8fa24e4f601dc5cb218e310f49fc0e8a99e42c2a1d240927d6ee57\": rpc error: code = NotFound desc = could not find container \"3058d378ab8fa24e4f601dc5cb218e310f49fc0e8a99e42c2a1d240927d6ee57\": container with ID starting with 3058d378ab8fa24e4f601dc5cb218e310f49fc0e8a99e42c2a1d240927d6ee57 not found: ID does not exist" Jul 15 23:48:50.075798 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:50.075775 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-597f796589-4tx26"] Jul 15 23:48:50.079208 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:50.079189 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-597f796589-4tx26"] Jul 15 23:48:51.300491 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:51.300458 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="331d2302-c007-4a2e-a3aa-781bcb64ff9d" path="/var/lib/kubelet/pods/331d2302-c007-4a2e-a3aa-781bcb64ff9d/volumes" Jul 15 23:48:54.067713 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:54.067659 2564 generic.go:356] "Generic (PLEG): container finished" podID="362c7d00-de2e-4c56-81f9-1088ce28347e" containerID="9921c7ad59d0afff5725a6d96472a9141636fcaa5a2a6979c8fba300350d2c51" exitCode=0 Jul 15 23:48:54.068036 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:54.067733 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jf8jd" event={"ID":"362c7d00-de2e-4c56-81f9-1088ce28347e","Type":"ContainerDied","Data":"9921c7ad59d0afff5725a6d96472a9141636fcaa5a2a6979c8fba300350d2c51"} Jul 15 23:48:54.068036 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:54.068033 2564 scope.go:117] "RemoveContainer" containerID="9921c7ad59d0afff5725a6d96472a9141636fcaa5a2a6979c8fba300350d2c51" Jul 15 23:48:55.073639 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:55.073603 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jf8jd" event={"ID":"362c7d00-de2e-4c56-81f9-1088ce28347e","Type":"ContainerStarted","Data":"6f2e2d3e426a000d4a4c3a72d9052d89a10d9c82e4ec327ca69509446100ac13"} Jul 15 23:48:59.090181 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:59.090140 2564 generic.go:356] "Generic (PLEG): container finished" podID="0bf55176-1282-44d4-9c63-345a50ab4d01" containerID="f2fbe3aa75c5c8f40dcf2ea53fd705d916bff737a1eae7f6c3c2555e77d53b41" exitCode=0 Jul 15 23:48:59.090547 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:59.090211 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-mkxvc" event={"ID":"0bf55176-1282-44d4-9c63-345a50ab4d01","Type":"ContainerDied","Data":"f2fbe3aa75c5c8f40dcf2ea53fd705d916bff737a1eae7f6c3c2555e77d53b41"} Jul 15 23:48:59.090590 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:59.090575 2564 scope.go:117] "RemoveContainer" containerID="f2fbe3aa75c5c8f40dcf2ea53fd705d916bff737a1eae7f6c3c2555e77d53b41" Jul 15 23:48:59.930196 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:59.930150 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f5546b47d-9whv9_2b04f591-5391-4cd9-a495-a01bb0e49ce2/router/0.log" Jul 15 23:48:59.935462 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:48:59.935440 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5l9w5_c8d25ea1-819e-46d2-854d-29b4be8e184f/serve-healthcheck-canary/0.log" Jul 15 23:49:00.096218 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:49:00.096189 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-mkxvc" event={"ID":"0bf55176-1282-44d4-9c63-345a50ab4d01","Type":"ContainerStarted","Data":"b2b16e850002d38e620e90a3045d3d33490dd0ed84edd10fa0f408db53a03b81"} Jul 15 23:51:48.874895 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:48.874857 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b4446c48-jw77t"] Jul 15 23:51:48.875291 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:48.875163 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="331d2302-c007-4a2e-a3aa-781bcb64ff9d" containerName="registry" Jul 15 23:51:48.875291 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:48.875175 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="331d2302-c007-4a2e-a3aa-781bcb64ff9d" containerName="registry" Jul 15 23:51:48.875291 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:48.875229 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="331d2302-c007-4a2e-a3aa-781bcb64ff9d" containerName="registry" Jul 15 23:51:48.877082 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:48.877066 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-jw77t" Jul 15 23:51:48.881361 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:48.881336 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 15 23:51:48.881764 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:48.881726 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 15 23:51:48.881865 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:48.881801 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 15 23:51:48.881865 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:48.881806 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 15 23:51:48.882145 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:48.882129 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-25q44\"" Jul 15 23:51:48.897238 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:48.897217 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b4446c48-jw77t"] Jul 15 23:51:48.975909 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:48.975868 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8d674d4-0a84-4d99-b2f9-3b35fdbe267e-tmp\") pod \"opendatahub-operator-controller-manager-7b4446c48-jw77t\" (UID: \"d8d674d4-0a84-4d99-b2f9-3b35fdbe267e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-jw77t" Jul 15 23:51:48.976064 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:48.975913 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d8d674d4-0a84-4d99-b2f9-3b35fdbe267e-manifests\") pod \"opendatahub-operator-controller-manager-7b4446c48-jw77t\" (UID: \"d8d674d4-0a84-4d99-b2f9-3b35fdbe267e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-jw77t" Jul 15 23:51:48.976064 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:48.975944 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhtqp\" (UniqueName: \"kubernetes.io/projected/d8d674d4-0a84-4d99-b2f9-3b35fdbe267e-kube-api-access-hhtqp\") pod \"opendatahub-operator-controller-manager-7b4446c48-jw77t\" (UID: \"d8d674d4-0a84-4d99-b2f9-3b35fdbe267e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-jw77t" Jul 15 23:51:48.976064 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:48.975965 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d8d674d4-0a84-4d99-b2f9-3b35fdbe267e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b4446c48-jw77t\" (UID: \"d8d674d4-0a84-4d99-b2f9-3b35fdbe267e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-jw77t" Jul 15 23:51:48.976064 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:48.975990 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8d674d4-0a84-4d99-b2f9-3b35fdbe267e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b4446c48-jw77t\" (UID: \"d8d674d4-0a84-4d99-b2f9-3b35fdbe267e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-jw77t" Jul 15 23:51:49.077314 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:49.077280 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhtqp\" (UniqueName: \"kubernetes.io/projected/d8d674d4-0a84-4d99-b2f9-3b35fdbe267e-kube-api-access-hhtqp\") pod \"opendatahub-operator-controller-manager-7b4446c48-jw77t\" (UID: \"d8d674d4-0a84-4d99-b2f9-3b35fdbe267e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-jw77t" Jul 15 23:51:49.077314 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:49.077314 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d8d674d4-0a84-4d99-b2f9-3b35fdbe267e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b4446c48-jw77t\" (UID: \"d8d674d4-0a84-4d99-b2f9-3b35fdbe267e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-jw77t" Jul 15 23:51:49.077545 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:49.077340 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8d674d4-0a84-4d99-b2f9-3b35fdbe267e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b4446c48-jw77t\" (UID: \"d8d674d4-0a84-4d99-b2f9-3b35fdbe267e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-jw77t" Jul 15 23:51:49.077545 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:49.077380 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8d674d4-0a84-4d99-b2f9-3b35fdbe267e-tmp\") pod \"opendatahub-operator-controller-manager-7b4446c48-jw77t\" (UID: \"d8d674d4-0a84-4d99-b2f9-3b35fdbe267e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-jw77t" Jul 15 23:51:49.077545 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:49.077398 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d8d674d4-0a84-4d99-b2f9-3b35fdbe267e-manifests\") pod \"opendatahub-operator-controller-manager-7b4446c48-jw77t\" (UID: \"d8d674d4-0a84-4d99-b2f9-3b35fdbe267e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-jw77t" Jul 15 23:51:49.077877 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:49.077845 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d8d674d4-0a84-4d99-b2f9-3b35fdbe267e-manifests\") pod \"opendatahub-operator-controller-manager-7b4446c48-jw77t\" (UID: \"d8d674d4-0a84-4d99-b2f9-3b35fdbe267e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-jw77t" Jul 15 23:51:49.079589 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:49.079567 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8d674d4-0a84-4d99-b2f9-3b35fdbe267e-tmp\") pod \"opendatahub-operator-controller-manager-7b4446c48-jw77t\" (UID: \"d8d674d4-0a84-4d99-b2f9-3b35fdbe267e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-jw77t" Jul 15 23:51:49.079824 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:49.079806 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d8d674d4-0a84-4d99-b2f9-3b35fdbe267e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b4446c48-jw77t\" (UID: \"d8d674d4-0a84-4d99-b2f9-3b35fdbe267e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-jw77t" Jul 15 23:51:49.079968 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:49.079948 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8d674d4-0a84-4d99-b2f9-3b35fdbe267e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b4446c48-jw77t\" (UID: \"d8d674d4-0a84-4d99-b2f9-3b35fdbe267e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-jw77t" Jul 15 23:51:49.084525 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:49.084500 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhtqp\" (UniqueName: \"kubernetes.io/projected/d8d674d4-0a84-4d99-b2f9-3b35fdbe267e-kube-api-access-hhtqp\") pod \"opendatahub-operator-controller-manager-7b4446c48-jw77t\" (UID: \"d8d674d4-0a84-4d99-b2f9-3b35fdbe267e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-jw77t" Jul 15 23:51:49.191413 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:49.191332 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-25q44\"" Jul 15 23:51:49.194799 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:49.194778 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-7g2gx_0f1c9d30-fe51-493e-9b47-84d63b56fa8f/console-operator/1.log" Jul 15 23:51:49.198703 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:49.198678 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-7g2gx_0f1c9d30-fe51-493e-9b47-84d63b56fa8f/console-operator/1.log" Jul 15 23:51:49.199126 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:49.199107 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-jw77t" Jul 15 23:51:49.202326 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:49.202302 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fp65r_d05a6a90-8e18-4a88-b6b9-b3a3712ffe07/ovn-acl-logging/0.log" Jul 15 23:51:49.207030 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:49.207011 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fp65r_d05a6a90-8e18-4a88-b6b9-b3a3712ffe07/ovn-acl-logging/0.log" Jul 15 23:51:49.207464 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:49.207447 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 15 23:51:49.338720 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:49.338689 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b4446c48-jw77t"] Jul 15 23:51:49.342558 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:51:49.342529 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8d674d4_0a84_4d99_b2f9_3b35fdbe267e.slice/crio-5a486d185cda1fd88f7af48dbe033678ea9217e1cc5afeb3e2da185f52065e57 WatchSource:0}: Error finding container 5a486d185cda1fd88f7af48dbe033678ea9217e1cc5afeb3e2da185f52065e57: Status 404 returned error can't find the container with id 5a486d185cda1fd88f7af48dbe033678ea9217e1cc5afeb3e2da185f52065e57 Jul 15 23:51:49.746536 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:49.746499 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-jw77t" event={"ID":"d8d674d4-0a84-4d99-b2f9-3b35fdbe267e","Type":"ContainerStarted","Data":"5a486d185cda1fd88f7af48dbe033678ea9217e1cc5afeb3e2da185f52065e57"} Jul 15 23:51:52.761070 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:52.761038 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-jw77t" event={"ID":"d8d674d4-0a84-4d99-b2f9-3b35fdbe267e","Type":"ContainerStarted","Data":"67ff770eccfe038e7f472640bd8767f930ba4e8bcb25da5131fd6f91ac44ba28"} Jul 15 23:51:53.766758 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:53.766718 2564 generic.go:356] "Generic (PLEG): container finished" podID="d8d674d4-0a84-4d99-b2f9-3b35fdbe267e" containerID="67ff770eccfe038e7f472640bd8767f930ba4e8bcb25da5131fd6f91ac44ba28" exitCode=0 Jul 15 23:51:53.767127 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:53.766806 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-jw77t" event={"ID":"d8d674d4-0a84-4d99-b2f9-3b35fdbe267e","Type":"ContainerDied","Data":"67ff770eccfe038e7f472640bd8767f930ba4e8bcb25da5131fd6f91ac44ba28"} Jul 15 23:51:53.767304 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:53.767289 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 23:51:54.772580 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:54.772545 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-jw77t" event={"ID":"d8d674d4-0a84-4d99-b2f9-3b35fdbe267e","Type":"ContainerStarted","Data":"40b6189ddfb7b54f0e2607d886998af546c5977f27b754e55d05ec09b5a6666d"} Jul 15 23:51:54.773063 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:54.772619 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-jw77t" Jul 15 23:51:54.793207 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:51:54.793153 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-jw77t" podStartSLOduration=2.473638518 podStartE2EDuration="6.793138496s" totalImagesPullingTime="3.248003091s" totalInitContainerRuntime="1.071496887s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:51:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:51:54.79177846 +0000 UTC m=+306.022757225" watchObservedRunningTime="2026-07-15 23:51:54.793138496 +0000 UTC m=+306.024117291" Jul 15 23:52:05.779367 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:05.779339 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-jw77t" Jul 15 23:52:16.893816 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:16.893782 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-755cb7796d-smzfz"] Jul 15 23:52:16.897082 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:16.897067 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-755cb7796d-smzfz" Jul 15 23:52:16.901841 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:16.901819 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 15 23:52:16.901963 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:16.901917 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 15 23:52:16.902850 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:16.902824 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 15 23:52:16.902968 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:16.902829 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rvx4t\"" Jul 15 23:52:16.902968 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:16.902827 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 15 23:52:16.903464 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:16.903216 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 15 23:52:16.909842 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:16.909821 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-755cb7796d-smzfz"] Jul 15 23:52:17.003723 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:17.003692 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a06d7772-d04b-4522-9697-246fb9c2a380-cert\") pod \"lws-controller-manager-755cb7796d-smzfz\" (UID: \"a06d7772-d04b-4522-9697-246fb9c2a380\") " pod="openshift-lws-operator/lws-controller-manager-755cb7796d-smzfz" Jul 15 23:52:17.003874 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:17.003732 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a06d7772-d04b-4522-9697-246fb9c2a380-metrics-cert\") pod \"lws-controller-manager-755cb7796d-smzfz\" (UID: \"a06d7772-d04b-4522-9697-246fb9c2a380\") " pod="openshift-lws-operator/lws-controller-manager-755cb7796d-smzfz" Jul 15 23:52:17.003874 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:17.003838 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbjjx\" (UniqueName: \"kubernetes.io/projected/a06d7772-d04b-4522-9697-246fb9c2a380-kube-api-access-qbjjx\") pod \"lws-controller-manager-755cb7796d-smzfz\" (UID: \"a06d7772-d04b-4522-9697-246fb9c2a380\") " pod="openshift-lws-operator/lws-controller-manager-755cb7796d-smzfz" Jul 15 23:52:17.003954 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:17.003882 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a06d7772-d04b-4522-9697-246fb9c2a380-manager-config\") pod \"lws-controller-manager-755cb7796d-smzfz\" (UID: \"a06d7772-d04b-4522-9697-246fb9c2a380\") " pod="openshift-lws-operator/lws-controller-manager-755cb7796d-smzfz" Jul 15 23:52:17.105185 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:17.105147 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a06d7772-d04b-4522-9697-246fb9c2a380-cert\") pod \"lws-controller-manager-755cb7796d-smzfz\" (UID: \"a06d7772-d04b-4522-9697-246fb9c2a380\") " pod="openshift-lws-operator/lws-controller-manager-755cb7796d-smzfz" Jul 15 23:52:17.105344 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:17.105204 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a06d7772-d04b-4522-9697-246fb9c2a380-metrics-cert\") pod \"lws-controller-manager-755cb7796d-smzfz\" (UID: \"a06d7772-d04b-4522-9697-246fb9c2a380\") " pod="openshift-lws-operator/lws-controller-manager-755cb7796d-smzfz" Jul 15 23:52:17.105344 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:17.105280 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbjjx\" (UniqueName: \"kubernetes.io/projected/a06d7772-d04b-4522-9697-246fb9c2a380-kube-api-access-qbjjx\") pod \"lws-controller-manager-755cb7796d-smzfz\" (UID: \"a06d7772-d04b-4522-9697-246fb9c2a380\") " pod="openshift-lws-operator/lws-controller-manager-755cb7796d-smzfz" Jul 15 23:52:17.105344 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:17.105308 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a06d7772-d04b-4522-9697-246fb9c2a380-manager-config\") pod \"lws-controller-manager-755cb7796d-smzfz\" (UID: \"a06d7772-d04b-4522-9697-246fb9c2a380\") " pod="openshift-lws-operator/lws-controller-manager-755cb7796d-smzfz" Jul 15 23:52:17.106296 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:17.106260 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a06d7772-d04b-4522-9697-246fb9c2a380-manager-config\") pod \"lws-controller-manager-755cb7796d-smzfz\" (UID: \"a06d7772-d04b-4522-9697-246fb9c2a380\") " pod="openshift-lws-operator/lws-controller-manager-755cb7796d-smzfz" Jul 15 23:52:17.107700 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:17.107649 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a06d7772-d04b-4522-9697-246fb9c2a380-metrics-cert\") pod \"lws-controller-manager-755cb7796d-smzfz\" (UID: \"a06d7772-d04b-4522-9697-246fb9c2a380\") " pod="openshift-lws-operator/lws-controller-manager-755cb7796d-smzfz" Jul 15 23:52:17.107820 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:17.107781 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a06d7772-d04b-4522-9697-246fb9c2a380-cert\") pod \"lws-controller-manager-755cb7796d-smzfz\" (UID: \"a06d7772-d04b-4522-9697-246fb9c2a380\") " pod="openshift-lws-operator/lws-controller-manager-755cb7796d-smzfz" Jul 15 23:52:17.113969 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:17.113939 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbjjx\" (UniqueName: \"kubernetes.io/projected/a06d7772-d04b-4522-9697-246fb9c2a380-kube-api-access-qbjjx\") pod \"lws-controller-manager-755cb7796d-smzfz\" (UID: \"a06d7772-d04b-4522-9697-246fb9c2a380\") " pod="openshift-lws-operator/lws-controller-manager-755cb7796d-smzfz" Jul 15 23:52:17.206059 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:17.206022 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-755cb7796d-smzfz" Jul 15 23:52:17.348843 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:17.348818 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-755cb7796d-smzfz"] Jul 15 23:52:17.350626 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:52:17.350586 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda06d7772_d04b_4522_9697_246fb9c2a380.slice/crio-8b49c9dcf368be0fb45d34d43df496ce5d284859489790f44e6a5c2e28d5b1ef WatchSource:0}: Error finding container 8b49c9dcf368be0fb45d34d43df496ce5d284859489790f44e6a5c2e28d5b1ef: Status 404 returned error can't find the container with id 8b49c9dcf368be0fb45d34d43df496ce5d284859489790f44e6a5c2e28d5b1ef Jul 15 23:52:17.872112 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:17.872069 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-755cb7796d-smzfz" event={"ID":"a06d7772-d04b-4522-9697-246fb9c2a380","Type":"ContainerStarted","Data":"8b49c9dcf368be0fb45d34d43df496ce5d284859489790f44e6a5c2e28d5b1ef"} Jul 15 23:52:20.887821 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:20.887782 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-755cb7796d-smzfz" event={"ID":"a06d7772-d04b-4522-9697-246fb9c2a380","Type":"ContainerStarted","Data":"3c3b8d10ad9f22223a1e0195a45d6218acdd4f6c1e144cae977062b8415f623a"} Jul 15 23:52:20.888207 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:20.887853 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-755cb7796d-smzfz" Jul 15 23:52:20.920571 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:20.920524 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-755cb7796d-smzfz" podStartSLOduration=2.367825429 podStartE2EDuration="4.920507242s" totalImagesPullingTime="2.552681813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:52:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:52:20.917987024 +0000 UTC m=+332.148965790" watchObservedRunningTime="2026-07-15 23:52:20.920507242 +0000 UTC m=+332.151485990" Jul 15 23:52:31.894082 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:52:31.894048 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-755cb7796d-smzfz" Jul 15 23:53:47.480620 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:47.480582 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kd5cr"] Jul 15 23:53:47.487619 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:47.487589 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kd5cr" Jul 15 23:53:47.490332 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:47.490310 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 23:53:47.490459 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:47.490310 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 15 23:53:47.491080 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:47.491066 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 23:53:47.491134 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:47.491069 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-8p5n6\"" Jul 15 23:53:47.497566 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:47.497547 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kd5cr"] Jul 15 23:53:47.634065 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:47.634028 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26fbv\" (UniqueName: \"kubernetes.io/projected/69aaaa06-afd3-444a-9cc0-7bdf5ecb8a1c-kube-api-access-26fbv\") pod \"dns-operator-controller-manager-864dd78c4c-kd5cr\" (UID: \"69aaaa06-afd3-444a-9cc0-7bdf5ecb8a1c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kd5cr" Jul 15 23:53:47.734549 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:47.734463 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26fbv\" (UniqueName: \"kubernetes.io/projected/69aaaa06-afd3-444a-9cc0-7bdf5ecb8a1c-kube-api-access-26fbv\") pod \"dns-operator-controller-manager-864dd78c4c-kd5cr\" (UID: \"69aaaa06-afd3-444a-9cc0-7bdf5ecb8a1c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kd5cr" Jul 15 23:53:47.747517 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:47.747488 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26fbv\" (UniqueName: \"kubernetes.io/projected/69aaaa06-afd3-444a-9cc0-7bdf5ecb8a1c-kube-api-access-26fbv\") pod \"dns-operator-controller-manager-864dd78c4c-kd5cr\" (UID: \"69aaaa06-afd3-444a-9cc0-7bdf5ecb8a1c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kd5cr" Jul 15 23:53:47.797954 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:47.797928 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kd5cr" Jul 15 23:53:47.929681 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:47.929637 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kd5cr"] Jul 15 23:53:47.932407 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:53:47.932375 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69aaaa06_afd3_444a_9cc0_7bdf5ecb8a1c.slice/crio-6a504c1c28298dcdd1d86947e93e1a5239c0d2015097b4535d864ace6d207115 WatchSource:0}: Error finding container 6a504c1c28298dcdd1d86947e93e1a5239c0d2015097b4535d864ace6d207115: Status 404 returned error can't find the container with id 6a504c1c28298dcdd1d86947e93e1a5239c0d2015097b4535d864ace6d207115 Jul 15 23:53:48.258324 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:48.258290 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kd5cr" event={"ID":"69aaaa06-afd3-444a-9cc0-7bdf5ecb8a1c","Type":"ContainerStarted","Data":"6a504c1c28298dcdd1d86947e93e1a5239c0d2015097b4535d864ace6d207115"} Jul 15 23:53:49.485410 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:49.485371 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-79md6"] Jul 15 23:53:49.488938 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:49.488912 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-79md6" Jul 15 23:53:49.491322 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:49.491303 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-hzmvr\"" Jul 15 23:53:49.497344 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:49.497060 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-79md6"] Jul 15 23:53:49.651019 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:49.650975 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6599j\" (UniqueName: \"kubernetes.io/projected/cd77e444-f48f-4b4a-8527-fe3057cb786d-kube-api-access-6599j\") pod \"limitador-operator-controller-manager-859d7b78bd-79md6\" (UID: \"cd77e444-f48f-4b4a-8527-fe3057cb786d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-79md6" Jul 15 23:53:49.752311 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:49.752223 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6599j\" (UniqueName: \"kubernetes.io/projected/cd77e444-f48f-4b4a-8527-fe3057cb786d-kube-api-access-6599j\") pod \"limitador-operator-controller-manager-859d7b78bd-79md6\" (UID: \"cd77e444-f48f-4b4a-8527-fe3057cb786d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-79md6" Jul 15 23:53:49.760759 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:49.760732 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6599j\" (UniqueName: \"kubernetes.io/projected/cd77e444-f48f-4b4a-8527-fe3057cb786d-kube-api-access-6599j\") pod \"limitador-operator-controller-manager-859d7b78bd-79md6\" (UID: \"cd77e444-f48f-4b4a-8527-fe3057cb786d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-79md6" Jul 15 23:53:49.802093 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:49.802052 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-79md6" Jul 15 23:53:50.078215 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:50.078189 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 15 23:53:50.162645 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:50.162618 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-79md6"] Jul 15 23:53:50.165888 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:53:50.165864 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd77e444_f48f_4b4a_8527_fe3057cb786d.slice/crio-11494b9b44f37c3f357dbfffde2fad64a90cf330dc8084f72dcad79e1ed1f453 WatchSource:0}: Error finding container 11494b9b44f37c3f357dbfffde2fad64a90cf330dc8084f72dcad79e1ed1f453: Status 404 returned error can't find the container with id 11494b9b44f37c3f357dbfffde2fad64a90cf330dc8084f72dcad79e1ed1f453 Jul 15 23:53:50.270081 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:50.270049 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-79md6" event={"ID":"cd77e444-f48f-4b4a-8527-fe3057cb786d","Type":"ContainerStarted","Data":"11494b9b44f37c3f357dbfffde2fad64a90cf330dc8084f72dcad79e1ed1f453"} Jul 15 23:53:50.271442 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:50.271417 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kd5cr" event={"ID":"69aaaa06-afd3-444a-9cc0-7bdf5ecb8a1c","Type":"ContainerStarted","Data":"fbe4f0c946a6d4f2e0f358e0774cbce3979c4604ec1b6cd72b59b713aee71fc2"} Jul 15 23:53:50.271569 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:50.271537 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kd5cr" Jul 15 23:53:50.287407 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:50.287316 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kd5cr" podStartSLOduration=1.14639511 podStartE2EDuration="3.287302541s" totalImagesPullingTime="2.140907431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:53:50.286802305 +0000 UTC m=+421.517781109" watchObservedRunningTime="2026-07-15 23:53:50.287302541 +0000 UTC m=+421.518281288" Jul 15 23:53:52.284143 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:52.284107 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-79md6" event={"ID":"cd77e444-f48f-4b4a-8527-fe3057cb786d","Type":"ContainerStarted","Data":"97100eb46bfb04e726ebb4145e3e2690aff741c5a2c0e99435ebe1d203b91293"} Jul 15 23:53:52.284515 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:52.284241 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-79md6" Jul 15 23:53:52.300759 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:53:52.300710 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-79md6" podStartSLOduration=1.363298927 podStartE2EDuration="3.300695466s" totalImagesPullingTime="1.937396539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:53:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:53:52.299275199 +0000 UTC m=+423.530253976" watchObservedRunningTime="2026-07-15 23:53:52.300695466 +0000 UTC m=+423.531674289" Jul 15 23:54:01.282269 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:01.282235 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kd5cr" Jul 15 23:54:02.796948 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:02.796906 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-79md6"] Jul 15 23:54:02.797423 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:02.797128 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-79md6" podUID="cd77e444-f48f-4b4a-8527-fe3057cb786d" containerName="manager" containerID="cri-o://97100eb46bfb04e726ebb4145e3e2690aff741c5a2c0e99435ebe1d203b91293" gracePeriod=2 Jul 15 23:54:02.799024 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:02.798998 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-79md6" Jul 15 23:54:02.815265 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:02.815240 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-79md6"] Jul 15 23:54:02.815652 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:54:02.815627 2564 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"cd77e444-f48f-4b4a-8527-fe3057cb786d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-79md6\": pods \"limitador-operator-controller-manager-859d7b78bd-79md6\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-79md6" Jul 15 23:54:02.818926 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:54:02.818895 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-79md6\" is forbidden: User \"system:node:ip-10-0-142-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-228.ec2.internal' and this object" podUID="cd77e444-f48f-4b4a-8527-fe3057cb786d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-79md6" Jul 15 23:54:02.825206 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:02.825184 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sj7s8"] Jul 15 23:54:02.825489 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:02.825478 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd77e444-f48f-4b4a-8527-fe3057cb786d" containerName="manager" Jul 15 23:54:02.825529 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:02.825491 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd77e444-f48f-4b4a-8527-fe3057cb786d" containerName="manager" Jul 15 23:54:02.825562 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:02.825556 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd77e444-f48f-4b4a-8527-fe3057cb786d" containerName="manager" Jul 15 23:54:02.828346 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:02.828330 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sj7s8" Jul 15 23:54:02.830546 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:54:02.830518 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-79md6\" is forbidden: User \"system:node:ip-10-0-142-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-228.ec2.internal' and this object" podUID="cd77e444-f48f-4b4a-8527-fe3057cb786d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-79md6" Jul 15 23:54:02.838650 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:02.838619 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sj7s8"] Jul 15 23:54:02.847204 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:02.847185 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k7tz\" (UniqueName: \"kubernetes.io/projected/053d1151-2c03-4261-a22b-15b797461db4-kube-api-access-4k7tz\") pod \"limitador-operator-controller-manager-859d7b78bd-sj7s8\" (UID: \"053d1151-2c03-4261-a22b-15b797461db4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sj7s8" Jul 15 23:54:02.948293 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:02.948259 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k7tz\" (UniqueName: \"kubernetes.io/projected/053d1151-2c03-4261-a22b-15b797461db4-kube-api-access-4k7tz\") pod \"limitador-operator-controller-manager-859d7b78bd-sj7s8\" (UID: \"053d1151-2c03-4261-a22b-15b797461db4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sj7s8" Jul 15 23:54:02.964236 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:02.964209 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k7tz\" (UniqueName: \"kubernetes.io/projected/053d1151-2c03-4261-a22b-15b797461db4-kube-api-access-4k7tz\") pod \"limitador-operator-controller-manager-859d7b78bd-sj7s8\" (UID: \"053d1151-2c03-4261-a22b-15b797461db4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sj7s8" Jul 15 23:54:03.042656 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:03.042633 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-79md6" Jul 15 23:54:03.045105 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:54:03.045080 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-79md6\" is forbidden: User \"system:node:ip-10-0-142-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-228.ec2.internal' and this object" podUID="cd77e444-f48f-4b4a-8527-fe3057cb786d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-79md6" Jul 15 23:54:03.049392 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:03.049342 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6599j\" (UniqueName: \"kubernetes.io/projected/cd77e444-f48f-4b4a-8527-fe3057cb786d-kube-api-access-6599j\") pod \"cd77e444-f48f-4b4a-8527-fe3057cb786d\" (UID: \"cd77e444-f48f-4b4a-8527-fe3057cb786d\") " Jul 15 23:54:03.051212 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:03.051182 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd77e444-f48f-4b4a-8527-fe3057cb786d-kube-api-access-6599j" (OuterVolumeSpecName: "kube-api-access-6599j") pod "cd77e444-f48f-4b4a-8527-fe3057cb786d" (UID: "cd77e444-f48f-4b4a-8527-fe3057cb786d"). InnerVolumeSpecName "kube-api-access-6599j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:54:03.150033 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:03.149996 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6599j\" (UniqueName: \"kubernetes.io/projected/cd77e444-f48f-4b4a-8527-fe3057cb786d-kube-api-access-6599j\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\"" Jul 15 23:54:03.173111 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:03.173071 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sj7s8" Jul 15 23:54:03.301653 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:03.301560 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd77e444-f48f-4b4a-8527-fe3057cb786d" path="/var/lib/kubelet/pods/cd77e444-f48f-4b4a-8527-fe3057cb786d/volumes" Jul 15 23:54:03.303230 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:03.303157 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sj7s8"] Jul 15 23:54:03.306247 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:54:03.306223 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod053d1151_2c03_4261_a22b_15b797461db4.slice/crio-edfb69b366b4919833089ad5f21ae0d51406f2da2a55aa5bbb922032fbeb7e0d WatchSource:0}: Error finding container edfb69b366b4919833089ad5f21ae0d51406f2da2a55aa5bbb922032fbeb7e0d: Status 404 returned error can't find the container with id edfb69b366b4919833089ad5f21ae0d51406f2da2a55aa5bbb922032fbeb7e0d Jul 15 23:54:03.331771 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:03.331748 2564 generic.go:356] "Generic (PLEG): container finished" podID="cd77e444-f48f-4b4a-8527-fe3057cb786d" containerID="97100eb46bfb04e726ebb4145e3e2690aff741c5a2c0e99435ebe1d203b91293" exitCode=0 Jul 15 23:54:03.331847 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:03.331792 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-79md6" Jul 15 23:54:03.331847 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:03.331818 2564 scope.go:117] "RemoveContainer" containerID="97100eb46bfb04e726ebb4145e3e2690aff741c5a2c0e99435ebe1d203b91293" Jul 15 23:54:03.333082 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:03.333062 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sj7s8" event={"ID":"053d1151-2c03-4261-a22b-15b797461db4","Type":"ContainerStarted","Data":"edfb69b366b4919833089ad5f21ae0d51406f2da2a55aa5bbb922032fbeb7e0d"} Jul 15 23:54:03.346042 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:03.346008 2564 scope.go:117] "RemoveContainer" containerID="97100eb46bfb04e726ebb4145e3e2690aff741c5a2c0e99435ebe1d203b91293" Jul 15 23:54:03.346329 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:54:03.346308 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97100eb46bfb04e726ebb4145e3e2690aff741c5a2c0e99435ebe1d203b91293\": container with ID starting with 97100eb46bfb04e726ebb4145e3e2690aff741c5a2c0e99435ebe1d203b91293 not found: ID does not exist" containerID="97100eb46bfb04e726ebb4145e3e2690aff741c5a2c0e99435ebe1d203b91293" Jul 15 23:54:03.346411 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:03.346339 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97100eb46bfb04e726ebb4145e3e2690aff741c5a2c0e99435ebe1d203b91293"} err="failed to get container status \"97100eb46bfb04e726ebb4145e3e2690aff741c5a2c0e99435ebe1d203b91293\": rpc error: code = NotFound desc = could not find container \"97100eb46bfb04e726ebb4145e3e2690aff741c5a2c0e99435ebe1d203b91293\": container with ID starting with 97100eb46bfb04e726ebb4145e3e2690aff741c5a2c0e99435ebe1d203b91293 not found: ID does not exist" Jul 15 23:54:04.338494 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:04.338459 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sj7s8" event={"ID":"053d1151-2c03-4261-a22b-15b797461db4","Type":"ContainerStarted","Data":"a478f24efecad0120538f474c3cef5a4947f4524c6952d30a1fabe2eef505ce5"} Jul 15 23:54:04.338923 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:04.338554 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sj7s8" Jul 15 23:54:04.353140 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:04.353096 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sj7s8" podStartSLOduration=2.353081637 podStartE2EDuration="2.353081637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:54:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:54:04.351860469 +0000 UTC m=+435.582839235" watchObservedRunningTime="2026-07-15 23:54:04.353081637 +0000 UTC m=+435.584060383" Jul 15 23:54:15.346489 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:15.346410 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sj7s8" Jul 15 23:54:46.613488 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:46.613450 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 15 23:54:46.617155 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:46.617133 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-h8cvd" Jul 15 23:54:46.619357 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:46.619336 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 15 23:54:46.619528 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:46.619510 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-drrn9\"" Jul 15 23:54:46.625005 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:46.624984 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 15 23:54:46.650144 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:46.650116 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 15 23:54:46.710076 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:46.710049 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/714ad55c-8990-4b05-851a-752186a5fe3e-config-file\") pod \"limitador-limitador-54d6d988d5-h8cvd\" (UID: \"714ad55c-8990-4b05-851a-752186a5fe3e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h8cvd" Jul 15 23:54:46.710196 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:46.710085 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltqv2\" (UniqueName: \"kubernetes.io/projected/714ad55c-8990-4b05-851a-752186a5fe3e-kube-api-access-ltqv2\") pod \"limitador-limitador-54d6d988d5-h8cvd\" (UID: \"714ad55c-8990-4b05-851a-752186a5fe3e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h8cvd" Jul 15 23:54:46.810431 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:46.810403 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/714ad55c-8990-4b05-851a-752186a5fe3e-config-file\") pod \"limitador-limitador-54d6d988d5-h8cvd\" (UID: \"714ad55c-8990-4b05-851a-752186a5fe3e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h8cvd" Jul 15 23:54:46.810558 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:46.810438 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltqv2\" (UniqueName: \"kubernetes.io/projected/714ad55c-8990-4b05-851a-752186a5fe3e-kube-api-access-ltqv2\") pod \"limitador-limitador-54d6d988d5-h8cvd\" (UID: \"714ad55c-8990-4b05-851a-752186a5fe3e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h8cvd" Jul 15 23:54:46.811149 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:46.811130 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/714ad55c-8990-4b05-851a-752186a5fe3e-config-file\") pod \"limitador-limitador-54d6d988d5-h8cvd\" (UID: \"714ad55c-8990-4b05-851a-752186a5fe3e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h8cvd" Jul 15 23:54:46.820293 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:46.820262 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltqv2\" (UniqueName: \"kubernetes.io/projected/714ad55c-8990-4b05-851a-752186a5fe3e-kube-api-access-ltqv2\") pod \"limitador-limitador-54d6d988d5-h8cvd\" (UID: \"714ad55c-8990-4b05-851a-752186a5fe3e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h8cvd" Jul 15 23:54:46.928363 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:46.928291 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-h8cvd" Jul 15 23:54:47.054815 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:47.054791 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 15 23:54:47.057059 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:54:47.057035 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod714ad55c_8990_4b05_851a_752186a5fe3e.slice/crio-5c9afc40d415da4f54b29ca7ce9e91d0298a661658f5109574127eb13d720b5d WatchSource:0}: Error finding container 5c9afc40d415da4f54b29ca7ce9e91d0298a661658f5109574127eb13d720b5d: Status 404 returned error can't find the container with id 5c9afc40d415da4f54b29ca7ce9e91d0298a661658f5109574127eb13d720b5d Jul 15 23:54:47.523995 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:47.523940 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-h8cvd" event={"ID":"714ad55c-8990-4b05-851a-752186a5fe3e","Type":"ContainerStarted","Data":"5c9afc40d415da4f54b29ca7ce9e91d0298a661658f5109574127eb13d720b5d"} Jul 15 23:54:49.534387 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:49.534355 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-h8cvd" event={"ID":"714ad55c-8990-4b05-851a-752186a5fe3e","Type":"ContainerStarted","Data":"9a798b2b9b60b6e30e85b09eb6aaa3b81518b3ef791d9e530375b9665ee76d4b"} Jul 15 23:54:49.534786 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:49.534437 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-h8cvd" Jul 15 23:54:49.551043 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:54:49.551000 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-h8cvd" podStartSLOduration=1.16911932 podStartE2EDuration="3.550985201s" totalImagesPullingTime="2.381865881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:54:49.54947879 +0000 UTC m=+480.780457528" watchObservedRunningTime="2026-07-15 23:54:49.550985201 +0000 UTC m=+480.781963950" Jul 15 23:55:00.540243 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:55:00.540215 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-h8cvd" Jul 15 23:55:15.392011 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:55:15.391978 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6b9d4cfbcc-nrqn7"] Jul 15 23:55:15.399781 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:55:15.399754 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b9d4cfbcc-nrqn7" Jul 15 23:55:15.401894 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:55:15.401861 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b9d4cfbcc-nrqn7"] Jul 15 23:55:15.402860 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:55:15.402838 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-59bdj\"" Jul 15 23:55:15.402959 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:55:15.402838 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 15 23:55:15.431163 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:55:15.431137 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1aa57933-5f43-4fef-8413-5ddf211dd066-tls-cert\") pod \"authorino-6b9d4cfbcc-nrqn7\" (UID: \"1aa57933-5f43-4fef-8413-5ddf211dd066\") " pod="kuadrant-system/authorino-6b9d4cfbcc-nrqn7" Jul 15 23:55:15.431278 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:55:15.431172 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnnjz\" (UniqueName: \"kubernetes.io/projected/1aa57933-5f43-4fef-8413-5ddf211dd066-kube-api-access-pnnjz\") pod \"authorino-6b9d4cfbcc-nrqn7\" (UID: \"1aa57933-5f43-4fef-8413-5ddf211dd066\") " pod="kuadrant-system/authorino-6b9d4cfbcc-nrqn7" Jul 15 23:55:15.532459 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:55:15.532429 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1aa57933-5f43-4fef-8413-5ddf211dd066-tls-cert\") pod \"authorino-6b9d4cfbcc-nrqn7\" (UID: \"1aa57933-5f43-4fef-8413-5ddf211dd066\") " pod="kuadrant-system/authorino-6b9d4cfbcc-nrqn7" Jul 15 23:55:15.532459 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:55:15.532464 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnnjz\" (UniqueName: \"kubernetes.io/projected/1aa57933-5f43-4fef-8413-5ddf211dd066-kube-api-access-pnnjz\") pod \"authorino-6b9d4cfbcc-nrqn7\" (UID: \"1aa57933-5f43-4fef-8413-5ddf211dd066\") " pod="kuadrant-system/authorino-6b9d4cfbcc-nrqn7" Jul 15 23:55:15.534893 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:55:15.534869 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1aa57933-5f43-4fef-8413-5ddf211dd066-tls-cert\") pod \"authorino-6b9d4cfbcc-nrqn7\" (UID: \"1aa57933-5f43-4fef-8413-5ddf211dd066\") " pod="kuadrant-system/authorino-6b9d4cfbcc-nrqn7" Jul 15 23:55:15.540322 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:55:15.540303 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnnjz\" (UniqueName: \"kubernetes.io/projected/1aa57933-5f43-4fef-8413-5ddf211dd066-kube-api-access-pnnjz\") pod \"authorino-6b9d4cfbcc-nrqn7\" (UID: \"1aa57933-5f43-4fef-8413-5ddf211dd066\") " pod="kuadrant-system/authorino-6b9d4cfbcc-nrqn7" Jul 15 23:55:15.709505 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:55:15.709474 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b9d4cfbcc-nrqn7" Jul 15 23:55:15.837770 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:55:15.837641 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b9d4cfbcc-nrqn7"] Jul 15 23:55:15.839990 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:55:15.839950 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1aa57933_5f43_4fef_8413_5ddf211dd066.slice/crio-b6e414f225e895c99d2b46fcc34de09c426a208f88092342503f29309535251a WatchSource:0}: Error finding container b6e414f225e895c99d2b46fcc34de09c426a208f88092342503f29309535251a: Status 404 returned error can't find the container with id b6e414f225e895c99d2b46fcc34de09c426a208f88092342503f29309535251a Jul 15 23:55:16.652385 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:55:16.652346 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b9d4cfbcc-nrqn7" event={"ID":"1aa57933-5f43-4fef-8413-5ddf211dd066","Type":"ContainerStarted","Data":"b6e414f225e895c99d2b46fcc34de09c426a208f88092342503f29309535251a"} Jul 15 23:55:19.668696 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:55:19.668647 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b9d4cfbcc-nrqn7" event={"ID":"1aa57933-5f43-4fef-8413-5ddf211dd066","Type":"ContainerStarted","Data":"9b6430d301325c5247e274e91f6b591e97dcc28110e76ff26fca1e144270c759"} Jul 15 23:55:19.683915 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:55:19.683870 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6b9d4cfbcc-nrqn7" podStartSLOduration=1.684221012 podStartE2EDuration="4.683855359s" totalImagesPullingTime="2.999634347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:55:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:55:19.683531733 +0000 UTC m=+510.914510480" watchObservedRunningTime="2026-07-15 23:55:19.683855359 +0000 UTC m=+510.914834105" Jul 15 23:56:00.243179 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:56:00.243090 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 15 23:56:24.801185 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:56:24.801147 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 15 23:56:29.799062 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:56:29.799019 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 15 23:56:49.231712 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:56:49.231683 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-7g2gx_0f1c9d30-fe51-493e-9b47-84d63b56fa8f/console-operator/1.log" Jul 15 23:56:49.234061 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:56:49.234038 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-7g2gx_0f1c9d30-fe51-493e-9b47-84d63b56fa8f/console-operator/1.log" Jul 15 23:56:49.238429 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:56:49.238408 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fp65r_d05a6a90-8e18-4a88-b6b9-b3a3712ffe07/ovn-acl-logging/0.log" Jul 15 23:56:49.240554 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:56:49.240536 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fp65r_d05a6a90-8e18-4a88-b6b9-b3a3712ffe07/ovn-acl-logging/0.log" Jul 15 23:56:56.490825 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:56:56.490786 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 15 23:57:21.307747 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:21.307712 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm"] Jul 15 23:57:21.310852 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:21.310835 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm" Jul 15 23:57:21.314125 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:21.314104 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 15 23:57:21.314254 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:21.314144 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 15 23:57:21.314254 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:21.314179 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 15 23:57:21.314254 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:21.314113 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fsglx\"" Jul 15 23:57:21.319499 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:21.319478 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm"] Jul 15 23:57:21.339148 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:21.339125 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9d98386-4141-40f3-bcbd-eae30aa64edf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm\" (UID: \"c9d98386-4141-40f3-bcbd-eae30aa64edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm" Jul 15 23:57:21.339257 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:21.339157 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9d98386-4141-40f3-bcbd-eae30aa64edf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm\" (UID: \"c9d98386-4141-40f3-bcbd-eae30aa64edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm" Jul 15 23:57:21.339257 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:21.339174 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzqdr\" (UniqueName: \"kubernetes.io/projected/c9d98386-4141-40f3-bcbd-eae30aa64edf-kube-api-access-pzqdr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm\" (UID: \"c9d98386-4141-40f3-bcbd-eae30aa64edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm" Jul 15 23:57:21.339335 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:21.339250 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9d98386-4141-40f3-bcbd-eae30aa64edf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm\" (UID: \"c9d98386-4141-40f3-bcbd-eae30aa64edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm" Jul 15 23:57:21.339335 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:21.339300 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9d98386-4141-40f3-bcbd-eae30aa64edf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm\" (UID: \"c9d98386-4141-40f3-bcbd-eae30aa64edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm" Jul 15 23:57:21.339397 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:21.339340 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9d98386-4141-40f3-bcbd-eae30aa64edf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm\" (UID: \"c9d98386-4141-40f3-bcbd-eae30aa64edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm" Jul 15 23:57:21.440034 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:21.440001 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9d98386-4141-40f3-bcbd-eae30aa64edf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm\" (UID: \"c9d98386-4141-40f3-bcbd-eae30aa64edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm" Jul 15 23:57:21.440183 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:21.440049 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9d98386-4141-40f3-bcbd-eae30aa64edf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm\" (UID: \"c9d98386-4141-40f3-bcbd-eae30aa64edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm" Jul 15 23:57:21.440183 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:21.440085 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9d98386-4141-40f3-bcbd-eae30aa64edf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm\" (UID: \"c9d98386-4141-40f3-bcbd-eae30aa64edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm" Jul 15 23:57:21.440183 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:21.440109 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzqdr\" (UniqueName: \"kubernetes.io/projected/c9d98386-4141-40f3-bcbd-eae30aa64edf-kube-api-access-pzqdr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm\" (UID: \"c9d98386-4141-40f3-bcbd-eae30aa64edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm" Jul 15 23:57:21.440183 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:21.440172 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9d98386-4141-40f3-bcbd-eae30aa64edf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm\" (UID: \"c9d98386-4141-40f3-bcbd-eae30aa64edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm" Jul 15 23:57:21.440375 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:21.440222 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9d98386-4141-40f3-bcbd-eae30aa64edf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm\" (UID: \"c9d98386-4141-40f3-bcbd-eae30aa64edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm" Jul 15 23:57:21.440538 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:21.440507 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9d98386-4141-40f3-bcbd-eae30aa64edf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm\" (UID: \"c9d98386-4141-40f3-bcbd-eae30aa64edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm" Jul 15 23:57:21.440538 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:21.440522 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9d98386-4141-40f3-bcbd-eae30aa64edf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm\" (UID: \"c9d98386-4141-40f3-bcbd-eae30aa64edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm" Jul 15 23:57:21.440681 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:21.440554 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9d98386-4141-40f3-bcbd-eae30aa64edf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm\" (UID: \"c9d98386-4141-40f3-bcbd-eae30aa64edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm" Jul 15 23:57:21.442466 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:21.442445 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9d98386-4141-40f3-bcbd-eae30aa64edf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm\" (UID: \"c9d98386-4141-40f3-bcbd-eae30aa64edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm" Jul 15 23:57:21.442581 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:21.442564 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9d98386-4141-40f3-bcbd-eae30aa64edf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm\" (UID: \"c9d98386-4141-40f3-bcbd-eae30aa64edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm" Jul 15 23:57:21.448577 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:21.448557 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzqdr\" (UniqueName: \"kubernetes.io/projected/c9d98386-4141-40f3-bcbd-eae30aa64edf-kube-api-access-pzqdr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm\" (UID: \"c9d98386-4141-40f3-bcbd-eae30aa64edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm" Jul 15 23:57:21.622322 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:21.622233 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm" Jul 15 23:57:21.756519 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:21.756492 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm"] Jul 15 23:57:21.758795 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:57:21.758768 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9d98386_4141_40f3_bcbd_eae30aa64edf.slice/crio-2e5ffd077b8ab8a7a681bf153c481c52a6e01baa30593b39f9eb1aa018d09ecf WatchSource:0}: Error finding container 2e5ffd077b8ab8a7a681bf153c481c52a6e01baa30593b39f9eb1aa018d09ecf: Status 404 returned error can't find the container with id 2e5ffd077b8ab8a7a681bf153c481c52a6e01baa30593b39f9eb1aa018d09ecf Jul 15 23:57:21.760001 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:21.759982 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 23:57:22.209150 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:22.209108 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm" event={"ID":"c9d98386-4141-40f3-bcbd-eae30aa64edf","Type":"ContainerStarted","Data":"2e5ffd077b8ab8a7a681bf153c481c52a6e01baa30593b39f9eb1aa018d09ecf"} Jul 15 23:57:22.999596 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:22.999557 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 15 23:57:23.217527 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:23.217475 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm" event={"ID":"c9d98386-4141-40f3-bcbd-eae30aa64edf","Type":"ContainerStarted","Data":"c39048036c6643ee1a9e82bec461e86162b6f1f3306c577e78131b04a717e8d2"} Jul 15 23:57:23.236595 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:23.236538 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm" podStartSLOduration=1.237166426 podStartE2EDuration="2.236521964s" totalImagesPullingTime="999.355538ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:57:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:57:23.23529852 +0000 UTC m=+634.466277289" watchObservedRunningTime="2026-07-15 23:57:23.236521964 +0000 UTC m=+634.467500710" Jul 15 23:57:31.622339 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:31.622302 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm" Jul 15 23:57:31.622819 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:31.622450 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm" Jul 15 23:57:31.634957 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:31.634934 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm" Jul 15 23:57:32.270561 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:32.270533 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm" Jul 15 23:57:32.300864 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:32.300832 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 15 23:57:38.993415 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:38.993377 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8"] Jul 15 23:57:38.997116 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:38.997097 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8" Jul 15 23:57:38.999428 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:38.999402 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 15 23:57:39.007036 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:39.007013 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8"] Jul 15 23:57:39.097865 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:39.097827 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb83ec3c-7a1c-459a-93d8-473efd97c5b0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8\" (UID: \"eb83ec3c-7a1c-459a-93d8-473efd97c5b0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8" Jul 15 23:57:39.098026 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:39.097888 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb83ec3c-7a1c-459a-93d8-473efd97c5b0-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8\" (UID: \"eb83ec3c-7a1c-459a-93d8-473efd97c5b0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8" Jul 15 23:57:39.098026 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:39.097953 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb83ec3c-7a1c-459a-93d8-473efd97c5b0-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8\" (UID: \"eb83ec3c-7a1c-459a-93d8-473efd97c5b0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8" Jul 15 23:57:39.098026 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:39.097992 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb83ec3c-7a1c-459a-93d8-473efd97c5b0-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8\" (UID: \"eb83ec3c-7a1c-459a-93d8-473efd97c5b0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8" Jul 15 23:57:39.098026 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:39.098006 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb83ec3c-7a1c-459a-93d8-473efd97c5b0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8\" (UID: \"eb83ec3c-7a1c-459a-93d8-473efd97c5b0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8" Jul 15 23:57:39.098026 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:39.098023 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zcb5\" (UniqueName: \"kubernetes.io/projected/eb83ec3c-7a1c-459a-93d8-473efd97c5b0-kube-api-access-5zcb5\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8\" (UID: \"eb83ec3c-7a1c-459a-93d8-473efd97c5b0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8" Jul 15 23:57:39.199172 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:39.199143 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb83ec3c-7a1c-459a-93d8-473efd97c5b0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8\" (UID: \"eb83ec3c-7a1c-459a-93d8-473efd97c5b0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8" Jul 15 23:57:39.199318 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:39.199190 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb83ec3c-7a1c-459a-93d8-473efd97c5b0-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8\" (UID: \"eb83ec3c-7a1c-459a-93d8-473efd97c5b0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8" Jul 15 23:57:39.199318 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:39.199211 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb83ec3c-7a1c-459a-93d8-473efd97c5b0-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8\" (UID: \"eb83ec3c-7a1c-459a-93d8-473efd97c5b0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8" Jul 15 23:57:39.199318 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:39.199229 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb83ec3c-7a1c-459a-93d8-473efd97c5b0-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8\" (UID: \"eb83ec3c-7a1c-459a-93d8-473efd97c5b0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8" Jul 15 23:57:39.199318 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:39.199245 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb83ec3c-7a1c-459a-93d8-473efd97c5b0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8\" (UID: \"eb83ec3c-7a1c-459a-93d8-473efd97c5b0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8" Jul 15 23:57:39.199318 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:39.199269 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zcb5\" (UniqueName: \"kubernetes.io/projected/eb83ec3c-7a1c-459a-93d8-473efd97c5b0-kube-api-access-5zcb5\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8\" (UID: \"eb83ec3c-7a1c-459a-93d8-473efd97c5b0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8" Jul 15 23:57:39.199581 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:39.199561 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb83ec3c-7a1c-459a-93d8-473efd97c5b0-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8\" (UID: \"eb83ec3c-7a1c-459a-93d8-473efd97c5b0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8" Jul 15 23:57:39.199653 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:39.199621 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb83ec3c-7a1c-459a-93d8-473efd97c5b0-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8\" (UID: \"eb83ec3c-7a1c-459a-93d8-473efd97c5b0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8" Jul 15 23:57:39.199772 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:39.199753 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb83ec3c-7a1c-459a-93d8-473efd97c5b0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8\" (UID: \"eb83ec3c-7a1c-459a-93d8-473efd97c5b0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8" Jul 15 23:57:39.201574 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:39.201550 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb83ec3c-7a1c-459a-93d8-473efd97c5b0-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8\" (UID: \"eb83ec3c-7a1c-459a-93d8-473efd97c5b0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8" Jul 15 23:57:39.201867 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:39.201848 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb83ec3c-7a1c-459a-93d8-473efd97c5b0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8\" (UID: \"eb83ec3c-7a1c-459a-93d8-473efd97c5b0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8" Jul 15 23:57:39.206901 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:39.206878 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zcb5\" (UniqueName: \"kubernetes.io/projected/eb83ec3c-7a1c-459a-93d8-473efd97c5b0-kube-api-access-5zcb5\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8\" (UID: \"eb83ec3c-7a1c-459a-93d8-473efd97c5b0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8" Jul 15 23:57:39.306479 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:39.306406 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8" Jul 15 23:57:39.438463 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:39.438440 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8"] Jul 15 23:57:39.441039 ip-10-0-142-228 kubenswrapper[2564]: W0715 23:57:39.441007 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb83ec3c_7a1c_459a_93d8_473efd97c5b0.slice/crio-39bb1b6819a127be6543b4cc04d1c4af6b539bdac4a95a35dec417736734f53c WatchSource:0}: Error finding container 39bb1b6819a127be6543b4cc04d1c4af6b539bdac4a95a35dec417736734f53c: Status 404 returned error can't find the container with id 39bb1b6819a127be6543b4cc04d1c4af6b539bdac4a95a35dec417736734f53c Jul 15 23:57:40.298333 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:40.298295 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8" event={"ID":"eb83ec3c-7a1c-459a-93d8-473efd97c5b0","Type":"ContainerStarted","Data":"3bd4242aaa82e829888c7a9d78a2db588eb9424833a9640b0bc9c7d2aefa3519"} Jul 15 23:57:40.298333 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:40.298339 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8" event={"ID":"eb83ec3c-7a1c-459a-93d8-473efd97c5b0","Type":"ContainerStarted","Data":"39bb1b6819a127be6543b4cc04d1c4af6b539bdac4a95a35dec417736734f53c"} Jul 15 23:57:40.313557 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:40.313510 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8" podStartSLOduration=2.148907114 podStartE2EDuration="2.313494588s" totalImagesPullingTime="164.587474ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:57:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:57:40.312468055 +0000 UTC m=+651.543446830" watchObservedRunningTime="2026-07-15 23:57:40.313494588 +0000 UTC m=+651.544473334" Jul 15 23:57:42.694659 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:42.694617 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 15 23:57:49.306992 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:49.306964 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8" Jul 15 23:57:49.307428 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:49.307084 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8" Jul 15 23:57:49.319286 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:49.319261 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8" Jul 15 23:57:49.350077 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:57:49.350056 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8" Jul 15 23:59:04.898515 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:59:04.898425 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6b9d4cfbcc-nrqn7"] Jul 15 23:59:04.899121 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:59:04.898625 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6b9d4cfbcc-nrqn7" podUID="1aa57933-5f43-4fef-8413-5ddf211dd066" containerName="authorino" containerID="cri-o://9b6430d301325c5247e274e91f6b591e97dcc28110e76ff26fca1e144270c759" gracePeriod=30 Jul 15 23:59:05.147074 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:59:05.147051 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b9d4cfbcc-nrqn7" Jul 15 23:59:05.238295 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:59:05.238271 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnnjz\" (UniqueName: \"kubernetes.io/projected/1aa57933-5f43-4fef-8413-5ddf211dd066-kube-api-access-pnnjz\") pod \"1aa57933-5f43-4fef-8413-5ddf211dd066\" (UID: \"1aa57933-5f43-4fef-8413-5ddf211dd066\") " Jul 15 23:59:05.238458 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:59:05.238397 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1aa57933-5f43-4fef-8413-5ddf211dd066-tls-cert\") pod \"1aa57933-5f43-4fef-8413-5ddf211dd066\" (UID: \"1aa57933-5f43-4fef-8413-5ddf211dd066\") " Jul 15 23:59:05.240418 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:59:05.240385 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1aa57933-5f43-4fef-8413-5ddf211dd066-kube-api-access-pnnjz" (OuterVolumeSpecName: "kube-api-access-pnnjz") pod "1aa57933-5f43-4fef-8413-5ddf211dd066" (UID: "1aa57933-5f43-4fef-8413-5ddf211dd066"). InnerVolumeSpecName "kube-api-access-pnnjz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:59:05.248241 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:59:05.248222 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1aa57933-5f43-4fef-8413-5ddf211dd066-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1aa57933-5f43-4fef-8413-5ddf211dd066" (UID: "1aa57933-5f43-4fef-8413-5ddf211dd066"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 23:59:05.339154 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:59:05.339127 2564 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1aa57933-5f43-4fef-8413-5ddf211dd066-tls-cert\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\"" Jul 15 23:59:05.339154 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:59:05.339155 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnnjz\" (UniqueName: \"kubernetes.io/projected/1aa57933-5f43-4fef-8413-5ddf211dd066-kube-api-access-pnnjz\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\"" Jul 15 23:59:05.690570 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:59:05.690484 2564 generic.go:356] "Generic (PLEG): container finished" podID="1aa57933-5f43-4fef-8413-5ddf211dd066" containerID="9b6430d301325c5247e274e91f6b591e97dcc28110e76ff26fca1e144270c759" exitCode=0 Jul 15 23:59:05.690570 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:59:05.690527 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b9d4cfbcc-nrqn7" Jul 15 23:59:05.690570 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:59:05.690535 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b9d4cfbcc-nrqn7" event={"ID":"1aa57933-5f43-4fef-8413-5ddf211dd066","Type":"ContainerDied","Data":"9b6430d301325c5247e274e91f6b591e97dcc28110e76ff26fca1e144270c759"} Jul 15 23:59:05.690859 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:59:05.690573 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b9d4cfbcc-nrqn7" event={"ID":"1aa57933-5f43-4fef-8413-5ddf211dd066","Type":"ContainerDied","Data":"b6e414f225e895c99d2b46fcc34de09c426a208f88092342503f29309535251a"} Jul 15 23:59:05.690859 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:59:05.690595 2564 scope.go:117] "RemoveContainer" containerID="9b6430d301325c5247e274e91f6b591e97dcc28110e76ff26fca1e144270c759" Jul 15 23:59:05.699079 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:59:05.699057 2564 scope.go:117] "RemoveContainer" containerID="9b6430d301325c5247e274e91f6b591e97dcc28110e76ff26fca1e144270c759" Jul 15 23:59:05.699304 ip-10-0-142-228 kubenswrapper[2564]: E0715 23:59:05.699287 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b6430d301325c5247e274e91f6b591e97dcc28110e76ff26fca1e144270c759\": container with ID starting with 9b6430d301325c5247e274e91f6b591e97dcc28110e76ff26fca1e144270c759 not found: ID does not exist" containerID="9b6430d301325c5247e274e91f6b591e97dcc28110e76ff26fca1e144270c759" Jul 15 23:59:05.699348 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:59:05.699313 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b6430d301325c5247e274e91f6b591e97dcc28110e76ff26fca1e144270c759"} err="failed to get container status \"9b6430d301325c5247e274e91f6b591e97dcc28110e76ff26fca1e144270c759\": rpc error: code = NotFound desc = could not find container \"9b6430d301325c5247e274e91f6b591e97dcc28110e76ff26fca1e144270c759\": container with ID starting with 9b6430d301325c5247e274e91f6b591e97dcc28110e76ff26fca1e144270c759 not found: ID does not exist" Jul 15 23:59:05.707231 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:59:05.707206 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6b9d4cfbcc-nrqn7"] Jul 15 23:59:05.712901 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:59:05.712879 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6b9d4cfbcc-nrqn7"] Jul 15 23:59:07.300982 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:59:07.300946 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1aa57933-5f43-4fef-8413-5ddf211dd066" path="/var/lib/kubelet/pods/1aa57933-5f43-4fef-8413-5ddf211dd066/volumes" Jul 15 23:59:33.396812 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:59:33.396778 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 15 23:59:43.290889 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:59:43.290845 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 15 23:59:55.498708 ip-10-0-142-228 kubenswrapper[2564]: I0715 23:59:55.498676 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:00:00.135770 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:00.135724 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736000-vw8kp"] Jul 16 00:00:00.136159 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:00.136098 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aa57933-5f43-4fef-8413-5ddf211dd066" containerName="authorino" Jul 16 00:00:00.136159 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:00.136111 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aa57933-5f43-4fef-8413-5ddf211dd066" containerName="authorino" Jul 16 00:00:00.136231 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:00.136178 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aa57933-5f43-4fef-8413-5ddf211dd066" containerName="authorino" Jul 16 00:00:00.140261 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:00.140244 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736000-vw8kp" Jul 16 00:00:00.142817 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:00.142794 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jg2q4\"" Jul 16 00:00:00.145714 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:00.145688 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736000-vw8kp"] Jul 16 00:00:00.168478 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:00.168459 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736000-vw8kp" Jul 16 00:00:00.238160 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:00.238124 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-pruner-29736000-fkgmc"] Jul 16 00:00:00.242265 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:00.242232 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29736000-fkgmc" Jul 16 00:00:00.245136 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:00.244945 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"pruner-dockercfg-pwmr9\"" Jul 16 00:00:00.245534 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:00.245516 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"serviceca\"" Jul 16 00:00:00.246992 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:00.246968 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29736000-fkgmc"] Jul 16 00:00:00.289050 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:00.288493 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/db3c9039-66f1-4011-b82b-3c78f2ae6358-serviceca\") pod \"image-pruner-29736000-fkgmc\" (UID: \"db3c9039-66f1-4011-b82b-3c78f2ae6358\") " pod="openshift-image-registry/image-pruner-29736000-fkgmc" Jul 16 00:00:00.289050 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:00.288544 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slbwg\" (UniqueName: \"kubernetes.io/projected/db3c9039-66f1-4011-b82b-3c78f2ae6358-kube-api-access-slbwg\") pod \"image-pruner-29736000-fkgmc\" (UID: \"db3c9039-66f1-4011-b82b-3c78f2ae6358\") " pod="openshift-image-registry/image-pruner-29736000-fkgmc" Jul 16 00:00:00.310182 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:00.310157 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736000-vw8kp"] Jul 16 00:00:00.314006 ip-10-0-142-228 kubenswrapper[2564]: W0716 00:00:00.313964 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea0185f8_0a3d_4d88_b3b4_90724b1e8f96.slice/crio-3e71e746ca95182a6722e13c3a63fbec68d0a9fe0254417a0c4c1da60505ba21 WatchSource:0}: Error finding container 3e71e746ca95182a6722e13c3a63fbec68d0a9fe0254417a0c4c1da60505ba21: Status 404 returned error can't find the container with id 3e71e746ca95182a6722e13c3a63fbec68d0a9fe0254417a0c4c1da60505ba21 Jul 16 00:00:00.389473 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:00.389385 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/db3c9039-66f1-4011-b82b-3c78f2ae6358-serviceca\") pod \"image-pruner-29736000-fkgmc\" (UID: \"db3c9039-66f1-4011-b82b-3c78f2ae6358\") " pod="openshift-image-registry/image-pruner-29736000-fkgmc" Jul 16 00:00:00.389473 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:00.389429 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slbwg\" (UniqueName: \"kubernetes.io/projected/db3c9039-66f1-4011-b82b-3c78f2ae6358-kube-api-access-slbwg\") pod \"image-pruner-29736000-fkgmc\" (UID: \"db3c9039-66f1-4011-b82b-3c78f2ae6358\") " pod="openshift-image-registry/image-pruner-29736000-fkgmc" Jul 16 00:00:00.390125 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:00.390104 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/db3c9039-66f1-4011-b82b-3c78f2ae6358-serviceca\") pod \"image-pruner-29736000-fkgmc\" (UID: \"db3c9039-66f1-4011-b82b-3c78f2ae6358\") " pod="openshift-image-registry/image-pruner-29736000-fkgmc" Jul 16 00:00:00.397273 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:00.397245 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slbwg\" (UniqueName: \"kubernetes.io/projected/db3c9039-66f1-4011-b82b-3c78f2ae6358-kube-api-access-slbwg\") pod \"image-pruner-29736000-fkgmc\" (UID: \"db3c9039-66f1-4011-b82b-3c78f2ae6358\") " pod="openshift-image-registry/image-pruner-29736000-fkgmc" Jul 16 00:00:00.554982 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:00.554953 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29736000-fkgmc" Jul 16 00:00:00.683061 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:00.682987 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29736000-fkgmc"] Jul 16 00:00:00.685917 ip-10-0-142-228 kubenswrapper[2564]: W0716 00:00:00.685882 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb3c9039_66f1_4011_b82b_3c78f2ae6358.slice/crio-f75aa0fa62fea6275df97fbe3a5c0d79d42850544ea04634a053766756cd2e76 WatchSource:0}: Error finding container f75aa0fa62fea6275df97fbe3a5c0d79d42850544ea04634a053766756cd2e76: Status 404 returned error can't find the container with id f75aa0fa62fea6275df97fbe3a5c0d79d42850544ea04634a053766756cd2e76 Jul 16 00:00:00.939939 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:00.939846 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29736000-fkgmc" event={"ID":"db3c9039-66f1-4011-b82b-3c78f2ae6358","Type":"ContainerStarted","Data":"6ef48e59d2a35d397f3dbb83be057e15326c13b1837cbba0f3a5161cfa6f9297"} Jul 16 00:00:00.939939 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:00.939908 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29736000-fkgmc" event={"ID":"db3c9039-66f1-4011-b82b-3c78f2ae6358","Type":"ContainerStarted","Data":"f75aa0fa62fea6275df97fbe3a5c0d79d42850544ea04634a053766756cd2e76"} Jul 16 00:00:00.941056 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:00.941030 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736000-vw8kp" event={"ID":"ea0185f8-0a3d-4d88-b3b4-90724b1e8f96","Type":"ContainerStarted","Data":"3e71e746ca95182a6722e13c3a63fbec68d0a9fe0254417a0c4c1da60505ba21"} Jul 16 00:00:00.954123 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:00.954070 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-pruner-29736000-fkgmc" podStartSLOduration=0.954053876 podStartE2EDuration="954.053876ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:00:00.952475975 +0000 UTC m=+792.183454750" watchObservedRunningTime="2026-07-16 00:00:00.954053876 +0000 UTC m=+792.185032601" Jul 16 00:00:01.947309 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:01.947275 2564 generic.go:356] "Generic (PLEG): container finished" podID="db3c9039-66f1-4011-b82b-3c78f2ae6358" containerID="6ef48e59d2a35d397f3dbb83be057e15326c13b1837cbba0f3a5161cfa6f9297" exitCode=0 Jul 16 00:00:01.947724 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:01.947361 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29736000-fkgmc" event={"ID":"db3c9039-66f1-4011-b82b-3c78f2ae6358","Type":"ContainerDied","Data":"6ef48e59d2a35d397f3dbb83be057e15326c13b1837cbba0f3a5161cfa6f9297"} Jul 16 00:00:03.091946 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:03.091922 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29736000-fkgmc" Jul 16 00:00:03.100261 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:03.100234 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:00:03.108410 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:03.108385 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/db3c9039-66f1-4011-b82b-3c78f2ae6358-serviceca\") pod \"db3c9039-66f1-4011-b82b-3c78f2ae6358\" (UID: \"db3c9039-66f1-4011-b82b-3c78f2ae6358\") " Jul 16 00:00:03.108539 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:03.108432 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-slbwg\" (UniqueName: \"kubernetes.io/projected/db3c9039-66f1-4011-b82b-3c78f2ae6358-kube-api-access-slbwg\") pod \"db3c9039-66f1-4011-b82b-3c78f2ae6358\" (UID: \"db3c9039-66f1-4011-b82b-3c78f2ae6358\") " Jul 16 00:00:03.108751 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:03.108725 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db3c9039-66f1-4011-b82b-3c78f2ae6358-serviceca" (OuterVolumeSpecName: "serviceca") pod "db3c9039-66f1-4011-b82b-3c78f2ae6358" (UID: "db3c9039-66f1-4011-b82b-3c78f2ae6358"). InnerVolumeSpecName "serviceca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:00:03.110656 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:03.110633 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db3c9039-66f1-4011-b82b-3c78f2ae6358-kube-api-access-slbwg" (OuterVolumeSpecName: "kube-api-access-slbwg") pod "db3c9039-66f1-4011-b82b-3c78f2ae6358" (UID: "db3c9039-66f1-4011-b82b-3c78f2ae6358"). InnerVolumeSpecName "kube-api-access-slbwg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:00:03.209330 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:03.209302 2564 reconciler_common.go:299] "Volume detached for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/db3c9039-66f1-4011-b82b-3c78f2ae6358-serviceca\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\"" Jul 16 00:00:03.209330 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:03.209329 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slbwg\" (UniqueName: \"kubernetes.io/projected/db3c9039-66f1-4011-b82b-3c78f2ae6358-kube-api-access-slbwg\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\"" Jul 16 00:00:03.957698 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:03.957655 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29736000-fkgmc" Jul 16 00:00:03.957860 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:03.957654 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29736000-fkgmc" event={"ID":"db3c9039-66f1-4011-b82b-3c78f2ae6358","Type":"ContainerDied","Data":"f75aa0fa62fea6275df97fbe3a5c0d79d42850544ea04634a053766756cd2e76"} Jul 16 00:00:03.957860 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:03.957800 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f75aa0fa62fea6275df97fbe3a5c0d79d42850544ea04634a053766756cd2e76" Jul 16 00:00:13.898125 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:13.898045 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:00:31.079232 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:31.079194 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736000-vw8kp" event={"ID":"ea0185f8-0a3d-4d88-b3b4-90724b1e8f96","Type":"ContainerStarted","Data":"480b8072e91779c1d23d8c1699b3ba236dc60489d81b465fa6cb12502e70e4c7"} Jul 16 00:00:31.096016 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:31.095960 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736000-vw8kp" podStartSLOduration=1.030366382 podStartE2EDuration="31.095940322s" totalImagesPullingTime="30.06557394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:00:31.093857998 +0000 UTC m=+822.324836756" watchObservedRunningTime="2026-07-16 00:00:31.095940322 +0000 UTC m=+822.326919070" Jul 16 00:00:32.085108 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:32.085065 2564 generic.go:356] "Generic (PLEG): container finished" podID="ea0185f8-0a3d-4d88-b3b4-90724b1e8f96" containerID="480b8072e91779c1d23d8c1699b3ba236dc60489d81b465fa6cb12502e70e4c7" exitCode=0 Jul 16 00:00:32.085490 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:32.085113 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736000-vw8kp" event={"ID":"ea0185f8-0a3d-4d88-b3b4-90724b1e8f96","Type":"ContainerDied","Data":"480b8072e91779c1d23d8c1699b3ba236dc60489d81b465fa6cb12502e70e4c7"} Jul 16 00:00:33.226033 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:33.226010 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736000-vw8kp" Jul 16 00:00:34.095379 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:34.095343 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736000-vw8kp" Jul 16 00:00:34.095379 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:34.095361 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736000-vw8kp" event={"ID":"ea0185f8-0a3d-4d88-b3b4-90724b1e8f96","Type":"ContainerDied","Data":"3e71e746ca95182a6722e13c3a63fbec68d0a9fe0254417a0c4c1da60505ba21"} Jul 16 00:00:34.095595 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:34.095404 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e71e746ca95182a6722e13c3a63fbec68d0a9fe0254417a0c4c1da60505ba21" Jul 16 00:00:44.192855 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:44.192820 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:00:57.800519 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:00:57.800481 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:01:30.499738 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:01:30.499694 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:01:39.897598 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:01:39.897565 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:01:49.260562 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:01:49.260489 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-7g2gx_0f1c9d30-fe51-493e-9b47-84d63b56fa8f/console-operator/1.log" Jul 16 00:01:49.261114 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:01:49.260583 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-7g2gx_0f1c9d30-fe51-493e-9b47-84d63b56fa8f/console-operator/1.log" Jul 16 00:01:49.267217 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:01:49.267196 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fp65r_d05a6a90-8e18-4a88-b6b9-b3a3712ffe07/ovn-acl-logging/0.log" Jul 16 00:01:49.267328 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:01:49.267201 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fp65r_d05a6a90-8e18-4a88-b6b9-b3a3712ffe07/ovn-acl-logging/0.log" Jul 16 00:01:49.899086 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:01:49.899050 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:01:58.591434 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:01:58.591398 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:02:08.206753 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:02:08.206720 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:02:24.895927 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:02:24.895887 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:02:31.318278 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:02:31.318243 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:02:38.994762 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:02:38.994724 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:03:04.204931 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:03:04.204882 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:03:15.794110 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:03:15.794029 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:03:38.494611 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:03:38.494578 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:03:49.496108 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:03:49.496075 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:04:05.513194 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:04:05.513164 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:04:14.993632 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:04:14.993588 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:04:25.197825 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:04:25.197792 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:04:34.699250 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:04:34.699215 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:04:44.791875 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:04:44.791794 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:06:33.107931 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:06:33.107894 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:06:42.398455 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:06:42.398416 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:06:49.287946 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:06:49.287914 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-7g2gx_0f1c9d30-fe51-493e-9b47-84d63b56fa8f/console-operator/1.log" Jul 16 00:06:49.288944 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:06:49.288928 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-7g2gx_0f1c9d30-fe51-493e-9b47-84d63b56fa8f/console-operator/1.log" Jul 16 00:06:49.294102 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:06:49.294082 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fp65r_d05a6a90-8e18-4a88-b6b9-b3a3712ffe07/ovn-acl-logging/0.log" Jul 16 00:06:49.295276 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:06:49.295258 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fp65r_d05a6a90-8e18-4a88-b6b9-b3a3712ffe07/ovn-acl-logging/0.log" Jul 16 00:06:55.605771 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:06:55.605733 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:07:07.695170 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:07:07.695131 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:07:17.495658 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:07:17.495620 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:07:28.595273 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:07:28.595238 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:07:37.705648 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:07:37.705608 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:07:48.988742 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:07:48.988644 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:08:01.401138 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:08:01.401105 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:08:09.198847 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:08:09.198810 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:08:21.449260 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:08:21.449225 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:08:45.808147 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:08:45.808113 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:08:53.798414 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:08:53.798376 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:09:03.699409 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:09:03.699375 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:09:13.997607 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:09:13.997526 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:09:24.495796 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:09:24.495758 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:09:37.096088 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:09:37.096051 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:09:46.888764 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:09:46.888721 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:09:55.992617 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:09:55.992574 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:10:04.791497 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:10:04.791459 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:10:16.290513 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:10:16.290476 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:10:26.804625 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:10:26.804589 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:10:37.699504 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:10:37.699470 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:10:47.693921 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:10:47.693890 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:10:56.701208 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:10:56.701171 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:11:06.596528 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:11:06.596489 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:11:19.594210 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:11:19.594169 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:11:28.499745 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:11:28.499703 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:11:41.504219 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:11:41.504182 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:11:49.314579 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:11:49.314548 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-7g2gx_0f1c9d30-fe51-493e-9b47-84d63b56fa8f/console-operator/1.log" Jul 16 00:11:49.317273 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:11:49.317252 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-7g2gx_0f1c9d30-fe51-493e-9b47-84d63b56fa8f/console-operator/1.log" Jul 16 00:11:49.321134 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:11:49.321112 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fp65r_d05a6a90-8e18-4a88-b6b9-b3a3712ffe07/ovn-acl-logging/0.log" Jul 16 00:11:49.323812 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:11:49.323793 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fp65r_d05a6a90-8e18-4a88-b6b9-b3a3712ffe07/ovn-acl-logging/0.log" Jul 16 00:11:53.597886 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:11:53.597850 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:12:07.991816 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:07.991780 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:12:19.905294 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:19.905213 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:12:38.502080 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:38.502046 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:12:42.514320 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:42.514284 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f093c30e-847f654b4d-4h84m"] Jul 16 00:12:42.514782 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:42.514619 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea0185f8-0a3d-4d88-b3b4-90724b1e8f96" containerName="cleanup" Jul 16 00:12:42.514782 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:42.514630 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea0185f8-0a3d-4d88-b3b4-90724b1e8f96" containerName="cleanup" Jul 16 00:12:42.514782 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:42.514649 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db3c9039-66f1-4011-b82b-3c78f2ae6358" containerName="image-pruner" Jul 16 00:12:42.514782 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:42.514655 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="db3c9039-66f1-4011-b82b-3c78f2ae6358" containerName="image-pruner" Jul 16 00:12:42.514782 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:42.514737 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea0185f8-0a3d-4d88-b3b4-90724b1e8f96" containerName="cleanup" Jul 16 00:12:42.514782 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:42.514747 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="db3c9039-66f1-4011-b82b-3c78f2ae6358" containerName="image-pruner" Jul 16 00:12:42.517731 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:42.517710 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f093c30e-847f654b4d-4h84m" Jul 16 00:12:42.520176 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:42.520153 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-f093c30e-serving-cert\"" Jul 16 00:12:42.520264 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:42.520210 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 16 00:12:42.521083 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:42.521065 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-hcmct\"" Jul 16 00:12:42.521168 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:42.521083 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 16 00:12:42.526961 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:42.526937 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f093c30e-847f654b4d-4h84m"] Jul 16 00:12:42.587503 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:42.587471 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19ded367-bdb0-4096-97f9-aad9487c3cba-openshift-service-ca\") pod \"maas-api-e2e-ait-f093c30e-847f654b4d-4h84m\" (UID: \"19ded367-bdb0-4096-97f9-aad9487c3cba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f093c30e-847f654b4d-4h84m" Jul 16 00:12:42.587718 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:42.587531 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19ded367-bdb0-4096-97f9-aad9487c3cba-maas-api-tls\") pod \"maas-api-e2e-ait-f093c30e-847f654b4d-4h84m\" (UID: \"19ded367-bdb0-4096-97f9-aad9487c3cba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f093c30e-847f654b4d-4h84m" Jul 16 00:12:42.587718 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:42.587631 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l8mg\" (UniqueName: \"kubernetes.io/projected/19ded367-bdb0-4096-97f9-aad9487c3cba-kube-api-access-9l8mg\") pod \"maas-api-e2e-ait-f093c30e-847f654b4d-4h84m\" (UID: \"19ded367-bdb0-4096-97f9-aad9487c3cba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f093c30e-847f654b4d-4h84m" Jul 16 00:12:42.689191 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:42.689148 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19ded367-bdb0-4096-97f9-aad9487c3cba-openshift-service-ca\") pod \"maas-api-e2e-ait-f093c30e-847f654b4d-4h84m\" (UID: \"19ded367-bdb0-4096-97f9-aad9487c3cba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f093c30e-847f654b4d-4h84m" Jul 16 00:12:42.689384 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:42.689217 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19ded367-bdb0-4096-97f9-aad9487c3cba-maas-api-tls\") pod \"maas-api-e2e-ait-f093c30e-847f654b4d-4h84m\" (UID: \"19ded367-bdb0-4096-97f9-aad9487c3cba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f093c30e-847f654b4d-4h84m" Jul 16 00:12:42.689384 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:42.689246 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l8mg\" (UniqueName: \"kubernetes.io/projected/19ded367-bdb0-4096-97f9-aad9487c3cba-kube-api-access-9l8mg\") pod \"maas-api-e2e-ait-f093c30e-847f654b4d-4h84m\" (UID: \"19ded367-bdb0-4096-97f9-aad9487c3cba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f093c30e-847f654b4d-4h84m" Jul 16 00:12:42.689509 ip-10-0-142-228 kubenswrapper[2564]: E0716 00:12:42.689385 2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-f093c30e-serving-cert: secret "maas-api-e2e-ait-f093c30e-serving-cert" not found Jul 16 00:12:42.689509 ip-10-0-142-228 kubenswrapper[2564]: E0716 00:12:42.689473 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19ded367-bdb0-4096-97f9-aad9487c3cba-maas-api-tls podName:19ded367-bdb0-4096-97f9-aad9487c3cba nodeName:}" failed. No retries permitted until 2026-07-16 00:12:43.189450353 +0000 UTC m=+1554.420429080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/19ded367-bdb0-4096-97f9-aad9487c3cba-maas-api-tls") pod "maas-api-e2e-ait-f093c30e-847f654b4d-4h84m" (UID: "19ded367-bdb0-4096-97f9-aad9487c3cba") : secret "maas-api-e2e-ait-f093c30e-serving-cert" not found Jul 16 00:12:42.689859 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:42.689841 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19ded367-bdb0-4096-97f9-aad9487c3cba-openshift-service-ca\") pod \"maas-api-e2e-ait-f093c30e-847f654b4d-4h84m\" (UID: \"19ded367-bdb0-4096-97f9-aad9487c3cba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f093c30e-847f654b4d-4h84m" Jul 16 00:12:42.700544 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:42.700520 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l8mg\" (UniqueName: \"kubernetes.io/projected/19ded367-bdb0-4096-97f9-aad9487c3cba-kube-api-access-9l8mg\") pod \"maas-api-e2e-ait-f093c30e-847f654b4d-4h84m\" (UID: \"19ded367-bdb0-4096-97f9-aad9487c3cba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f093c30e-847f654b4d-4h84m" Jul 16 00:12:43.192911 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:43.192876 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19ded367-bdb0-4096-97f9-aad9487c3cba-maas-api-tls\") pod \"maas-api-e2e-ait-f093c30e-847f654b4d-4h84m\" (UID: \"19ded367-bdb0-4096-97f9-aad9487c3cba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f093c30e-847f654b4d-4h84m" Jul 16 00:12:43.195268 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:43.195242 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19ded367-bdb0-4096-97f9-aad9487c3cba-maas-api-tls\") pod \"maas-api-e2e-ait-f093c30e-847f654b4d-4h84m\" (UID: \"19ded367-bdb0-4096-97f9-aad9487c3cba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f093c30e-847f654b4d-4h84m" Jul 16 00:12:43.430518 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:43.430487 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f093c30e-847f654b4d-4h84m" Jul 16 00:12:43.557217 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:43.557191 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f093c30e-847f654b4d-4h84m"] Jul 16 00:12:43.560012 ip-10-0-142-228 kubenswrapper[2564]: W0716 00:12:43.559982 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19ded367_bdb0_4096_97f9_aad9487c3cba.slice/crio-ba691cc94767786950c07f0fd9c0bce4274e0217687311dccde0cacbcf7b6285 WatchSource:0}: Error finding container ba691cc94767786950c07f0fd9c0bce4274e0217687311dccde0cacbcf7b6285: Status 404 returned error can't find the container with id ba691cc94767786950c07f0fd9c0bce4274e0217687311dccde0cacbcf7b6285 Jul 16 00:12:43.561373 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:43.561349 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 00:12:44.388455 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:44.388414 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f093c30e-847f654b4d-4h84m" event={"ID":"19ded367-bdb0-4096-97f9-aad9487c3cba","Type":"ContainerStarted","Data":"ba691cc94767786950c07f0fd9c0bce4274e0217687311dccde0cacbcf7b6285"} Jul 16 00:12:46.399283 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:46.399245 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f093c30e-847f654b4d-4h84m" event={"ID":"19ded367-bdb0-4096-97f9-aad9487c3cba","Type":"ContainerStarted","Data":"b88b47b51b7a4912c09dd466b6bce75a58e62163bb06951ef7b988d91dfc226c"} Jul 16 00:12:46.399694 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:46.399311 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f093c30e-847f654b4d-4h84m" Jul 16 00:12:46.417053 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:46.417004 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f093c30e-847f654b4d-4h84m" podStartSLOduration=2.162003163 podStartE2EDuration="4.416990536s" totalImagesPullingTime="2.254987373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:12:46.415723877 +0000 UTC m=+1557.646702650" watchObservedRunningTime="2026-07-16 00:12:46.416990536 +0000 UTC m=+1557.647969689" Jul 16 00:12:52.410445 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:52.410360 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f093c30e-847f654b4d-4h84m" Jul 16 00:12:55.140612 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:55.140521 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-447d0dec-687f697d69-sj55d"] Jul 16 00:12:55.144620 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:55.144598 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-447d0dec-687f697d69-sj55d" Jul 16 00:12:55.146875 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:55.146843 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-447d0dec-serving-cert\"" Jul 16 00:12:55.160496 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:55.160474 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-447d0dec-687f697d69-sj55d"] Jul 16 00:12:55.301097 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:55.301067 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a0f41e2-713b-485f-aa34-dcd9832be8c0-maas-api-tls\") pod \"maas-api-e2e-migrate-447d0dec-687f697d69-sj55d\" (UID: \"7a0f41e2-713b-485f-aa34-dcd9832be8c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-447d0dec-687f697d69-sj55d" Jul 16 00:12:55.301280 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:55.301121 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r42vm\" (UniqueName: \"kubernetes.io/projected/7a0f41e2-713b-485f-aa34-dcd9832be8c0-kube-api-access-r42vm\") pod \"maas-api-e2e-migrate-447d0dec-687f697d69-sj55d\" (UID: \"7a0f41e2-713b-485f-aa34-dcd9832be8c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-447d0dec-687f697d69-sj55d" Jul 16 00:12:55.301280 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:55.301202 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a0f41e2-713b-485f-aa34-dcd9832be8c0-openshift-service-ca\") pod \"maas-api-e2e-migrate-447d0dec-687f697d69-sj55d\" (UID: \"7a0f41e2-713b-485f-aa34-dcd9832be8c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-447d0dec-687f697d69-sj55d" Jul 16 00:12:55.402588 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:55.402506 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r42vm\" (UniqueName: \"kubernetes.io/projected/7a0f41e2-713b-485f-aa34-dcd9832be8c0-kube-api-access-r42vm\") pod \"maas-api-e2e-migrate-447d0dec-687f697d69-sj55d\" (UID: \"7a0f41e2-713b-485f-aa34-dcd9832be8c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-447d0dec-687f697d69-sj55d" Jul 16 00:12:55.402780 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:55.402637 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a0f41e2-713b-485f-aa34-dcd9832be8c0-openshift-service-ca\") pod \"maas-api-e2e-migrate-447d0dec-687f697d69-sj55d\" (UID: \"7a0f41e2-713b-485f-aa34-dcd9832be8c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-447d0dec-687f697d69-sj55d" Jul 16 00:12:55.402780 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:55.402709 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a0f41e2-713b-485f-aa34-dcd9832be8c0-maas-api-tls\") pod \"maas-api-e2e-migrate-447d0dec-687f697d69-sj55d\" (UID: \"7a0f41e2-713b-485f-aa34-dcd9832be8c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-447d0dec-687f697d69-sj55d" Jul 16 00:12:55.403274 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:55.403249 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a0f41e2-713b-485f-aa34-dcd9832be8c0-openshift-service-ca\") pod \"maas-api-e2e-migrate-447d0dec-687f697d69-sj55d\" (UID: \"7a0f41e2-713b-485f-aa34-dcd9832be8c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-447d0dec-687f697d69-sj55d" Jul 16 00:12:55.405114 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:55.405093 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a0f41e2-713b-485f-aa34-dcd9832be8c0-maas-api-tls\") pod \"maas-api-e2e-migrate-447d0dec-687f697d69-sj55d\" (UID: \"7a0f41e2-713b-485f-aa34-dcd9832be8c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-447d0dec-687f697d69-sj55d" Jul 16 00:12:55.410830 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:55.410806 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r42vm\" (UniqueName: \"kubernetes.io/projected/7a0f41e2-713b-485f-aa34-dcd9832be8c0-kube-api-access-r42vm\") pod \"maas-api-e2e-migrate-447d0dec-687f697d69-sj55d\" (UID: \"7a0f41e2-713b-485f-aa34-dcd9832be8c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-447d0dec-687f697d69-sj55d" Jul 16 00:12:55.454766 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:55.454740 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-447d0dec-687f697d69-sj55d" Jul 16 00:12:55.587132 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:55.587109 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-447d0dec-687f697d69-sj55d"] Jul 16 00:12:55.589779 ip-10-0-142-228 kubenswrapper[2564]: W0716 00:12:55.589750 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a0f41e2_713b_485f_aa34_dcd9832be8c0.slice/crio-02e832873cecc474387d6252529acc600ec09dc4bf18a36ab5db99bbb11d7ace WatchSource:0}: Error finding container 02e832873cecc474387d6252529acc600ec09dc4bf18a36ab5db99bbb11d7ace: Status 404 returned error can't find the container with id 02e832873cecc474387d6252529acc600ec09dc4bf18a36ab5db99bbb11d7ace Jul 16 00:12:56.445446 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:56.445411 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-447d0dec-687f697d69-sj55d" event={"ID":"7a0f41e2-713b-485f-aa34-dcd9832be8c0","Type":"ContainerStarted","Data":"cc17f000d199d25208b150f1dc46450d66ad065fc0aa9d3af03d054a975b25da"} Jul 16 00:12:56.445826 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:56.445473 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-447d0dec-687f697d69-sj55d" event={"ID":"7a0f41e2-713b-485f-aa34-dcd9832be8c0","Type":"ContainerStarted","Data":"02e832873cecc474387d6252529acc600ec09dc4bf18a36ab5db99bbb11d7ace"} Jul 16 00:12:56.445826 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:56.445501 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-447d0dec-687f697d69-sj55d" Jul 16 00:12:56.462207 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:56.462163 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-447d0dec-687f697d69-sj55d" podStartSLOduration=0.786584589 podStartE2EDuration="1.462146793s" totalImagesPullingTime="675.562204ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:12:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:12:56.461341538 +0000 UTC m=+1567.692320334" watchObservedRunningTime="2026-07-16 00:12:56.462146793 +0000 UTC m=+1567.693125539" Jul 16 00:12:58.801968 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:12:58.801929 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:13:02.455590 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:13:02.455568 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-447d0dec-687f697d69-sj55d" Jul 16 00:13:06.798177 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:13:06.798145 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6"] Jul 16 00:13:06.801840 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:13:06.801816 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6" Jul 16 00:13:06.804337 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:13:06.804317 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-a5fc7f57-serving-cert\"" Jul 16 00:13:06.812569 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:13:06.812549 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6"] Jul 16 00:13:06.898918 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:13:06.898828 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12cc1ed0-2ad4-45e0-a8a7-6995b3a05b95-maas-api-tls\") pod \"maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6\" (UID: \"12cc1ed0-2ad4-45e0-a8a7-6995b3a05b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6" Jul 16 00:13:06.898918 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:13:06.898871 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbt29\" (UniqueName: \"kubernetes.io/projected/12cc1ed0-2ad4-45e0-a8a7-6995b3a05b95-kube-api-access-tbt29\") pod \"maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6\" (UID: \"12cc1ed0-2ad4-45e0-a8a7-6995b3a05b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6" Jul 16 00:13:06.898918 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:13:06.898894 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12cc1ed0-2ad4-45e0-a8a7-6995b3a05b95-openshift-service-ca\") pod \"maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6\" (UID: \"12cc1ed0-2ad4-45e0-a8a7-6995b3a05b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6" Jul 16 00:13:07.000155 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:13:07.000121 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12cc1ed0-2ad4-45e0-a8a7-6995b3a05b95-maas-api-tls\") pod \"maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6\" (UID: \"12cc1ed0-2ad4-45e0-a8a7-6995b3a05b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6" Jul 16 00:13:07.000155 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:13:07.000158 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbt29\" (UniqueName: \"kubernetes.io/projected/12cc1ed0-2ad4-45e0-a8a7-6995b3a05b95-kube-api-access-tbt29\") pod \"maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6\" (UID: \"12cc1ed0-2ad4-45e0-a8a7-6995b3a05b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6" Jul 16 00:13:07.000406 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:13:07.000183 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12cc1ed0-2ad4-45e0-a8a7-6995b3a05b95-openshift-service-ca\") pod \"maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6\" (UID: \"12cc1ed0-2ad4-45e0-a8a7-6995b3a05b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6" Jul 16 00:13:07.000938 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:13:07.000909 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12cc1ed0-2ad4-45e0-a8a7-6995b3a05b95-openshift-service-ca\") pod \"maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6\" (UID: \"12cc1ed0-2ad4-45e0-a8a7-6995b3a05b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6" Jul 16 00:13:07.002688 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:13:07.002649 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12cc1ed0-2ad4-45e0-a8a7-6995b3a05b95-maas-api-tls\") pod \"maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6\" (UID: \"12cc1ed0-2ad4-45e0-a8a7-6995b3a05b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6" Jul 16 00:13:07.010614 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:13:07.010589 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbt29\" (UniqueName: \"kubernetes.io/projected/12cc1ed0-2ad4-45e0-a8a7-6995b3a05b95-kube-api-access-tbt29\") pod \"maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6\" (UID: \"12cc1ed0-2ad4-45e0-a8a7-6995b3a05b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6" Jul 16 00:13:07.114604 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:13:07.114567 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6" Jul 16 00:13:07.247798 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:13:07.247764 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6"] Jul 16 00:13:07.248683 ip-10-0-142-228 kubenswrapper[2564]: W0716 00:13:07.248641 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12cc1ed0_2ad4_45e0_a8a7_6995b3a05b95.slice/crio-bee71efb9b79042ad404eb2bbeb593ed9007ac3fefed1c3134d10094562d513e WatchSource:0}: Error finding container bee71efb9b79042ad404eb2bbeb593ed9007ac3fefed1c3134d10094562d513e: Status 404 returned error can't find the container with id bee71efb9b79042ad404eb2bbeb593ed9007ac3fefed1c3134d10094562d513e Jul 16 00:13:07.499109 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:13:07.499071 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6" event={"ID":"12cc1ed0-2ad4-45e0-a8a7-6995b3a05b95","Type":"ContainerStarted","Data":"bee71efb9b79042ad404eb2bbeb593ed9007ac3fefed1c3134d10094562d513e"} Jul 16 00:13:08.505163 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:13:08.505126 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6" event={"ID":"12cc1ed0-2ad4-45e0-a8a7-6995b3a05b95","Type":"ContainerStarted","Data":"b56d698c7713e63ce122cb10f0e465c7907d9c852ad5bff46bca78a1327cf407"} Jul 16 00:13:08.505560 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:13:08.505241 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6" Jul 16 00:13:08.522109 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:13:08.522055 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6" podStartSLOduration=2.082403268 podStartE2EDuration="2.522037172s" totalImagesPullingTime="439.633904ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:13:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:08.521336799 +0000 UTC m=+1579.752315547" watchObservedRunningTime="2026-07-16 00:13:08.522037172 +0000 UTC m=+1579.753015919" Jul 16 00:13:11.198864 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:13:11.198819 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:13:14.514715 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:13:14.514685 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6" Jul 16 00:13:23.190265 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:13:23.190233 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:14:40.301812 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:14:40.301774 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:14:49.000828 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:14:49.000797 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:14:55.707417 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:14:55.707382 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k"] Jul 16 00:14:55.711294 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:14:55.711271 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k" Jul 16 00:14:55.713749 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:14:55.713729 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-9ed299d2-serving-cert\"" Jul 16 00:14:55.724048 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:14:55.724022 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k"] Jul 16 00:14:55.831396 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:14:55.831360 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec9b6d1-3991-4cf8-8096-2fe9e0223ae2-openshift-service-ca\") pod \"maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k\" (UID: \"5ec9b6d1-3991-4cf8-8096-2fe9e0223ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k" Jul 16 00:14:55.831556 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:14:55.831422 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rm9j\" (UniqueName: \"kubernetes.io/projected/5ec9b6d1-3991-4cf8-8096-2fe9e0223ae2-kube-api-access-8rm9j\") pod \"maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k\" (UID: \"5ec9b6d1-3991-4cf8-8096-2fe9e0223ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k" Jul 16 00:14:55.831556 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:14:55.831487 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ec9b6d1-3991-4cf8-8096-2fe9e0223ae2-maas-api-tls\") pod \"maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k\" (UID: \"5ec9b6d1-3991-4cf8-8096-2fe9e0223ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k" Jul 16 00:14:55.932685 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:14:55.932637 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rm9j\" (UniqueName: \"kubernetes.io/projected/5ec9b6d1-3991-4cf8-8096-2fe9e0223ae2-kube-api-access-8rm9j\") pod \"maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k\" (UID: \"5ec9b6d1-3991-4cf8-8096-2fe9e0223ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k" Jul 16 00:14:55.932853 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:14:55.932719 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ec9b6d1-3991-4cf8-8096-2fe9e0223ae2-maas-api-tls\") pod \"maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k\" (UID: \"5ec9b6d1-3991-4cf8-8096-2fe9e0223ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k" Jul 16 00:14:55.932853 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:14:55.932769 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec9b6d1-3991-4cf8-8096-2fe9e0223ae2-openshift-service-ca\") pod \"maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k\" (UID: \"5ec9b6d1-3991-4cf8-8096-2fe9e0223ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k" Jul 16 00:14:55.933391 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:14:55.933368 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec9b6d1-3991-4cf8-8096-2fe9e0223ae2-openshift-service-ca\") pod \"maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k\" (UID: \"5ec9b6d1-3991-4cf8-8096-2fe9e0223ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k" Jul 16 00:14:55.935134 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:14:55.935115 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ec9b6d1-3991-4cf8-8096-2fe9e0223ae2-maas-api-tls\") pod \"maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k\" (UID: \"5ec9b6d1-3991-4cf8-8096-2fe9e0223ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k" Jul 16 00:14:55.942998 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:14:55.942974 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rm9j\" (UniqueName: \"kubernetes.io/projected/5ec9b6d1-3991-4cf8-8096-2fe9e0223ae2-kube-api-access-8rm9j\") pod \"maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k\" (UID: \"5ec9b6d1-3991-4cf8-8096-2fe9e0223ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k" Jul 16 00:14:56.024931 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:14:56.024865 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k" Jul 16 00:14:56.153540 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:14:56.153513 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k"] Jul 16 00:14:56.155713 ip-10-0-142-228 kubenswrapper[2564]: W0716 00:14:56.155681 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ec9b6d1_3991_4cf8_8096_2fe9e0223ae2.slice/crio-5769b77eea9250bdf5f68d50c8708627140555a6d174a3cb97bdf98b5524347c WatchSource:0}: Error finding container 5769b77eea9250bdf5f68d50c8708627140555a6d174a3cb97bdf98b5524347c: Status 404 returned error can't find the container with id 5769b77eea9250bdf5f68d50c8708627140555a6d174a3cb97bdf98b5524347c Jul 16 00:14:57.012045 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:14:57.012011 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k" event={"ID":"5ec9b6d1-3991-4cf8-8096-2fe9e0223ae2","Type":"ContainerStarted","Data":"698c78ec7fd5753f8b6dbc6ee7ca34ed3b5c76998881bc36b596bd44e1209ac9"} Jul 16 00:14:57.012429 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:14:57.012059 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k" event={"ID":"5ec9b6d1-3991-4cf8-8096-2fe9e0223ae2","Type":"ContainerStarted","Data":"5769b77eea9250bdf5f68d50c8708627140555a6d174a3cb97bdf98b5524347c"} Jul 16 00:14:57.012429 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:14:57.012114 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k" Jul 16 00:14:57.028891 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:14:57.028850 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k" podStartSLOduration=1.590035033 podStartE2EDuration="2.028835934s" totalImagesPullingTime="438.800901ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:14:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:14:57.027163965 +0000 UTC m=+1688.258142734" watchObservedRunningTime="2026-07-16 00:14:57.028835934 +0000 UTC m=+1688.259814680" Jul 16 00:15:00.143707 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:00.143651 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736015-8qq4d"] Jul 16 00:15:00.147453 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:00.147424 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-447d0dec-29736015-r2kk2"] Jul 16 00:15:00.147558 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:00.147539 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736015-8qq4d" Jul 16 00:15:00.150623 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:00.150604 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-9ed299d2-29736015-wn28m"] Jul 16 00:15:00.150748 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:00.150730 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-447d0dec-29736015-r2kk2" Jul 16 00:15:00.153037 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:00.153014 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jg2q4\"" Jul 16 00:15:00.154063 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:00.154041 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f093c30e-29736015-lfnfj"] Jul 16 00:15:00.154500 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:00.154471 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-9ed299d2-29736015-wn28m" Jul 16 00:15:00.157802 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:00.157784 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-a5fc7f57-29736015-dqnbh"] Jul 16 00:15:00.158381 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:00.157976 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f093c30e-29736015-lfnfj" Jul 16 00:15:00.161952 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:00.161930 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736015-8qq4d" Jul 16 00:15:00.161952 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:00.161949 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736015-8qq4d"] Jul 16 00:15:00.162129 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:00.161985 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-447d0dec-29736015-r2kk2"] Jul 16 00:15:00.162129 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:00.162061 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-a5fc7f57-29736015-dqnbh" Jul 16 00:15:00.162954 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:00.162935 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-9ed299d2-29736015-wn28m"] Jul 16 00:15:00.171875 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:00.171734 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-447d0dec-29736015-r2kk2" Jul 16 00:15:00.172510 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:00.172489 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f093c30e-29736015-lfnfj"] Jul 16 00:15:00.191869 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:00.191274 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-a5fc7f57-29736015-dqnbh"] Jul 16 00:15:00.218258 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:00.218236 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-9ed299d2-29736015-wn28m" Jul 16 00:15:00.226346 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:00.226320 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f093c30e-29736015-lfnfj" Jul 16 00:15:00.267150 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:00.266946 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-a5fc7f57-29736015-dqnbh" Jul 16 00:15:00.389379 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:00.386957 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736015-8qq4d"] Jul 16 00:15:00.414242 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:00.414216 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-447d0dec-29736015-r2kk2"] Jul 16 00:15:00.417035 ip-10-0-142-228 kubenswrapper[2564]: W0716 00:15:00.416716 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod208839f3_88d7_42ac_8638_d139d84cf593.slice/crio-c599fc7cea596e10a521b31b37e452b8d734c6e4ec5af34819f9ad70fb02f6b8 WatchSource:0}: Error finding container c599fc7cea596e10a521b31b37e452b8d734c6e4ec5af34819f9ad70fb02f6b8: Status 404 returned error can't find the container with id c599fc7cea596e10a521b31b37e452b8d734c6e4ec5af34819f9ad70fb02f6b8 Jul 16 00:15:00.442044 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:00.441820 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-9ed299d2-29736015-wn28m"] Jul 16 00:15:00.467908 ip-10-0-142-228 kubenswrapper[2564]: W0716 00:15:00.467885 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13cc3613_3235_4cc3_8665_d1c1705e925d.slice/crio-393cdf4fa3688151945fc757e736936025788827d6ab91968e2a573cdba7b595 WatchSource:0}: Error finding container 393cdf4fa3688151945fc757e736936025788827d6ab91968e2a573cdba7b595: Status 404 returned error can't find the container with id 393cdf4fa3688151945fc757e736936025788827d6ab91968e2a573cdba7b595 Jul 16 00:15:00.681724 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:00.681643 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f093c30e-29736015-lfnfj"] Jul 16 00:15:00.683736 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:00.683713 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-a5fc7f57-29736015-dqnbh"] Jul 16 00:15:00.684088 ip-10-0-142-228 kubenswrapper[2564]: W0716 00:15:00.684062 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cefcfa3_2084_4d29_9e78_ca9de700db93.slice/crio-69b8689aa7a693c63e050ceb350651e423bb0db2497e07744f760b3a128badba WatchSource:0}: Error finding container 69b8689aa7a693c63e050ceb350651e423bb0db2497e07744f760b3a128badba: Status 404 returned error can't find the container with id 69b8689aa7a693c63e050ceb350651e423bb0db2497e07744f760b3a128badba Jul 16 00:15:00.685744 ip-10-0-142-228 kubenswrapper[2564]: W0716 00:15:00.685688 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe0fffa9_6872_47f6_9174_1bb7f5909cc3.slice/crio-c0eabc2848822912904cb4714e62b05eb237c0dcdd701ec3eb3da3cca24a1893 WatchSource:0}: Error finding container c0eabc2848822912904cb4714e62b05eb237c0dcdd701ec3eb3da3cca24a1893: Status 404 returned error can't find the container with id c0eabc2848822912904cb4714e62b05eb237c0dcdd701ec3eb3da3cca24a1893 Jul 16 00:15:01.033045 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:01.033009 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-9ed299d2-29736015-wn28m" event={"ID":"13cc3613-3235-4cc3-8665-d1c1705e925d","Type":"ContainerStarted","Data":"cf121b2e61b2474b8651adce09e18a2fb74cefc236a5e67e42106f4c3048bf80"} Jul 16 00:15:01.033225 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:01.033068 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-9ed299d2-29736015-wn28m" event={"ID":"13cc3613-3235-4cc3-8665-d1c1705e925d","Type":"ContainerStarted","Data":"393cdf4fa3688151945fc757e736936025788827d6ab91968e2a573cdba7b595"} Jul 16 00:15:01.034540 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:01.034508 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736015-8qq4d" event={"ID":"5b8c3d1f-ad6d-444d-9a78-cdf9dc981afc","Type":"ContainerStarted","Data":"8acec7b6c43f74dcc61cfc36db2a44f8e5744871355c09fae22a20b27428157e"} Jul 16 00:15:01.034652 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:01.034566 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736015-8qq4d" event={"ID":"5b8c3d1f-ad6d-444d-9a78-cdf9dc981afc","Type":"ContainerStarted","Data":"eef092cbefe759cb8a2deb08723077b9d51d6bb154b26877c19b429e6afb722b"} Jul 16 00:15:01.035728 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:01.035702 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-a5fc7f57-29736015-dqnbh" event={"ID":"fe0fffa9-6872-47f6-9174-1bb7f5909cc3","Type":"ContainerStarted","Data":"c0eabc2848822912904cb4714e62b05eb237c0dcdd701ec3eb3da3cca24a1893"} Jul 16 00:15:01.037263 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:01.037243 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f093c30e-29736015-lfnfj" event={"ID":"8cefcfa3-2084-4d29-9e78-ca9de700db93","Type":"ContainerStarted","Data":"fb1c598efffa4a0d903a10caf61c980c733be6b67ccf90e030289a7f9d5f2902"} Jul 16 00:15:01.037366 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:01.037281 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f093c30e-29736015-lfnfj" event={"ID":"8cefcfa3-2084-4d29-9e78-ca9de700db93","Type":"ContainerStarted","Data":"69b8689aa7a693c63e050ceb350651e423bb0db2497e07744f760b3a128badba"} Jul 16 00:15:01.038737 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:01.038717 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-447d0dec-29736015-r2kk2" event={"ID":"208839f3-88d7-42ac-8638-d139d84cf593","Type":"ContainerStarted","Data":"1cc4b5dab98ca50c00706a897d2a16f55bc82fa869167d0aad0f9982aef6d450"} Jul 16 00:15:01.038836 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:01.038749 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-447d0dec-29736015-r2kk2" event={"ID":"208839f3-88d7-42ac-8638-d139d84cf593","Type":"ContainerStarted","Data":"c599fc7cea596e10a521b31b37e452b8d734c6e4ec5af34819f9ad70fb02f6b8"} Jul 16 00:15:01.048254 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:01.048181 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-9ed299d2-29736015-wn28m" podStartSLOduration=1.048163633 podStartE2EDuration="1.048163633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:15:01.047802941 +0000 UTC m=+1692.278781722" watchObservedRunningTime="2026-07-16 00:15:01.048163633 +0000 UTC m=+1692.279142382" Jul 16 00:15:01.062448 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:01.062407 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736015-8qq4d" podStartSLOduration=1.062394042 podStartE2EDuration="1.062394042s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:15:01.060874911 +0000 UTC m=+1692.291853664" watchObservedRunningTime="2026-07-16 00:15:01.062394042 +0000 UTC m=+1692.293372789" Jul 16 00:15:01.077386 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:01.077343 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-447d0dec-29736015-r2kk2" podStartSLOduration=1.077331259 podStartE2EDuration="1.077331259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:15:01.075172944 +0000 UTC m=+1692.306151690" watchObservedRunningTime="2026-07-16 00:15:01.077331259 +0000 UTC m=+1692.308310005" Jul 16 00:15:01.090573 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:01.090534 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f093c30e-29736015-lfnfj" podStartSLOduration=1.09052341 podStartE2EDuration="1.09052341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:15:01.088728184 +0000 UTC m=+1692.319706955" watchObservedRunningTime="2026-07-16 00:15:01.09052341 +0000 UTC m=+1692.321502159" Jul 16 00:15:02.046002 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:02.045968 2564 generic.go:356] "Generic (PLEG): container finished" podID="8cefcfa3-2084-4d29-9e78-ca9de700db93" containerID="fb1c598efffa4a0d903a10caf61c980c733be6b67ccf90e030289a7f9d5f2902" exitCode=0 Jul 16 00:15:02.046406 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:02.046050 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f093c30e-29736015-lfnfj" event={"ID":"8cefcfa3-2084-4d29-9e78-ca9de700db93","Type":"ContainerDied","Data":"fb1c598efffa4a0d903a10caf61c980c733be6b67ccf90e030289a7f9d5f2902"} Jul 16 00:15:02.047522 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:02.047501 2564 generic.go:356] "Generic (PLEG): container finished" podID="208839f3-88d7-42ac-8638-d139d84cf593" containerID="1cc4b5dab98ca50c00706a897d2a16f55bc82fa869167d0aad0f9982aef6d450" exitCode=0 Jul 16 00:15:02.047618 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:02.047588 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-447d0dec-29736015-r2kk2" event={"ID":"208839f3-88d7-42ac-8638-d139d84cf593","Type":"ContainerDied","Data":"1cc4b5dab98ca50c00706a897d2a16f55bc82fa869167d0aad0f9982aef6d450"} Jul 16 00:15:02.048974 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:02.048953 2564 generic.go:356] "Generic (PLEG): container finished" podID="13cc3613-3235-4cc3-8665-d1c1705e925d" containerID="cf121b2e61b2474b8651adce09e18a2fb74cefc236a5e67e42106f4c3048bf80" exitCode=7 Jul 16 00:15:02.049047 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:02.048974 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-9ed299d2-29736015-wn28m" event={"ID":"13cc3613-3235-4cc3-8665-d1c1705e925d","Type":"ContainerDied","Data":"cf121b2e61b2474b8651adce09e18a2fb74cefc236a5e67e42106f4c3048bf80"} Jul 16 00:15:02.049191 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:02.049176 2564 scope.go:117] "RemoveContainer" containerID="cf121b2e61b2474b8651adce09e18a2fb74cefc236a5e67e42106f4c3048bf80" Jul 16 00:15:02.050462 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:02.050440 2564 generic.go:356] "Generic (PLEG): container finished" podID="5b8c3d1f-ad6d-444d-9a78-cdf9dc981afc" containerID="8acec7b6c43f74dcc61cfc36db2a44f8e5744871355c09fae22a20b27428157e" exitCode=0 Jul 16 00:15:02.050538 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:02.050512 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736015-8qq4d" event={"ID":"5b8c3d1f-ad6d-444d-9a78-cdf9dc981afc","Type":"ContainerDied","Data":"8acec7b6c43f74dcc61cfc36db2a44f8e5744871355c09fae22a20b27428157e"} Jul 16 00:15:02.051925 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:02.051903 2564 generic.go:356] "Generic (PLEG): container finished" podID="fe0fffa9-6872-47f6-9174-1bb7f5909cc3" containerID="080b4a3ea1096124b69166453ede8c35f8bffee2c8bd33d45446717ed717f922" exitCode=0 Jul 16 00:15:02.052007 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:02.051936 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-a5fc7f57-29736015-dqnbh" event={"ID":"fe0fffa9-6872-47f6-9174-1bb7f5909cc3","Type":"ContainerDied","Data":"080b4a3ea1096124b69166453ede8c35f8bffee2c8bd33d45446717ed717f922"} Jul 16 00:15:02.332874 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:02.332789 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:15:03.021777 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:03.021747 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k" Jul 16 00:15:03.061020 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:03.060975 2564 generic.go:356] "Generic (PLEG): container finished" podID="13cc3613-3235-4cc3-8665-d1c1705e925d" containerID="33b1d11ddc3cb837779869fb1d129e7ca90956af98530fa3405fb631fa3f3a04" exitCode=7 Jul 16 00:15:03.061528 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:03.061053 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-9ed299d2-29736015-wn28m" event={"ID":"13cc3613-3235-4cc3-8665-d1c1705e925d","Type":"ContainerDied","Data":"33b1d11ddc3cb837779869fb1d129e7ca90956af98530fa3405fb631fa3f3a04"} Jul 16 00:15:03.061528 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:03.061126 2564 scope.go:117] "RemoveContainer" containerID="cf121b2e61b2474b8651adce09e18a2fb74cefc236a5e67e42106f4c3048bf80" Jul 16 00:15:03.062325 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:03.061770 2564 scope.go:117] "RemoveContainer" containerID="33b1d11ddc3cb837779869fb1d129e7ca90956af98530fa3405fb631fa3f3a04" Jul 16 00:15:03.062325 ip-10-0-142-228 kubenswrapper[2564]: E0716 00:15:03.062034 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-mt-9ed299d2-29736015-wn28m_odh-ai-gateway-infra(13cc3613-3235-4cc3-8665-d1c1705e925d)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-9ed299d2-29736015-wn28m" podUID="13cc3613-3235-4cc3-8665-d1c1705e925d" Jul 16 00:15:03.222299 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:03.222272 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-a5fc7f57-29736015-dqnbh" Jul 16 00:15:03.259116 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:03.259088 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f093c30e-29736015-lfnfj" Jul 16 00:15:03.278787 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:03.278726 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736015-8qq4d" Jul 16 00:15:03.282478 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:03.282460 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-447d0dec-29736015-r2kk2" Jul 16 00:15:04.067965 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:04.067940 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-a5fc7f57-29736015-dqnbh" Jul 16 00:15:04.068414 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:04.067935 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-a5fc7f57-29736015-dqnbh" event={"ID":"fe0fffa9-6872-47f6-9174-1bb7f5909cc3","Type":"ContainerDied","Data":"c0eabc2848822912904cb4714e62b05eb237c0dcdd701ec3eb3da3cca24a1893"} Jul 16 00:15:04.068414 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:04.068068 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0eabc2848822912904cb4714e62b05eb237c0dcdd701ec3eb3da3cca24a1893" Jul 16 00:15:04.069185 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:04.069160 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f093c30e-29736015-lfnfj" Jul 16 00:15:04.069185 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:04.069172 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f093c30e-29736015-lfnfj" event={"ID":"8cefcfa3-2084-4d29-9e78-ca9de700db93","Type":"ContainerDied","Data":"69b8689aa7a693c63e050ceb350651e423bb0db2497e07744f760b3a128badba"} Jul 16 00:15:04.069376 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:04.069209 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69b8689aa7a693c63e050ceb350651e423bb0db2497e07744f760b3a128badba" Jul 16 00:15:04.070555 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:04.070535 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-447d0dec-29736015-r2kk2" Jul 16 00:15:04.070644 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:04.070560 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-447d0dec-29736015-r2kk2" event={"ID":"208839f3-88d7-42ac-8638-d139d84cf593","Type":"ContainerDied","Data":"c599fc7cea596e10a521b31b37e452b8d734c6e4ec5af34819f9ad70fb02f6b8"} Jul 16 00:15:04.070644 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:04.070600 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c599fc7cea596e10a521b31b37e452b8d734c6e4ec5af34819f9ad70fb02f6b8" Jul 16 00:15:04.072390 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:04.072370 2564 scope.go:117] "RemoveContainer" containerID="33b1d11ddc3cb837779869fb1d129e7ca90956af98530fa3405fb631fa3f3a04" Jul 16 00:15:04.072594 ip-10-0-142-228 kubenswrapper[2564]: E0716 00:15:04.072569 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-mt-9ed299d2-29736015-wn28m_odh-ai-gateway-infra(13cc3613-3235-4cc3-8665-d1c1705e925d)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-9ed299d2-29736015-wn28m" podUID="13cc3613-3235-4cc3-8665-d1c1705e925d" Jul 16 00:15:04.073748 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:04.073730 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736015-8qq4d" event={"ID":"5b8c3d1f-ad6d-444d-9a78-cdf9dc981afc","Type":"ContainerDied","Data":"eef092cbefe759cb8a2deb08723077b9d51d6bb154b26877c19b429e6afb722b"} Jul 16 00:15:04.073827 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:04.073761 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eef092cbefe759cb8a2deb08723077b9d51d6bb154b26877c19b429e6afb722b" Jul 16 00:15:04.073827 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:04.073767 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736015-8qq4d" Jul 16 00:15:17.296516 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:17.296444 2564 scope.go:117] "RemoveContainer" containerID="33b1d11ddc3cb837779869fb1d129e7ca90956af98530fa3405fb631fa3f3a04" Jul 16 00:15:18.143795 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:18.143757 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-9ed299d2-29736015-wn28m" event={"ID":"13cc3613-3235-4cc3-8665-d1c1705e925d","Type":"ContainerStarted","Data":"f084ff8839c2b408af6876e46cde6f350ec53ea879e3ab0976b2bea6650f1fbe"} Jul 16 00:15:18.193561 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:18.193526 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:15:19.150863 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:19.150833 2564 generic.go:356] "Generic (PLEG): container finished" podID="13cc3613-3235-4cc3-8665-d1c1705e925d" containerID="f084ff8839c2b408af6876e46cde6f350ec53ea879e3ab0976b2bea6650f1fbe" exitCode=0 Jul 16 00:15:19.151260 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:19.150907 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-9ed299d2-29736015-wn28m" event={"ID":"13cc3613-3235-4cc3-8665-d1c1705e925d","Type":"ContainerDied","Data":"f084ff8839c2b408af6876e46cde6f350ec53ea879e3ab0976b2bea6650f1fbe"} Jul 16 00:15:19.151260 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:19.150974 2564 scope.go:117] "RemoveContainer" containerID="33b1d11ddc3cb837779869fb1d129e7ca90956af98530fa3405fb631fa3f3a04" Jul 16 00:15:19.173804 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:19.173776 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-9ed299d2-29736015-wn28m"] Jul 16 00:15:20.295536 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:20.295510 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-9ed299d2-29736015-wn28m" Jul 16 00:15:21.163275 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:21.163248 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-9ed299d2-29736015-wn28m" Jul 16 00:15:21.163451 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:21.163288 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-9ed299d2-29736015-wn28m" event={"ID":"13cc3613-3235-4cc3-8665-d1c1705e925d","Type":"ContainerDied","Data":"393cdf4fa3688151945fc757e736936025788827d6ab91968e2a573cdba7b595"} Jul 16 00:15:21.163451 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:21.163336 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="393cdf4fa3688151945fc757e736936025788827d6ab91968e2a573cdba7b595" Jul 16 00:15:21.195771 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:21.195735 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-9ed299d2-29736015-wn28m"] Jul 16 00:15:21.203264 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:21.203240 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-9ed299d2-29736015-wn28m"] Jul 16 00:15:21.301999 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:21.301971 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13cc3613-3235-4cc3-8665-d1c1705e925d" path="/var/lib/kubelet/pods/13cc3613-3235-4cc3-8665-d1c1705e925d/volumes" Jul 16 00:15:39.402582 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:39.402543 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:15:51.896999 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:15:51.896959 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:16:30.139968 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.139936 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz"] Jul 16 00:16:30.140523 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.140458 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13cc3613-3235-4cc3-8665-d1c1705e925d" containerName="cleanup" Jul 16 00:16:30.140523 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.140479 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="13cc3613-3235-4cc3-8665-d1c1705e925d" containerName="cleanup" Jul 16 00:16:30.140523 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.140501 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="208839f3-88d7-42ac-8638-d139d84cf593" containerName="cleanup" Jul 16 00:16:30.140523 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.140509 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="208839f3-88d7-42ac-8638-d139d84cf593" containerName="cleanup" Jul 16 00:16:30.140754 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.140527 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cefcfa3-2084-4d29-9e78-ca9de700db93" containerName="cleanup" Jul 16 00:16:30.140754 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.140535 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cefcfa3-2084-4d29-9e78-ca9de700db93" containerName="cleanup" Jul 16 00:16:30.140754 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.140544 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe0fffa9-6872-47f6-9174-1bb7f5909cc3" containerName="cleanup" Jul 16 00:16:30.140754 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.140553 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe0fffa9-6872-47f6-9174-1bb7f5909cc3" containerName="cleanup" Jul 16 00:16:30.140754 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.140575 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b8c3d1f-ad6d-444d-9a78-cdf9dc981afc" containerName="cleanup" Jul 16 00:16:30.140754 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.140584 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b8c3d1f-ad6d-444d-9a78-cdf9dc981afc" containerName="cleanup" Jul 16 00:16:30.140754 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.140602 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13cc3613-3235-4cc3-8665-d1c1705e925d" containerName="cleanup" Jul 16 00:16:30.140754 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.140611 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="13cc3613-3235-4cc3-8665-d1c1705e925d" containerName="cleanup" Jul 16 00:16:30.141109 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.140837 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="13cc3613-3235-4cc3-8665-d1c1705e925d" containerName="cleanup" Jul 16 00:16:30.141109 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.140854 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="13cc3613-3235-4cc3-8665-d1c1705e925d" containerName="cleanup" Jul 16 00:16:30.141109 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.140868 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b8c3d1f-ad6d-444d-9a78-cdf9dc981afc" containerName="cleanup" Jul 16 00:16:30.141109 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.140879 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe0fffa9-6872-47f6-9174-1bb7f5909cc3" containerName="cleanup" Jul 16 00:16:30.141109 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.140889 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cefcfa3-2084-4d29-9e78-ca9de700db93" containerName="cleanup" Jul 16 00:16:30.141109 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.140900 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="208839f3-88d7-42ac-8638-d139d84cf593" containerName="cleanup" Jul 16 00:16:30.144132 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.144112 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz" Jul 16 00:16:30.146323 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.146296 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-30d4db-serving-cert\"" Jul 16 00:16:30.154903 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.154877 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz"] Jul 16 00:16:30.228592 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.228560 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b55493df-40b5-42ca-9d5a-38e4c3803245-maas-api-tls\") pod \"maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz\" (UID: \"b55493df-40b5-42ca-9d5a-38e4c3803245\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz" Jul 16 00:16:30.228592 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.228593 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b55493df-40b5-42ca-9d5a-38e4c3803245-openshift-service-ca\") pod \"maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz\" (UID: \"b55493df-40b5-42ca-9d5a-38e4c3803245\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz" Jul 16 00:16:30.228796 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.228765 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq49v\" (UniqueName: \"kubernetes.io/projected/b55493df-40b5-42ca-9d5a-38e4c3803245-kube-api-access-bq49v\") pod \"maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz\" (UID: \"b55493df-40b5-42ca-9d5a-38e4c3803245\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz" Jul 16 00:16:30.329233 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.329170 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq49v\" (UniqueName: \"kubernetes.io/projected/b55493df-40b5-42ca-9d5a-38e4c3803245-kube-api-access-bq49v\") pod \"maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz\" (UID: \"b55493df-40b5-42ca-9d5a-38e4c3803245\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz" Jul 16 00:16:30.329404 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.329277 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b55493df-40b5-42ca-9d5a-38e4c3803245-maas-api-tls\") pod \"maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz\" (UID: \"b55493df-40b5-42ca-9d5a-38e4c3803245\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz" Jul 16 00:16:30.329404 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.329298 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b55493df-40b5-42ca-9d5a-38e4c3803245-openshift-service-ca\") pod \"maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz\" (UID: \"b55493df-40b5-42ca-9d5a-38e4c3803245\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz" Jul 16 00:16:30.329534 ip-10-0-142-228 kubenswrapper[2564]: E0716 00:16:30.329413 2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-30d4db-serving-cert: secret "maas-api-e2e-inf-a-30d4db-serving-cert" not found Jul 16 00:16:30.329534 ip-10-0-142-228 kubenswrapper[2564]: E0716 00:16:30.329480 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b55493df-40b5-42ca-9d5a-38e4c3803245-maas-api-tls podName:b55493df-40b5-42ca-9d5a-38e4c3803245 nodeName:}" failed. No retries permitted until 2026-07-16 00:16:30.829465124 +0000 UTC m=+1782.060443849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b55493df-40b5-42ca-9d5a-38e4c3803245-maas-api-tls") pod "maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz" (UID: "b55493df-40b5-42ca-9d5a-38e4c3803245") : secret "maas-api-e2e-inf-a-30d4db-serving-cert" not found Jul 16 00:16:30.330073 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.330055 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b55493df-40b5-42ca-9d5a-38e4c3803245-openshift-service-ca\") pod \"maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz\" (UID: \"b55493df-40b5-42ca-9d5a-38e4c3803245\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz" Jul 16 00:16:30.347030 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.347009 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq49v\" (UniqueName: \"kubernetes.io/projected/b55493df-40b5-42ca-9d5a-38e4c3803245-kube-api-access-bq49v\") pod \"maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz\" (UID: \"b55493df-40b5-42ca-9d5a-38e4c3803245\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz" Jul 16 00:16:30.832135 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.832103 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b55493df-40b5-42ca-9d5a-38e4c3803245-maas-api-tls\") pod \"maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz\" (UID: \"b55493df-40b5-42ca-9d5a-38e4c3803245\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz" Jul 16 00:16:30.834448 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:30.834419 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b55493df-40b5-42ca-9d5a-38e4c3803245-maas-api-tls\") pod \"maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz\" (UID: \"b55493df-40b5-42ca-9d5a-38e4c3803245\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz" Jul 16 00:16:31.057357 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:31.057320 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz" Jul 16 00:16:31.190974 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:31.190947 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz"] Jul 16 00:16:31.193048 ip-10-0-142-228 kubenswrapper[2564]: W0716 00:16:31.193020 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb55493df_40b5_42ca_9d5a_38e4c3803245.slice/crio-255ffd2c73ee67f0d9adb52361af0fc77eb40558a79b7ab79a6e38858e863526 WatchSource:0}: Error finding container 255ffd2c73ee67f0d9adb52361af0fc77eb40558a79b7ab79a6e38858e863526: Status 404 returned error can't find the container with id 255ffd2c73ee67f0d9adb52361af0fc77eb40558a79b7ab79a6e38858e863526 Jul 16 00:16:31.503336 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:31.503299 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz" event={"ID":"b55493df-40b5-42ca-9d5a-38e4c3803245","Type":"ContainerStarted","Data":"255ffd2c73ee67f0d9adb52361af0fc77eb40558a79b7ab79a6e38858e863526"} Jul 16 00:16:32.509703 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:32.509642 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz" event={"ID":"b55493df-40b5-42ca-9d5a-38e4c3803245","Type":"ContainerStarted","Data":"4cc131744b213a93a3ef57dad7d97201395e0ffa355dda7b58ec1c5655815cdb"} Jul 16 00:16:32.510342 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:32.509774 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz" Jul 16 00:16:32.525870 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:32.525822 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz" podStartSLOduration=2.01038188 podStartE2EDuration="2.525805981s" totalImagesPullingTime="515.424101ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:16:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:16:32.524925805 +0000 UTC m=+1783.755904570" watchObservedRunningTime="2026-07-16 00:16:32.525805981 +0000 UTC m=+1783.756784765" Jul 16 00:16:37.848620 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:37.848585 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8"] Jul 16 00:16:37.849213 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:37.849146 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13cc3613-3235-4cc3-8665-d1c1705e925d" containerName="cleanup" Jul 16 00:16:37.849213 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:37.849164 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="13cc3613-3235-4cc3-8665-d1c1705e925d" containerName="cleanup" Jul 16 00:16:37.849327 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:37.849238 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="13cc3613-3235-4cc3-8665-d1c1705e925d" containerName="cleanup" Jul 16 00:16:37.852513 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:37.852494 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8" Jul 16 00:16:37.855560 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:37.855536 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-4dc784-serving-cert\"" Jul 16 00:16:37.864315 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:37.864286 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8"] Jul 16 00:16:37.884760 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:37.884731 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a64e71a7-3107-4728-a307-c82dc5a598bf-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8\" (UID: \"a64e71a7-3107-4728-a307-c82dc5a598bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8" Jul 16 00:16:37.884891 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:37.884779 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsx5f\" (UniqueName: \"kubernetes.io/projected/a64e71a7-3107-4728-a307-c82dc5a598bf-kube-api-access-bsx5f\") pod \"maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8\" (UID: \"a64e71a7-3107-4728-a307-c82dc5a598bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8" Jul 16 00:16:37.884891 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:37.884876 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a64e71a7-3107-4728-a307-c82dc5a598bf-maas-api-tls\") pod \"maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8\" (UID: \"a64e71a7-3107-4728-a307-c82dc5a598bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8" Jul 16 00:16:37.985391 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:37.985349 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a64e71a7-3107-4728-a307-c82dc5a598bf-maas-api-tls\") pod \"maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8\" (UID: \"a64e71a7-3107-4728-a307-c82dc5a598bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8" Jul 16 00:16:37.985586 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:37.985406 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a64e71a7-3107-4728-a307-c82dc5a598bf-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8\" (UID: \"a64e71a7-3107-4728-a307-c82dc5a598bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8" Jul 16 00:16:37.985586 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:37.985442 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsx5f\" (UniqueName: \"kubernetes.io/projected/a64e71a7-3107-4728-a307-c82dc5a598bf-kube-api-access-bsx5f\") pod \"maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8\" (UID: \"a64e71a7-3107-4728-a307-c82dc5a598bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8" Jul 16 00:16:37.986118 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:37.986096 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a64e71a7-3107-4728-a307-c82dc5a598bf-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8\" (UID: \"a64e71a7-3107-4728-a307-c82dc5a598bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8" Jul 16 00:16:37.987854 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:37.987833 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a64e71a7-3107-4728-a307-c82dc5a598bf-maas-api-tls\") pod \"maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8\" (UID: \"a64e71a7-3107-4728-a307-c82dc5a598bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8" Jul 16 00:16:37.994636 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:37.994616 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsx5f\" (UniqueName: \"kubernetes.io/projected/a64e71a7-3107-4728-a307-c82dc5a598bf-kube-api-access-bsx5f\") pod \"maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8\" (UID: \"a64e71a7-3107-4728-a307-c82dc5a598bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8" Jul 16 00:16:38.166411 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:38.166307 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8" Jul 16 00:16:38.348139 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:38.348115 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8"] Jul 16 00:16:38.350548 ip-10-0-142-228 kubenswrapper[2564]: W0716 00:16:38.350517 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda64e71a7_3107_4728_a307_c82dc5a598bf.slice/crio-c10b4b643cd3087ea946a2f11fb8b1592e0dd77ea611e26afc737c447927190c WatchSource:0}: Error finding container c10b4b643cd3087ea946a2f11fb8b1592e0dd77ea611e26afc737c447927190c: Status 404 returned error can't find the container with id c10b4b643cd3087ea946a2f11fb8b1592e0dd77ea611e26afc737c447927190c Jul 16 00:16:38.522683 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:38.522638 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz" Jul 16 00:16:38.545234 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:38.545202 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8" event={"ID":"a64e71a7-3107-4728-a307-c82dc5a598bf","Type":"ContainerStarted","Data":"c10b4b643cd3087ea946a2f11fb8b1592e0dd77ea611e26afc737c447927190c"} Jul 16 00:16:39.552001 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:39.551966 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8" event={"ID":"a64e71a7-3107-4728-a307-c82dc5a598bf","Type":"ContainerStarted","Data":"dfb05aab511fa7db45e8eb6ea46c58e5142b85a0d885b04e171a14954c3aa421"} Jul 16 00:16:39.552439 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:39.552108 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8" Jul 16 00:16:39.570248 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:39.570203 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8" podStartSLOduration=2.059894415 podStartE2EDuration="2.570189347s" totalImagesPullingTime="510.294932ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:16:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:16:39.567703656 +0000 UTC m=+1790.798682422" watchObservedRunningTime="2026-07-16 00:16:39.570189347 +0000 UTC m=+1790.801168094" Jul 16 00:16:40.298534 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:40.298499 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:16:45.563450 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:45.563372 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8" Jul 16 00:16:49.353167 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:49.353132 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-7g2gx_0f1c9d30-fe51-493e-9b47-84d63b56fa8f/console-operator/1.log" Jul 16 00:16:49.356532 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:49.356505 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-7g2gx_0f1c9d30-fe51-493e-9b47-84d63b56fa8f/console-operator/1.log" Jul 16 00:16:49.359980 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:49.359961 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fp65r_d05a6a90-8e18-4a88-b6b9-b3a3712ffe07/ovn-acl-logging/0.log" Jul 16 00:16:49.362899 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:49.362882 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fp65r_d05a6a90-8e18-4a88-b6b9-b3a3712ffe07/ovn-acl-logging/0.log" Jul 16 00:16:53.810888 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:16:53.810845 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:17:07.997869 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:17:07.997760 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:17:24.000885 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:17:24.000850 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:17:57.293385 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:17:57.293346 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:18:39.717949 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:39.717913 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:18:46.945212 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:46.945179 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m"] Jul 16 00:18:46.949131 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:46.949114 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m" Jul 16 00:18:46.951430 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:46.951408 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-2aa494-serving-cert\"" Jul 16 00:18:46.959922 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:46.959895 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m"] Jul 16 00:18:47.004518 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:47.004489 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14c72bcc-c62a-472b-98da-2d59fbeb690e-maas-api-tls\") pod \"maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m\" (UID: \"14c72bcc-c62a-472b-98da-2d59fbeb690e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m" Jul 16 00:18:47.004681 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:47.004529 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtwzr\" (UniqueName: \"kubernetes.io/projected/14c72bcc-c62a-472b-98da-2d59fbeb690e-kube-api-access-dtwzr\") pod \"maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m\" (UID: \"14c72bcc-c62a-472b-98da-2d59fbeb690e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m" Jul 16 00:18:47.004681 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:47.004651 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14c72bcc-c62a-472b-98da-2d59fbeb690e-openshift-service-ca\") pod \"maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m\" (UID: \"14c72bcc-c62a-472b-98da-2d59fbeb690e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m" Jul 16 00:18:47.105566 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:47.105530 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14c72bcc-c62a-472b-98da-2d59fbeb690e-openshift-service-ca\") pod \"maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m\" (UID: \"14c72bcc-c62a-472b-98da-2d59fbeb690e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m" Jul 16 00:18:47.105773 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:47.105579 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14c72bcc-c62a-472b-98da-2d59fbeb690e-maas-api-tls\") pod \"maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m\" (UID: \"14c72bcc-c62a-472b-98da-2d59fbeb690e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m" Jul 16 00:18:47.105773 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:47.105612 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtwzr\" (UniqueName: \"kubernetes.io/projected/14c72bcc-c62a-472b-98da-2d59fbeb690e-kube-api-access-dtwzr\") pod \"maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m\" (UID: \"14c72bcc-c62a-472b-98da-2d59fbeb690e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m" Jul 16 00:18:47.106232 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:47.106207 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14c72bcc-c62a-472b-98da-2d59fbeb690e-openshift-service-ca\") pod \"maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m\" (UID: \"14c72bcc-c62a-472b-98da-2d59fbeb690e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m" Jul 16 00:18:47.108036 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:47.108017 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14c72bcc-c62a-472b-98da-2d59fbeb690e-maas-api-tls\") pod \"maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m\" (UID: \"14c72bcc-c62a-472b-98da-2d59fbeb690e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m" Jul 16 00:18:47.131165 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:47.131138 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtwzr\" (UniqueName: \"kubernetes.io/projected/14c72bcc-c62a-472b-98da-2d59fbeb690e-kube-api-access-dtwzr\") pod \"maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m\" (UID: \"14c72bcc-c62a-472b-98da-2d59fbeb690e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m" Jul 16 00:18:47.259691 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:47.259626 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m" Jul 16 00:18:47.405535 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:47.405505 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m"] Jul 16 00:18:47.407274 ip-10-0-142-228 kubenswrapper[2564]: W0716 00:18:47.407242 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14c72bcc_c62a_472b_98da_2d59fbeb690e.slice/crio-c0f0c3ae4725f69d345286dc303a132d5a2875a4396237891036b52dc1625624 WatchSource:0}: Error finding container c0f0c3ae4725f69d345286dc303a132d5a2875a4396237891036b52dc1625624: Status 404 returned error can't find the container with id c0f0c3ae4725f69d345286dc303a132d5a2875a4396237891036b52dc1625624 Jul 16 00:18:47.408867 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:47.408849 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 00:18:48.205286 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:48.205257 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m" event={"ID":"14c72bcc-c62a-472b-98da-2d59fbeb690e","Type":"ContainerStarted","Data":"472dad00967fd7ef90d19b35319421a8322ed2b8abec38d1e49b50804f2977b5"} Jul 16 00:18:48.205637 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:48.205311 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m" event={"ID":"14c72bcc-c62a-472b-98da-2d59fbeb690e","Type":"ContainerStarted","Data":"c0f0c3ae4725f69d345286dc303a132d5a2875a4396237891036b52dc1625624"} Jul 16 00:18:48.205637 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:48.205339 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m" Jul 16 00:18:48.225565 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:48.225518 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m" podStartSLOduration=1.7366774120000001 podStartE2EDuration="2.225502675s" totalImagesPullingTime="488.825263ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:18:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:18:48.223615353 +0000 UTC m=+1919.454594100" watchObservedRunningTime="2026-07-16 00:18:48.225502675 +0000 UTC m=+1919.456481422" Jul 16 00:18:51.515565 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:51.515527 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:18:54.215859 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:54.215826 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m" Jul 16 00:18:54.761826 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:54.761792 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-452237-79f6f966bf-p9b98"] Jul 16 00:18:54.765534 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:54.765512 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-452237-79f6f966bf-p9b98" Jul 16 00:18:54.768274 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:54.768245 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-452237-serving-cert\"" Jul 16 00:18:54.778137 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:54.778110 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-452237-79f6f966bf-p9b98"] Jul 16 00:18:54.880732 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:54.880699 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fqn7\" (UniqueName: \"kubernetes.io/projected/17bf1678-1cb0-42e7-b2b9-cb98b755e68a-kube-api-access-7fqn7\") pod \"maas-api-e2e-api-b-452237-79f6f966bf-p9b98\" (UID: \"17bf1678-1cb0-42e7-b2b9-cb98b755e68a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-452237-79f6f966bf-p9b98" Jul 16 00:18:54.880899 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:54.880744 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17bf1678-1cb0-42e7-b2b9-cb98b755e68a-openshift-service-ca\") pod \"maas-api-e2e-api-b-452237-79f6f966bf-p9b98\" (UID: \"17bf1678-1cb0-42e7-b2b9-cb98b755e68a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-452237-79f6f966bf-p9b98" Jul 16 00:18:54.880899 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:54.880827 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17bf1678-1cb0-42e7-b2b9-cb98b755e68a-maas-api-tls\") pod \"maas-api-e2e-api-b-452237-79f6f966bf-p9b98\" (UID: \"17bf1678-1cb0-42e7-b2b9-cb98b755e68a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-452237-79f6f966bf-p9b98" Jul 16 00:18:54.982060 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:54.982021 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17bf1678-1cb0-42e7-b2b9-cb98b755e68a-maas-api-tls\") pod \"maas-api-e2e-api-b-452237-79f6f966bf-p9b98\" (UID: \"17bf1678-1cb0-42e7-b2b9-cb98b755e68a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-452237-79f6f966bf-p9b98" Jul 16 00:18:54.982231 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:54.982108 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fqn7\" (UniqueName: \"kubernetes.io/projected/17bf1678-1cb0-42e7-b2b9-cb98b755e68a-kube-api-access-7fqn7\") pod \"maas-api-e2e-api-b-452237-79f6f966bf-p9b98\" (UID: \"17bf1678-1cb0-42e7-b2b9-cb98b755e68a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-452237-79f6f966bf-p9b98" Jul 16 00:18:54.982231 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:54.982144 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17bf1678-1cb0-42e7-b2b9-cb98b755e68a-openshift-service-ca\") pod \"maas-api-e2e-api-b-452237-79f6f966bf-p9b98\" (UID: \"17bf1678-1cb0-42e7-b2b9-cb98b755e68a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-452237-79f6f966bf-p9b98" Jul 16 00:18:54.982231 ip-10-0-142-228 kubenswrapper[2564]: E0716 00:18:54.982194 2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-452237-serving-cert: secret "maas-api-e2e-api-b-452237-serving-cert" not found Jul 16 00:18:54.982350 ip-10-0-142-228 kubenswrapper[2564]: E0716 00:18:54.982271 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17bf1678-1cb0-42e7-b2b9-cb98b755e68a-maas-api-tls podName:17bf1678-1cb0-42e7-b2b9-cb98b755e68a nodeName:}" failed. No retries permitted until 2026-07-16 00:18:55.48224942 +0000 UTC m=+1926.713228162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/17bf1678-1cb0-42e7-b2b9-cb98b755e68a-maas-api-tls") pod "maas-api-e2e-api-b-452237-79f6f966bf-p9b98" (UID: "17bf1678-1cb0-42e7-b2b9-cb98b755e68a") : secret "maas-api-e2e-api-b-452237-serving-cert" not found Jul 16 00:18:54.982824 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:54.982805 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17bf1678-1cb0-42e7-b2b9-cb98b755e68a-openshift-service-ca\") pod \"maas-api-e2e-api-b-452237-79f6f966bf-p9b98\" (UID: \"17bf1678-1cb0-42e7-b2b9-cb98b755e68a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-452237-79f6f966bf-p9b98" Jul 16 00:18:54.991808 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:54.991780 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fqn7\" (UniqueName: \"kubernetes.io/projected/17bf1678-1cb0-42e7-b2b9-cb98b755e68a-kube-api-access-7fqn7\") pod \"maas-api-e2e-api-b-452237-79f6f966bf-p9b98\" (UID: \"17bf1678-1cb0-42e7-b2b9-cb98b755e68a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-452237-79f6f966bf-p9b98" Jul 16 00:18:55.485679 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:55.485641 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17bf1678-1cb0-42e7-b2b9-cb98b755e68a-maas-api-tls\") pod \"maas-api-e2e-api-b-452237-79f6f966bf-p9b98\" (UID: \"17bf1678-1cb0-42e7-b2b9-cb98b755e68a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-452237-79f6f966bf-p9b98" Jul 16 00:18:55.488097 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:55.488075 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17bf1678-1cb0-42e7-b2b9-cb98b755e68a-maas-api-tls\") pod \"maas-api-e2e-api-b-452237-79f6f966bf-p9b98\" (UID: \"17bf1678-1cb0-42e7-b2b9-cb98b755e68a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-452237-79f6f966bf-p9b98" Jul 16 00:18:55.677451 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:55.677420 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-452237-79f6f966bf-p9b98" Jul 16 00:18:55.821221 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:55.821192 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-452237-79f6f966bf-p9b98"] Jul 16 00:18:55.822639 ip-10-0-142-228 kubenswrapper[2564]: W0716 00:18:55.822614 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17bf1678_1cb0_42e7_b2b9_cb98b755e68a.slice/crio-bdc6c619fd2a476ea2ee9e24cab9e611ab1fb4802cf3fda23973303b559200e9 WatchSource:0}: Error finding container bdc6c619fd2a476ea2ee9e24cab9e611ab1fb4802cf3fda23973303b559200e9: Status 404 returned error can't find the container with id bdc6c619fd2a476ea2ee9e24cab9e611ab1fb4802cf3fda23973303b559200e9 Jul 16 00:18:56.251094 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:56.251068 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-452237-79f6f966bf-p9b98" event={"ID":"17bf1678-1cb0-42e7-b2b9-cb98b755e68a","Type":"ContainerStarted","Data":"bdc6c619fd2a476ea2ee9e24cab9e611ab1fb4802cf3fda23973303b559200e9"} Jul 16 00:18:57.257465 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:57.257426 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-452237-79f6f966bf-p9b98" event={"ID":"17bf1678-1cb0-42e7-b2b9-cb98b755e68a","Type":"ContainerStarted","Data":"ecd693c2b8d51156192ecc123f6453dd1a7a193ad3bbea08caeb1c4bd5b37792"} Jul 16 00:18:57.257873 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:57.257591 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-452237-79f6f966bf-p9b98" Jul 16 00:18:57.274719 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:18:57.274649 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-452237-79f6f966bf-p9b98" podStartSLOduration=2.872506312 podStartE2EDuration="3.274630443s" totalImagesPullingTime="402.124131ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:18:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:18:57.27432772 +0000 UTC m=+1928.505306468" watchObservedRunningTime="2026-07-16 00:18:57.274630443 +0000 UTC m=+1928.505609187" Jul 16 00:19:03.268992 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:03.268963 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-452237-79f6f966bf-p9b98" Jul 16 00:19:07.014127 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:07.014091 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:19:26.201490 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:26.201449 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:19:36.943590 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:36.943557 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx"] Jul 16 00:19:36.947765 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:36.947741 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx" Jul 16 00:19:36.950408 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:36.950382 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-26b6c6-serving-cert\"" Jul 16 00:19:36.959316 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:36.959291 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx"] Jul 16 00:19:37.043981 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:37.043941 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/afb0e227-a417-4798-8e4b-09c0b707ef9a-maas-api-tls\") pod \"maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx\" (UID: \"afb0e227-a417-4798-8e4b-09c0b707ef9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx" Jul 16 00:19:37.044151 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:37.044002 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhvpf\" (UniqueName: \"kubernetes.io/projected/afb0e227-a417-4798-8e4b-09c0b707ef9a-kube-api-access-nhvpf\") pod \"maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx\" (UID: \"afb0e227-a417-4798-8e4b-09c0b707ef9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx" Jul 16 00:19:37.044151 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:37.044089 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/afb0e227-a417-4798-8e4b-09c0b707ef9a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx\" (UID: \"afb0e227-a417-4798-8e4b-09c0b707ef9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx" Jul 16 00:19:37.145561 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:37.145527 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/afb0e227-a417-4798-8e4b-09c0b707ef9a-maas-api-tls\") pod \"maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx\" (UID: \"afb0e227-a417-4798-8e4b-09c0b707ef9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx" Jul 16 00:19:37.145776 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:37.145571 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhvpf\" (UniqueName: \"kubernetes.io/projected/afb0e227-a417-4798-8e4b-09c0b707ef9a-kube-api-access-nhvpf\") pod \"maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx\" (UID: \"afb0e227-a417-4798-8e4b-09c0b707ef9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx" Jul 16 00:19:37.145776 ip-10-0-142-228 kubenswrapper[2564]: E0716 00:19:37.145661 2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-26b6c6-serving-cert: secret "maas-api-e2e-shared-a-26b6c6-serving-cert" not found Jul 16 00:19:37.145776 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:37.145722 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/afb0e227-a417-4798-8e4b-09c0b707ef9a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx\" (UID: \"afb0e227-a417-4798-8e4b-09c0b707ef9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx" Jul 16 00:19:37.145776 ip-10-0-142-228 kubenswrapper[2564]: E0716 00:19:37.145749 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afb0e227-a417-4798-8e4b-09c0b707ef9a-maas-api-tls podName:afb0e227-a417-4798-8e4b-09c0b707ef9a nodeName:}" failed. No retries permitted until 2026-07-16 00:19:37.645732368 +0000 UTC m=+1968.876711093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/afb0e227-a417-4798-8e4b-09c0b707ef9a-maas-api-tls") pod "maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx" (UID: "afb0e227-a417-4798-8e4b-09c0b707ef9a") : secret "maas-api-e2e-shared-a-26b6c6-serving-cert" not found Jul 16 00:19:37.146360 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:37.146343 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/afb0e227-a417-4798-8e4b-09c0b707ef9a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx\" (UID: \"afb0e227-a417-4798-8e4b-09c0b707ef9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx" Jul 16 00:19:37.153892 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:37.153870 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhvpf\" (UniqueName: \"kubernetes.io/projected/afb0e227-a417-4798-8e4b-09c0b707ef9a-kube-api-access-nhvpf\") pod \"maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx\" (UID: \"afb0e227-a417-4798-8e4b-09c0b707ef9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx" Jul 16 00:19:37.650806 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:37.650769 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/afb0e227-a417-4798-8e4b-09c0b707ef9a-maas-api-tls\") pod \"maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx\" (UID: \"afb0e227-a417-4798-8e4b-09c0b707ef9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx" Jul 16 00:19:37.653147 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:37.653122 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/afb0e227-a417-4798-8e4b-09c0b707ef9a-maas-api-tls\") pod \"maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx\" (UID: \"afb0e227-a417-4798-8e4b-09c0b707ef9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx" Jul 16 00:19:37.860812 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:37.860779 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx" Jul 16 00:19:38.000071 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:38.000047 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx"] Jul 16 00:19:38.002154 ip-10-0-142-228 kubenswrapper[2564]: W0716 00:19:38.002127 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafb0e227_a417_4798_8e4b_09c0b707ef9a.slice/crio-f87afd27b9140ad1977553a1cad9de74a67a277a60909a9e251caea8100694bb WatchSource:0}: Error finding container f87afd27b9140ad1977553a1cad9de74a67a277a60909a9e251caea8100694bb: Status 404 returned error can't find the container with id f87afd27b9140ad1977553a1cad9de74a67a277a60909a9e251caea8100694bb Jul 16 00:19:38.115755 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:38.115710 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:19:38.468808 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:38.468759 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx" event={"ID":"afb0e227-a417-4798-8e4b-09c0b707ef9a","Type":"ContainerStarted","Data":"b903c0babbc93f78be972468f39016be4b4afcbb3b745ac7a2616f630ffd7bc7"} Jul 16 00:19:38.468962 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:38.468847 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx" Jul 16 00:19:38.468962 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:38.468876 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx" event={"ID":"afb0e227-a417-4798-8e4b-09c0b707ef9a","Type":"ContainerStarted","Data":"f87afd27b9140ad1977553a1cad9de74a67a277a60909a9e251caea8100694bb"} Jul 16 00:19:38.487328 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:38.487275 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx" podStartSLOduration=2.156470438 podStartE2EDuration="2.487256728s" totalImagesPullingTime="330.78629ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:19:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:19:38.484330263 +0000 UTC m=+1969.715309011" watchObservedRunningTime="2026-07-16 00:19:38.487256728 +0000 UTC m=+1969.718235475" Jul 16 00:19:44.480235 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:44.480161 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx" Jul 16 00:19:45.036855 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:45.036824 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl"] Jul 16 00:19:45.040630 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:45.040612 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl" Jul 16 00:19:45.044069 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:45.044051 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-c688a9-serving-cert\"" Jul 16 00:19:45.049927 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:45.049903 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl"] Jul 16 00:19:45.123879 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:45.123850 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d153bfec-b1f3-4027-a31b-40569e83b208-maas-api-tls\") pod \"maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl\" (UID: \"d153bfec-b1f3-4027-a31b-40569e83b208\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl" Jul 16 00:19:45.124055 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:45.123903 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6fjs\" (UniqueName: \"kubernetes.io/projected/d153bfec-b1f3-4027-a31b-40569e83b208-kube-api-access-r6fjs\") pod \"maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl\" (UID: \"d153bfec-b1f3-4027-a31b-40569e83b208\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl" Jul 16 00:19:45.124055 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:45.123937 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d153bfec-b1f3-4027-a31b-40569e83b208-openshift-service-ca\") pod \"maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl\" (UID: \"d153bfec-b1f3-4027-a31b-40569e83b208\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl" Jul 16 00:19:45.225225 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:45.225188 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d153bfec-b1f3-4027-a31b-40569e83b208-maas-api-tls\") pod \"maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl\" (UID: \"d153bfec-b1f3-4027-a31b-40569e83b208\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl" Jul 16 00:19:45.225410 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:45.225233 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6fjs\" (UniqueName: \"kubernetes.io/projected/d153bfec-b1f3-4027-a31b-40569e83b208-kube-api-access-r6fjs\") pod \"maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl\" (UID: \"d153bfec-b1f3-4027-a31b-40569e83b208\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl" Jul 16 00:19:45.225410 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:45.225256 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d153bfec-b1f3-4027-a31b-40569e83b208-openshift-service-ca\") pod \"maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl\" (UID: \"d153bfec-b1f3-4027-a31b-40569e83b208\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl" Jul 16 00:19:45.225410 ip-10-0-142-228 kubenswrapper[2564]: E0716 00:19:45.225355 2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-c688a9-serving-cert: secret "maas-api-e2e-shared-b-c688a9-serving-cert" not found Jul 16 00:19:45.225570 ip-10-0-142-228 kubenswrapper[2564]: E0716 00:19:45.225432 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d153bfec-b1f3-4027-a31b-40569e83b208-maas-api-tls podName:d153bfec-b1f3-4027-a31b-40569e83b208 nodeName:}" failed. No retries permitted until 2026-07-16 00:19:45.725411453 +0000 UTC m=+1976.956390199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d153bfec-b1f3-4027-a31b-40569e83b208-maas-api-tls") pod "maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl" (UID: "d153bfec-b1f3-4027-a31b-40569e83b208") : secret "maas-api-e2e-shared-b-c688a9-serving-cert" not found Jul 16 00:19:45.226017 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:45.226000 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d153bfec-b1f3-4027-a31b-40569e83b208-openshift-service-ca\") pod \"maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl\" (UID: \"d153bfec-b1f3-4027-a31b-40569e83b208\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl" Jul 16 00:19:45.233534 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:45.233505 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6fjs\" (UniqueName: \"kubernetes.io/projected/d153bfec-b1f3-4027-a31b-40569e83b208-kube-api-access-r6fjs\") pod \"maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl\" (UID: \"d153bfec-b1f3-4027-a31b-40569e83b208\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl" Jul 16 00:19:45.730162 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:45.730128 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d153bfec-b1f3-4027-a31b-40569e83b208-maas-api-tls\") pod \"maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl\" (UID: \"d153bfec-b1f3-4027-a31b-40569e83b208\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl" Jul 16 00:19:45.732602 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:45.732576 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d153bfec-b1f3-4027-a31b-40569e83b208-maas-api-tls\") pod \"maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl\" (UID: \"d153bfec-b1f3-4027-a31b-40569e83b208\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl" Jul 16 00:19:45.956713 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:45.956106 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl" Jul 16 00:19:46.097080 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:46.097054 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl"] Jul 16 00:19:46.099498 ip-10-0-142-228 kubenswrapper[2564]: W0716 00:19:46.099457 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd153bfec_b1f3_4027_a31b_40569e83b208.slice/crio-1898bf920dc8768d230910f47feca79f7ade552eadd275fb72b56031a0451c6a WatchSource:0}: Error finding container 1898bf920dc8768d230910f47feca79f7ade552eadd275fb72b56031a0451c6a: Status 404 returned error can't find the container with id 1898bf920dc8768d230910f47feca79f7ade552eadd275fb72b56031a0451c6a Jul 16 00:19:46.512507 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:46.512482 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl" event={"ID":"d153bfec-b1f3-4027-a31b-40569e83b208","Type":"ContainerStarted","Data":"1898bf920dc8768d230910f47feca79f7ade552eadd275fb72b56031a0451c6a"} Jul 16 00:19:47.519200 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:47.519160 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl" event={"ID":"d153bfec-b1f3-4027-a31b-40569e83b208","Type":"ContainerStarted","Data":"f2ddd573997a1690005caa78ca28ff879270e19504aecd2ed13b95baafa68cc3"} Jul 16 00:19:47.519584 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:47.519222 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl" Jul 16 00:19:47.535724 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:47.535679 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl" podStartSLOduration=2.187053451 podStartE2EDuration="2.535647462s" totalImagesPullingTime="348.594011ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:19:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:19:47.533480103 +0000 UTC m=+1978.764458851" watchObservedRunningTime="2026-07-16 00:19:47.535647462 +0000 UTC m=+1978.766626239" Jul 16 00:19:53.530626 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:53.530593 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl" Jul 16 00:19:53.891325 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:19:53.891238 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:20:23.996014 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:20:23.995978 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:20:42.095717 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:20:42.095683 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:21:00.902174 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:21:00.902137 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:21:20.004281 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:21:20.004201 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:21:41.604833 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:21:41.604801 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:21:49.387330 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:21:49.387295 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-7g2gx_0f1c9d30-fe51-493e-9b47-84d63b56fa8f/console-operator/1.log" Jul 16 00:21:49.389937 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:21:49.389912 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-7g2gx_0f1c9d30-fe51-493e-9b47-84d63b56fa8f/console-operator/1.log" Jul 16 00:21:49.393740 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:21:49.393721 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fp65r_d05a6a90-8e18-4a88-b6b9-b3a3712ffe07/ovn-acl-logging/0.log" Jul 16 00:21:49.396286 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:21:49.396271 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fp65r_d05a6a90-8e18-4a88-b6b9-b3a3712ffe07/ovn-acl-logging/0.log" Jul 16 00:21:49.584541 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:21:49.584513 2564 scope.go:117] "RemoveContainer" containerID="f084ff8839c2b408af6876e46cde6f350ec53ea879e3ab0976b2bea6650f1fbe" Jul 16 00:22:00.400455 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:22:00.400418 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:22:16.998367 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:22:16.998335 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:22:36.903086 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:22:36.903045 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:22:56.321438 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:22:56.321362 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:23:17.303076 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:23:17.303046 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:23:31.627089 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:23:31.627050 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:23:56.198449 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:23:56.198414 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:24:24.598336 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:24:24.598297 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:24:41.700151 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:24:41.700102 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:25:00.301304 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:00.301269 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5"] Jul 16 00:25:00.304809 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:00.304789 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" Jul 16 00:25:00.307179 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:00.307157 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-26b6c6\"/\"openshift-service-ca.crt\"" Jul 16 00:25:00.307309 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:00.307159 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-26b6c6\"/\"kube-root-ca.crt\"" Jul 16 00:25:00.308056 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:00.308035 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-26b6c6\"/\"default-dockercfg-b4v4l\"" Jul 16 00:25:00.308161 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:00.308105 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-26b6c6\"/\"rate-test-model-26b6c6-kserve-self-signed-certs\"" Jul 16 00:25:00.317973 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:00.317938 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5"] Jul 16 00:25:00.387288 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:00.387255 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/493ce156-e361-4895-936e-a5375b662aa6-home\") pod \"rate-test-model-26b6c6-kserve-545d58d95f-9x9v5\" (UID: \"493ce156-e361-4895-936e-a5375b662aa6\") " pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" Jul 16 00:25:00.387498 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:00.387329 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/493ce156-e361-4895-936e-a5375b662aa6-tls-certs\") pod \"rate-test-model-26b6c6-kserve-545d58d95f-9x9v5\" (UID: \"493ce156-e361-4895-936e-a5375b662aa6\") " pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" Jul 16 00:25:00.387498 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:00.387409 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/493ce156-e361-4895-936e-a5375b662aa6-model-cache\") pod \"rate-test-model-26b6c6-kserve-545d58d95f-9x9v5\" (UID: \"493ce156-e361-4895-936e-a5375b662aa6\") " pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" Jul 16 00:25:00.387498 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:00.387461 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/493ce156-e361-4895-936e-a5375b662aa6-dshm\") pod \"rate-test-model-26b6c6-kserve-545d58d95f-9x9v5\" (UID: \"493ce156-e361-4895-936e-a5375b662aa6\") " pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" Jul 16 00:25:00.387498 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:00.387486 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/493ce156-e361-4895-936e-a5375b662aa6-tmp-dir\") pod \"rate-test-model-26b6c6-kserve-545d58d95f-9x9v5\" (UID: \"493ce156-e361-4895-936e-a5375b662aa6\") " pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" Jul 16 00:25:00.387706 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:00.387510 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tq7d\" (UniqueName: \"kubernetes.io/projected/493ce156-e361-4895-936e-a5375b662aa6-kube-api-access-4tq7d\") pod \"rate-test-model-26b6c6-kserve-545d58d95f-9x9v5\" (UID: \"493ce156-e361-4895-936e-a5375b662aa6\") " pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" Jul 16 00:25:00.488520 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:00.488483 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/493ce156-e361-4895-936e-a5375b662aa6-tls-certs\") pod \"rate-test-model-26b6c6-kserve-545d58d95f-9x9v5\" (UID: \"493ce156-e361-4895-936e-a5375b662aa6\") " pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" Jul 16 00:25:00.488520 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:00.488524 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/493ce156-e361-4895-936e-a5375b662aa6-model-cache\") pod \"rate-test-model-26b6c6-kserve-545d58d95f-9x9v5\" (UID: \"493ce156-e361-4895-936e-a5375b662aa6\") " pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" Jul 16 00:25:00.488788 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:00.488559 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/493ce156-e361-4895-936e-a5375b662aa6-dshm\") pod \"rate-test-model-26b6c6-kserve-545d58d95f-9x9v5\" (UID: \"493ce156-e361-4895-936e-a5375b662aa6\") " pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" Jul 16 00:25:00.488788 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:00.488582 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/493ce156-e361-4895-936e-a5375b662aa6-tmp-dir\") pod \"rate-test-model-26b6c6-kserve-545d58d95f-9x9v5\" (UID: \"493ce156-e361-4895-936e-a5375b662aa6\") " pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" Jul 16 00:25:00.488788 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:00.488606 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tq7d\" (UniqueName: \"kubernetes.io/projected/493ce156-e361-4895-936e-a5375b662aa6-kube-api-access-4tq7d\") pod \"rate-test-model-26b6c6-kserve-545d58d95f-9x9v5\" (UID: \"493ce156-e361-4895-936e-a5375b662aa6\") " pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" Jul 16 00:25:00.488788 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:00.488706 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/493ce156-e361-4895-936e-a5375b662aa6-home\") pod \"rate-test-model-26b6c6-kserve-545d58d95f-9x9v5\" (UID: \"493ce156-e361-4895-936e-a5375b662aa6\") " pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" Jul 16 00:25:00.489102 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:00.489069 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/493ce156-e361-4895-936e-a5375b662aa6-model-cache\") pod \"rate-test-model-26b6c6-kserve-545d58d95f-9x9v5\" (UID: \"493ce156-e361-4895-936e-a5375b662aa6\") " pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" Jul 16 00:25:00.489211 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:00.489117 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/493ce156-e361-4895-936e-a5375b662aa6-home\") pod \"rate-test-model-26b6c6-kserve-545d58d95f-9x9v5\" (UID: \"493ce156-e361-4895-936e-a5375b662aa6\") " pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" Jul 16 00:25:00.489211 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:00.489166 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/493ce156-e361-4895-936e-a5375b662aa6-tmp-dir\") pod \"rate-test-model-26b6c6-kserve-545d58d95f-9x9v5\" (UID: \"493ce156-e361-4895-936e-a5375b662aa6\") " pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" Jul 16 00:25:00.490886 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:00.490865 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/493ce156-e361-4895-936e-a5375b662aa6-dshm\") pod \"rate-test-model-26b6c6-kserve-545d58d95f-9x9v5\" (UID: \"493ce156-e361-4895-936e-a5375b662aa6\") " pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" Jul 16 00:25:00.491160 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:00.491141 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/493ce156-e361-4895-936e-a5375b662aa6-tls-certs\") pod \"rate-test-model-26b6c6-kserve-545d58d95f-9x9v5\" (UID: \"493ce156-e361-4895-936e-a5375b662aa6\") " pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" Jul 16 00:25:00.496093 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:00.496073 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tq7d\" (UniqueName: \"kubernetes.io/projected/493ce156-e361-4895-936e-a5375b662aa6-kube-api-access-4tq7d\") pod \"rate-test-model-26b6c6-kserve-545d58d95f-9x9v5\" (UID: \"493ce156-e361-4895-936e-a5375b662aa6\") " pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" Jul 16 00:25:00.627359 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:00.627266 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" Jul 16 00:25:00.760818 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:00.760789 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5"] Jul 16 00:25:00.763071 ip-10-0-142-228 kubenswrapper[2564]: W0716 00:25:00.763047 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod493ce156_e361_4895_936e_a5375b662aa6.slice/crio-a12b01797b91fa47c4312f8272471c985945f7d62f0de4900b1493ab98b43e3f WatchSource:0}: Error finding container a12b01797b91fa47c4312f8272471c985945f7d62f0de4900b1493ab98b43e3f: Status 404 returned error can't find the container with id a12b01797b91fa47c4312f8272471c985945f7d62f0de4900b1493ab98b43e3f Jul 16 00:25:01.115702 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:01.115653 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" event={"ID":"493ce156-e361-4895-936e-a5375b662aa6","Type":"ContainerStarted","Data":"3201740e868bb38f5bc2ae1b6c022b889e326228b5ba4156a91987dce0c4041b"} Jul 16 00:25:01.115867 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:01.115711 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" event={"ID":"493ce156-e361-4895-936e-a5375b662aa6","Type":"ContainerStarted","Data":"a12b01797b91fa47c4312f8272471c985945f7d62f0de4900b1493ab98b43e3f"} Jul 16 00:25:01.132798 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:01.132751 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" podStartSLOduration=1.132736353 podStartE2EDuration="1.132736353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:25:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:25:01.131740319 +0000 UTC m=+2292.362719126" watchObservedRunningTime="2026-07-16 00:25:01.132736353 +0000 UTC m=+2292.363715131" Jul 16 00:25:03.998560 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:03.998522 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:25:10.628301 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:10.628264 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" Jul 16 00:25:10.628919 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:10.628313 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" Jul 16 00:25:10.640610 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:10.640586 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" Jul 16 00:25:11.178213 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:11.178182 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" Jul 16 00:25:33.294253 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:25:33.294214 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:26:02.114140 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:02.114060 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:26:18.714741 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:18.714707 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:26:25.462356 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:25.462323 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5"] Jul 16 00:26:35.327595 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:35.327560 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:26:40.483493 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:40.483454 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" podUID="493ce156-e361-4895-936e-a5375b662aa6" containerName="main" containerID="cri-o://3201740e868bb38f5bc2ae1b6c022b889e326228b5ba4156a91987dce0c4041b" gracePeriod=45 Jul 16 00:26:40.633941 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:40.633903 2564 generic.go:356] "Generic (PLEG): container finished" podID="493ce156-e361-4895-936e-a5375b662aa6" containerID="3201740e868bb38f5bc2ae1b6c022b889e326228b5ba4156a91987dce0c4041b" exitCode=0 Jul 16 00:26:40.634090 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:40.633980 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" event={"ID":"493ce156-e361-4895-936e-a5375b662aa6","Type":"ContainerDied","Data":"3201740e868bb38f5bc2ae1b6c022b889e326228b5ba4156a91987dce0c4041b"} Jul 16 00:26:40.729952 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:40.729930 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" Jul 16 00:26:40.786729 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:40.786637 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/493ce156-e361-4895-936e-a5375b662aa6-home\") pod \"493ce156-e361-4895-936e-a5375b662aa6\" (UID: \"493ce156-e361-4895-936e-a5375b662aa6\") " Jul 16 00:26:40.786729 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:40.786728 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/493ce156-e361-4895-936e-a5375b662aa6-dshm\") pod \"493ce156-e361-4895-936e-a5375b662aa6\" (UID: \"493ce156-e361-4895-936e-a5375b662aa6\") " Jul 16 00:26:40.786944 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:40.786805 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/493ce156-e361-4895-936e-a5375b662aa6-model-cache\") pod \"493ce156-e361-4895-936e-a5375b662aa6\" (UID: \"493ce156-e361-4895-936e-a5375b662aa6\") " Jul 16 00:26:40.786944 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:40.786833 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tq7d\" (UniqueName: \"kubernetes.io/projected/493ce156-e361-4895-936e-a5375b662aa6-kube-api-access-4tq7d\") pod \"493ce156-e361-4895-936e-a5375b662aa6\" (UID: \"493ce156-e361-4895-936e-a5375b662aa6\") " Jul 16 00:26:40.786944 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:40.786863 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/493ce156-e361-4895-936e-a5375b662aa6-tls-certs\") pod \"493ce156-e361-4895-936e-a5375b662aa6\" (UID: \"493ce156-e361-4895-936e-a5375b662aa6\") " Jul 16 00:26:40.786944 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:40.786877 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/493ce156-e361-4895-936e-a5375b662aa6-tmp-dir\") pod \"493ce156-e361-4895-936e-a5375b662aa6\" (UID: \"493ce156-e361-4895-936e-a5375b662aa6\") " Jul 16 00:26:40.786944 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:40.786881 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/493ce156-e361-4895-936e-a5375b662aa6-home" (OuterVolumeSpecName: "home") pod "493ce156-e361-4895-936e-a5375b662aa6" (UID: "493ce156-e361-4895-936e-a5375b662aa6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:26:40.787197 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:40.787080 2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/493ce156-e361-4895-936e-a5375b662aa6-home\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\"" Jul 16 00:26:40.787197 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:40.787141 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/493ce156-e361-4895-936e-a5375b662aa6-model-cache" (OuterVolumeSpecName: "model-cache") pod "493ce156-e361-4895-936e-a5375b662aa6" (UID: "493ce156-e361-4895-936e-a5375b662aa6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:26:40.787197 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:40.787167 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/493ce156-e361-4895-936e-a5375b662aa6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "493ce156-e361-4895-936e-a5375b662aa6" (UID: "493ce156-e361-4895-936e-a5375b662aa6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:26:40.789048 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:40.789014 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/493ce156-e361-4895-936e-a5375b662aa6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "493ce156-e361-4895-936e-a5375b662aa6" (UID: "493ce156-e361-4895-936e-a5375b662aa6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 00:26:40.789157 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:40.789051 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/493ce156-e361-4895-936e-a5375b662aa6-dshm" (OuterVolumeSpecName: "dshm") pod "493ce156-e361-4895-936e-a5375b662aa6" (UID: "493ce156-e361-4895-936e-a5375b662aa6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:26:40.789157 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:40.789055 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/493ce156-e361-4895-936e-a5375b662aa6-kube-api-access-4tq7d" (OuterVolumeSpecName: "kube-api-access-4tq7d") pod "493ce156-e361-4895-936e-a5375b662aa6" (UID: "493ce156-e361-4895-936e-a5375b662aa6"). InnerVolumeSpecName "kube-api-access-4tq7d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:26:40.888274 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:40.888245 2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/493ce156-e361-4895-936e-a5375b662aa6-model-cache\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\"" Jul 16 00:26:40.888274 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:40.888270 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tq7d\" (UniqueName: \"kubernetes.io/projected/493ce156-e361-4895-936e-a5375b662aa6-kube-api-access-4tq7d\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\"" Jul 16 00:26:40.888274 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:40.888281 2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/493ce156-e361-4895-936e-a5375b662aa6-tls-certs\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\"" Jul 16 00:26:40.888483 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:40.888310 2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/493ce156-e361-4895-936e-a5375b662aa6-tmp-dir\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\"" Jul 16 00:26:40.888483 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:40.888318 2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/493ce156-e361-4895-936e-a5375b662aa6-dshm\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\"" Jul 16 00:26:41.640332 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:41.640243 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" event={"ID":"493ce156-e361-4895-936e-a5375b662aa6","Type":"ContainerDied","Data":"a12b01797b91fa47c4312f8272471c985945f7d62f0de4900b1493ab98b43e3f"} Jul 16 00:26:41.640332 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:41.640280 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5" Jul 16 00:26:41.640332 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:41.640307 2564 scope.go:117] "RemoveContainer" containerID="3201740e868bb38f5bc2ae1b6c022b889e326228b5ba4156a91987dce0c4041b" Jul 16 00:26:41.663416 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:41.663392 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5"] Jul 16 00:26:41.668674 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:41.668642 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-26b6c6/rate-test-model-26b6c6-kserve-545d58d95f-9x9v5"] Jul 16 00:26:43.302443 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:43.302407 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="493ce156-e361-4895-936e-a5375b662aa6" path="/var/lib/kubelet/pods/493ce156-e361-4895-936e-a5375b662aa6/volumes" Jul 16 00:26:49.417933 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:49.417897 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-7g2gx_0f1c9d30-fe51-493e-9b47-84d63b56fa8f/console-operator/1.log" Jul 16 00:26:49.422860 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:49.422837 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-7g2gx_0f1c9d30-fe51-493e-9b47-84d63b56fa8f/console-operator/1.log" Jul 16 00:26:49.424281 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:49.424263 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fp65r_d05a6a90-8e18-4a88-b6b9-b3a3712ffe07/ovn-acl-logging/0.log" Jul 16 00:26:49.429123 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:49.429106 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fp65r_d05a6a90-8e18-4a88-b6b9-b3a3712ffe07/ovn-acl-logging/0.log" Jul 16 00:26:58.237881 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:26:58.237845 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:27:09.336325 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:09.336294 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h8cvd"] Jul 16 00:27:10.670789 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:10.670759 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b4446c48-jw77t_d8d674d4-0a84-4d99-b2f9-3b35fdbe267e/copy-manifests/0.log" Jul 16 00:27:10.680332 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:10.680310 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b4446c48-jw77t_d8d674d4-0a84-4d99-b2f9-3b35fdbe267e/manager/0.log" Jul 16 00:27:11.216363 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:11.216338 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-ait-f093c30e-847f654b4d-4h84m_19ded367-bdb0-4096-97f9-aad9487c3cba/maas-api/0.log" Jul 16 00:27:11.341072 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:11.341044 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-api-a-2aa494-d6d8dc9b6-l5b8m_14c72bcc-c62a-472b-98da-2d59fbeb690e/maas-api/0.log" Jul 16 00:27:11.470205 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:11.470130 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-api-b-452237-79f6f966bf-p9b98_17bf1678-1cb0-42e7-b2b9-cb98b755e68a/maas-api/0.log" Jul 16 00:27:11.601287 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:11.601253 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-derive-a5fc7f57-785b7d9fc6-nv5r6_12cc1ed0-2ad4-45e0-a8a7-6995b3a05b95/maas-api/0.log" Jul 16 00:27:11.739648 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:11.739576 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-inf-a-30d4db-7567bcb6bc-dqhkz_b55493df-40b5-42ca-9d5a-38e4c3803245/maas-api/0.log" Jul 16 00:27:11.869587 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:11.869554 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-inf-b-4dc784-75d5f87fc9-wd6j8_a64e71a7-3107-4728-a307-c82dc5a598bf/maas-api/0.log" Jul 16 00:27:12.004851 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:12.004778 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-migrate-447d0dec-687f697d69-sj55d_7a0f41e2-713b-485f-aa34-dcd9832be8c0/maas-api/0.log" Jul 16 00:27:12.129356 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:12.129324 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-mt-9ed299d2-678ddbdcd-nsh8k_5ec9b6d1-3991-4cf8-8096-2fe9e0223ae2/maas-api/0.log" Jul 16 00:27:12.252950 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:12.252923 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-shared-a-26b6c6-7b59fcc5f7-d2rqx_afb0e227-a417-4798-8e4b-09c0b707ef9a/maas-api/0.log" Jul 16 00:27:12.382814 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:12.382744 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-shared-b-c688a9-cbfb9f6-gr4pl_d153bfec-b1f3-4027-a31b-40569e83b208/maas-api/0.log" Jul 16 00:27:12.508302 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:12.508277 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29736000-vw8kp_ea0185f8-0a3d-4d88-b3b4-90724b1e8f96/cleanup/0.log" Jul 16 00:27:12.628166 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:12.628139 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29736015-8qq4d_5b8c3d1f-ad6d-444d-9a78-cdf9dc981afc/cleanup/0.log" Jul 16 00:27:12.750371 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:12.750344 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-ait-f093c30e-29736015-lfnfj_8cefcfa3-2084-4d29-9e78-ca9de700db93/cleanup/0.log" Jul 16 00:27:12.874546 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:12.874518 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-derive-a5fc7f57-29736015-dqnbh_fe0fffa9-6872-47f6-9174-1bb7f5909cc3/cleanup/0.log" Jul 16 00:27:12.995482 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:12.995454 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-migrate-447d0dec-29736015-r2kk2_208839f3-88d7-42ac-8638-d139d84cf593/cleanup/0.log" Jul 16 00:27:14.789105 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:14.789079 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kd5cr_69aaaa06-afd3-444a-9cc0-7bdf5ecb8a1c/manager/0.log" Jul 16 00:27:15.330176 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:15.330146 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-h8cvd_714ad55c-8990-4b05-851a-752186a5fe3e/limitador/0.log" Jul 16 00:27:15.467344 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:15.467314 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-sj7s8_053d1151-2c03-4261-a22b-15b797461db4/manager/0.log" Jul 16 00:27:16.719986 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:16.719957 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f5546b47d-9whv9_2b04f591-5391-4cd9-a495-a01bb0e49ce2/router/0.log" Jul 16 00:27:17.421131 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:17.421102 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkhlxm_c9d98386-4141-40f3-bcbd-eae30aa64edf/main/0.log" Jul 16 00:27:17.651780 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:17.651744 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-vwxl8_eb83ec3c-7a1c-459a-93d8-473efd97c5b0/main/0.log" Jul 16 00:27:26.740372 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:26.740334 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tgnmg_ae3abafe-42bb-46fb-8165-4b95893c4b8d/global-pull-secret-syncer/0.log" Jul 16 00:27:26.908396 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:26.908352 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-j5p5p_b613c0ea-4e1e-44b2-a508-90569d8f9d2f/konnectivity-agent/0.log" Jul 16 00:27:27.080199 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:27.080129 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-228.ec2.internal_58146809344bc600ef4d3117f4b90eae/haproxy/0.log" Jul 16 00:27:32.683626 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:32.683594 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kd5cr_69aaaa06-afd3-444a-9cc0-7bdf5ecb8a1c/manager/0.log" Jul 16 00:27:33.073215 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:33.073184 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-h8cvd_714ad55c-8990-4b05-851a-752186a5fe3e/limitador/0.log" Jul 16 00:27:33.144117 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:33.144089 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-sj7s8_053d1151-2c03-4261-a22b-15b797461db4/manager/0.log" Jul 16 00:27:35.082063 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:35.082029 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-z98bm_b5d573b8-fa44-4cc5-aad2-b88e6d5dd69b/cluster-monitoring-operator/0.log" Jul 16 00:27:35.338567 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:35.338490 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kwg52_4f557024-5b84-41bf-8d9a-97309ab7bbd1/node-exporter/0.log" Jul 16 00:27:35.362189 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:35.362166 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kwg52_4f557024-5b84-41bf-8d9a-97309ab7bbd1/kube-rbac-proxy/0.log" Jul 16 00:27:35.386291 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:35.386266 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kwg52_4f557024-5b84-41bf-8d9a-97309ab7bbd1/init-textfile/0.log" Jul 16 00:27:36.680962 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:36.680932 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9plpw/perf-node-gather-daemonset-2rcm2"] Jul 16 00:27:36.681350 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:36.681338 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="493ce156-e361-4895-936e-a5375b662aa6" containerName="main" Jul 16 00:27:36.681397 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:36.681351 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="493ce156-e361-4895-936e-a5375b662aa6" containerName="main" Jul 16 00:27:36.681431 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:36.681420 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="493ce156-e361-4895-936e-a5375b662aa6" containerName="main" Jul 16 00:27:36.684578 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:36.684556 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2rcm2" Jul 16 00:27:36.687102 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:36.687078 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9plpw\"/\"default-dockercfg-2clp9\"" Jul 16 00:27:36.687373 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:36.687356 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9plpw\"/\"openshift-service-ca.crt\"" Jul 16 00:27:36.688431 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:36.688411 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9plpw\"/\"kube-root-ca.crt\"" Jul 16 00:27:36.699214 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:36.699191 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9plpw/perf-node-gather-daemonset-2rcm2"] Jul 16 00:27:36.748026 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:36.748001 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs68z\" (UniqueName: \"kubernetes.io/projected/43891d15-bf78-442a-934b-037235d075b8-kube-api-access-rs68z\") pod \"perf-node-gather-daemonset-2rcm2\" (UID: \"43891d15-bf78-442a-934b-037235d075b8\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2rcm2" Jul 16 00:27:36.748167 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:36.748045 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43891d15-bf78-442a-934b-037235d075b8-sys\") pod \"perf-node-gather-daemonset-2rcm2\" (UID: \"43891d15-bf78-442a-934b-037235d075b8\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2rcm2" Jul 16 00:27:36.748167 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:36.748096 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/43891d15-bf78-442a-934b-037235d075b8-lib-modules\") pod \"perf-node-gather-daemonset-2rcm2\" (UID: \"43891d15-bf78-442a-934b-037235d075b8\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2rcm2" Jul 16 00:27:36.748167 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:36.748152 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/43891d15-bf78-442a-934b-037235d075b8-proc\") pod \"perf-node-gather-daemonset-2rcm2\" (UID: \"43891d15-bf78-442a-934b-037235d075b8\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2rcm2" Jul 16 00:27:36.748273 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:36.748196 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/43891d15-bf78-442a-934b-037235d075b8-podres\") pod \"perf-node-gather-daemonset-2rcm2\" (UID: \"43891d15-bf78-442a-934b-037235d075b8\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2rcm2" Jul 16 00:27:36.849544 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:36.849514 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/43891d15-bf78-442a-934b-037235d075b8-proc\") pod \"perf-node-gather-daemonset-2rcm2\" (UID: \"43891d15-bf78-442a-934b-037235d075b8\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2rcm2" Jul 16 00:27:36.849726 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:36.849566 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/43891d15-bf78-442a-934b-037235d075b8-podres\") pod \"perf-node-gather-daemonset-2rcm2\" (UID: \"43891d15-bf78-442a-934b-037235d075b8\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2rcm2" Jul 16 00:27:36.849726 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:36.849608 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs68z\" (UniqueName: \"kubernetes.io/projected/43891d15-bf78-442a-934b-037235d075b8-kube-api-access-rs68z\") pod \"perf-node-gather-daemonset-2rcm2\" (UID: \"43891d15-bf78-442a-934b-037235d075b8\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2rcm2" Jul 16 00:27:36.849726 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:36.849634 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43891d15-bf78-442a-934b-037235d075b8-sys\") pod \"perf-node-gather-daemonset-2rcm2\" (UID: \"43891d15-bf78-442a-934b-037235d075b8\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2rcm2" Jul 16 00:27:36.849726 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:36.849634 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/43891d15-bf78-442a-934b-037235d075b8-proc\") pod \"perf-node-gather-daemonset-2rcm2\" (UID: \"43891d15-bf78-442a-934b-037235d075b8\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2rcm2" Jul 16 00:27:36.849726 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:36.849688 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/43891d15-bf78-442a-934b-037235d075b8-lib-modules\") pod \"perf-node-gather-daemonset-2rcm2\" (UID: \"43891d15-bf78-442a-934b-037235d075b8\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2rcm2" Jul 16 00:27:36.849912 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:36.849745 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43891d15-bf78-442a-934b-037235d075b8-sys\") pod \"perf-node-gather-daemonset-2rcm2\" (UID: \"43891d15-bf78-442a-934b-037235d075b8\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2rcm2" Jul 16 00:27:36.849912 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:36.849787 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/43891d15-bf78-442a-934b-037235d075b8-podres\") pod \"perf-node-gather-daemonset-2rcm2\" (UID: \"43891d15-bf78-442a-934b-037235d075b8\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2rcm2" Jul 16 00:27:36.849912 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:36.849821 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/43891d15-bf78-442a-934b-037235d075b8-lib-modules\") pod \"perf-node-gather-daemonset-2rcm2\" (UID: \"43891d15-bf78-442a-934b-037235d075b8\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2rcm2" Jul 16 00:27:36.860129 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:36.860110 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs68z\" (UniqueName: \"kubernetes.io/projected/43891d15-bf78-442a-934b-037235d075b8-kube-api-access-rs68z\") pod \"perf-node-gather-daemonset-2rcm2\" (UID: \"43891d15-bf78-442a-934b-037235d075b8\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2rcm2" Jul 16 00:27:36.995477 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:36.995446 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2rcm2" Jul 16 00:27:37.136384 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:37.136358 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9plpw/perf-node-gather-daemonset-2rcm2"] Jul 16 00:27:37.138834 ip-10-0-142-228 kubenswrapper[2564]: W0716 00:27:37.138801 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod43891d15_bf78_442a_934b_037235d075b8.slice/crio-6d572d7959886a1e302a6b04a7afa87b3077b7ad89c8cf7c5baa94b40a312155 WatchSource:0}: Error finding container 6d572d7959886a1e302a6b04a7afa87b3077b7ad89c8cf7c5baa94b40a312155: Status 404 returned error can't find the container with id 6d572d7959886a1e302a6b04a7afa87b3077b7ad89c8cf7c5baa94b40a312155 Jul 16 00:27:37.383889 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:37.383859 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-ftx8k_b45a97fe-1c83-40e9-b190-8231a1b07291/networking-console-plugin/0.log" Jul 16 00:27:37.934672 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:37.934629 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2rcm2" event={"ID":"43891d15-bf78-442a-934b-037235d075b8","Type":"ContainerStarted","Data":"44ce5ddd4302395948d47145a9f22c19270d25723aed41748fec7f23b5d7325c"} Jul 16 00:27:37.935070 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:37.934697 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2rcm2" event={"ID":"43891d15-bf78-442a-934b-037235d075b8","Type":"ContainerStarted","Data":"6d572d7959886a1e302a6b04a7afa87b3077b7ad89c8cf7c5baa94b40a312155"} Jul 16 00:27:37.935070 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:37.934771 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2rcm2" Jul 16 00:27:37.954998 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:37.954965 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-7g2gx_0f1c9d30-fe51-493e-9b47-84d63b56fa8f/console-operator/1.log" Jul 16 00:27:37.955166 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:37.955132 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2rcm2" podStartSLOduration=1.955118058 podStartE2EDuration="1.955118058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:27:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:27:37.953234259 +0000 UTC m=+2449.184213027" watchObservedRunningTime="2026-07-16 00:27:37.955118058 +0000 UTC m=+2449.186096856" Jul 16 00:27:37.960932 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:37.960896 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-7g2gx_0f1c9d30-fe51-493e-9b47-84d63b56fa8f/console-operator/2.log" Jul 16 00:27:38.484629 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:38.484596 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-g2lfs_1d5f05be-c572-4a00-baa7-09554f6124ec/download-server/0.log" Jul 16 00:27:39.135088 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:39.135060 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-98v79_745e0d0a-e9fc-490f-994f-634357fcf39a/volume-data-source-validator/0.log" Jul 16 00:27:40.306208 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:40.306175 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jwfwf_d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9/dns/0.log" Jul 16 00:27:40.330401 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:40.330378 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jwfwf_d3f498ea-4092-4cf8-bcdf-601ad1a6cbb9/kube-rbac-proxy/0.log" Jul 16 00:27:40.445392 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:40.445363 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cj8th_480440ce-6eb7-434a-8e64-478fc9b19cc5/dns-node-resolver/0.log" Jul 16 00:27:41.040577 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:41.040548 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-pruner-29736000-fkgmc_db3c9039-66f1-4011-b82b-3c78f2ae6358/image-pruner/0.log" Jul 16 00:27:41.154190 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:41.154164 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r9q5g_5917490d-3db7-4d93-aa21-b302f20e9699/node-ca/0.log" Jul 16 00:27:42.622560 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:42.622533 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f5546b47d-9whv9_2b04f591-5391-4cd9-a495-a01bb0e49ce2/router/0.log" Jul 16 00:27:43.305429 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:43.305396 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5l9w5_c8d25ea1-819e-46d2-854d-29b4be8e184f/serve-healthcheck-canary/0.log" Jul 16 00:27:43.871081 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:43.871052 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-mkxvc_0bf55176-1282-44d4-9c63-345a50ab4d01/insights-operator/0.log" Jul 16 00:27:43.871820 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:43.871802 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-mkxvc_0bf55176-1282-44d4-9c63-345a50ab4d01/insights-operator/1.log" Jul 16 00:27:43.899195 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:43.899164 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9xf75_a98e13d5-bfc4-4f77-b7be-6926d366292e/kube-rbac-proxy/0.log" Jul 16 00:27:43.925039 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:43.925019 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9xf75_a98e13d5-bfc4-4f77-b7be-6926d366292e/exporter/0.log" Jul 16 00:27:43.949223 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:43.949202 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2rcm2" Jul 16 00:27:43.963833 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:43.963793 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9xf75_a98e13d5-bfc4-4f77-b7be-6926d366292e/extractor/0.log" Jul 16 00:27:47.596365 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:47.596338 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f5546b47d-9whv9_2b04f591-5391-4cd9-a495-a01bb0e49ce2/router/0.log" Jul 16 00:27:47.711234 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:47.711207 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b4446c48-jw77t_d8d674d4-0a84-4d99-b2f9-3b35fdbe267e/manager/0.log" Jul 16 00:27:47.741062 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:47.741038 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b4446c48-jw77t_d8d674d4-0a84-4d99-b2f9-3b35fdbe267e/copy-manifests/0.log" Jul 16 00:27:49.097563 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:49.097537 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-755cb7796d-smzfz_a06d7772-d04b-4522-9697-246fb9c2a380/manager/0.log" Jul 16 00:27:49.240523 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:49.240502 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f5546b47d-9whv9_2b04f591-5391-4cd9-a495-a01bb0e49ce2/router/0.log" Jul 16 00:27:54.961599 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:54.961571 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-v9ch7_5253c532-534e-4c36-a572-efa63cfc7d48/migrator/0.log" Jul 16 00:27:54.997716 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:54.997682 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-v9ch7_5253c532-534e-4c36-a572-efa63cfc7d48/graceful-termination/0.log" Jul 16 00:27:55.457683 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:55.457643 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-jf8jd_362c7d00-de2e-4c56-81f9-1088ce28347e/kube-storage-version-migrator-operator/1.log" Jul 16 00:27:55.458627 ip-10-0-142-228 kubenswrapper[2564]: I0716 00:27:55.458606 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-jf8jd_362c7d00-de2e-4c56-81f9-1088ce28347e/kube-storage-version-migrator-operator/0.log"