Jul 17 17:47:22.580263 ip-10-0-135-140 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 17 17:47:22.580381 ip-10-0-135-140 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 17 17:47:22.580472 ip-10-0-135-140 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 17 17:47:22.580900 ip-10-0-135-140 systemd[1]: Failed to start Kubernetes Kubelet. Jul 17 17:47:32.643173 ip-10-0-135-140 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 17 17:47:32.643194 ip-10-0-135-140 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b4c71d31f0394c5094cc87d6369dcfdb -- Jul 17 17:49:11.660477 ip-10-0-135-140 systemd[1]: Starting Kubernetes Kubelet... Jul 17 17:49:12.025623 ip-10-0-135-140 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 17:49:12.025623 ip-10-0-135-140 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 17 17:49:12.025623 ip-10-0-135-140 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 17:49:12.025623 ip-10-0-135-140 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 17 17:49:12.025623 ip-10-0-135-140 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 17:49:12.026531 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.026453 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 17 17:49:12.031036 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031022 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 17:49:12.031036 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031036 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 17:49:12.031095 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031040 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 17:49:12.031095 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031044 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 17:49:12.031095 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031046 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 17:49:12.031095 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031050 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 17:49:12.031095 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031053 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 17:49:12.031095 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031055 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 17:49:12.031095 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031059 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 17:49:12.031095 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031061 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 17:49:12.031095 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031064 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 17:49:12.031095 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031066 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 17:49:12.031095 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031069 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 17:49:12.031095 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031076 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 17:49:12.031095 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031079 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 17:49:12.031095 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031084 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 17:49:12.031095 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031088 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 17:49:12.031095 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031091 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 17:49:12.031095 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031093 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 17:49:12.031095 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031096 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 17:49:12.031095 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031099 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 17:49:12.031563 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031103 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 17:49:12.031563 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031105 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 17:49:12.031563 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031108 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 17:49:12.031563 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031111 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 17:49:12.031563 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031113 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 17:49:12.031563 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031116 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 17:49:12.031563 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031118 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 17:49:12.031563 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031121 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 17:49:12.031563 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031123 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 17:49:12.031563 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031126 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 17:49:12.031563 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031128 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 17:49:12.031563 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031130 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 17:49:12.031563 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031133 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 17:49:12.031563 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031136 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 17:49:12.031563 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031138 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 17:49:12.031563 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031141 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 17:49:12.031563 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031143 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 17:49:12.031563 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031145 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 17 17:49:12.031563 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031148 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 17:49:12.031563 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031150 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 17:49:12.032048 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031153 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 17:49:12.032048 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031155 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 17:49:12.032048 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031157 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 17:49:12.032048 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031160 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 17:49:12.032048 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031163 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 17:49:12.032048 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031165 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 17:49:12.032048 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031183 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 17:49:12.032048 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031185 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 17:49:12.032048 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031187 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 17:49:12.032048 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031190 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 17:49:12.032048 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031192 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 17:49:12.032048 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031195 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 17:49:12.032048 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031197 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 17:49:12.032048 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031200 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 17:49:12.032048 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031203 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 17:49:12.032048 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031205 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 17:49:12.032048 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031208 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 17:49:12.032048 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031211 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 17:49:12.032048 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031214 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 17:49:12.032048 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031216 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 17:49:12.032569 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031218 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 17:49:12.032569 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031221 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 17:49:12.032569 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031224 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 17:49:12.032569 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031226 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 17:49:12.032569 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031228 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 17:49:12.032569 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031231 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 17:49:12.032569 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031234 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 17:49:12.032569 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031236 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 17:49:12.032569 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031239 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 17:49:12.032569 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031242 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 17:49:12.032569 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031244 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 17:49:12.032569 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031247 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 17:49:12.032569 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031249 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 17:49:12.032569 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031252 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 17:49:12.032569 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031257 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 17:49:12.032569 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031260 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 17:49:12.032569 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031263 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 17:49:12.032569 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031265 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 17:49:12.032569 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031268 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 17:49:12.033007 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031270 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 17:49:12.033007 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031272 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 17:49:12.033007 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031275 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 17:49:12.033007 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031277 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 17:49:12.033007 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031280 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 17:49:12.033007 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031283 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 17:49:12.033007 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031286 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 17:49:12.033007 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031289 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 17:49:12.033007 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031291 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 17:49:12.033007 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031294 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 17:49:12.033007 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031297 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 17:49:12.033007 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031301 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 17:49:12.033007 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031304 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 17:49:12.033007 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031307 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 17:49:12.033007 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031310 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 17:49:12.033007 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031313 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 17:49:12.033007 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031316 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 17:49:12.033007 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031318 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 17:49:12.033007 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.031321 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 17:49:12.033007 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032816 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 17:49:12.033494 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032824 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 17:49:12.033494 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032827 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 17:49:12.033494 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032830 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 17:49:12.033494 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032833 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 17:49:12.033494 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032836 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 17:49:12.033494 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032838 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 17:49:12.033494 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032841 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 17:49:12.033494 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032844 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 17:49:12.033494 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032847 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 17:49:12.033494 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032850 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 17:49:12.033494 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032853 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 17:49:12.033494 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032856 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 17:49:12.033494 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032858 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 17:49:12.033494 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032861 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 17:49:12.033494 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032863 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 17:49:12.033494 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032866 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 17:49:12.033494 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032869 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 17:49:12.033494 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032871 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 17:49:12.033494 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032875 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 17:49:12.033494 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032878 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 17:49:12.033979 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032881 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 17:49:12.033979 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032883 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 17:49:12.033979 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032886 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 17:49:12.033979 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032888 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 17:49:12.033979 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032890 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 17:49:12.033979 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032893 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 17:49:12.033979 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032895 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 17:49:12.033979 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032898 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 17:49:12.033979 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032900 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 17:49:12.033979 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032902 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 17:49:12.033979 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032904 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 17:49:12.033979 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032907 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 17:49:12.033979 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032910 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 17:49:12.033979 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032912 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 17:49:12.033979 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032914 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 17:49:12.033979 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032917 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 17 17:49:12.033979 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032919 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 17:49:12.033979 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032922 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 17:49:12.033979 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032925 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 17:49:12.033979 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032929 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 17:49:12.034475 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032932 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 17:49:12.034475 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032934 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 17:49:12.034475 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032937 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 17:49:12.034475 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032939 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 17:49:12.034475 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032941 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 17:49:12.034475 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032944 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 17:49:12.034475 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032947 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 17:49:12.034475 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032950 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 17:49:12.034475 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032953 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 17:49:12.034475 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032956 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 17:49:12.034475 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032960 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 17:49:12.034475 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032962 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 17:49:12.034475 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032965 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 17:49:12.034475 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032968 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 17:49:12.034475 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032971 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 17:49:12.034475 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032974 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 17:49:12.034475 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032976 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 17:49:12.034475 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032980 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 17:49:12.034475 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032983 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 17:49:12.034942 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032985 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 17:49:12.034942 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032987 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 17:49:12.034942 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032990 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 17:49:12.034942 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032993 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 17:49:12.034942 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032995 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 17:49:12.034942 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.032997 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 17:49:12.034942 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033000 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 17:49:12.034942 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033003 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 17:49:12.034942 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033005 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 17:49:12.034942 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033008 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 17:49:12.034942 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033010 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 17:49:12.034942 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033013 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 17:49:12.034942 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033016 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 17:49:12.034942 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033018 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 17:49:12.034942 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033021 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 17:49:12.034942 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033023 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 17:49:12.034942 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033026 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 17:49:12.034942 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033028 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 17:49:12.034942 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033030 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 17:49:12.034942 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033033 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 17:49:12.035434 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033035 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 17:49:12.035434 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033037 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 17:49:12.035434 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033040 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 17:49:12.035434 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033043 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 17:49:12.035434 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033046 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 17:49:12.035434 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033048 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 17:49:12.035434 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033050 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 17:49:12.035434 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033053 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 17:49:12.035434 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033055 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 17:49:12.035434 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033060 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 17:49:12.035434 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033064 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 17:49:12.035434 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033066 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 17:49:12.035434 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033069 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 17:49:12.035434 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033071 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 17:49:12.035434 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033074 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 17:49:12.035434 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033076 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 17:49:12.035434 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033079 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 17:49:12.035434 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033081 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 17:49:12.035434 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033084 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 17:49:12.035888 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033444 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 17:49:12.035888 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033449 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 17:49:12.035888 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033453 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 17:49:12.035888 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033455 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 17:49:12.035888 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033458 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 17:49:12.035888 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033460 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 17:49:12.035888 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033463 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 17:49:12.035888 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033466 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 17:49:12.035888 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033468 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 17:49:12.035888 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033471 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 17:49:12.035888 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033473 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 17:49:12.035888 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033475 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 17:49:12.035888 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033478 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 17:49:12.035888 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033480 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 17:49:12.035888 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033483 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 17:49:12.035888 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033486 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 17:49:12.035888 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033489 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 17:49:12.035888 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033492 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 17:49:12.035888 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033494 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 17:49:12.035888 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033496 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 17:49:12.036397 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033499 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 17:49:12.036397 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033501 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 17:49:12.036397 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033504 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 17:49:12.036397 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033507 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 17:49:12.036397 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033509 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 17:49:12.036397 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033512 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 17:49:12.036397 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033515 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 17:49:12.036397 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033517 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 17:49:12.036397 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033520 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 17:49:12.036397 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033522 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 17:49:12.036397 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033525 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 17:49:12.036397 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033527 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 17:49:12.036397 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033530 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 17:49:12.036397 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033533 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 17:49:12.036397 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033535 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 17:49:12.036397 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033537 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 17:49:12.036397 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033540 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 17:49:12.036397 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033542 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 17:49:12.036397 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033544 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 17:49:12.036847 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033549 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 17:49:12.036847 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033553 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 17:49:12.036847 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033556 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 17:49:12.036847 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033558 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 17:49:12.036847 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033561 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 17:49:12.036847 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033563 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 17:49:12.036847 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033567 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 17:49:12.036847 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033570 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 17:49:12.036847 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033573 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 17:49:12.036847 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033577 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 17:49:12.036847 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033579 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 17:49:12.036847 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033582 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 17:49:12.036847 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033584 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 17 17:49:12.036847 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033588 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 17:49:12.036847 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033592 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 17:49:12.036847 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033595 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 17:49:12.036847 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033598 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 17:49:12.036847 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033600 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 17:49:12.036847 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033603 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 17:49:12.037351 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033605 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 17:49:12.037351 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033608 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 17:49:12.037351 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033610 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 17:49:12.037351 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033613 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 17:49:12.037351 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033615 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 17:49:12.037351 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033617 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 17:49:12.037351 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033620 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 17:49:12.037351 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033623 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 17:49:12.037351 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033625 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 17:49:12.037351 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033628 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 17:49:12.037351 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033630 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 17:49:12.037351 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033632 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 17:49:12.037351 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033635 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 17:49:12.037351 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033637 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 17:49:12.037351 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033639 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 17:49:12.037351 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033642 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 17:49:12.037351 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033644 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 17:49:12.037351 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033647 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 17:49:12.037351 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033649 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 17:49:12.037351 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033651 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 17:49:12.037830 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033654 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 17:49:12.037830 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033657 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 17:49:12.037830 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033663 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 17:49:12.037830 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033666 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 17:49:12.037830 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033668 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 17:49:12.037830 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033671 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 17:49:12.037830 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033673 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 17:49:12.037830 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033676 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 17:49:12.037830 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033678 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 17:49:12.037830 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033680 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 17:49:12.037830 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033683 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 17:49:12.037830 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033685 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 17:49:12.037830 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033687 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 17:49:12.037830 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033690 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 17:49:12.037830 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033692 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 17:49:12.037830 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033694 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 17:49:12.037830 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033697 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 17:49:12.037830 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033699 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 17:49:12.037830 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033702 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 17:49:12.037830 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033704 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 17:49:12.038334 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.033707 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 17:49:12.038334 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033769 2580 flags.go:64] FLAG: --address="0.0.0.0" Jul 17 17:49:12.038334 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033775 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 17 17:49:12.038334 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033783 2580 flags.go:64] FLAG: --anonymous-auth="true" Jul 17 17:49:12.038334 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033787 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 17 17:49:12.038334 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033791 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 17 17:49:12.038334 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033794 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 17 17:49:12.038334 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033798 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 17 17:49:12.038334 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033802 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 17 17:49:12.038334 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033806 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 17 17:49:12.038334 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033808 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 17 17:49:12.038334 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033812 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 17 17:49:12.038334 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033815 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 17 17:49:12.038334 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033818 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 17 17:49:12.038334 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033823 2580 flags.go:64] FLAG: --cgroup-root="" Jul 17 17:49:12.038334 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033825 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 17 17:49:12.038334 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033828 2580 flags.go:64] FLAG: --client-ca-file="" Jul 17 17:49:12.038334 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033831 2580 flags.go:64] FLAG: --cloud-provider="external" Jul 17 17:49:12.038334 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033834 2580 flags.go:64] FLAG: --cluster-dns="[]" Jul 17 17:49:12.038334 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033838 2580 flags.go:64] FLAG: --cluster-domain="" Jul 17 17:49:12.038334 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033841 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 17 17:49:12.038334 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033844 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 17 17:49:12.038334 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033847 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 17 17:49:12.038334 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033850 2580 flags.go:64] FLAG: --container-log-max-files="5" Jul 17 17:49:12.038903 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033854 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 17 17:49:12.038903 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033856 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 17 17:49:12.038903 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033859 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 17 17:49:12.038903 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033863 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 17 17:49:12.038903 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033866 2580 flags.go:64] FLAG: --contention-profiling="false" Jul 17 17:49:12.038903 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033869 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 17 17:49:12.038903 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033872 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 17 17:49:12.038903 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033875 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 17 17:49:12.038903 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033878 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 17 17:49:12.038903 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033882 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 17 17:49:12.038903 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033885 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 17 17:49:12.038903 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033888 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 17 17:49:12.038903 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033890 2580 flags.go:64] FLAG: --enable-load-reader="false" Jul 17 17:49:12.038903 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033893 2580 flags.go:64] FLAG: --enable-server="true" Jul 17 17:49:12.038903 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033896 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 17 17:49:12.038903 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033900 2580 flags.go:64] FLAG: --event-burst="100" Jul 17 17:49:12.038903 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033903 2580 flags.go:64] FLAG: --event-qps="50" Jul 17 17:49:12.038903 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033906 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 17 17:49:12.038903 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033909 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 17 17:49:12.038903 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033912 2580 flags.go:64] FLAG: --eviction-hard="" Jul 17 17:49:12.038903 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033922 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 17 17:49:12.038903 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033925 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 17 17:49:12.038903 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033929 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 17 17:49:12.038903 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033932 2580 flags.go:64] FLAG: --eviction-soft="" Jul 17 17:49:12.038903 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033935 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 17 17:49:12.039525 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033938 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 17 17:49:12.039525 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033940 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 17 17:49:12.039525 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033943 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jul 17 17:49:12.039525 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033946 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 17 17:49:12.039525 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033949 2580 flags.go:64] FLAG: --fail-swap-on="true" Jul 17 17:49:12.039525 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033951 2580 flags.go:64] FLAG: --feature-gates="" Jul 17 17:49:12.039525 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033955 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jul 17 17:49:12.039525 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033958 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 17 17:49:12.039525 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033961 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 17 17:49:12.039525 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033964 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 17 17:49:12.039525 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033967 2580 flags.go:64] FLAG: --healthz-port="10248" Jul 17 17:49:12.039525 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033969 2580 flags.go:64] FLAG: --help="false" Jul 17 17:49:12.039525 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033972 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-135-140.ec2.internal" Jul 17 17:49:12.039525 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033975 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 17 17:49:12.039525 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033978 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jul 17 17:49:12.039525 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033981 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 17 17:49:12.039525 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033984 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 17 17:49:12.039525 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033988 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 17 17:49:12.039525 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033991 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 17 17:49:12.039525 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033993 2580 flags.go:64] FLAG: --image-service-endpoint="" Jul 17 17:49:12.039525 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033996 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 17 17:49:12.039525 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.033999 2580 flags.go:64] FLAG: --kube-api-burst="100" Jul 17 17:49:12.039525 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034001 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 17 17:49:12.040215 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034004 2580 flags.go:64] FLAG: --kube-api-qps="50" Jul 17 17:49:12.040215 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034007 2580 flags.go:64] FLAG: --kube-reserved="" Jul 17 17:49:12.040215 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034010 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 17 17:49:12.040215 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034012 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 17 17:49:12.040215 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034015 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jul 17 17:49:12.040215 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034018 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 17 17:49:12.040215 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034024 2580 flags.go:64] FLAG: --lock-file="" Jul 17 17:49:12.040215 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034027 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 17 17:49:12.040215 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034030 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 17 17:49:12.040215 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034033 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 17 17:49:12.040215 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034038 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jul 17 17:49:12.040215 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034040 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 17 17:49:12.040215 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034043 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jul 17 17:49:12.040215 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034046 2580 flags.go:64] FLAG: --logging-format="text" Jul 17 17:49:12.040215 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034049 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 17 17:49:12.040215 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034052 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 17 17:49:12.040215 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034054 2580 flags.go:64] FLAG: --manifest-url="" Jul 17 17:49:12.040215 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034057 2580 flags.go:64] FLAG: --manifest-url-header="" Jul 17 17:49:12.040215 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034061 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 17 17:49:12.040215 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034064 2580 flags.go:64] FLAG: --max-open-files="1000000" Jul 17 17:49:12.040215 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034068 2580 flags.go:64] FLAG: --max-pods="110" Jul 17 17:49:12.040215 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034071 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 17 17:49:12.040215 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034073 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 17 17:49:12.040215 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034076 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jul 17 17:49:12.040215 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034079 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 17 17:49:12.040901 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034082 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 17 17:49:12.040901 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034084 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 17 17:49:12.040901 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034088 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 17 17:49:12.040901 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034094 2580 flags.go:64] FLAG: --node-status-max-images="50" Jul 17 17:49:12.040901 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034097 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 17 17:49:12.040901 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034100 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jul 17 17:49:12.040901 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034103 2580 flags.go:64] FLAG: --pod-cidr="" Jul 17 17:49:12.040901 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034105 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 17 17:49:12.040901 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034110 2580 flags.go:64] FLAG: --pod-manifest-path="" Jul 17 17:49:12.040901 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034113 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jul 17 17:49:12.040901 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034116 2580 flags.go:64] FLAG: --pods-per-core="0" Jul 17 17:49:12.040901 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034119 2580 flags.go:64] FLAG: --port="10250" Jul 17 17:49:12.040901 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034122 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 17 17:49:12.040901 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034126 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c51fa0cff40bad53" Jul 17 17:49:12.040901 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034130 2580 flags.go:64] FLAG: --qos-reserved="" Jul 17 17:49:12.040901 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034133 2580 flags.go:64] FLAG: --read-only-port="10255" Jul 17 17:49:12.040901 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034136 2580 flags.go:64] FLAG: --register-node="true" Jul 17 17:49:12.040901 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034138 2580 flags.go:64] FLAG: --register-with-taints="" Jul 17 17:49:12.040901 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034142 2580 flags.go:64] FLAG: --registry-burst="10" Jul 17 17:49:12.040901 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034145 2580 flags.go:64] FLAG: --registry-qps="5" Jul 17 17:49:12.040901 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034148 2580 flags.go:64] FLAG: --reserved-cpus="" Jul 17 17:49:12.040901 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034151 2580 flags.go:64] FLAG: --reserved-memory="" Jul 17 17:49:12.040901 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034154 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 17 17:49:12.040901 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034157 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 17 17:49:12.040901 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034160 2580 flags.go:64] FLAG: --rotate-certificates="false" Jul 17 17:49:12.041607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034163 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 17 17:49:12.041607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034165 2580 flags.go:64] FLAG: --runonce="false" Jul 17 17:49:12.041607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034181 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 17 17:49:12.041607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034184 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 17 17:49:12.041607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034188 2580 flags.go:64] FLAG: --seccomp-default="false" Jul 17 17:49:12.041607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034191 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 17 17:49:12.041607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034194 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 17 17:49:12.041607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034197 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 17 17:49:12.041607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034199 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 17 17:49:12.041607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034203 2580 flags.go:64] FLAG: --storage-driver-password="root" Jul 17 17:49:12.041607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034206 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jul 17 17:49:12.041607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034209 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jul 17 17:49:12.041607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034212 2580 flags.go:64] FLAG: --storage-driver-user="root" Jul 17 17:49:12.041607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034214 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 17 17:49:12.041607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034217 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 17 17:49:12.041607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034220 2580 flags.go:64] FLAG: --system-cgroups="" Jul 17 17:49:12.041607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034223 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 17 17:49:12.041607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034228 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 17 17:49:12.041607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034230 2580 flags.go:64] FLAG: --tls-cert-file="" Jul 17 17:49:12.041607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034233 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 17 17:49:12.041607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034238 2580 flags.go:64] FLAG: --tls-min-version="" Jul 17 17:49:12.041607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034242 2580 flags.go:64] FLAG: --tls-private-key-file="" Jul 17 17:49:12.041607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034245 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jul 17 17:49:12.041607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034247 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 17 17:49:12.041607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034250 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jul 17 17:49:12.042609 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034253 2580 flags.go:64] FLAG: --v="2" Jul 17 17:49:12.042609 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034257 2580 flags.go:64] FLAG: --version="false" Jul 17 17:49:12.042609 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034260 2580 flags.go:64] FLAG: --vmodule="" Jul 17 17:49:12.042609 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034264 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 17 17:49:12.042609 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.034267 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 17 17:49:12.042609 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034376 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 17:49:12.042609 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034380 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 17:49:12.042609 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034382 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 17:49:12.042609 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034385 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 17:49:12.042609 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034389 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 17:49:12.042609 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034393 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 17:49:12.042609 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034395 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 17:49:12.042609 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034398 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 17:49:12.042609 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034401 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 17:49:12.042609 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034404 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 17:49:12.042609 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034406 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 17:49:12.042609 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034408 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 17:49:12.042609 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034411 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 17:49:12.042609 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034414 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 17:49:12.042609 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034416 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 17:49:12.043215 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034418 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 17:49:12.043215 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034421 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 17:49:12.043215 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034424 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 17:49:12.043215 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034426 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 17:49:12.043215 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034429 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 17:49:12.043215 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034431 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 17:49:12.043215 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034434 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 17:49:12.043215 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034438 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 17:49:12.043215 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034442 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 17:49:12.043215 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034444 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 17:49:12.043215 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034446 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 17:49:12.043215 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034449 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 17:49:12.043215 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034451 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 17:49:12.043215 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034454 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 17:49:12.043215 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034456 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 17:49:12.043215 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034458 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 17:49:12.043215 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034461 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 17:49:12.043215 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034465 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 17:49:12.043215 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034468 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 17:49:12.043683 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034471 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 17:49:12.043683 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034474 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 17:49:12.043683 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034476 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 17:49:12.043683 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034480 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 17:49:12.043683 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034483 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 17:49:12.043683 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034485 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 17:49:12.043683 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034488 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 17:49:12.043683 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034490 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 17:49:12.043683 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034493 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 17:49:12.043683 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034495 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 17:49:12.043683 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034497 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 17:49:12.043683 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034500 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 17:49:12.043683 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034502 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 17:49:12.043683 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034505 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 17:49:12.043683 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034507 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 17:49:12.043683 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034510 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 17:49:12.043683 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034512 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 17:49:12.043683 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034515 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 17:49:12.043683 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034517 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 17:49:12.043683 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034520 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 17:49:12.044260 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034523 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 17:49:12.044260 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034527 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 17:49:12.044260 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034529 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 17:49:12.044260 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034532 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 17:49:12.044260 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034534 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 17:49:12.044260 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034537 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 17:49:12.044260 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034540 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 17:49:12.044260 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034543 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 17:49:12.044260 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034546 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 17:49:12.044260 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034549 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 17:49:12.044260 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034552 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 17:49:12.044260 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034555 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 17:49:12.044260 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034558 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 17:49:12.044260 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034560 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 17:49:12.044260 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034563 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 17:49:12.044260 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034566 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 17:49:12.044260 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034569 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 17:49:12.044260 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034571 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 17:49:12.044260 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034574 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 17:49:12.044726 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034576 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 17:49:12.044726 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034579 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 17:49:12.044726 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034581 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 17:49:12.044726 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034584 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 17:49:12.044726 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034586 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 17:49:12.044726 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034589 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 17:49:12.044726 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034592 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 17:49:12.044726 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034594 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 17:49:12.044726 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034597 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 17:49:12.044726 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034599 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 17:49:12.044726 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034601 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 17:49:12.044726 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034604 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 17:49:12.044726 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034606 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 17:49:12.044726 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034611 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 17:49:12.044726 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034614 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 17:49:12.044726 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034617 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 17:49:12.044726 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034619 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 17:49:12.044726 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034622 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 17 17:49:12.044726 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034624 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 17:49:12.044726 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034627 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 17:49:12.045224 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034629 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 17:49:12.045224 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034631 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 17:49:12.045224 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034634 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 17:49:12.045224 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034636 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 17:49:12.045224 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034639 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 17:49:12.045224 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.034641 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 17:49:12.045224 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.035209 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 17:49:12.045224 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.043815 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 17 17:49:12.045224 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.043831 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 17 17:49:12.045224 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.043854 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 17 17:49:12.045224 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.043860 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 17 17:49:12.045224 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.043923 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 17:49:12.045224 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.043929 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 17:49:12.045224 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.043932 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 17:49:12.045224 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.043936 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 17:49:12.045600 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.043939 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 17:49:12.045600 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.043942 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 17:49:12.045600 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.043945 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 17:49:12.045600 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.043948 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 17:49:12.045600 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.043951 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 17:49:12.045600 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.043955 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 17:49:12.045600 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.043959 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 17:49:12.045600 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.043962 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 17:49:12.045600 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.043965 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 17:49:12.045600 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.043968 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 17:49:12.045600 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.043971 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 17:49:12.045600 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.043973 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 17:49:12.045600 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.043977 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 17:49:12.045600 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.043979 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 17:49:12.045600 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.043982 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 17:49:12.045600 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.043985 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 17:49:12.045600 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.043987 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 17 17:49:12.045600 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.043990 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 17:49:12.045600 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.043992 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 17:49:12.045600 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.043995 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 17:49:12.046078 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.043997 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 17:49:12.046078 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044000 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 17:49:12.046078 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044002 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 17:49:12.046078 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044005 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 17:49:12.046078 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044009 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 17:49:12.046078 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044012 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 17:49:12.046078 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044014 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 17:49:12.046078 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044017 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 17:49:12.046078 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044021 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 17:49:12.046078 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044024 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 17:49:12.046078 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044027 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 17:49:12.046078 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044030 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 17:49:12.046078 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044033 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 17:49:12.046078 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044036 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 17:49:12.046078 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044038 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 17:49:12.046078 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044041 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 17:49:12.046078 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044044 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 17:49:12.046078 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044046 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 17:49:12.046078 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044049 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 17:49:12.046551 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044052 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 17:49:12.046551 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044054 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 17:49:12.046551 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044057 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 17:49:12.046551 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044060 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 17:49:12.046551 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044062 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 17:49:12.046551 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044065 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 17:49:12.046551 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044068 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 17:49:12.046551 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044071 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 17:49:12.046551 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044073 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 17:49:12.046551 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044076 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 17:49:12.046551 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044079 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 17:49:12.046551 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044081 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 17:49:12.046551 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044084 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 17:49:12.046551 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044087 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 17:49:12.046551 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044090 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 17:49:12.046551 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044092 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 17:49:12.046551 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044095 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 17:49:12.046551 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044098 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 17:49:12.046551 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044101 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 17:49:12.046551 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044103 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 17:49:12.047039 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044106 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 17:49:12.047039 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044108 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 17:49:12.047039 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044111 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 17:49:12.047039 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044113 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 17:49:12.047039 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044116 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 17:49:12.047039 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044118 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 17:49:12.047039 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044121 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 17:49:12.047039 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044123 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 17:49:12.047039 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044125 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 17:49:12.047039 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044128 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 17:49:12.047039 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044130 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 17:49:12.047039 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044133 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 17:49:12.047039 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044135 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 17:49:12.047039 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044137 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 17:49:12.047039 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044140 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 17:49:12.047039 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044142 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 17:49:12.047039 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044152 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 17:49:12.047039 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044154 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 17:49:12.047039 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044157 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 17:49:12.047039 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044160 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 17:49:12.047535 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044162 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 17:49:12.047535 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044164 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 17:49:12.047535 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044186 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 17:49:12.047535 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044191 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 17:49:12.047535 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044194 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 17:49:12.047535 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044197 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 17:49:12.047535 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044199 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 17:49:12.047535 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044202 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 17:49:12.047535 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044204 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 17:49:12.047535 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044207 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 17:49:12.047535 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044210 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 17:49:12.047535 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044214 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 17:49:12.047535 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044217 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 17:49:12.047535 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044220 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 17:49:12.047535 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044222 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 17:49:12.047535 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044225 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 17:49:12.047913 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.044230 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 17:49:12.047913 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044347 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 17:49:12.047913 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044352 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 17:49:12.047913 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044356 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 17:49:12.047913 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044358 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 17:49:12.047913 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044361 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 17:49:12.047913 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044363 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 17:49:12.047913 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044366 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 17:49:12.047913 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044368 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 17:49:12.047913 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044371 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 17:49:12.047913 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044373 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 17:49:12.047913 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044376 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 17:49:12.047913 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044378 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 17:49:12.047913 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044386 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 17:49:12.047913 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044389 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 17:49:12.048381 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044392 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 17:49:12.048381 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044394 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 17:49:12.048381 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044398 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 17:49:12.048381 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044402 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 17:49:12.048381 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044405 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 17:49:12.048381 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044407 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 17:49:12.048381 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044410 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 17:49:12.048381 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044412 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 17:49:12.048381 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044415 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 17:49:12.048381 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044418 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 17:49:12.048381 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044420 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 17:49:12.048381 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044423 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 17:49:12.048381 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044425 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 17:49:12.048381 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044429 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 17:49:12.048381 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044433 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 17:49:12.048381 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044435 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 17:49:12.048381 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044438 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 17:49:12.048381 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044440 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 17:49:12.048381 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044443 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 17:49:12.048833 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044445 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 17:49:12.048833 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044448 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 17:49:12.048833 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044450 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 17:49:12.048833 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044453 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 17:49:12.048833 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044455 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 17:49:12.048833 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044457 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 17:49:12.048833 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044460 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 17:49:12.048833 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044462 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 17:49:12.048833 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044464 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 17:49:12.048833 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044467 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 17:49:12.048833 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044469 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 17:49:12.048833 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044472 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 17:49:12.048833 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044479 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 17:49:12.048833 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044482 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 17:49:12.048833 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044484 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 17:49:12.048833 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044487 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 17:49:12.048833 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044489 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 17:49:12.048833 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044492 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 17:49:12.048833 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044495 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 17:49:12.048833 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044497 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 17:49:12.049319 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044500 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 17:49:12.049319 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044502 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 17:49:12.049319 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044505 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 17:49:12.049319 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044508 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 17:49:12.049319 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044510 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 17:49:12.049319 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044512 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 17:49:12.049319 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044515 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 17:49:12.049319 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044517 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 17:49:12.049319 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044519 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 17:49:12.049319 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044522 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 17:49:12.049319 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044524 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 17:49:12.049319 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044527 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 17:49:12.049319 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044529 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 17:49:12.049319 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044531 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 17:49:12.049319 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044534 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 17:49:12.049319 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044536 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 17 17:49:12.049319 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044538 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 17:49:12.049319 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044541 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 17:49:12.049319 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044543 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 17:49:12.049319 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044546 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 17:49:12.049809 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044548 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 17:49:12.049809 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044550 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 17:49:12.049809 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044552 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 17:49:12.049809 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044555 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 17:49:12.049809 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044557 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 17:49:12.049809 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044565 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 17:49:12.049809 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044568 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 17:49:12.049809 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044570 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 17:49:12.049809 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044573 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 17:49:12.049809 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044575 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 17:49:12.049809 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044577 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 17:49:12.049809 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044580 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 17:49:12.049809 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044582 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 17:49:12.049809 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044585 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 17:49:12.049809 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044587 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 17:49:12.049809 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044590 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 17:49:12.049809 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044592 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 17:49:12.049809 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044595 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 17:49:12.049809 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044597 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 17:49:12.049809 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044599 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 17:49:12.050309 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044603 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 17:49:12.050309 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044607 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 17:49:12.050309 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044610 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 17:49:12.050309 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044613 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 17:49:12.050309 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044615 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 17:49:12.050309 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:12.044618 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 17:49:12.050309 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.044623 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 17:49:12.050309 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.044723 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jul 17 17:49:12.050309 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.046506 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 17 17:49:12.050309 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.047841 2580 server.go:1019] "Starting client certificate rotation" Jul 17 17:49:12.050309 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.047937 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 17:49:12.050309 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.047972 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 17:49:12.050608 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.050596 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 17:49:12.052030 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.052012 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 17:49:12.065413 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.065391 2580 log.go:25] "Validated CRI v1 runtime API" Jul 17 17:49:12.067596 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.067582 2580 log.go:25] "Validated CRI v1 image API" Jul 17 17:49:12.068423 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.068407 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 17 17:49:12.070947 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.070924 2580 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a310a7ac-e820-43a2-bede-5ed82103ba94:/dev/nvme0n1p3 e6d799bb-9711-46a5-abf5-049b1623a410:/dev/nvme0n1p4] Jul 17 17:49:12.070994 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.070955 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 17 17:49:12.076905 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.076888 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 17:49:12.077152 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.077038 2580 manager.go:216] Machine: {Timestamp:2026-07-17 17:49:12.075974859 +0000 UTC m=+0.305770524 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100835 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dd43ba4f62d9a6dec06d143b10b0b SystemUUID:ec2dd43b-a4f6-2d9a-6dec-06d143b10b0b BootID:b4c71d31-f039-4c50-94cc-87d6369dcfdb Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f7:3b:88:32:23 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f7:3b:88:32:23 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:60:68:31:64:43 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 17 17:49:12.077225 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.077153 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 17 17:49:12.077284 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.077272 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 17 17:49:12.078710 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.078588 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 17 17:49:12.079226 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.078629 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-140.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 17 17:49:12.079803 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.079790 2580 topology_manager.go:138] "Creating topology manager with none policy" Jul 17 17:49:12.079861 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.079811 2580 container_manager_linux.go:309] "Creating device plugin manager" Jul 17 17:49:12.079861 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.079822 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 17:49:12.080734 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.080722 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 17:49:12.081861 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.081850 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 17 17:49:12.084326 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.084313 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 17 17:49:12.084457 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.084447 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 17 17:49:12.084512 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.084484 2580 kubelet.go:486] "Attempting to sync node with API server" Jul 17 17:49:12.084512 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.084498 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 17 17:49:12.084512 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.084512 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 17 17:49:12.084643 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.084524 2580 kubelet.go:398] "Adding apiserver pod source" Jul 17 17:49:12.084643 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.084535 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 17 17:49:12.084953 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.084939 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 17:49:12.085033 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.084962 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 17:49:12.086980 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.086964 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 17 17:49:12.088185 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.088156 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 17 17:49:12.088273 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.088203 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 17 17:49:12.088715 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.088704 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 17 17:49:12.088766 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.088725 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 17 17:49:12.088766 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.088732 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 17 17:49:12.088766 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.088742 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 17 17:49:12.088766 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.088763 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 17 17:49:12.088871 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.088773 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 17 17:49:12.088871 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.088789 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 17 17:49:12.088871 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.088798 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 17 17:49:12.088871 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.088805 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 17 17:49:12.088871 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.088810 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 17 17:49:12.088871 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.088818 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 17 17:49:12.088871 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.088824 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 17 17:49:12.090002 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.089992 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 17 17:49:12.090002 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.090002 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 17 17:49:12.093184 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.093153 2580 server.go:1268] "Started kubelet" Jul 17 17:49:12.093362 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.093321 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 17 17:49:12.093455 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.093377 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 17 17:49:12.093828 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.093785 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 17 17:49:12.094063 ip-10-0-135-140 systemd[1]: Started Kubernetes Kubelet. Jul 17 17:49:12.094274 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.094267 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 17 17:49:12.096482 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.096468 2580 server.go:310] "Adding debug handlers to kubelet server" Jul 17 17:49:12.097321 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.097299 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-140.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 17 17:49:12.097425 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:12.097374 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-140.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 17 17:49:12.097466 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:12.097412 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 17 17:49:12.099055 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:12.099028 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 17 17:49:12.100839 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:12.099719 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-140.ec2.internal.18c324fe527dedac default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-140.ec2.internal,UID:ip-10-0-135-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-140.ec2.internal,},FirstTimestamp:2026-07-17 17:49:12.09312606 +0000 UTC m=+0.322921703,LastTimestamp:2026-07-17 17:49:12.09312606 +0000 UTC m=+0.322921703,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-140.ec2.internal,}" Jul 17 17:49:12.101768 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.101754 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 17 17:49:12.101817 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.101765 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 17 17:49:12.101864 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:12.101819 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-140.ec2.internal\" not found" Jul 17 17:49:12.102434 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.102367 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 17 17:49:12.102434 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.102372 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 17 17:49:12.102434 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.102395 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 17 17:49:12.102605 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.102467 2580 reconstruct.go:97] "Volume reconstruction finished" Jul 17 17:49:12.102605 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.102476 2580 reconciler.go:29] "Reconciler: start to sync state" Jul 17 17:49:12.102687 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.102639 2580 factory.go:55] Registering systemd factory Jul 17 17:49:12.102687 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.102678 2580 factory.go:223] Registration of the systemd container factory successfully Jul 17 17:49:12.102905 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.102893 2580 factory.go:153] Registering CRI-O factory Jul 17 17:49:12.102964 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.102909 2580 factory.go:223] Registration of the crio container factory successfully Jul 17 17:49:12.102964 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.102955 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 17 17:49:12.103052 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.102978 2580 factory.go:103] Registering Raw factory Jul 17 17:49:12.103052 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.102995 2580 manager.go:1196] Started watching for new ooms in manager Jul 17 17:49:12.103408 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.103393 2580 manager.go:349] Starting recovery of all containers Jul 17 17:49:12.112262 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:12.112233 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-140.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 17 17:49:12.112359 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:12.112254 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 17 17:49:12.115370 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.115345 2580 manager.go:354] Recovery completed Jul 17 17:49:12.116610 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:12.116586 2580 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 17 17:49:12.119507 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.119495 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:49:12.121269 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.121250 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-140.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:49:12.121348 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.121284 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-140.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:49:12.121348 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.121298 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-140.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:49:12.121769 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.121757 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 17 17:49:12.121769 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.121763 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:49:12.121855 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.121772 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 17 17:49:12.121855 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.121789 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 17 17:49:12.122034 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.122017 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zwwd7" Jul 17 17:49:12.122394 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.122381 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-140.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:49:12.122452 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.122405 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-140.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:49:12.122452 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.122415 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-140.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:49:12.122687 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.122676 2580 policy_none.go:49] "None policy: Start" Jul 17 17:49:12.122724 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.122693 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 17 17:49:12.122724 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.122703 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 17 17:49:12.123450 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:12.123374 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-140.ec2.internal.18c324fe542b5a46 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-140.ec2.internal,UID:ip-10-0-135-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-140.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-140.ec2.internal,},FirstTimestamp:2026-07-17 17:49:12.121268806 +0000 UTC m=+0.351064450,LastTimestamp:2026-07-17 17:49:12.121268806 +0000 UTC m=+0.351064450,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-140.ec2.internal,}" Jul 17 17:49:12.123560 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.123519 2580 policy_none.go:47] "Start" Jul 17 17:49:12.131423 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.131408 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zwwd7" Jul 17 17:49:12.132479 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:12.132412 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-140.ec2.internal.18c324fe542bb09a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-140.ec2.internal,UID:ip-10-0-135-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-140.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-140.ec2.internal,},FirstTimestamp:2026-07-17 17:49:12.121290906 +0000 UTC m=+0.351086549,LastTimestamp:2026-07-17 17:49:12.121290906 +0000 UTC m=+0.351086549,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-140.ec2.internal,}" Jul 17 17:49:12.159819 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.159707 2580 manager.go:337] "Starting Device Plugin manager" Jul 17 17:49:12.170707 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:12.159834 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 17 17:49:12.170707 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.159846 2580 server.go:87] "Starting device plugin registration server" Jul 17 17:49:12.170707 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.160053 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 17 17:49:12.170707 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.160063 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 17 17:49:12.170707 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.160157 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 17 17:49:12.170707 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.160260 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 17 17:49:12.170707 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.160267 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 17 17:49:12.170707 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:12.160714 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 17 17:49:12.170707 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:12.160751 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-140.ec2.internal\" not found" Jul 17 17:49:12.233349 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.233318 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 17 17:49:12.234617 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.234600 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 17 17:49:12.234719 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.234645 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 17 17:49:12.235132 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.235121 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jul 17 17:49:12.235217 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:12.235185 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 17 17:49:12.237104 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.237077 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 17:49:12.261050 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.261025 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:49:12.261834 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.261816 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-140.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:49:12.261908 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.261841 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-140.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:49:12.261908 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.261854 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-140.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:49:12.261908 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.261878 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-140.ec2.internal" Jul 17 17:49:12.271036 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.271021 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-140.ec2.internal" Jul 17 17:49:12.271125 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:12.271045 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-140.ec2.internal\": node \"ip-10-0-135-140.ec2.internal\" not found" Jul 17 17:49:12.292881 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:12.292832 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-140.ec2.internal\" not found" Jul 17 17:49:12.336125 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.336106 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-140.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-140.ec2.internal"] Jul 17 17:49:12.336194 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.336165 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:49:12.336936 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.336918 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-140.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:49:12.337005 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.336954 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-140.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:49:12.337005 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.336972 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-140.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:49:12.338017 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.338006 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:49:12.338157 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.338144 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-140.ec2.internal" Jul 17 17:49:12.338217 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.338190 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:49:12.338657 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.338641 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-140.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:49:12.338729 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.338665 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-140.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:49:12.338729 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.338675 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-140.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:49:12.338729 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.338648 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-140.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:49:12.338847 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.338733 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-140.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:49:12.338847 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.338743 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-140.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:49:12.339641 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.339628 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-140.ec2.internal" Jul 17 17:49:12.339711 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.339650 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:49:12.340361 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.340347 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-140.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:49:12.340433 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.340371 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-140.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:49:12.340433 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.340383 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-140.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:49:12.364713 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:12.364697 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-140.ec2.internal\" not found" node="ip-10-0-135-140.ec2.internal" Jul 17 17:49:12.369140 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:12.369123 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-140.ec2.internal\" not found" node="ip-10-0-135-140.ec2.internal" Jul 17 17:49:12.393177 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:12.393157 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-140.ec2.internal\" not found" Jul 17 17:49:12.404854 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.404834 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d01160169480c99a5a2ee1861725d8a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-140.ec2.internal\" (UID: \"d01160169480c99a5a2ee1861725d8a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-140.ec2.internal" Jul 17 17:49:12.404938 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.404858 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2e8d81a968918cba8978dd311f485be1-config\") pod \"kube-apiserver-proxy-ip-10-0-135-140.ec2.internal\" (UID: \"2e8d81a968918cba8978dd311f485be1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-140.ec2.internal" Jul 17 17:49:12.404938 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.404874 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d01160169480c99a5a2ee1861725d8a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-140.ec2.internal\" (UID: \"d01160169480c99a5a2ee1861725d8a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-140.ec2.internal" Jul 17 17:49:12.494149 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:12.494127 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-140.ec2.internal\" not found" Jul 17 17:49:12.505523 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.505497 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d01160169480c99a5a2ee1861725d8a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-140.ec2.internal\" (UID: \"d01160169480c99a5a2ee1861725d8a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-140.ec2.internal" Jul 17 17:49:12.505619 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.505525 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2e8d81a968918cba8978dd311f485be1-config\") pod \"kube-apiserver-proxy-ip-10-0-135-140.ec2.internal\" (UID: \"2e8d81a968918cba8978dd311f485be1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-140.ec2.internal" Jul 17 17:49:12.505619 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.505544 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d01160169480c99a5a2ee1861725d8a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-140.ec2.internal\" (UID: \"d01160169480c99a5a2ee1861725d8a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-140.ec2.internal" Jul 17 17:49:12.505619 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.505594 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d01160169480c99a5a2ee1861725d8a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-140.ec2.internal\" (UID: \"d01160169480c99a5a2ee1861725d8a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-140.ec2.internal" Jul 17 17:49:12.505619 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.505602 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2e8d81a968918cba8978dd311f485be1-config\") pod \"kube-apiserver-proxy-ip-10-0-135-140.ec2.internal\" (UID: \"2e8d81a968918cba8978dd311f485be1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-140.ec2.internal" Jul 17 17:49:12.505758 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.505597 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d01160169480c99a5a2ee1861725d8a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-140.ec2.internal\" (UID: \"d01160169480c99a5a2ee1861725d8a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-140.ec2.internal" Jul 17 17:49:12.594935 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:12.594880 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-140.ec2.internal\" not found" Jul 17 17:49:12.666406 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.666388 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-140.ec2.internal" Jul 17 17:49:12.672887 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:12.672863 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-140.ec2.internal" Jul 17 17:49:12.695984 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:12.695961 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-140.ec2.internal\" not found" Jul 17 17:49:12.796550 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:12.796506 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-140.ec2.internal\" not found" Jul 17 17:49:12.897061 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:12.896981 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-140.ec2.internal\" not found" Jul 17 17:49:12.997546 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:12.997521 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-140.ec2.internal\" not found" Jul 17 17:49:13.046987 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:13.046962 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 17 17:49:13.047456 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:13.047131 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 17 17:49:13.098416 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:13.098393 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-140.ec2.internal\" not found" Jul 17 17:49:13.135023 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:13.134997 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 17:44:13 +0000 UTC" deadline="2028-02-09 20:48:57.973663619 +0000 UTC" Jul 17 17:49:13.135114 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:13.135027 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13730h59m44.83864331s" Jul 17 17:49:13.199338 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:13.199282 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-140.ec2.internal\" not found" Jul 17 17:49:13.258538 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:13.258505 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd01160169480c99a5a2ee1861725d8a8.slice/crio-a46e5b893d5e325583d37deb55150464897224dcd06ef4559f993e37c91a0e8e WatchSource:0}: Error finding container a46e5b893d5e325583d37deb55150464897224dcd06ef4559f993e37c91a0e8e: Status 404 returned error can't find the container with id a46e5b893d5e325583d37deb55150464897224dcd06ef4559f993e37c91a0e8e Jul 17 17:49:13.259366 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:13.259340 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e8d81a968918cba8978dd311f485be1.slice/crio-9406caf6556de0fc4ee098413aeb8a5b8699387c8adee066aa6ff36aa29da8dd WatchSource:0}: Error finding container 9406caf6556de0fc4ee098413aeb8a5b8699387c8adee066aa6ff36aa29da8dd: Status 404 returned error can't find the container with id 9406caf6556de0fc4ee098413aeb8a5b8699387c8adee066aa6ff36aa29da8dd Jul 17 17:49:13.264060 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:13.264046 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 17:49:13.299230 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:13.299195 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:49:13.299340 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:13.299322 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-140.ec2.internal\" not found" Jul 17 17:49:13.300186 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:13.300154 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-140.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:49:13.300258 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:13.300194 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-140.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:49:13.300258 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:13.300209 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-140.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:49:13.337824 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:13.337806 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 17:49:13.359527 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:13.359508 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 17:49:13.402451 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:13.402430 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-140.ec2.internal" Jul 17 17:49:13.414379 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:13.414361 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 17:49:13.415864 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:13.415851 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-140.ec2.internal" Jul 17 17:49:13.426419 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:13.426402 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 17:49:13.535014 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:13.534938 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 17:49:15.328445 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.328374 2580 apiserver.go:52] "Watching apiserver" Jul 17 17:49:15.337514 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.337486 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 17 17:49:15.337954 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.337923 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-140.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv","openshift-multus/multus-h9rx7","openshift-multus/network-metrics-daemon-mvwcb","openshift-network-diagnostics/network-check-target-bpn6w","openshift-ovn-kubernetes/ovnkube-node-t6bnj","kube-system/konnectivity-agent-pkgcs","openshift-cluster-node-tuning-operator/tuned-9kl8t","openshift-dns/node-resolver-xh7s7","openshift-image-registry/node-ca-jwff2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-140.ec2.internal","openshift-multus/multus-additional-cni-plugins-ngvvf","openshift-network-operator/iptables-alerter-c2skf","kube-system/global-pull-secret-syncer-7nlmb"] Jul 17 17:49:15.340615 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.340595 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pkgcs" Jul 17 17:49:15.343245 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.343224 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 17 17:49:15.343338 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.343249 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-h5hft\"" Jul 17 17:49:15.343440 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.343425 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 17 17:49:15.343640 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.343623 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c2skf" Jul 17 17:49:15.345191 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.345173 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 17 17:49:15.346163 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.346145 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 17 17:49:15.346362 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.346347 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 17 17:49:15.346506 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.346487 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.346575 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.346516 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dbjcz\"" Jul 17 17:49:15.346645 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.346622 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 17 17:49:15.348254 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.348010 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:15.348254 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:15.348097 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvwcb" podUID="f5c93f78-e5a9-40b3-b394-e495edb54560" Jul 17 17:49:15.349187 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.349167 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 17 17:49:15.349549 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.349531 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 17 17:49:15.349795 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.349776 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8gjdw\"" Jul 17 17:49:15.350034 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.350014 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 17 17:49:15.350398 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.350196 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 17 17:49:15.350622 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.350591 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:49:15.350697 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:15.350681 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bpn6w" podUID="5c4c1690-71bc-4c37-bc2e-8c73015042b8" Jul 17 17:49:15.353304 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.352430 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.354643 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.354617 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xh7s7" Jul 17 17:49:15.354782 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.354627 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 17 17:49:15.355077 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355046 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 17 17:49:15.355165 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355089 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bpsq4\"" Jul 17 17:49:15.355224 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355170 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-system-cni-dir\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.355224 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355204 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-etc-kubernetes\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.355318 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355232 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 17 17:49:15.355318 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355246 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 17 17:49:15.355318 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355231 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f45033c7-3177-498b-a9d4-205296d7decb-iptables-alerter-script\") pod \"iptables-alerter-c2skf\" (UID: \"f45033c7-3177-498b-a9d4-205296d7decb\") " pod="openshift-network-operator/iptables-alerter-c2skf" Jul 17 17:49:15.355318 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355288 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-cnibin\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.355503 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355337 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-host-run-k8s-cni-cncf-io\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.355503 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355370 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-host-run-netns\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.355503 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355396 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-host-var-lib-cni-multus\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.355503 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355421 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtvl7\" (UniqueName: \"kubernetes.io/projected/4c85ec7c-9695-46c8-ba1d-48a401af6a10-kube-api-access-xtvl7\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.355503 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355446 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f45033c7-3177-498b-a9d4-205296d7decb-host-slash\") pod \"iptables-alerter-c2skf\" (UID: \"f45033c7-3177-498b-a9d4-205296d7decb\") " pod="openshift-network-operator/iptables-alerter-c2skf" Jul 17 17:49:15.355503 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355469 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99p78\" (UniqueName: \"kubernetes.io/projected/f45033c7-3177-498b-a9d4-205296d7decb-kube-api-access-99p78\") pod \"iptables-alerter-c2skf\" (UID: \"f45033c7-3177-498b-a9d4-205296d7decb\") " pod="openshift-network-operator/iptables-alerter-c2skf" Jul 17 17:49:15.355831 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355517 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-multus-cni-dir\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.355831 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355546 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-multus-socket-dir-parent\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.355831 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355570 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-host-var-lib-cni-bin\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.355831 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355588 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-host-var-lib-kubelet\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.355831 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355618 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-hostroot\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.355831 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355658 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4c85ec7c-9695-46c8-ba1d-48a401af6a10-multus-daemon-config\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.355831 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355668 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 17 17:49:15.355831 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355681 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/12d7cf3a-4015-4324-b26f-db47d30161b2-agent-certs\") pod \"konnectivity-agent-pkgcs\" (UID: \"12d7cf3a-4015-4324-b26f-db47d30161b2\") " pod="kube-system/konnectivity-agent-pkgcs" Jul 17 17:49:15.355831 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355701 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-os-release\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.355831 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355722 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c85ec7c-9695-46c8-ba1d-48a401af6a10-cni-binary-copy\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.355831 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355763 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-multus-conf-dir\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.355831 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355787 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-host-run-multus-certs\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.355831 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355812 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5c93f78-e5a9-40b3-b394-e495edb54560-metrics-certs\") pod \"network-metrics-daemon-mvwcb\" (UID: \"f5c93f78-e5a9-40b3-b394-e495edb54560\") " pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:15.355831 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355837 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbnkx\" (UniqueName: \"kubernetes.io/projected/f5c93f78-e5a9-40b3-b394-e495edb54560-kube-api-access-kbnkx\") pod \"network-metrics-daemon-mvwcb\" (UID: \"f5c93f78-e5a9-40b3-b394-e495edb54560\") " pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:15.356413 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.355863 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/12d7cf3a-4015-4324-b26f-db47d30161b2-konnectivity-ca\") pod \"konnectivity-agent-pkgcs\" (UID: \"12d7cf3a-4015-4324-b26f-db47d30161b2\") " pod="kube-system/konnectivity-agent-pkgcs" Jul 17 17:49:15.356496 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.356476 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 17 17:49:15.357387 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.357362 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 17 17:49:15.357624 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.357611 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 17 17:49:15.357734 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.357669 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:15.357734 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:15.357722 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nlmb" podUID="030fdd55-bca5-482e-9b12-0552be384774" Jul 17 17:49:15.357867 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.357829 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bqlnf\"" Jul 17 17:49:15.358429 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.358412 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 17:49:15.361945 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.361913 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv" Jul 17 17:49:15.366379 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.366358 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m7vzb\"" Jul 17 17:49:15.367230 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.367212 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 17 17:49:15.367442 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.367425 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 17 17:49:15.367892 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.367874 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 17 17:49:15.368054 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.367878 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jwff2" Jul 17 17:49:15.370278 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.370260 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 17 17:49:15.370952 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.370666 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kpf9p\"" Jul 17 17:49:15.370952 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.370856 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 17 17:49:15.371108 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.370976 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 17 17:49:15.371108 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.371048 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.373633 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.373598 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gqkb2\"" Jul 17 17:49:15.373633 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.373619 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 17 17:49:15.373815 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.373632 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 17 17:49:15.373956 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.373931 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ngvvf" Jul 17 17:49:15.376688 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.376248 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 17 17:49:15.376688 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.376401 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 17 17:49:15.376688 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.376492 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mlfbk\"" Jul 17 17:49:15.378520 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.378500 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-b5j7d" Jul 17 17:49:15.386539 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.386516 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-b5j7d" Jul 17 17:49:15.446295 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.446269 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 17 17:49:15.456076 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456056 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-lib-modules\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.456182 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456087 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ea25ecd-4ba5-4c84-8068-d7adfed46344-system-cni-dir\") pod \"multus-additional-cni-plugins-ngvvf\" (UID: \"5ea25ecd-4ba5-4c84-8068-d7adfed46344\") " pod="openshift-multus/multus-additional-cni-plugins-ngvvf" Jul 17 17:49:15.456182 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456132 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5c93f78-e5a9-40b3-b394-e495edb54560-metrics-certs\") pod \"network-metrics-daemon-mvwcb\" (UID: \"f5c93f78-e5a9-40b3-b394-e495edb54560\") " pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:15.456182 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456166 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-etc-openvswitch\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.456342 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456191 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6070f265-4c28-44f8-856d-8be554ec058b-ovn-node-metrics-cert\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.456342 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456223 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-957lx\" (UniqueName: \"kubernetes.io/projected/0ac788ff-552c-4ea0-8de1-857bb7e041cf-kube-api-access-957lx\") pod \"node-resolver-xh7s7\" (UID: \"0ac788ff-552c-4ea0-8de1-857bb7e041cf\") " pod="openshift-dns/node-resolver-xh7s7" Jul 17 17:49:15.456342 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456249 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/30191e16-8838-488b-9b97-3cf158ae905d-socket-dir\") pod \"aws-ebs-csi-driver-node-prxlv\" (UID: \"30191e16-8838-488b-9b97-3cf158ae905d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv" Jul 17 17:49:15.456342 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:15.456265 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:49:15.456342 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456272 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-etc-kubernetes\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.456342 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456296 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6070f265-4c28-44f8-856d-8be554ec058b-ovnkube-script-lib\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.456342 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:15.456320 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5c93f78-e5a9-40b3-b394-e495edb54560-metrics-certs podName:f5c93f78-e5a9-40b3-b394-e495edb54560 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:15.956302536 +0000 UTC m=+2.943518868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5c93f78-e5a9-40b3-b394-e495edb54560-metrics-certs") pod "network-metrics-daemon-mvwcb" (UID: "f5c93f78-e5a9-40b3-b394-e495edb54560") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:49:15.456629 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456348 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-run\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.456629 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456365 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-sys\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.456629 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456379 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-var-lib-kubelet\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.456629 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456400 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtvl7\" (UniqueName: \"kubernetes.io/projected/4c85ec7c-9695-46c8-ba1d-48a401af6a10-kube-api-access-xtvl7\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.456629 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456423 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-run-openvswitch\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.456629 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456446 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/030fdd55-bca5-482e-9b12-0552be384774-kubelet-config\") pod \"global-pull-secret-syncer-7nlmb\" (UID: \"030fdd55-bca5-482e-9b12-0552be384774\") " pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:15.456629 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456558 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2xwk\" (UniqueName: \"kubernetes.io/projected/ed763a53-c3ff-4b3f-98c0-5870995f4a86-kube-api-access-b2xwk\") pod \"node-ca-jwff2\" (UID: \"ed763a53-c3ff-4b3f-98c0-5870995f4a86\") " pod="openshift-image-registry/node-ca-jwff2" Jul 17 17:49:15.456629 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456592 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f45033c7-3177-498b-a9d4-205296d7decb-host-slash\") pod \"iptables-alerter-c2skf\" (UID: \"f45033c7-3177-498b-a9d4-205296d7decb\") " pod="openshift-network-operator/iptables-alerter-c2skf" Jul 17 17:49:15.456629 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456617 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-multus-cni-dir\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.457027 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456705 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-host-var-lib-kubelet\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.457027 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456740 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-node-log\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.457027 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456707 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f45033c7-3177-498b-a9d4-205296d7decb-host-slash\") pod \"iptables-alerter-c2skf\" (UID: \"f45033c7-3177-498b-a9d4-205296d7decb\") " pod="openshift-network-operator/iptables-alerter-c2skf" Jul 17 17:49:15.457027 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456790 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-host-var-lib-kubelet\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.457027 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456803 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-host-cni-bin\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.457027 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456830 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ac788ff-552c-4ea0-8de1-857bb7e041cf-tmp-dir\") pod \"node-resolver-xh7s7\" (UID: \"0ac788ff-552c-4ea0-8de1-857bb7e041cf\") " pod="openshift-dns/node-resolver-xh7s7" Jul 17 17:49:15.457027 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456848 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-multus-cni-dir\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.457027 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456891 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/30191e16-8838-488b-9b97-3cf158ae905d-sys-fs\") pod \"aws-ebs-csi-driver-node-prxlv\" (UID: \"30191e16-8838-488b-9b97-3cf158ae905d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv" Jul 17 17:49:15.457027 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456914 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vj6w\" (UniqueName: \"kubernetes.io/projected/1686df19-eef6-4614-83ce-300256377400-kube-api-access-2vj6w\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.457027 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456937 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-multus-conf-dir\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.457027 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456958 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-host-kubelet\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.457027 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456975 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-var-lib-openvswitch\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.457027 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.456996 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.457027 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457004 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-multus-conf-dir\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.457027 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457019 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-etc-modprobe-d\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.457652 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457044 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ea25ecd-4ba5-4c84-8068-d7adfed46344-os-release\") pod \"multus-additional-cni-plugins-ngvvf\" (UID: \"5ea25ecd-4ba5-4c84-8068-d7adfed46344\") " pod="openshift-multus/multus-additional-cni-plugins-ngvvf" Jul 17 17:49:15.457652 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457067 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5ea25ecd-4ba5-4c84-8068-d7adfed46344-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ngvvf\" (UID: \"5ea25ecd-4ba5-4c84-8068-d7adfed46344\") " pod="openshift-multus/multus-additional-cni-plugins-ngvvf" Jul 17 17:49:15.457652 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457091 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-host-run-netns\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.457652 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457117 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-host-cni-netd\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.457652 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457132 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/030fdd55-bca5-482e-9b12-0552be384774-original-pull-secret\") pod \"global-pull-secret-syncer-7nlmb\" (UID: \"030fdd55-bca5-482e-9b12-0552be384774\") " pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:15.457652 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457166 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-host-run-netns\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.457652 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457213 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-host-run-netns\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.457652 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457234 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99p78\" (UniqueName: \"kubernetes.io/projected/f45033c7-3177-498b-a9d4-205296d7decb-kube-api-access-99p78\") pod \"iptables-alerter-c2skf\" (UID: \"f45033c7-3177-498b-a9d4-205296d7decb\") " pod="openshift-network-operator/iptables-alerter-c2skf" Jul 17 17:49:15.457652 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457263 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-host-slash\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.457652 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457378 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6070f265-4c28-44f8-856d-8be554ec058b-env-overrides\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.457652 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457413 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-etc-sysctl-d\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.457652 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457449 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-host\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.457652 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457484 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ea25ecd-4ba5-4c84-8068-d7adfed46344-cni-binary-copy\") pod \"multus-additional-cni-plugins-ngvvf\" (UID: \"5ea25ecd-4ba5-4c84-8068-d7adfed46344\") " pod="openshift-multus/multus-additional-cni-plugins-ngvvf" Jul 17 17:49:15.457652 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457512 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-run-ovn\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.457652 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457530 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/30191e16-8838-488b-9b97-3cf158ae905d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-prxlv\" (UID: \"30191e16-8838-488b-9b97-3cf158ae905d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv" Jul 17 17:49:15.457652 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457562 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-host-run-multus-certs\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.458283 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457586 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f45033c7-3177-498b-a9d4-205296d7decb-iptables-alerter-script\") pod \"iptables-alerter-c2skf\" (UID: \"f45033c7-3177-498b-a9d4-205296d7decb\") " pod="openshift-network-operator/iptables-alerter-c2skf" Jul 17 17:49:15.458283 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457608 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lscfs\" (UniqueName: \"kubernetes.io/projected/6070f265-4c28-44f8-856d-8be554ec058b-kube-api-access-lscfs\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.458283 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457626 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-etc-kubernetes\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.458283 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457633 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-host-run-multus-certs\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.458283 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457653 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/030fdd55-bca5-482e-9b12-0552be384774-dbus\") pod \"global-pull-secret-syncer-7nlmb\" (UID: \"030fdd55-bca5-482e-9b12-0552be384774\") " pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:15.458283 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457670 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-log-socket\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.458283 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457692 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6070f265-4c28-44f8-856d-8be554ec058b-ovnkube-config\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.458283 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457715 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-hostroot\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.458283 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457744 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4c85ec7c-9695-46c8-ba1d-48a401af6a10-multus-daemon-config\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.458283 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457789 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/12d7cf3a-4015-4324-b26f-db47d30161b2-konnectivity-ca\") pod \"konnectivity-agent-pkgcs\" (UID: \"12d7cf3a-4015-4324-b26f-db47d30161b2\") " pod="kube-system/konnectivity-agent-pkgcs" Jul 17 17:49:15.458283 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457808 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/30191e16-8838-488b-9b97-3cf158ae905d-registration-dir\") pod \"aws-ebs-csi-driver-node-prxlv\" (UID: \"30191e16-8838-488b-9b97-3cf158ae905d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv" Jul 17 17:49:15.458283 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457829 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/30191e16-8838-488b-9b97-3cf158ae905d-device-dir\") pod \"aws-ebs-csi-driver-node-prxlv\" (UID: \"30191e16-8838-488b-9b97-3cf158ae905d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv" Jul 17 17:49:15.458283 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457850 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-etc-sysconfig\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.458283 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457876 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mpqz\" (UniqueName: \"kubernetes.io/projected/5ea25ecd-4ba5-4c84-8068-d7adfed46344-kube-api-access-5mpqz\") pod \"multus-additional-cni-plugins-ngvvf\" (UID: \"5ea25ecd-4ba5-4c84-8068-d7adfed46344\") " pod="openshift-multus/multus-additional-cni-plugins-ngvvf" Jul 17 17:49:15.458283 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457901 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-os-release\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.458283 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457923 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c85ec7c-9695-46c8-ba1d-48a401af6a10-cni-binary-copy\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.458283 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457943 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbnkx\" (UniqueName: \"kubernetes.io/projected/f5c93f78-e5a9-40b3-b394-e495edb54560-kube-api-access-kbnkx\") pod \"network-metrics-daemon-mvwcb\" (UID: \"f5c93f78-e5a9-40b3-b394-e495edb54560\") " pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:15.458913 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457957 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/30191e16-8838-488b-9b97-3cf158ae905d-etc-selinux\") pod \"aws-ebs-csi-driver-node-prxlv\" (UID: \"30191e16-8838-488b-9b97-3cf158ae905d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv" Jul 17 17:49:15.458913 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457975 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59qkh\" (UniqueName: \"kubernetes.io/projected/30191e16-8838-488b-9b97-3cf158ae905d-kube-api-access-59qkh\") pod \"aws-ebs-csi-driver-node-prxlv\" (UID: \"30191e16-8838-488b-9b97-3cf158ae905d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv" Jul 17 17:49:15.458913 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.457998 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78dw2\" (UniqueName: \"kubernetes.io/projected/5c4c1690-71bc-4c37-bc2e-8c73015042b8-kube-api-access-78dw2\") pod \"network-check-target-bpn6w\" (UID: \"5c4c1690-71bc-4c37-bc2e-8c73015042b8\") " pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:49:15.458913 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458020 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed763a53-c3ff-4b3f-98c0-5870995f4a86-host\") pod \"node-ca-jwff2\" (UID: \"ed763a53-c3ff-4b3f-98c0-5870995f4a86\") " pod="openshift-image-registry/node-ca-jwff2" Jul 17 17:49:15.458913 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458041 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1686df19-eef6-4614-83ce-300256377400-tmp\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.458913 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458064 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-system-cni-dir\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.458913 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458078 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-systemd-units\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.458913 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458092 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ac788ff-552c-4ea0-8de1-857bb7e041cf-hosts-file\") pod \"node-resolver-xh7s7\" (UID: \"0ac788ff-552c-4ea0-8de1-857bb7e041cf\") " pod="openshift-dns/node-resolver-xh7s7" Jul 17 17:49:15.458913 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458116 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ed763a53-c3ff-4b3f-98c0-5870995f4a86-serviceca\") pod \"node-ca-jwff2\" (UID: \"ed763a53-c3ff-4b3f-98c0-5870995f4a86\") " pod="openshift-image-registry/node-ca-jwff2" Jul 17 17:49:15.458913 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458130 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-etc-sysctl-conf\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.458913 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458147 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-etc-systemd\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.458913 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458170 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ea25ecd-4ba5-4c84-8068-d7adfed46344-cnibin\") pod \"multus-additional-cni-plugins-ngvvf\" (UID: \"5ea25ecd-4ba5-4c84-8068-d7adfed46344\") " pod="openshift-multus/multus-additional-cni-plugins-ngvvf" Jul 17 17:49:15.458913 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458200 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ea25ecd-4ba5-4c84-8068-d7adfed46344-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ngvvf\" (UID: \"5ea25ecd-4ba5-4c84-8068-d7adfed46344\") " pod="openshift-multus/multus-additional-cni-plugins-ngvvf" Jul 17 17:49:15.458913 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458223 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-cnibin\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.458913 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458240 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-host-run-k8s-cni-cncf-io\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.458913 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458251 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f45033c7-3177-498b-a9d4-205296d7decb-iptables-alerter-script\") pod \"iptables-alerter-c2skf\" (UID: \"f45033c7-3177-498b-a9d4-205296d7decb\") " pod="openshift-network-operator/iptables-alerter-c2skf" Jul 17 17:49:15.458913 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458263 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-host-var-lib-cni-multus\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.459547 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458289 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-host-run-ovn-kubernetes\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.459547 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458305 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1686df19-eef6-4614-83ce-300256377400-etc-tuned\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.459547 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458329 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-etc-kubernetes\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.459547 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458330 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5ea25ecd-4ba5-4c84-8068-d7adfed46344-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ngvvf\" (UID: \"5ea25ecd-4ba5-4c84-8068-d7adfed46344\") " pod="openshift-multus/multus-additional-cni-plugins-ngvvf" Jul 17 17:49:15.459547 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458371 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-multus-socket-dir-parent\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.459547 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458395 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-host-var-lib-cni-bin\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.459547 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458416 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/12d7cf3a-4015-4324-b26f-db47d30161b2-agent-certs\") pod \"konnectivity-agent-pkgcs\" (UID: \"12d7cf3a-4015-4324-b26f-db47d30161b2\") " pod="kube-system/konnectivity-agent-pkgcs" Jul 17 17:49:15.459547 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458424 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-system-cni-dir\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.459547 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458433 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-run-systemd\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.459547 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458506 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-host-var-lib-cni-bin\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.459547 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458520 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-multus-socket-dir-parent\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.459547 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458562 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-hostroot\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.459547 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458782 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 17 17:49:15.459547 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458851 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-os-release\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.459547 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458863 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-cnibin\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.459547 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458863 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-host-run-k8s-cni-cncf-io\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.459547 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.458925 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4c85ec7c-9695-46c8-ba1d-48a401af6a10-host-var-lib-cni-multus\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.459547 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.459353 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c85ec7c-9695-46c8-ba1d-48a401af6a10-cni-binary-copy\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.460461 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.459360 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/12d7cf3a-4015-4324-b26f-db47d30161b2-konnectivity-ca\") pod \"konnectivity-agent-pkgcs\" (UID: \"12d7cf3a-4015-4324-b26f-db47d30161b2\") " pod="kube-system/konnectivity-agent-pkgcs" Jul 17 17:49:15.460461 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.459381 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4c85ec7c-9695-46c8-ba1d-48a401af6a10-multus-daemon-config\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.462671 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.462650 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/12d7cf3a-4015-4324-b26f-db47d30161b2-agent-certs\") pod \"konnectivity-agent-pkgcs\" (UID: \"12d7cf3a-4015-4324-b26f-db47d30161b2\") " pod="kube-system/konnectivity-agent-pkgcs" Jul 17 17:49:15.469548 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.469528 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtvl7\" (UniqueName: \"kubernetes.io/projected/4c85ec7c-9695-46c8-ba1d-48a401af6a10-kube-api-access-xtvl7\") pod \"multus-h9rx7\" (UID: \"4c85ec7c-9695-46c8-ba1d-48a401af6a10\") " pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.469803 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.469781 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99p78\" (UniqueName: \"kubernetes.io/projected/f45033c7-3177-498b-a9d4-205296d7decb-kube-api-access-99p78\") pod \"iptables-alerter-c2skf\" (UID: \"f45033c7-3177-498b-a9d4-205296d7decb\") " pod="openshift-network-operator/iptables-alerter-c2skf" Jul 17 17:49:15.470481 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.470465 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbnkx\" (UniqueName: \"kubernetes.io/projected/f5c93f78-e5a9-40b3-b394-e495edb54560-kube-api-access-kbnkx\") pod \"network-metrics-daemon-mvwcb\" (UID: \"f5c93f78-e5a9-40b3-b394-e495edb54560\") " pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:15.483813 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.483772 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-140.ec2.internal" event={"ID":"2e8d81a968918cba8978dd311f485be1","Type":"ContainerStarted","Data":"9406caf6556de0fc4ee098413aeb8a5b8699387c8adee066aa6ff36aa29da8dd"} Jul 17 17:49:15.484921 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.484899 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-140.ec2.internal" event={"ID":"d01160169480c99a5a2ee1861725d8a8","Type":"ContainerStarted","Data":"a46e5b893d5e325583d37deb55150464897224dcd06ef4559f993e37c91a0e8e"} Jul 17 17:49:15.558805 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.558773 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-log-socket\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.558969 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.558815 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6070f265-4c28-44f8-856d-8be554ec058b-ovnkube-config\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.558969 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.558843 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/30191e16-8838-488b-9b97-3cf158ae905d-registration-dir\") pod \"aws-ebs-csi-driver-node-prxlv\" (UID: \"30191e16-8838-488b-9b97-3cf158ae905d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv" Jul 17 17:49:15.558969 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.558867 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/30191e16-8838-488b-9b97-3cf158ae905d-device-dir\") pod \"aws-ebs-csi-driver-node-prxlv\" (UID: \"30191e16-8838-488b-9b97-3cf158ae905d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv" Jul 17 17:49:15.558969 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.558869 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-log-socket\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.558969 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.558889 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-etc-sysconfig\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.558969 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.558914 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mpqz\" (UniqueName: \"kubernetes.io/projected/5ea25ecd-4ba5-4c84-8068-d7adfed46344-kube-api-access-5mpqz\") pod \"multus-additional-cni-plugins-ngvvf\" (UID: \"5ea25ecd-4ba5-4c84-8068-d7adfed46344\") " pod="openshift-multus/multus-additional-cni-plugins-ngvvf" Jul 17 17:49:15.558969 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.558940 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/30191e16-8838-488b-9b97-3cf158ae905d-etc-selinux\") pod \"aws-ebs-csi-driver-node-prxlv\" (UID: \"30191e16-8838-488b-9b97-3cf158ae905d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv" Jul 17 17:49:15.558969 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.558947 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/30191e16-8838-488b-9b97-3cf158ae905d-device-dir\") pod \"aws-ebs-csi-driver-node-prxlv\" (UID: \"30191e16-8838-488b-9b97-3cf158ae905d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv" Jul 17 17:49:15.558969 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.558952 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-etc-sysconfig\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.558969 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.558964 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59qkh\" (UniqueName: \"kubernetes.io/projected/30191e16-8838-488b-9b97-3cf158ae905d-kube-api-access-59qkh\") pod \"aws-ebs-csi-driver-node-prxlv\" (UID: \"30191e16-8838-488b-9b97-3cf158ae905d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv" Jul 17 17:49:15.559303 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559001 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78dw2\" (UniqueName: \"kubernetes.io/projected/5c4c1690-71bc-4c37-bc2e-8c73015042b8-kube-api-access-78dw2\") pod \"network-check-target-bpn6w\" (UID: \"5c4c1690-71bc-4c37-bc2e-8c73015042b8\") " pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:49:15.559303 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559027 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed763a53-c3ff-4b3f-98c0-5870995f4a86-host\") pod \"node-ca-jwff2\" (UID: \"ed763a53-c3ff-4b3f-98c0-5870995f4a86\") " pod="openshift-image-registry/node-ca-jwff2" Jul 17 17:49:15.559303 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559049 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1686df19-eef6-4614-83ce-300256377400-tmp\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.559303 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559073 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-systemd-units\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.559303 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559094 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ac788ff-552c-4ea0-8de1-857bb7e041cf-hosts-file\") pod \"node-resolver-xh7s7\" (UID: \"0ac788ff-552c-4ea0-8de1-857bb7e041cf\") " pod="openshift-dns/node-resolver-xh7s7" Jul 17 17:49:15.559303 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559117 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ed763a53-c3ff-4b3f-98c0-5870995f4a86-serviceca\") pod \"node-ca-jwff2\" (UID: \"ed763a53-c3ff-4b3f-98c0-5870995f4a86\") " pod="openshift-image-registry/node-ca-jwff2" Jul 17 17:49:15.559303 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559139 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-etc-sysctl-conf\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.559303 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559147 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/30191e16-8838-488b-9b97-3cf158ae905d-registration-dir\") pod \"aws-ebs-csi-driver-node-prxlv\" (UID: \"30191e16-8838-488b-9b97-3cf158ae905d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv" Jul 17 17:49:15.559303 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559162 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-etc-systemd\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.559303 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559188 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ea25ecd-4ba5-4c84-8068-d7adfed46344-cnibin\") pod \"multus-additional-cni-plugins-ngvvf\" (UID: \"5ea25ecd-4ba5-4c84-8068-d7adfed46344\") " pod="openshift-multus/multus-additional-cni-plugins-ngvvf" Jul 17 17:49:15.559303 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559192 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-systemd-units\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.559303 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559211 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ea25ecd-4ba5-4c84-8068-d7adfed46344-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ngvvf\" (UID: \"5ea25ecd-4ba5-4c84-8068-d7adfed46344\") " pod="openshift-multus/multus-additional-cni-plugins-ngvvf" Jul 17 17:49:15.559303 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559236 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/30191e16-8838-488b-9b97-3cf158ae905d-etc-selinux\") pod \"aws-ebs-csi-driver-node-prxlv\" (UID: \"30191e16-8838-488b-9b97-3cf158ae905d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv" Jul 17 17:49:15.559303 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559238 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-host-run-ovn-kubernetes\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.559303 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559267 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1686df19-eef6-4614-83ce-300256377400-etc-tuned\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.559303 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559273 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-host-run-ovn-kubernetes\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.559303 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559283 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5ea25ecd-4ba5-4c84-8068-d7adfed46344-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ngvvf\" (UID: \"5ea25ecd-4ba5-4c84-8068-d7adfed46344\") " pod="openshift-multus/multus-additional-cni-plugins-ngvvf" Jul 17 17:49:15.559917 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559301 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-run-systemd\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.559917 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559317 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-lib-modules\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.559917 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559319 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ac788ff-552c-4ea0-8de1-857bb7e041cf-hosts-file\") pod \"node-resolver-xh7s7\" (UID: \"0ac788ff-552c-4ea0-8de1-857bb7e041cf\") " pod="openshift-dns/node-resolver-xh7s7" Jul 17 17:49:15.559917 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559332 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ea25ecd-4ba5-4c84-8068-d7adfed46344-system-cni-dir\") pod \"multus-additional-cni-plugins-ngvvf\" (UID: \"5ea25ecd-4ba5-4c84-8068-d7adfed46344\") " pod="openshift-multus/multus-additional-cni-plugins-ngvvf" Jul 17 17:49:15.559917 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559356 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-etc-openvswitch\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.559917 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559371 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6070f265-4c28-44f8-856d-8be554ec058b-ovn-node-metrics-cert\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.559917 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559378 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6070f265-4c28-44f8-856d-8be554ec058b-ovnkube-config\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.559917 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559387 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-957lx\" (UniqueName: \"kubernetes.io/projected/0ac788ff-552c-4ea0-8de1-857bb7e041cf-kube-api-access-957lx\") pod \"node-resolver-xh7s7\" (UID: \"0ac788ff-552c-4ea0-8de1-857bb7e041cf\") " pod="openshift-dns/node-resolver-xh7s7" Jul 17 17:49:15.559917 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559399 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed763a53-c3ff-4b3f-98c0-5870995f4a86-host\") pod \"node-ca-jwff2\" (UID: \"ed763a53-c3ff-4b3f-98c0-5870995f4a86\") " pod="openshift-image-registry/node-ca-jwff2" Jul 17 17:49:15.559917 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559402 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/30191e16-8838-488b-9b97-3cf158ae905d-socket-dir\") pod \"aws-ebs-csi-driver-node-prxlv\" (UID: \"30191e16-8838-488b-9b97-3cf158ae905d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv" Jul 17 17:49:15.559917 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559453 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-etc-systemd\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.559917 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559478 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-etc-kubernetes\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.559917 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559497 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/30191e16-8838-488b-9b97-3cf158ae905d-socket-dir\") pod \"aws-ebs-csi-driver-node-prxlv\" (UID: \"30191e16-8838-488b-9b97-3cf158ae905d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv" Jul 17 17:49:15.559917 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559505 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6070f265-4c28-44f8-856d-8be554ec058b-ovnkube-script-lib\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.559917 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559530 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-run\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.559917 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559552 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-sys\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.559917 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559574 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-var-lib-kubelet\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.559917 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559635 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-var-lib-kubelet\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.560971 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559668 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-run-openvswitch\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.560971 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559686 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/030fdd55-bca5-482e-9b12-0552be384774-kubelet-config\") pod \"global-pull-secret-syncer-7nlmb\" (UID: \"030fdd55-bca5-482e-9b12-0552be384774\") " pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:15.560971 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559701 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2xwk\" (UniqueName: \"kubernetes.io/projected/ed763a53-c3ff-4b3f-98c0-5870995f4a86-kube-api-access-b2xwk\") pod \"node-ca-jwff2\" (UID: \"ed763a53-c3ff-4b3f-98c0-5870995f4a86\") " pod="openshift-image-registry/node-ca-jwff2" Jul 17 17:49:15.560971 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559704 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-etc-sysctl-conf\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.560971 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559719 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-node-log\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.560971 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559721 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ed763a53-c3ff-4b3f-98c0-5870995f4a86-serviceca\") pod \"node-ca-jwff2\" (UID: \"ed763a53-c3ff-4b3f-98c0-5870995f4a86\") " pod="openshift-image-registry/node-ca-jwff2" Jul 17 17:49:15.560971 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559734 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-host-cni-bin\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.560971 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559741 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ea25ecd-4ba5-4c84-8068-d7adfed46344-cnibin\") pod \"multus-additional-cni-plugins-ngvvf\" (UID: \"5ea25ecd-4ba5-4c84-8068-d7adfed46344\") " pod="openshift-multus/multus-additional-cni-plugins-ngvvf" Jul 17 17:49:15.560971 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559770 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ac788ff-552c-4ea0-8de1-857bb7e041cf-tmp-dir\") pod \"node-resolver-xh7s7\" (UID: \"0ac788ff-552c-4ea0-8de1-857bb7e041cf\") " pod="openshift-dns/node-resolver-xh7s7" Jul 17 17:49:15.560971 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559798 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/30191e16-8838-488b-9b97-3cf158ae905d-sys-fs\") pod \"aws-ebs-csi-driver-node-prxlv\" (UID: \"30191e16-8838-488b-9b97-3cf158ae905d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv" Jul 17 17:49:15.560971 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559825 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vj6w\" (UniqueName: \"kubernetes.io/projected/1686df19-eef6-4614-83ce-300256377400-kube-api-access-2vj6w\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.560971 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559852 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-host-kubelet\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.560971 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559883 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-var-lib-openvswitch\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.560971 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559891 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ea25ecd-4ba5-4c84-8068-d7adfed46344-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ngvvf\" (UID: \"5ea25ecd-4ba5-4c84-8068-d7adfed46344\") " pod="openshift-multus/multus-additional-cni-plugins-ngvvf" Jul 17 17:49:15.560971 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559909 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.560971 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559935 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-etc-modprobe-d\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.560971 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559959 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ac788ff-552c-4ea0-8de1-857bb7e041cf-tmp-dir\") pod \"node-resolver-xh7s7\" (UID: \"0ac788ff-552c-4ea0-8de1-857bb7e041cf\") " pod="openshift-dns/node-resolver-xh7s7" Jul 17 17:49:15.561828 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559958 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ea25ecd-4ba5-4c84-8068-d7adfed46344-os-release\") pod \"multus-additional-cni-plugins-ngvvf\" (UID: \"5ea25ecd-4ba5-4c84-8068-d7adfed46344\") " pod="openshift-multus/multus-additional-cni-plugins-ngvvf" Jul 17 17:49:15.561828 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.559984 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5ea25ecd-4ba5-4c84-8068-d7adfed46344-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ngvvf\" (UID: \"5ea25ecd-4ba5-4c84-8068-d7adfed46344\") " pod="openshift-multus/multus-additional-cni-plugins-ngvvf" Jul 17 17:49:15.561828 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560002 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-host-run-netns\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.561828 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560006 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ea25ecd-4ba5-4c84-8068-d7adfed46344-os-release\") pod \"multus-additional-cni-plugins-ngvvf\" (UID: \"5ea25ecd-4ba5-4c84-8068-d7adfed46344\") " pod="openshift-multus/multus-additional-cni-plugins-ngvvf" Jul 17 17:49:15.561828 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560017 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-host-cni-netd\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.561828 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560034 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/030fdd55-bca5-482e-9b12-0552be384774-original-pull-secret\") pod \"global-pull-secret-syncer-7nlmb\" (UID: \"030fdd55-bca5-482e-9b12-0552be384774\") " pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:15.561828 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560052 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-host-slash\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.561828 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560066 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6070f265-4c28-44f8-856d-8be554ec058b-env-overrides\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.561828 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560081 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-etc-sysctl-d\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.561828 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560070 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-etc-kubernetes\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.561828 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560094 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-host\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.561828 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560105 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-run-openvswitch\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.561828 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560109 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ea25ecd-4ba5-4c84-8068-d7adfed46344-cni-binary-copy\") pod \"multus-additional-cni-plugins-ngvvf\" (UID: \"5ea25ecd-4ba5-4c84-8068-d7adfed46344\") " pod="openshift-multus/multus-additional-cni-plugins-ngvvf" Jul 17 17:49:15.561828 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560134 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-run\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.561828 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560161 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-run-ovn\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.561828 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560186 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-sys\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.561828 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560222 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-run-ovn\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.562448 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560227 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/030fdd55-bca5-482e-9b12-0552be384774-kubelet-config\") pod \"global-pull-secret-syncer-7nlmb\" (UID: \"030fdd55-bca5-482e-9b12-0552be384774\") " pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:15.562448 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560260 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-var-lib-openvswitch\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.562448 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560291 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.562448 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560322 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-etc-modprobe-d\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.562448 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560187 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/30191e16-8838-488b-9b97-3cf158ae905d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-prxlv\" (UID: \"30191e16-8838-488b-9b97-3cf158ae905d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv" Jul 17 17:49:15.562448 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560337 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/30191e16-8838-488b-9b97-3cf158ae905d-sys-fs\") pod \"aws-ebs-csi-driver-node-prxlv\" (UID: \"30191e16-8838-488b-9b97-3cf158ae905d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv" Jul 17 17:49:15.562448 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560363 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lscfs\" (UniqueName: \"kubernetes.io/projected/6070f265-4c28-44f8-856d-8be554ec058b-kube-api-access-lscfs\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.562448 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560375 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-host-kubelet\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.562448 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560389 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/030fdd55-bca5-482e-9b12-0552be384774-dbus\") pod \"global-pull-secret-syncer-7nlmb\" (UID: \"030fdd55-bca5-482e-9b12-0552be384774\") " pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:15.562448 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560432 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ea25ecd-4ba5-4c84-8068-d7adfed46344-cni-binary-copy\") pod \"multus-additional-cni-plugins-ngvvf\" (UID: \"5ea25ecd-4ba5-4c84-8068-d7adfed46344\") " pod="openshift-multus/multus-additional-cni-plugins-ngvvf" Jul 17 17:49:15.562448 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:15.560450 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 17:49:15.562448 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560468 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/030fdd55-bca5-482e-9b12-0552be384774-dbus\") pod \"global-pull-secret-syncer-7nlmb\" (UID: \"030fdd55-bca5-482e-9b12-0552be384774\") " pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:15.562448 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560473 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-host-slash\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.562448 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:15.560510 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030fdd55-bca5-482e-9b12-0552be384774-original-pull-secret podName:030fdd55-bca5-482e-9b12-0552be384774 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:16.06049396 +0000 UTC m=+3.047710290 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/030fdd55-bca5-482e-9b12-0552be384774-original-pull-secret") pod "global-pull-secret-syncer-7nlmb" (UID: "030fdd55-bca5-482e-9b12-0552be384774") : object "kube-system"/"original-pull-secret" not registered Jul 17 17:49:15.562448 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560513 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/30191e16-8838-488b-9b97-3cf158ae905d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-prxlv\" (UID: \"30191e16-8838-488b-9b97-3cf158ae905d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv" Jul 17 17:49:15.562448 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560553 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-etc-sysctl-d\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.562448 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560583 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-host\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.563112 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560686 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-host-run-netns\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.563112 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560716 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-node-log\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.563112 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560723 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-host-cni-netd\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.563112 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560796 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-host-cni-bin\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.563112 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560806 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ea25ecd-4ba5-4c84-8068-d7adfed46344-system-cni-dir\") pod \"multus-additional-cni-plugins-ngvvf\" (UID: \"5ea25ecd-4ba5-4c84-8068-d7adfed46344\") " pod="openshift-multus/multus-additional-cni-plugins-ngvvf" Jul 17 17:49:15.563112 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560852 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-run-systemd\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.563112 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560929 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6070f265-4c28-44f8-856d-8be554ec058b-env-overrides\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.563112 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.560954 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1686df19-eef6-4614-83ce-300256377400-lib-modules\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.563112 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.561000 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6070f265-4c28-44f8-856d-8be554ec058b-etc-openvswitch\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.563112 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.561103 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5ea25ecd-4ba5-4c84-8068-d7adfed46344-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ngvvf\" (UID: \"5ea25ecd-4ba5-4c84-8068-d7adfed46344\") " pod="openshift-multus/multus-additional-cni-plugins-ngvvf" Jul 17 17:49:15.563112 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.561464 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5ea25ecd-4ba5-4c84-8068-d7adfed46344-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ngvvf\" (UID: \"5ea25ecd-4ba5-4c84-8068-d7adfed46344\") " pod="openshift-multus/multus-additional-cni-plugins-ngvvf" Jul 17 17:49:15.563112 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.561531 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6070f265-4c28-44f8-856d-8be554ec058b-ovnkube-script-lib\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.563112 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.561778 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1686df19-eef6-4614-83ce-300256377400-etc-tuned\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.563112 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.562038 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1686df19-eef6-4614-83ce-300256377400-tmp\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.563684 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.563376 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6070f265-4c28-44f8-856d-8be554ec058b-ovn-node-metrics-cert\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.570285 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:15.570263 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 17:49:15.570371 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:15.570288 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 17:49:15.570371 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:15.570302 2580 projected.go:196] Error preparing data for projected volume kube-api-access-78dw2 for pod openshift-network-diagnostics/network-check-target-bpn6w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:49:15.570466 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:15.570400 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c4c1690-71bc-4c37-bc2e-8c73015042b8-kube-api-access-78dw2 podName:5c4c1690-71bc-4c37-bc2e-8c73015042b8 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:16.070347265 +0000 UTC m=+3.057563610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-78dw2" (UniqueName: "kubernetes.io/projected/5c4c1690-71bc-4c37-bc2e-8c73015042b8-kube-api-access-78dw2") pod "network-check-target-bpn6w" (UID: "5c4c1690-71bc-4c37-bc2e-8c73015042b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:49:15.573047 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.573000 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mpqz\" (UniqueName: \"kubernetes.io/projected/5ea25ecd-4ba5-4c84-8068-d7adfed46344-kube-api-access-5mpqz\") pod \"multus-additional-cni-plugins-ngvvf\" (UID: \"5ea25ecd-4ba5-4c84-8068-d7adfed46344\") " pod="openshift-multus/multus-additional-cni-plugins-ngvvf" Jul 17 17:49:15.573464 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.573371 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vj6w\" (UniqueName: \"kubernetes.io/projected/1686df19-eef6-4614-83ce-300256377400-kube-api-access-2vj6w\") pod \"tuned-9kl8t\" (UID: \"1686df19-eef6-4614-83ce-300256377400\") " pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.573464 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.573443 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59qkh\" (UniqueName: \"kubernetes.io/projected/30191e16-8838-488b-9b97-3cf158ae905d-kube-api-access-59qkh\") pod \"aws-ebs-csi-driver-node-prxlv\" (UID: \"30191e16-8838-488b-9b97-3cf158ae905d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv" Jul 17 17:49:15.573617 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.573494 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2xwk\" (UniqueName: \"kubernetes.io/projected/ed763a53-c3ff-4b3f-98c0-5870995f4a86-kube-api-access-b2xwk\") pod \"node-ca-jwff2\" (UID: \"ed763a53-c3ff-4b3f-98c0-5870995f4a86\") " pod="openshift-image-registry/node-ca-jwff2" Jul 17 17:49:15.573617 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.573521 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lscfs\" (UniqueName: \"kubernetes.io/projected/6070f265-4c28-44f8-856d-8be554ec058b-kube-api-access-lscfs\") pod \"ovnkube-node-t6bnj\" (UID: \"6070f265-4c28-44f8-856d-8be554ec058b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.575212 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.575190 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-957lx\" (UniqueName: \"kubernetes.io/projected/0ac788ff-552c-4ea0-8de1-857bb7e041cf-kube-api-access-957lx\") pod \"node-resolver-xh7s7\" (UID: \"0ac788ff-552c-4ea0-8de1-857bb7e041cf\") " pod="openshift-dns/node-resolver-xh7s7" Jul 17 17:49:15.604929 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.604873 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 17:49:15.653275 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.653249 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pkgcs" Jul 17 17:49:15.664968 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.664945 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c2skf" Jul 17 17:49:15.671521 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.671505 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h9rx7" Jul 17 17:49:15.678251 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.678233 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:15.686871 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.686831 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xh7s7" Jul 17 17:49:15.693464 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.693445 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv" Jul 17 17:49:15.701054 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.701035 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jwff2" Jul 17 17:49:15.708136 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.708121 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" Jul 17 17:49:15.713825 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.713811 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ngvvf" Jul 17 17:49:15.962957 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:15.962869 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5c93f78-e5a9-40b3-b394-e495edb54560-metrics-certs\") pod \"network-metrics-daemon-mvwcb\" (UID: \"f5c93f78-e5a9-40b3-b394-e495edb54560\") " pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:15.963116 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:15.962988 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:49:15.963116 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:15.963051 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5c93f78-e5a9-40b3-b394-e495edb54560-metrics-certs podName:f5c93f78-e5a9-40b3-b394-e495edb54560 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:16.96303232 +0000 UTC m=+3.950248649 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5c93f78-e5a9-40b3-b394-e495edb54560-metrics-certs") pod "network-metrics-daemon-mvwcb" (UID: "f5c93f78-e5a9-40b3-b394-e495edb54560") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:49:16.063232 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:16.063204 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/030fdd55-bca5-482e-9b12-0552be384774-original-pull-secret\") pod \"global-pull-secret-syncer-7nlmb\" (UID: \"030fdd55-bca5-482e-9b12-0552be384774\") " pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:16.063392 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:16.063324 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 17:49:16.063392 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:16.063391 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030fdd55-bca5-482e-9b12-0552be384774-original-pull-secret podName:030fdd55-bca5-482e-9b12-0552be384774 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:17.063373835 +0000 UTC m=+4.050590177 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/030fdd55-bca5-482e-9b12-0552be384774-original-pull-secret") pod "global-pull-secret-syncer-7nlmb" (UID: "030fdd55-bca5-482e-9b12-0552be384774") : object "kube-system"/"original-pull-secret" not registered Jul 17 17:49:16.164096 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:16.164060 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78dw2\" (UniqueName: \"kubernetes.io/projected/5c4c1690-71bc-4c37-bc2e-8c73015042b8-kube-api-access-78dw2\") pod \"network-check-target-bpn6w\" (UID: \"5c4c1690-71bc-4c37-bc2e-8c73015042b8\") " pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:49:16.164277 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:16.164196 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 17:49:16.164277 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:16.164217 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 17:49:16.164277 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:16.164227 2580 projected.go:196] Error preparing data for projected volume kube-api-access-78dw2 for pod openshift-network-diagnostics/network-check-target-bpn6w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:49:16.164277 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:16.164274 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c4c1690-71bc-4c37-bc2e-8c73015042b8-kube-api-access-78dw2 podName:5c4c1690-71bc-4c37-bc2e-8c73015042b8 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:17.164260592 +0000 UTC m=+4.151476923 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-78dw2" (UniqueName: "kubernetes.io/projected/5c4c1690-71bc-4c37-bc2e-8c73015042b8-kube-api-access-78dw2") pod "network-check-target-bpn6w" (UID: "5c4c1690-71bc-4c37-bc2e-8c73015042b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:49:16.389788 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:16.389737 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 17:44:15 +0000 UTC" deadline="2028-04-07 09:29:29.24650689 +0000 UTC" Jul 17 17:49:16.390303 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:16.389789 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15111h40m12.856722257s" Jul 17 17:49:16.392885 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:16.392849 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded763a53_c3ff_4b3f_98c0_5870995f4a86.slice/crio-60dcea72b81d6115996be95ffb672586503b8a01a55a1db0494b3308b3397c74 WatchSource:0}: Error finding container 60dcea72b81d6115996be95ffb672586503b8a01a55a1db0494b3308b3397c74: Status 404 returned error can't find the container with id 60dcea72b81d6115996be95ffb672586503b8a01a55a1db0494b3308b3397c74 Jul 17 17:49:16.395357 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:16.395311 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c85ec7c_9695_46c8_ba1d_48a401af6a10.slice/crio-13e746a9da4336ae768441b96fd375ec73e89dc997322c5a10ef0cd6919f2ce1 WatchSource:0}: Error finding container 13e746a9da4336ae768441b96fd375ec73e89dc997322c5a10ef0cd6919f2ce1: Status 404 returned error can't find the container with id 13e746a9da4336ae768441b96fd375ec73e89dc997322c5a10ef0cd6919f2ce1 Jul 17 17:49:16.398626 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:16.398603 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30191e16_8838_488b_9b97_3cf158ae905d.slice/crio-3a3262e390006c2a78de21f2042001d9c290480a509f472749c9c59cedeb41eb WatchSource:0}: Error finding container 3a3262e390006c2a78de21f2042001d9c290480a509f472749c9c59cedeb41eb: Status 404 returned error can't find the container with id 3a3262e390006c2a78de21f2042001d9c290480a509f472749c9c59cedeb41eb Jul 17 17:49:16.399460 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:16.399438 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ac788ff_552c_4ea0_8de1_857bb7e041cf.slice/crio-185a736e691947899e12da5735462029418af1be7bded09934de510a8b035b8c WatchSource:0}: Error finding container 185a736e691947899e12da5735462029418af1be7bded09934de510a8b035b8c: Status 404 returned error can't find the container with id 185a736e691947899e12da5735462029418af1be7bded09934de510a8b035b8c Jul 17 17:49:16.400209 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:16.400091 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf45033c7_3177_498b_a9d4_205296d7decb.slice/crio-407a9996264c271376d426b22e9bda2da22bc7f72ba478778b05225c731acbde WatchSource:0}: Error finding container 407a9996264c271376d426b22e9bda2da22bc7f72ba478778b05225c731acbde: Status 404 returned error can't find the container with id 407a9996264c271376d426b22e9bda2da22bc7f72ba478778b05225c731acbde Jul 17 17:49:16.401569 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:16.401027 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12d7cf3a_4015_4324_b26f_db47d30161b2.slice/crio-1b308a6b248716231f0b746563c212feb04e5c84a999f884e723662da9007c20 WatchSource:0}: Error finding container 1b308a6b248716231f0b746563c212feb04e5c84a999f884e723662da9007c20: Status 404 returned error can't find the container with id 1b308a6b248716231f0b746563c212feb04e5c84a999f884e723662da9007c20 Jul 17 17:49:16.402489 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:16.402178 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6070f265_4c28_44f8_856d_8be554ec058b.slice/crio-09fc0ddff61723582818764aaa6c701019785afc80bd3ae67b21294cf98b495b WatchSource:0}: Error finding container 09fc0ddff61723582818764aaa6c701019785afc80bd3ae67b21294cf98b495b: Status 404 returned error can't find the container with id 09fc0ddff61723582818764aaa6c701019785afc80bd3ae67b21294cf98b495b Jul 17 17:49:16.403374 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:16.403248 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ea25ecd_4ba5_4c84_8068_d7adfed46344.slice/crio-3a16c58c2d86a492f1b115c0601fedd830bed8d9536621317196327a7980aad9 WatchSource:0}: Error finding container 3a16c58c2d86a492f1b115c0601fedd830bed8d9536621317196327a7980aad9: Status 404 returned error can't find the container with id 3a16c58c2d86a492f1b115c0601fedd830bed8d9536621317196327a7980aad9 Jul 17 17:49:16.405532 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:16.405372 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1686df19_eef6_4614_83ce_300256377400.slice/crio-c357532eeb27c9ed7e77d7270cb4bac4f4c503a1019daf29a0255095e091d796 WatchSource:0}: Error finding container c357532eeb27c9ed7e77d7270cb4bac4f4c503a1019daf29a0255095e091d796: Status 404 returned error can't find the container with id c357532eeb27c9ed7e77d7270cb4bac4f4c503a1019daf29a0255095e091d796 Jul 17 17:49:16.478964 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:16.478797 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:16.479076 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:16.479056 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvwcb" podUID="f5c93f78-e5a9-40b3-b394-e495edb54560" Jul 17 17:49:16.487420 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:16.487389 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pkgcs" event={"ID":"12d7cf3a-4015-4324-b26f-db47d30161b2","Type":"ContainerStarted","Data":"1b308a6b248716231f0b746563c212feb04e5c84a999f884e723662da9007c20"} Jul 17 17:49:16.488487 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:16.488464 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c2skf" event={"ID":"f45033c7-3177-498b-a9d4-205296d7decb","Type":"ContainerStarted","Data":"407a9996264c271376d426b22e9bda2da22bc7f72ba478778b05225c731acbde"} Jul 17 17:49:16.489624 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:16.489601 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xh7s7" event={"ID":"0ac788ff-552c-4ea0-8de1-857bb7e041cf","Type":"ContainerStarted","Data":"185a736e691947899e12da5735462029418af1be7bded09934de510a8b035b8c"} Jul 17 17:49:16.490699 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:16.490671 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv" event={"ID":"30191e16-8838-488b-9b97-3cf158ae905d","Type":"ContainerStarted","Data":"3a3262e390006c2a78de21f2042001d9c290480a509f472749c9c59cedeb41eb"} Jul 17 17:49:16.491723 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:16.491702 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h9rx7" event={"ID":"4c85ec7c-9695-46c8-ba1d-48a401af6a10","Type":"ContainerStarted","Data":"13e746a9da4336ae768441b96fd375ec73e89dc997322c5a10ef0cd6919f2ce1"} Jul 17 17:49:16.492730 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:16.492702 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" event={"ID":"6070f265-4c28-44f8-856d-8be554ec058b","Type":"ContainerStarted","Data":"09fc0ddff61723582818764aaa6c701019785afc80bd3ae67b21294cf98b495b"} Jul 17 17:49:16.493647 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:16.493629 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jwff2" event={"ID":"ed763a53-c3ff-4b3f-98c0-5870995f4a86","Type":"ContainerStarted","Data":"60dcea72b81d6115996be95ffb672586503b8a01a55a1db0494b3308b3397c74"} Jul 17 17:49:16.495385 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:16.495361 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-140.ec2.internal" event={"ID":"2e8d81a968918cba8978dd311f485be1","Type":"ContainerStarted","Data":"ea7761c8de13dd2487e912980cd64eb8e4c4a2703c8028bc62e592169afba9e9"} Jul 17 17:49:16.496501 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:16.496484 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" event={"ID":"1686df19-eef6-4614-83ce-300256377400","Type":"ContainerStarted","Data":"c357532eeb27c9ed7e77d7270cb4bac4f4c503a1019daf29a0255095e091d796"} Jul 17 17:49:16.497460 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:16.497441 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngvvf" event={"ID":"5ea25ecd-4ba5-4c84-8068-d7adfed46344","Type":"ContainerStarted","Data":"3a16c58c2d86a492f1b115c0601fedd830bed8d9536621317196327a7980aad9"} Jul 17 17:49:16.510618 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:16.510580 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-140.ec2.internal" podStartSLOduration=2.510565441 podStartE2EDuration="2.510565441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:49:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:16.510462011 +0000 UTC m=+3.497678360" watchObservedRunningTime="2026-07-17 17:49:16.510565441 +0000 UTC m=+3.497781791" Jul 17 17:49:16.971903 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:16.971863 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5c93f78-e5a9-40b3-b394-e495edb54560-metrics-certs\") pod \"network-metrics-daemon-mvwcb\" (UID: \"f5c93f78-e5a9-40b3-b394-e495edb54560\") " pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:16.972096 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:16.972010 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:49:16.972096 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:16.972074 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5c93f78-e5a9-40b3-b394-e495edb54560-metrics-certs podName:f5c93f78-e5a9-40b3-b394-e495edb54560 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:18.972054879 +0000 UTC m=+5.959271223 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5c93f78-e5a9-40b3-b394-e495edb54560-metrics-certs") pod "network-metrics-daemon-mvwcb" (UID: "f5c93f78-e5a9-40b3-b394-e495edb54560") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:49:17.072919 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:17.072880 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/030fdd55-bca5-482e-9b12-0552be384774-original-pull-secret\") pod \"global-pull-secret-syncer-7nlmb\" (UID: \"030fdd55-bca5-482e-9b12-0552be384774\") " pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:17.073088 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:17.073071 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 17:49:17.073145 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:17.073130 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030fdd55-bca5-482e-9b12-0552be384774-original-pull-secret podName:030fdd55-bca5-482e-9b12-0552be384774 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:19.07311368 +0000 UTC m=+6.060330023 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/030fdd55-bca5-482e-9b12-0552be384774-original-pull-secret") pod "global-pull-secret-syncer-7nlmb" (UID: "030fdd55-bca5-482e-9b12-0552be384774") : object "kube-system"/"original-pull-secret" not registered Jul 17 17:49:17.174878 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:17.174220 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78dw2\" (UniqueName: \"kubernetes.io/projected/5c4c1690-71bc-4c37-bc2e-8c73015042b8-kube-api-access-78dw2\") pod \"network-check-target-bpn6w\" (UID: \"5c4c1690-71bc-4c37-bc2e-8c73015042b8\") " pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:49:17.174878 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:17.174439 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 17:49:17.174878 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:17.174456 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 17:49:17.174878 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:17.174468 2580 projected.go:196] Error preparing data for projected volume kube-api-access-78dw2 for pod openshift-network-diagnostics/network-check-target-bpn6w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:49:17.174878 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:17.174527 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c4c1690-71bc-4c37-bc2e-8c73015042b8-kube-api-access-78dw2 podName:5c4c1690-71bc-4c37-bc2e-8c73015042b8 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:19.174508349 +0000 UTC m=+6.161724694 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-78dw2" (UniqueName: "kubernetes.io/projected/5c4c1690-71bc-4c37-bc2e-8c73015042b8-kube-api-access-78dw2") pod "network-check-target-bpn6w" (UID: "5c4c1690-71bc-4c37-bc2e-8c73015042b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:49:17.390353 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:17.390080 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 17:44:15 +0000 UTC" deadline="2028-02-13 14:04:28.782991107 +0000 UTC" Jul 17 17:49:17.390353 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:17.390139 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13820h15m11.39285596s" Jul 17 17:49:17.480344 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:17.479887 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:17.480344 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:17.480016 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nlmb" podUID="030fdd55-bca5-482e-9b12-0552be384774" Jul 17 17:49:17.480344 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:17.480161 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:49:17.480344 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:17.480246 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bpn6w" podUID="5c4c1690-71bc-4c37-bc2e-8c73015042b8" Jul 17 17:49:17.511635 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:17.511597 2580 generic.go:356] "Generic (PLEG): container finished" podID="d01160169480c99a5a2ee1861725d8a8" containerID="5eb24c1082ac432d1de3f492c3bed1b1f18fe8b8979b0bdf5af98479418fe437" exitCode=0 Jul 17 17:49:17.512507 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:17.512480 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-140.ec2.internal" event={"ID":"d01160169480c99a5a2ee1861725d8a8","Type":"ContainerDied","Data":"5eb24c1082ac432d1de3f492c3bed1b1f18fe8b8979b0bdf5af98479418fe437"} Jul 17 17:49:18.478397 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:18.478365 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:18.478843 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:18.478505 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvwcb" podUID="f5c93f78-e5a9-40b3-b394-e495edb54560" Jul 17 17:49:18.541895 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:18.541860 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-140.ec2.internal" event={"ID":"d01160169480c99a5a2ee1861725d8a8","Type":"ContainerStarted","Data":"05e8c8845c4032b5c610b38074c2e277b5b86eb9eb2de9045feabe10de99484c"} Jul 17 17:49:18.989263 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:18.989227 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5c93f78-e5a9-40b3-b394-e495edb54560-metrics-certs\") pod \"network-metrics-daemon-mvwcb\" (UID: \"f5c93f78-e5a9-40b3-b394-e495edb54560\") " pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:18.989447 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:18.989374 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:49:18.989447 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:18.989435 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5c93f78-e5a9-40b3-b394-e495edb54560-metrics-certs podName:f5c93f78-e5a9-40b3-b394-e495edb54560 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:22.989416099 +0000 UTC m=+9.976632441 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5c93f78-e5a9-40b3-b394-e495edb54560-metrics-certs") pod "network-metrics-daemon-mvwcb" (UID: "f5c93f78-e5a9-40b3-b394-e495edb54560") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:49:19.089926 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:19.089888 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/030fdd55-bca5-482e-9b12-0552be384774-original-pull-secret\") pod \"global-pull-secret-syncer-7nlmb\" (UID: \"030fdd55-bca5-482e-9b12-0552be384774\") " pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:19.090104 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:19.090029 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 17:49:19.090104 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:19.090093 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030fdd55-bca5-482e-9b12-0552be384774-original-pull-secret podName:030fdd55-bca5-482e-9b12-0552be384774 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:23.090074908 +0000 UTC m=+10.077291249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/030fdd55-bca5-482e-9b12-0552be384774-original-pull-secret") pod "global-pull-secret-syncer-7nlmb" (UID: "030fdd55-bca5-482e-9b12-0552be384774") : object "kube-system"/"original-pull-secret" not registered Jul 17 17:49:19.191192 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:19.191153 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78dw2\" (UniqueName: \"kubernetes.io/projected/5c4c1690-71bc-4c37-bc2e-8c73015042b8-kube-api-access-78dw2\") pod \"network-check-target-bpn6w\" (UID: \"5c4c1690-71bc-4c37-bc2e-8c73015042b8\") " pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:49:19.191371 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:19.191360 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 17:49:19.191431 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:19.191382 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 17:49:19.191431 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:19.191395 2580 projected.go:196] Error preparing data for projected volume kube-api-access-78dw2 for pod openshift-network-diagnostics/network-check-target-bpn6w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:49:19.191522 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:19.191454 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c4c1690-71bc-4c37-bc2e-8c73015042b8-kube-api-access-78dw2 podName:5c4c1690-71bc-4c37-bc2e-8c73015042b8 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:23.19143578 +0000 UTC m=+10.178652135 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-78dw2" (UniqueName: "kubernetes.io/projected/5c4c1690-71bc-4c37-bc2e-8c73015042b8-kube-api-access-78dw2") pod "network-check-target-bpn6w" (UID: "5c4c1690-71bc-4c37-bc2e-8c73015042b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:49:19.480615 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:19.479860 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:49:19.480615 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:19.479983 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bpn6w" podUID="5c4c1690-71bc-4c37-bc2e-8c73015042b8" Jul 17 17:49:19.480615 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:19.480404 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:19.480615 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:19.480494 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nlmb" podUID="030fdd55-bca5-482e-9b12-0552be384774" Jul 17 17:49:20.478930 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:20.478900 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:20.479103 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:20.479027 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvwcb" podUID="f5c93f78-e5a9-40b3-b394-e495edb54560" Jul 17 17:49:21.478547 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:21.478512 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:49:21.479014 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:21.478520 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:21.479014 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:21.478658 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bpn6w" podUID="5c4c1690-71bc-4c37-bc2e-8c73015042b8" Jul 17 17:49:21.479014 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:21.478718 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nlmb" podUID="030fdd55-bca5-482e-9b12-0552be384774" Jul 17 17:49:22.478377 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:22.478265 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:22.478555 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:22.478413 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvwcb" podUID="f5c93f78-e5a9-40b3-b394-e495edb54560" Jul 17 17:49:23.021814 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:23.021776 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5c93f78-e5a9-40b3-b394-e495edb54560-metrics-certs\") pod \"network-metrics-daemon-mvwcb\" (UID: \"f5c93f78-e5a9-40b3-b394-e495edb54560\") " pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:23.022281 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:23.021937 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:49:23.022281 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:23.021999 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5c93f78-e5a9-40b3-b394-e495edb54560-metrics-certs podName:f5c93f78-e5a9-40b3-b394-e495edb54560 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:31.021981505 +0000 UTC m=+18.009197837 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5c93f78-e5a9-40b3-b394-e495edb54560-metrics-certs") pod "network-metrics-daemon-mvwcb" (UID: "f5c93f78-e5a9-40b3-b394-e495edb54560") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:49:23.123226 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:23.123188 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/030fdd55-bca5-482e-9b12-0552be384774-original-pull-secret\") pod \"global-pull-secret-syncer-7nlmb\" (UID: \"030fdd55-bca5-482e-9b12-0552be384774\") " pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:23.123391 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:23.123319 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 17:49:23.123391 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:23.123377 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030fdd55-bca5-482e-9b12-0552be384774-original-pull-secret podName:030fdd55-bca5-482e-9b12-0552be384774 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:31.123359282 +0000 UTC m=+18.110575624 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/030fdd55-bca5-482e-9b12-0552be384774-original-pull-secret") pod "global-pull-secret-syncer-7nlmb" (UID: "030fdd55-bca5-482e-9b12-0552be384774") : object "kube-system"/"original-pull-secret" not registered Jul 17 17:49:23.224549 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:23.224517 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78dw2\" (UniqueName: \"kubernetes.io/projected/5c4c1690-71bc-4c37-bc2e-8c73015042b8-kube-api-access-78dw2\") pod \"network-check-target-bpn6w\" (UID: \"5c4c1690-71bc-4c37-bc2e-8c73015042b8\") " pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:49:23.224718 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:23.224706 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 17:49:23.224886 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:23.224728 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 17:49:23.224886 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:23.224740 2580 projected.go:196] Error preparing data for projected volume kube-api-access-78dw2 for pod openshift-network-diagnostics/network-check-target-bpn6w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:49:23.224886 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:23.224811 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c4c1690-71bc-4c37-bc2e-8c73015042b8-kube-api-access-78dw2 podName:5c4c1690-71bc-4c37-bc2e-8c73015042b8 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:31.224794165 +0000 UTC m=+18.212010510 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-78dw2" (UniqueName: "kubernetes.io/projected/5c4c1690-71bc-4c37-bc2e-8c73015042b8-kube-api-access-78dw2") pod "network-check-target-bpn6w" (UID: "5c4c1690-71bc-4c37-bc2e-8c73015042b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:49:23.491518 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:23.491442 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:49:23.491790 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:23.491456 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:23.491969 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:23.491933 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bpn6w" podUID="5c4c1690-71bc-4c37-bc2e-8c73015042b8" Jul 17 17:49:23.492057 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:23.491996 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nlmb" podUID="030fdd55-bca5-482e-9b12-0552be384774" Jul 17 17:49:24.478515 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:24.478133 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:24.478515 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:24.478233 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvwcb" podUID="f5c93f78-e5a9-40b3-b394-e495edb54560" Jul 17 17:49:25.482929 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:25.482901 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:49:25.483372 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:25.483028 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bpn6w" podUID="5c4c1690-71bc-4c37-bc2e-8c73015042b8" Jul 17 17:49:25.483372 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:25.483081 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:25.483372 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:25.483201 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nlmb" podUID="030fdd55-bca5-482e-9b12-0552be384774" Jul 17 17:49:26.478530 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:26.478490 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:26.478710 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:26.478610 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvwcb" podUID="f5c93f78-e5a9-40b3-b394-e495edb54560" Jul 17 17:49:27.478510 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:27.478430 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:27.478923 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:27.478567 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nlmb" podUID="030fdd55-bca5-482e-9b12-0552be384774" Jul 17 17:49:27.478923 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:27.478659 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:49:27.478923 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:27.478739 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bpn6w" podUID="5c4c1690-71bc-4c37-bc2e-8c73015042b8" Jul 17 17:49:28.478770 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:28.478716 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:28.479168 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:28.478853 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvwcb" podUID="f5c93f78-e5a9-40b3-b394-e495edb54560" Jul 17 17:49:29.478782 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:29.478725 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:29.479209 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:29.478901 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nlmb" podUID="030fdd55-bca5-482e-9b12-0552be384774" Jul 17 17:49:29.479209 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:29.478942 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:49:29.479209 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:29.479045 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bpn6w" podUID="5c4c1690-71bc-4c37-bc2e-8c73015042b8" Jul 17 17:49:30.478916 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:30.478885 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:30.479389 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:30.479023 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvwcb" podUID="f5c93f78-e5a9-40b3-b394-e495edb54560" Jul 17 17:49:31.086525 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:31.086489 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5c93f78-e5a9-40b3-b394-e495edb54560-metrics-certs\") pod \"network-metrics-daemon-mvwcb\" (UID: \"f5c93f78-e5a9-40b3-b394-e495edb54560\") " pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:31.086784 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:31.086619 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:49:31.086784 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:31.086695 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5c93f78-e5a9-40b3-b394-e495edb54560-metrics-certs podName:f5c93f78-e5a9-40b3-b394-e495edb54560 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:47.086676438 +0000 UTC m=+34.073892774 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5c93f78-e5a9-40b3-b394-e495edb54560-metrics-certs") pod "network-metrics-daemon-mvwcb" (UID: "f5c93f78-e5a9-40b3-b394-e495edb54560") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:49:31.187087 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:31.187055 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/030fdd55-bca5-482e-9b12-0552be384774-original-pull-secret\") pod \"global-pull-secret-syncer-7nlmb\" (UID: \"030fdd55-bca5-482e-9b12-0552be384774\") " pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:31.187256 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:31.187224 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 17:49:31.187298 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:31.187282 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030fdd55-bca5-482e-9b12-0552be384774-original-pull-secret podName:030fdd55-bca5-482e-9b12-0552be384774 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:47.187265518 +0000 UTC m=+34.174481850 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/030fdd55-bca5-482e-9b12-0552be384774-original-pull-secret") pod "global-pull-secret-syncer-7nlmb" (UID: "030fdd55-bca5-482e-9b12-0552be384774") : object "kube-system"/"original-pull-secret" not registered Jul 17 17:49:31.288145 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:31.288111 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78dw2\" (UniqueName: \"kubernetes.io/projected/5c4c1690-71bc-4c37-bc2e-8c73015042b8-kube-api-access-78dw2\") pod \"network-check-target-bpn6w\" (UID: \"5c4c1690-71bc-4c37-bc2e-8c73015042b8\") " pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:49:31.288326 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:31.288306 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 17:49:31.288392 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:31.288328 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 17:49:31.288392 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:31.288338 2580 projected.go:196] Error preparing data for projected volume kube-api-access-78dw2 for pod openshift-network-diagnostics/network-check-target-bpn6w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:49:31.288392 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:31.288390 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c4c1690-71bc-4c37-bc2e-8c73015042b8-kube-api-access-78dw2 podName:5c4c1690-71bc-4c37-bc2e-8c73015042b8 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:47.288375436 +0000 UTC m=+34.275591764 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-78dw2" (UniqueName: "kubernetes.io/projected/5c4c1690-71bc-4c37-bc2e-8c73015042b8-kube-api-access-78dw2") pod "network-check-target-bpn6w" (UID: "5c4c1690-71bc-4c37-bc2e-8c73015042b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:49:31.478716 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:31.478646 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:49:31.478873 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:31.478795 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:31.478932 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:31.478880 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nlmb" podUID="030fdd55-bca5-482e-9b12-0552be384774" Jul 17 17:49:31.478932 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:31.478792 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bpn6w" podUID="5c4c1690-71bc-4c37-bc2e-8c73015042b8" Jul 17 17:49:32.478434 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:32.478394 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:32.478599 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:32.478546 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvwcb" podUID="f5c93f78-e5a9-40b3-b394-e495edb54560" Jul 17 17:49:33.478935 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:33.478896 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:33.479380 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:33.479016 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nlmb" podUID="030fdd55-bca5-482e-9b12-0552be384774" Jul 17 17:49:33.479429 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:33.479392 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:49:33.479481 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:33.479456 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bpn6w" podUID="5c4c1690-71bc-4c37-bc2e-8c73015042b8" Jul 17 17:49:34.478206 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:34.478181 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:34.478391 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:34.478287 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvwcb" podUID="f5c93f78-e5a9-40b3-b394-e495edb54560" Jul 17 17:49:35.484215 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:35.483659 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:35.484215 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:35.483810 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nlmb" podUID="030fdd55-bca5-482e-9b12-0552be384774" Jul 17 17:49:35.484215 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:35.484094 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:49:35.484215 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:35.484181 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bpn6w" podUID="5c4c1690-71bc-4c37-bc2e-8c73015042b8" Jul 17 17:49:35.578948 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:35.578634 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pkgcs" event={"ID":"12d7cf3a-4015-4324-b26f-db47d30161b2","Type":"ContainerStarted","Data":"e40db87ee2ebd94c3a7c5e55e5a0023f0d46726bc1ff55f7d5019885920f00ef"} Jul 17 17:49:36.478931 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:36.478713 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:36.479077 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:36.479026 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvwcb" podUID="f5c93f78-e5a9-40b3-b394-e495edb54560" Jul 17 17:49:36.582258 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:36.582230 2580 generic.go:356] "Generic (PLEG): container finished" podID="5ea25ecd-4ba5-4c84-8068-d7adfed46344" containerID="1aa25e743cf2b261b0d52316747601cbd7bda33393ee07a63833f2178a84046b" exitCode=0 Jul 17 17:49:36.583060 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:36.582322 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngvvf" event={"ID":"5ea25ecd-4ba5-4c84-8068-d7adfed46344","Type":"ContainerDied","Data":"1aa25e743cf2b261b0d52316747601cbd7bda33393ee07a63833f2178a84046b"} Jul 17 17:49:36.583739 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:36.583713 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xh7s7" event={"ID":"0ac788ff-552c-4ea0-8de1-857bb7e041cf","Type":"ContainerStarted","Data":"93906629c82c1e0d69fcfe7a581a888a95f21ac7cc896d1167f8dcea364a132d"} Jul 17 17:49:36.585253 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:36.585234 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv" event={"ID":"30191e16-8838-488b-9b97-3cf158ae905d","Type":"ContainerStarted","Data":"380e4f378314edf52fc1914c16ca1470d36c493e5a45fbd0a3ad52c03be2c56f"} Jul 17 17:49:36.586725 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:36.586704 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h9rx7" event={"ID":"4c85ec7c-9695-46c8-ba1d-48a401af6a10","Type":"ContainerStarted","Data":"252bf93285fe32bb111424f8463703e484f66fb7a0cfd935ddee1c5d9bb38163"} Jul 17 17:49:36.592714 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:36.592691 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" event={"ID":"6070f265-4c28-44f8-856d-8be554ec058b","Type":"ContainerStarted","Data":"c62c8149d157f663e53b05ad0a4c25cafd726c7d2b23a4072a9769ffe94702db"} Jul 17 17:49:36.592828 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:36.592786 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" event={"ID":"6070f265-4c28-44f8-856d-8be554ec058b","Type":"ContainerStarted","Data":"1f2c59fac113af42721767a679cc334393b4459e610eaa8aa7f1d871e72ab40b"} Jul 17 17:49:36.592879 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:36.592828 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" event={"ID":"6070f265-4c28-44f8-856d-8be554ec058b","Type":"ContainerStarted","Data":"681a9e27cbe3dbe0eb5c2841dc7aab50750ad398220803d163386eda777add5f"} Jul 17 17:49:36.592879 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:36.592860 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" event={"ID":"6070f265-4c28-44f8-856d-8be554ec058b","Type":"ContainerStarted","Data":"66476143e4c4543c1fd7250f6e99ce9ce75810891996fb86fc7a348134b82020"} Jul 17 17:49:36.592971 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:36.592891 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" event={"ID":"6070f265-4c28-44f8-856d-8be554ec058b","Type":"ContainerStarted","Data":"a83237bd9648976c60c1c4945659ca5e762348984316afc6c0d9a82dd16fc905"} Jul 17 17:49:36.592971 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:36.592927 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" event={"ID":"6070f265-4c28-44f8-856d-8be554ec058b","Type":"ContainerStarted","Data":"b70cb968dd92fbd03ae9285d2d2e5d64c59d8153dd39c6f4cfc0933963d0c8cd"} Jul 17 17:49:36.594057 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:36.594039 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jwff2" event={"ID":"ed763a53-c3ff-4b3f-98c0-5870995f4a86","Type":"ContainerStarted","Data":"a6d155f6e6f7f11b1432baf1c9192a7421f296cc58cddb3cc6c65e72e58fe59f"} Jul 17 17:49:36.595281 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:36.595260 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" event={"ID":"1686df19-eef6-4614-83ce-300256377400","Type":"ContainerStarted","Data":"4b8d12d99ac8f0db3584ddd96f5cf08b8056993ed7c277649832852d40402723"} Jul 17 17:49:36.607709 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:36.607669 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-140.ec2.internal" podStartSLOduration=22.607658344 podStartE2EDuration="22.607658344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:49:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:18.561024876 +0000 UTC m=+5.548241220" watchObservedRunningTime="2026-07-17 17:49:36.607658344 +0000 UTC m=+23.594874693" Jul 17 17:49:36.622931 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:36.622893 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pkgcs" podStartSLOduration=12.863876573 podStartE2EDuration="23.622882104s" totalImagesPullingTime="10.759005531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:36.622556947 +0000 UTC m=+23.609773297" watchObservedRunningTime="2026-07-17 17:49:36.622882104 +0000 UTC m=+23.610098453" Jul 17 17:49:36.653206 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:36.653176 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-h9rx7" podStartSLOduration=4.553644045 podStartE2EDuration="23.653166206s" totalImagesPullingTime="19.099522161s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:36.653072921 +0000 UTC m=+23.640289272" watchObservedRunningTime="2026-07-17 17:49:36.653166206 +0000 UTC m=+23.640382556" Jul 17 17:49:36.653440 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:36.653420 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9kl8t" podStartSLOduration=4.621647958 podStartE2EDuration="23.653415346s" totalImagesPullingTime="19.031767388s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:36.637925859 +0000 UTC m=+23.625142206" watchObservedRunningTime="2026-07-17 17:49:36.653415346 +0000 UTC m=+23.640631745" Jul 17 17:49:36.669431 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:36.669398 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xh7s7" podStartSLOduration=4.637446769 podStartE2EDuration="23.669388127s" totalImagesPullingTime="19.031941358s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:36.669145289 +0000 UTC m=+23.656361639" watchObservedRunningTime="2026-07-17 17:49:36.669388127 +0000 UTC m=+23.656604477" Jul 17 17:49:36.703835 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:36.703802 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jwff2" podStartSLOduration=4.664036622 podStartE2EDuration="23.703791605s" totalImagesPullingTime="19.039754983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:36.703191437 +0000 UTC m=+23.690407787" watchObservedRunningTime="2026-07-17 17:49:36.703791605 +0000 UTC m=+23.691007955" Jul 17 17:49:36.913957 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:36.913934 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pkgcs" Jul 17 17:49:36.914415 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:36.914397 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pkgcs" Jul 17 17:49:36.938723 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:36.938701 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 17 17:49:37.417354 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:37.417238 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T17:49:36.938721084Z","UUID":"f57d08cc-c51b-4c44-9365-74878bb88deb","Handler":null,"Name":"","Endpoint":""} Jul 17 17:49:37.419055 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:37.419030 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 17 17:49:37.419199 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:37.419074 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 17 17:49:37.478870 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:37.478839 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:49:37.479018 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:37.478940 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bpn6w" podUID="5c4c1690-71bc-4c37-bc2e-8c73015042b8" Jul 17 17:49:37.479237 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:37.479220 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:37.479341 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:37.479322 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nlmb" podUID="030fdd55-bca5-482e-9b12-0552be384774" Jul 17 17:49:37.599675 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:37.599459 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c2skf" event={"ID":"f45033c7-3177-498b-a9d4-205296d7decb","Type":"ContainerStarted","Data":"80bc514579a4ebd8fcf89fe0ee925d976b43856161a4cdae08f9bf43187b8174"} Jul 17 17:49:37.601730 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:37.601660 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv" event={"ID":"30191e16-8838-488b-9b97-3cf158ae905d","Type":"ContainerStarted","Data":"390266ba10cee4df2426f8f8484dc156c6c3297e6a38a6ca6fe63558d2d107f2"} Jul 17 17:49:37.614247 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:37.614208 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c2skf" podStartSLOduration=5.582101729 podStartE2EDuration="24.614195438s" totalImagesPullingTime="19.032093709s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:37.613769249 +0000 UTC m=+24.600985620" watchObservedRunningTime="2026-07-17 17:49:37.614195438 +0000 UTC m=+24.601411788" Jul 17 17:49:38.478462 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:38.478416 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:38.478663 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:38.478538 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvwcb" podUID="f5c93f78-e5a9-40b3-b394-e495edb54560" Jul 17 17:49:38.607912 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:38.607799 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" event={"ID":"6070f265-4c28-44f8-856d-8be554ec058b","Type":"ContainerStarted","Data":"010cd524885d525f4b63e906988710c90510275c96a52bc3a38a794ea04d100d"} Jul 17 17:49:38.610017 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:38.609986 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv" event={"ID":"30191e16-8838-488b-9b97-3cf158ae905d","Type":"ContainerStarted","Data":"c70629cfcbf0aa748fdc60b30cd8721e9cb2fda2dd0d0766b094f0f46d3e8be9"} Jul 17 17:49:38.610141 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:38.610030 2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 17 17:49:38.627849 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:38.627799 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prxlv" podStartSLOduration=4.329798327 podStartE2EDuration="25.627781978s" totalImagesPullingTime="21.297983651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:49:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:38.627675748 +0000 UTC m=+25.614892099" watchObservedRunningTime="2026-07-17 17:49:38.627781978 +0000 UTC m=+25.614998326" Jul 17 17:49:39.193557 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:39.193307 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pkgcs" Jul 17 17:49:39.193977 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:39.193950 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pkgcs" Jul 17 17:49:39.479015 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:39.478943 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:39.479230 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:39.479063 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nlmb" podUID="030fdd55-bca5-482e-9b12-0552be384774" Jul 17 17:49:39.479230 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:39.479119 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:49:39.479320 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:39.479241 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bpn6w" podUID="5c4c1690-71bc-4c37-bc2e-8c73015042b8" Jul 17 17:49:40.478461 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:40.478430 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:40.478934 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:40.478544 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvwcb" podUID="f5c93f78-e5a9-40b3-b394-e495edb54560" Jul 17 17:49:41.478583 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:41.478344 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:41.479353 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:41.478417 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:49:41.479353 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:41.478686 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nlmb" podUID="030fdd55-bca5-482e-9b12-0552be384774" Jul 17 17:49:41.479353 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:41.478814 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bpn6w" podUID="5c4c1690-71bc-4c37-bc2e-8c73015042b8" Jul 17 17:49:41.619683 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:41.619653 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" event={"ID":"6070f265-4c28-44f8-856d-8be554ec058b","Type":"ContainerStarted","Data":"596e4f1780a03276fe476453097338305ee066fad3d989a27db55dd5049568f7"} Jul 17 17:49:41.619991 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:41.619974 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:41.621451 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:41.621428 2580 generic.go:356] "Generic (PLEG): container finished" podID="5ea25ecd-4ba5-4c84-8068-d7adfed46344" containerID="d7d0fdb49a13071d17d8e76d35760d2504ae29dfc1419acc043c67b175fbd046" exitCode=0 Jul 17 17:49:41.621533 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:41.621478 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngvvf" event={"ID":"5ea25ecd-4ba5-4c84-8068-d7adfed46344","Type":"ContainerDied","Data":"d7d0fdb49a13071d17d8e76d35760d2504ae29dfc1419acc043c67b175fbd046"} Jul 17 17:49:41.635867 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:41.635846 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:41.645156 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:41.645120 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" podStartSLOduration=9.536718484 podStartE2EDuration="28.645109375s" totalImagesPullingTime="19.108390891s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:41.64468612 +0000 UTC m=+28.631902490" watchObservedRunningTime="2026-07-17 17:49:41.645109375 +0000 UTC m=+28.632325724" Jul 17 17:49:42.478658 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:42.478594 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:42.479099 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:42.478704 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvwcb" podUID="f5c93f78-e5a9-40b3-b394-e495edb54560" Jul 17 17:49:42.623619 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:42.623591 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:42.623902 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:42.623672 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:42.638697 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:42.638672 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:49:42.671595 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:42.671563 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7nlmb"] Jul 17 17:49:42.671745 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:42.671725 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:42.671897 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:42.671873 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nlmb" podUID="030fdd55-bca5-482e-9b12-0552be384774" Jul 17 17:49:42.674870 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:42.674844 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mvwcb"] Jul 17 17:49:42.675080 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:42.674961 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:42.675151 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:42.675069 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvwcb" podUID="f5c93f78-e5a9-40b3-b394-e495edb54560" Jul 17 17:49:42.675538 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:42.675508 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bpn6w"] Jul 17 17:49:42.675640 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:42.675610 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:49:42.675734 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:42.675712 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bpn6w" podUID="5c4c1690-71bc-4c37-bc2e-8c73015042b8" Jul 17 17:49:43.627250 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:43.627217 2580 generic.go:356] "Generic (PLEG): container finished" podID="5ea25ecd-4ba5-4c84-8068-d7adfed46344" containerID="2f1351fe925ee4ea66b628e8d1f930e5e5a868e0140302f9709ebbbd0e241cc3" exitCode=0 Jul 17 17:49:43.627674 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:43.627307 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngvvf" event={"ID":"5ea25ecd-4ba5-4c84-8068-d7adfed46344","Type":"ContainerDied","Data":"2f1351fe925ee4ea66b628e8d1f930e5e5a868e0140302f9709ebbbd0e241cc3"} Jul 17 17:49:44.477920 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:44.477894 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:44.478023 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:44.478007 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:49:44.478069 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:44.478035 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:44.478069 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:44.478021 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nlmb" podUID="030fdd55-bca5-482e-9b12-0552be384774" Jul 17 17:49:44.478137 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:44.478117 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bpn6w" podUID="5c4c1690-71bc-4c37-bc2e-8c73015042b8" Jul 17 17:49:44.478235 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:44.478211 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvwcb" podUID="f5c93f78-e5a9-40b3-b394-e495edb54560" Jul 17 17:49:45.634195 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:45.633942 2580 generic.go:356] "Generic (PLEG): container finished" podID="5ea25ecd-4ba5-4c84-8068-d7adfed46344" containerID="4a248212f9183d9c307e8a7bc234a56a9cab5a966e3ed0d256f385233f17d747" exitCode=0 Jul 17 17:49:45.634542 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:45.634017 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngvvf" event={"ID":"5ea25ecd-4ba5-4c84-8068-d7adfed46344","Type":"ContainerDied","Data":"4a248212f9183d9c307e8a7bc234a56a9cab5a966e3ed0d256f385233f17d747"} Jul 17 17:49:46.478941 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:46.478912 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:46.479133 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:46.478916 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:49:46.479133 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:46.479037 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nlmb" podUID="030fdd55-bca5-482e-9b12-0552be384774" Jul 17 17:49:46.479133 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:46.479068 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:46.479298 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:46.479134 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bpn6w" podUID="5c4c1690-71bc-4c37-bc2e-8c73015042b8" Jul 17 17:49:46.479298 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:46.479215 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvwcb" podUID="f5c93f78-e5a9-40b3-b394-e495edb54560" Jul 17 17:49:47.105861 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:47.105831 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5c93f78-e5a9-40b3-b394-e495edb54560-metrics-certs\") pod \"network-metrics-daemon-mvwcb\" (UID: \"f5c93f78-e5a9-40b3-b394-e495edb54560\") " pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:47.106297 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:47.105957 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:49:47.106297 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:47.106011 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5c93f78-e5a9-40b3-b394-e495edb54560-metrics-certs podName:f5c93f78-e5a9-40b3-b394-e495edb54560 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:19.10599732 +0000 UTC m=+66.093213648 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5c93f78-e5a9-40b3-b394-e495edb54560-metrics-certs") pod "network-metrics-daemon-mvwcb" (UID: "f5c93f78-e5a9-40b3-b394-e495edb54560") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:49:47.206982 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:47.206947 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/030fdd55-bca5-482e-9b12-0552be384774-original-pull-secret\") pod \"global-pull-secret-syncer-7nlmb\" (UID: \"030fdd55-bca5-482e-9b12-0552be384774\") " pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:47.207145 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:47.207066 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 17:49:47.207145 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:47.207129 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030fdd55-bca5-482e-9b12-0552be384774-original-pull-secret podName:030fdd55-bca5-482e-9b12-0552be384774 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:19.207113417 +0000 UTC m=+66.194329745 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/030fdd55-bca5-482e-9b12-0552be384774-original-pull-secret") pod "global-pull-secret-syncer-7nlmb" (UID: "030fdd55-bca5-482e-9b12-0552be384774") : object "kube-system"/"original-pull-secret" not registered Jul 17 17:49:47.307604 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:47.307573 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78dw2\" (UniqueName: \"kubernetes.io/projected/5c4c1690-71bc-4c37-bc2e-8c73015042b8-kube-api-access-78dw2\") pod \"network-check-target-bpn6w\" (UID: \"5c4c1690-71bc-4c37-bc2e-8c73015042b8\") " pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:49:47.307771 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:47.307729 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 17:49:47.307771 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:47.307760 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 17:49:47.307771 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:47.307770 2580 projected.go:196] Error preparing data for projected volume kube-api-access-78dw2 for pod openshift-network-diagnostics/network-check-target-bpn6w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:49:47.307906 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:47.307821 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c4c1690-71bc-4c37-bc2e-8c73015042b8-kube-api-access-78dw2 podName:5c4c1690-71bc-4c37-bc2e-8c73015042b8 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:19.307804521 +0000 UTC m=+66.295020852 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-78dw2" (UniqueName: "kubernetes.io/projected/5c4c1690-71bc-4c37-bc2e-8c73015042b8-kube-api-access-78dw2") pod "network-check-target-bpn6w" (UID: "5c4c1690-71bc-4c37-bc2e-8c73015042b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:49:48.382122 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.380502 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-140.ec2.internal" event="NodeReady" Jul 17 17:49:48.382122 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.380625 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 17 17:49:48.414845 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.414812 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b9b7fb9b-v58vp"] Jul 17 17:49:48.416555 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.416525 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:49:48.419414 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.419393 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 17 17:49:48.421038 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.420931 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 17 17:49:48.421373 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.420913 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-szkls\"" Jul 17 17:49:48.421739 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.421724 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 17 17:49:48.422006 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.421980 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-kcmzb"] Jul 17 17:49:48.423574 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.423553 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-vwvfg"] Jul 17 17:49:48.423690 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.423672 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" Jul 17 17:49:48.425181 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.425160 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4khbn"] Jul 17 17:49:48.425352 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.425326 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-vwvfg" Jul 17 17:49:48.425885 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.425862 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 17 17:49:48.427000 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.426975 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-5d5xw"] Jul 17 17:49:48.427683 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.427652 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4khbn" Jul 17 17:49:48.428290 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.428268 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-297dl"] Jul 17 17:49:48.428408 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.428379 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-84lrw\"" Jul 17 17:49:48.428408 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.428398 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 17 17:49:48.428588 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.428570 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kdcpd\"" Jul 17 17:49:48.428651 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.428585 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 17 17:49:48.428707 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.428692 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 17 17:49:48.428827 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.428798 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 17 17:49:48.428902 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.428851 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 17 17:49:48.429019 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.429002 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-5d5xw" Jul 17 17:49:48.429117 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.429021 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 17 17:49:48.429489 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.429469 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 17 17:49:48.429489 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.429492 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 17 17:49:48.429895 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.429877 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-56cbf4fbfd-spcrn"] Jul 17 17:49:48.430429 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.430174 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-297dl" Jul 17 17:49:48.431649 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.431607 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tcqx6"] Jul 17 17:49:48.431804 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.431785 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 17 17:49:48.431884 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.431824 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 17 17:49:48.431934 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.431900 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 17 17:49:48.432052 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.432036 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 17 17:49:48.432183 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.432143 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:49:48.432243 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.432209 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-wddkb\"" Jul 17 17:49:48.433105 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.432808 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 17 17:49:48.433105 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.432872 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 17 17:49:48.433105 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.432911 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 17 17:49:48.433105 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.432977 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 17 17:49:48.433105 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.432997 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 17 17:49:48.433105 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.433038 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 17 17:49:48.433411 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.433343 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 17 17:49:48.433411 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.433364 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vbm2n"] Jul 17 17:49:48.433678 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.433660 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tcqx6" Jul 17 17:49:48.434548 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.434522 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-s2sdf\"" Jul 17 17:49:48.435183 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.435072 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-mcn8b\"" Jul 17 17:49:48.435183 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.435147 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vbm2n" Jul 17 17:49:48.436401 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.436382 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 17 17:49:48.438235 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.437914 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 17 17:49:48.438235 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.438098 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 17 17:49:48.447079 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.442377 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gm5xt\"" Jul 17 17:49:48.447079 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.442842 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 17 17:49:48.447079 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.445286 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 17 17:49:48.447379 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.447157 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 17 17:49:48.448128 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.448108 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 17 17:49:48.448340 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.448322 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 17 17:49:48.448729 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.448706 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 17 17:49:48.448920 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.448900 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 17 17:49:48.449022 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.449001 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4khbn"] Jul 17 17:49:48.449092 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.448767 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 17 17:49:48.449193 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.449175 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 17 17:49:48.449260 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.448831 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 17 17:49:48.449937 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.449915 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9bqzg\"" Jul 17 17:49:48.450128 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.450110 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-r9wr9\"" Jul 17 17:49:48.450783 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.450765 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 17 17:49:48.450950 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.450892 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-kcmzb"] Jul 17 17:49:48.451867 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.451790 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b9b7fb9b-v58vp"] Jul 17 17:49:48.452352 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.452339 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-297dl"] Jul 17 17:49:48.453496 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.453430 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tcqx6"] Jul 17 17:49:48.454678 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.454660 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wcffs"] Jul 17 17:49:48.457073 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.456843 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-kcprj"] Jul 17 17:49:48.457208 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.457186 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wcffs" Jul 17 17:49:48.460348 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.460329 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qwg4s"] Jul 17 17:49:48.460497 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.460441 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-kcprj" Jul 17 17:49:48.461942 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.461921 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 17 17:49:48.462043 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.461926 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 17 17:49:48.462043 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.462016 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-66fzz\"" Jul 17 17:49:48.463233 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.463215 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56cbf4fbfd-spcrn"] Jul 17 17:49:48.463363 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.463274 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-5d5xw"] Jul 17 17:49:48.463363 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.463294 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-vwvfg"] Jul 17 17:49:48.463363 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.463331 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qwg4s" Jul 17 17:49:48.464534 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.463999 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-kcprj"] Jul 17 17:49:48.465722 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.465704 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qwg4s"] Jul 17 17:49:48.466688 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.466394 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-7k26p\"" Jul 17 17:49:48.466688 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.466502 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4fmcs\"" Jul 17 17:49:48.466890 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.466827 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 17 17:49:48.467596 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.466033 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 17 17:49:48.467596 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.465958 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 17 17:49:48.467810 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.467791 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vbm2n"] Jul 17 17:49:48.467926 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.467907 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 17 17:49:48.468411 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.468390 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wcffs"] Jul 17 17:49:48.469116 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.469099 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 17 17:49:48.478096 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.478068 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:49:48.478396 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.478382 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:49:48.478665 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.478650 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:49:48.480645 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.480621 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 17:49:48.480736 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.480669 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nlkcj\"" Jul 17 17:49:48.481386 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.481354 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xgrcl\"" Jul 17 17:49:48.481560 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.481541 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 17:49:48.516093 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516065 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5752d\" (UniqueName: \"kubernetes.io/projected/e0f81ac5-1933-4808-b012-511ceb72f397-kube-api-access-5752d\") pod \"cluster-samples-operator-79b7c55f87-vbm2n\" (UID: \"e0f81ac5-1933-4808-b012-511ceb72f397\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vbm2n" Jul 17 17:49:48.516193 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516104 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/734e9676-1625-453c-8752-a60ff53e569b-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-297dl\" (UID: \"734e9676-1625-453c-8752-a60ff53e569b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-297dl" Jul 17 17:49:48.516193 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516131 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-bound-sa-token\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:49:48.516193 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516156 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d5gq\" (UniqueName: \"kubernetes.io/projected/36b82608-4a35-44da-9af1-6d56c88cb1e2-kube-api-access-7d5gq\") pod \"console-operator-565b7b569d-kcmzb\" (UID: \"36b82608-4a35-44da-9af1-6d56c88cb1e2\") " pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" Jul 17 17:49:48.516193 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516183 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/36b82608-4a35-44da-9af1-6d56c88cb1e2-serving-cert\") pod \"console-operator-565b7b569d-kcmzb\" (UID: \"36b82608-4a35-44da-9af1-6d56c88cb1e2\") " pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" Jul 17 17:49:48.516367 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516207 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-service-ca-bundle\") pod \"router-default-56cbf4fbfd-spcrn\" (UID: \"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8\") " pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:49:48.516367 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516230 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-metrics-certs\") pod \"router-default-56cbf4fbfd-spcrn\" (UID: \"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8\") " pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:49:48.516367 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516276 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h59lh\" (UniqueName: \"kubernetes.io/projected/960e1622-2795-40a6-bb03-eaf54f315d96-kube-api-access-h59lh\") pod \"insights-operator-555d9d7885-5d5xw\" (UID: \"960e1622-2795-40a6-bb03-eaf54f315d96\") " pod="openshift-insights/insights-operator-555d9d7885-5d5xw" Jul 17 17:49:48.516367 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516317 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4f8df35-139a-4910-866b-e4a5609e5e1d-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-vwvfg\" (UID: \"e4f8df35-139a-4910-866b-e4a5609e5e1d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-vwvfg" Jul 17 17:49:48.516367 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516357 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36b82608-4a35-44da-9af1-6d56c88cb1e2-trusted-ca\") pod \"console-operator-565b7b569d-kcmzb\" (UID: \"36b82608-4a35-44da-9af1-6d56c88cb1e2\") " pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" Jul 17 17:49:48.516582 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516399 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f746ad0f-5018-420f-8fc8-6816f0225211-registry-certificates\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:49:48.516582 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516414 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36b82608-4a35-44da-9af1-6d56c88cb1e2-config\") pod \"console-operator-565b7b569d-kcmzb\" (UID: \"36b82608-4a35-44da-9af1-6d56c88cb1e2\") " pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" Jul 17 17:49:48.516582 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516430 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qg4k\" (UniqueName: \"kubernetes.io/projected/734e9676-1625-453c-8752-a60ff53e569b-kube-api-access-2qg4k\") pod \"cluster-monitoring-operator-76cf8966f8-297dl\" (UID: \"734e9676-1625-453c-8752-a60ff53e569b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-297dl" Jul 17 17:49:48.516582 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516460 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/734e9676-1625-453c-8752-a60ff53e569b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-297dl\" (UID: \"734e9676-1625-453c-8752-a60ff53e569b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-297dl" Jul 17 17:49:48.516582 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516481 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xzqc\" (UniqueName: \"kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-kube-api-access-9xzqc\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:49:48.516582 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516506 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/960e1622-2795-40a6-bb03-eaf54f315d96-snapshots\") pod \"insights-operator-555d9d7885-5d5xw\" (UID: \"960e1622-2795-40a6-bb03-eaf54f315d96\") " pod="openshift-insights/insights-operator-555d9d7885-5d5xw" Jul 17 17:49:48.516582 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516534 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f746ad0f-5018-420f-8fc8-6816f0225211-image-registry-private-configuration\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:49:48.516582 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516550 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b3db565-1f0f-4487-a819-653eb100b9dc-serving-cert\") pod \"service-ca-operator-5bcbc94c78-4khbn\" (UID: \"4b3db565-1f0f-4487-a819-653eb100b9dc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4khbn" Jul 17 17:49:48.516582 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516582 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/960e1622-2795-40a6-bb03-eaf54f315d96-tmp\") pod \"insights-operator-555d9d7885-5d5xw\" (UID: \"960e1622-2795-40a6-bb03-eaf54f315d96\") " pod="openshift-insights/insights-operator-555d9d7885-5d5xw" Jul 17 17:49:48.516941 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516603 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f746ad0f-5018-420f-8fc8-6816f0225211-ca-trust-extracted\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:49:48.516941 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516620 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/960e1622-2795-40a6-bb03-eaf54f315d96-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-5d5xw\" (UID: \"960e1622-2795-40a6-bb03-eaf54f315d96\") " pod="openshift-insights/insights-operator-555d9d7885-5d5xw" Jul 17 17:49:48.516941 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516644 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8jx7\" (UniqueName: \"kubernetes.io/projected/f7bbedb5-767b-4aca-a270-41b0695c2eb2-kube-api-access-x8jx7\") pod \"volume-data-source-validator-78cf4c6f6-tcqx6\" (UID: \"f7bbedb5-767b-4aca-a270-41b0695c2eb2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tcqx6" Jul 17 17:49:48.516941 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516696 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0f81ac5-1933-4808-b012-511ceb72f397-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vbm2n\" (UID: \"e0f81ac5-1933-4808-b012-511ceb72f397\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vbm2n" Jul 17 17:49:48.516941 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516712 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b3db565-1f0f-4487-a819-653eb100b9dc-config\") pod \"service-ca-operator-5bcbc94c78-4khbn\" (UID: \"4b3db565-1f0f-4487-a819-653eb100b9dc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4khbn" Jul 17 17:49:48.516941 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516734 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqxl7\" (UniqueName: \"kubernetes.io/projected/e4f8df35-139a-4910-866b-e4a5609e5e1d-kube-api-access-hqxl7\") pod \"kube-storage-version-migrator-operator-7658d9b749-vwvfg\" (UID: \"e4f8df35-139a-4910-866b-e4a5609e5e1d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-vwvfg" Jul 17 17:49:48.516941 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516786 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xthdr\" (UniqueName: \"kubernetes.io/projected/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-kube-api-access-xthdr\") pod \"router-default-56cbf4fbfd-spcrn\" (UID: \"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8\") " pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:49:48.516941 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516809 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/960e1622-2795-40a6-bb03-eaf54f315d96-serving-cert\") pod \"insights-operator-555d9d7885-5d5xw\" (UID: \"960e1622-2795-40a6-bb03-eaf54f315d96\") " pod="openshift-insights/insights-operator-555d9d7885-5d5xw" Jul 17 17:49:48.516941 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516833 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-default-certificate\") pod \"router-default-56cbf4fbfd-spcrn\" (UID: \"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8\") " pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:49:48.516941 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516855 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f746ad0f-5018-420f-8fc8-6816f0225211-installation-pull-secrets\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:49:48.516941 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516881 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-registry-tls\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:49:48.516941 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516894 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmwbp\" (UniqueName: \"kubernetes.io/projected/4b3db565-1f0f-4487-a819-653eb100b9dc-kube-api-access-pmwbp\") pod \"service-ca-operator-5bcbc94c78-4khbn\" (UID: \"4b3db565-1f0f-4487-a819-653eb100b9dc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4khbn" Jul 17 17:49:48.516941 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516918 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/960e1622-2795-40a6-bb03-eaf54f315d96-service-ca-bundle\") pod \"insights-operator-555d9d7885-5d5xw\" (UID: \"960e1622-2795-40a6-bb03-eaf54f315d96\") " pod="openshift-insights/insights-operator-555d9d7885-5d5xw" Jul 17 17:49:48.517411 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516953 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f746ad0f-5018-420f-8fc8-6816f0225211-trusted-ca\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:49:48.517411 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516967 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4f8df35-139a-4910-866b-e4a5609e5e1d-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-vwvfg\" (UID: \"e4f8df35-139a-4910-866b-e4a5609e5e1d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-vwvfg" Jul 17 17:49:48.517411 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.516989 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-stats-auth\") pod \"router-default-56cbf4fbfd-spcrn\" (UID: \"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8\") " pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:49:48.599787 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.599736 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:48.617386 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.617358 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0f81ac5-1933-4808-b012-511ceb72f397-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vbm2n\" (UID: \"e0f81ac5-1933-4808-b012-511ceb72f397\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vbm2n" Jul 17 17:49:48.617529 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.617398 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b3db565-1f0f-4487-a819-653eb100b9dc-config\") pod \"service-ca-operator-5bcbc94c78-4khbn\" (UID: \"4b3db565-1f0f-4487-a819-653eb100b9dc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4khbn" Jul 17 17:49:48.617529 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.617425 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqxl7\" (UniqueName: \"kubernetes.io/projected/e4f8df35-139a-4910-866b-e4a5609e5e1d-kube-api-access-hqxl7\") pod \"kube-storage-version-migrator-operator-7658d9b749-vwvfg\" (UID: \"e4f8df35-139a-4910-866b-e4a5609e5e1d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-vwvfg" Jul 17 17:49:48.617529 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.617453 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xthdr\" (UniqueName: \"kubernetes.io/projected/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-kube-api-access-xthdr\") pod \"router-default-56cbf4fbfd-spcrn\" (UID: \"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8\") " pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:49:48.617529 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.617482 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkfdp\" (UniqueName: \"kubernetes.io/projected/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-kube-api-access-bkfdp\") pod \"dns-default-wcffs\" (UID: \"cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703\") " pod="openshift-dns/dns-default-wcffs" Jul 17 17:49:48.617529 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.617505 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7qpl\" (UniqueName: \"kubernetes.io/projected/1b1e2bce-2c51-4d72-a176-c74abc546be6-kube-api-access-k7qpl\") pod \"network-check-source-7bc5b6bf85-kcprj\" (UID: \"1b1e2bce-2c51-4d72-a176-c74abc546be6\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-kcprj" Jul 17 17:49:48.617817 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.617535 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfl6m\" (UniqueName: \"kubernetes.io/projected/b40ec2a7-8dec-4513-80ca-2255cc34c77c-kube-api-access-hfl6m\") pod \"ingress-canary-qwg4s\" (UID: \"b40ec2a7-8dec-4513-80ca-2255cc34c77c\") " pod="openshift-ingress-canary/ingress-canary-qwg4s" Jul 17 17:49:48.617817 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.617563 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/960e1622-2795-40a6-bb03-eaf54f315d96-serving-cert\") pod \"insights-operator-555d9d7885-5d5xw\" (UID: \"960e1622-2795-40a6-bb03-eaf54f315d96\") " pod="openshift-insights/insights-operator-555d9d7885-5d5xw" Jul 17 17:49:48.617817 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.617589 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-default-certificate\") pod \"router-default-56cbf4fbfd-spcrn\" (UID: \"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8\") " pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:49:48.617817 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.617617 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f746ad0f-5018-420f-8fc8-6816f0225211-installation-pull-secrets\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:49:48.617817 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.617640 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-registry-tls\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:49:48.617817 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:48.617506 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 17:49:48.617817 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.617663 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmwbp\" (UniqueName: \"kubernetes.io/projected/4b3db565-1f0f-4487-a819-653eb100b9dc-kube-api-access-pmwbp\") pod \"service-ca-operator-5bcbc94c78-4khbn\" (UID: \"4b3db565-1f0f-4487-a819-653eb100b9dc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4khbn" Jul 17 17:49:48.617817 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.617686 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/960e1622-2795-40a6-bb03-eaf54f315d96-service-ca-bundle\") pod \"insights-operator-555d9d7885-5d5xw\" (UID: \"960e1622-2795-40a6-bb03-eaf54f315d96\") " pod="openshift-insights/insights-operator-555d9d7885-5d5xw" Jul 17 17:49:48.617817 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.617710 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f746ad0f-5018-420f-8fc8-6816f0225211-trusted-ca\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:49:48.617817 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.617736 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4f8df35-139a-4910-866b-e4a5609e5e1d-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-vwvfg\" (UID: \"e4f8df35-139a-4910-866b-e4a5609e5e1d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-vwvfg" Jul 17 17:49:48.618307 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:48.617861 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 17:49:48.618307 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:48.617879 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b9b7fb9b-v58vp: secret "image-registry-tls" not found Jul 17 17:49:48.618307 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:48.617950 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-registry-tls podName:f746ad0f-5018-420f-8fc8-6816f0225211 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:49.117927764 +0000 UTC m=+36.105144111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-registry-tls") pod "image-registry-7b9b7fb9b-v58vp" (UID: "f746ad0f-5018-420f-8fc8-6816f0225211") : secret "image-registry-tls" not found Jul 17 17:49:48.618307 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.618060 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b3db565-1f0f-4487-a819-653eb100b9dc-config\") pod \"service-ca-operator-5bcbc94c78-4khbn\" (UID: \"4b3db565-1f0f-4487-a819-653eb100b9dc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4khbn" Jul 17 17:49:48.618307 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:48.618296 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0f81ac5-1933-4808-b012-511ceb72f397-samples-operator-tls podName:e0f81ac5-1933-4808-b012-511ceb72f397 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:49.118278457 +0000 UTC m=+36.105494785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e0f81ac5-1933-4808-b012-511ceb72f397-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vbm2n" (UID: "e0f81ac5-1933-4808-b012-511ceb72f397") : secret "samples-operator-tls" not found Jul 17 17:49:48.618565 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.618322 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-stats-auth\") pod \"router-default-56cbf4fbfd-spcrn\" (UID: \"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8\") " pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:49:48.618565 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.618362 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5752d\" (UniqueName: \"kubernetes.io/projected/e0f81ac5-1933-4808-b012-511ceb72f397-kube-api-access-5752d\") pod \"cluster-samples-operator-79b7c55f87-vbm2n\" (UID: \"e0f81ac5-1933-4808-b012-511ceb72f397\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vbm2n" Jul 17 17:49:48.618565 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.618387 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/734e9676-1625-453c-8752-a60ff53e569b-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-297dl\" (UID: \"734e9676-1625-453c-8752-a60ff53e569b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-297dl" Jul 17 17:49:48.618565 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.618415 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-bound-sa-token\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:49:48.618565 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.618442 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d5gq\" (UniqueName: \"kubernetes.io/projected/36b82608-4a35-44da-9af1-6d56c88cb1e2-kube-api-access-7d5gq\") pod \"console-operator-565b7b569d-kcmzb\" (UID: \"36b82608-4a35-44da-9af1-6d56c88cb1e2\") " pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" Jul 17 17:49:48.618565 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.618469 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/36b82608-4a35-44da-9af1-6d56c88cb1e2-serving-cert\") pod \"console-operator-565b7b569d-kcmzb\" (UID: \"36b82608-4a35-44da-9af1-6d56c88cb1e2\") " pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" Jul 17 17:49:48.618565 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.618493 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-service-ca-bundle\") pod \"router-default-56cbf4fbfd-spcrn\" (UID: \"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8\") " pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:49:48.618565 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.618520 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-metrics-certs\") pod \"router-default-56cbf4fbfd-spcrn\" (UID: \"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8\") " pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:49:48.618565 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.618544 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h59lh\" (UniqueName: \"kubernetes.io/projected/960e1622-2795-40a6-bb03-eaf54f315d96-kube-api-access-h59lh\") pod \"insights-operator-555d9d7885-5d5xw\" (UID: \"960e1622-2795-40a6-bb03-eaf54f315d96\") " pod="openshift-insights/insights-operator-555d9d7885-5d5xw" Jul 17 17:49:48.619038 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.618570 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-tmp-dir\") pod \"dns-default-wcffs\" (UID: \"cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703\") " pod="openshift-dns/dns-default-wcffs" Jul 17 17:49:48.619038 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.618599 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4f8df35-139a-4910-866b-e4a5609e5e1d-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-vwvfg\" (UID: \"e4f8df35-139a-4910-866b-e4a5609e5e1d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-vwvfg" Jul 17 17:49:48.619038 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.618625 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36b82608-4a35-44da-9af1-6d56c88cb1e2-trusted-ca\") pod \"console-operator-565b7b569d-kcmzb\" (UID: \"36b82608-4a35-44da-9af1-6d56c88cb1e2\") " pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" Jul 17 17:49:48.619038 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.618669 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f746ad0f-5018-420f-8fc8-6816f0225211-registry-certificates\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:49:48.619038 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.618693 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36b82608-4a35-44da-9af1-6d56c88cb1e2-config\") pod \"console-operator-565b7b569d-kcmzb\" (UID: \"36b82608-4a35-44da-9af1-6d56c88cb1e2\") " pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" Jul 17 17:49:48.619038 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.618710 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/960e1622-2795-40a6-bb03-eaf54f315d96-service-ca-bundle\") pod \"insights-operator-555d9d7885-5d5xw\" (UID: \"960e1622-2795-40a6-bb03-eaf54f315d96\") " pod="openshift-insights/insights-operator-555d9d7885-5d5xw" Jul 17 17:49:48.619038 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.618720 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qg4k\" (UniqueName: \"kubernetes.io/projected/734e9676-1625-453c-8752-a60ff53e569b-kube-api-access-2qg4k\") pod \"cluster-monitoring-operator-76cf8966f8-297dl\" (UID: \"734e9676-1625-453c-8752-a60ff53e569b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-297dl" Jul 17 17:49:48.619038 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.618777 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-config-volume\") pod \"dns-default-wcffs\" (UID: \"cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703\") " pod="openshift-dns/dns-default-wcffs" Jul 17 17:49:48.619038 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.618817 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/734e9676-1625-453c-8752-a60ff53e569b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-297dl\" (UID: \"734e9676-1625-453c-8752-a60ff53e569b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-297dl" Jul 17 17:49:48.619038 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.618854 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xzqc\" (UniqueName: \"kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-kube-api-access-9xzqc\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:49:48.619038 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.618881 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/960e1622-2795-40a6-bb03-eaf54f315d96-snapshots\") pod \"insights-operator-555d9d7885-5d5xw\" (UID: \"960e1622-2795-40a6-bb03-eaf54f315d96\") " pod="openshift-insights/insights-operator-555d9d7885-5d5xw" Jul 17 17:49:48.619038 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.618912 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b40ec2a7-8dec-4513-80ca-2255cc34c77c-cert\") pod \"ingress-canary-qwg4s\" (UID: \"b40ec2a7-8dec-4513-80ca-2255cc34c77c\") " pod="openshift-ingress-canary/ingress-canary-qwg4s" Jul 17 17:49:48.619038 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.618944 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f746ad0f-5018-420f-8fc8-6816f0225211-image-registry-private-configuration\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:49:48.619038 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.618982 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b3db565-1f0f-4487-a819-653eb100b9dc-serving-cert\") pod \"service-ca-operator-5bcbc94c78-4khbn\" (UID: \"4b3db565-1f0f-4487-a819-653eb100b9dc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4khbn" Jul 17 17:49:48.619038 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.619020 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-metrics-tls\") pod \"dns-default-wcffs\" (UID: \"cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703\") " pod="openshift-dns/dns-default-wcffs" Jul 17 17:49:48.619775 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.619059 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/960e1622-2795-40a6-bb03-eaf54f315d96-tmp\") pod \"insights-operator-555d9d7885-5d5xw\" (UID: \"960e1622-2795-40a6-bb03-eaf54f315d96\") " pod="openshift-insights/insights-operator-555d9d7885-5d5xw" Jul 17 17:49:48.619775 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.619088 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f746ad0f-5018-420f-8fc8-6816f0225211-ca-trust-extracted\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:49:48.619775 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.619113 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/960e1622-2795-40a6-bb03-eaf54f315d96-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-5d5xw\" (UID: \"960e1622-2795-40a6-bb03-eaf54f315d96\") " pod="openshift-insights/insights-operator-555d9d7885-5d5xw" Jul 17 17:49:48.619775 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.619180 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f746ad0f-5018-420f-8fc8-6816f0225211-trusted-ca\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:49:48.619775 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.619257 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/734e9676-1625-453c-8752-a60ff53e569b-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-297dl\" (UID: \"734e9676-1625-453c-8752-a60ff53e569b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-297dl" Jul 17 17:49:48.619775 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.619730 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8jx7\" (UniqueName: \"kubernetes.io/projected/f7bbedb5-767b-4aca-a270-41b0695c2eb2-kube-api-access-x8jx7\") pod \"volume-data-source-validator-78cf4c6f6-tcqx6\" (UID: \"f7bbedb5-767b-4aca-a270-41b0695c2eb2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tcqx6" Jul 17 17:49:48.620063 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.619922 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/960e1622-2795-40a6-bb03-eaf54f315d96-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-5d5xw\" (UID: \"960e1622-2795-40a6-bb03-eaf54f315d96\") " pod="openshift-insights/insights-operator-555d9d7885-5d5xw" Jul 17 17:49:48.620441 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.620250 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/960e1622-2795-40a6-bb03-eaf54f315d96-tmp\") pod \"insights-operator-555d9d7885-5d5xw\" (UID: \"960e1622-2795-40a6-bb03-eaf54f315d96\") " pod="openshift-insights/insights-operator-555d9d7885-5d5xw" Jul 17 17:49:48.620536 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:48.620486 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-service-ca-bundle podName:e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:49.120469265 +0000 UTC m=+36.107685627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-service-ca-bundle") pod "router-default-56cbf4fbfd-spcrn" (UID: "e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8") : configmap references non-existent config key: service-ca.crt Jul 17 17:49:48.620536 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.620515 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f746ad0f-5018-420f-8fc8-6816f0225211-ca-trust-extracted\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:49:48.620639 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:48.620548 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 17:49:48.620639 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:48.620552 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 17:49:48.620639 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:48.620581 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-metrics-certs podName:e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:49.120570028 +0000 UTC m=+36.107786397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-metrics-certs") pod "router-default-56cbf4fbfd-spcrn" (UID: "e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8") : secret "router-metrics-certs-default" not found Jul 17 17:49:48.620639 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:48.620612 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734e9676-1625-453c-8752-a60ff53e569b-cluster-monitoring-operator-tls podName:734e9676-1625-453c-8752-a60ff53e569b nodeName:}" failed. No retries permitted until 2026-07-17 17:49:49.120596367 +0000 UTC m=+36.107812715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/734e9676-1625-453c-8752-a60ff53e569b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-297dl" (UID: "734e9676-1625-453c-8752-a60ff53e569b") : secret "cluster-monitoring-operator-tls" not found Jul 17 17:49:48.621163 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.621073 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f746ad0f-5018-420f-8fc8-6816f0225211-registry-certificates\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:49:48.621163 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.621085 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/960e1622-2795-40a6-bb03-eaf54f315d96-snapshots\") pod \"insights-operator-555d9d7885-5d5xw\" (UID: \"960e1622-2795-40a6-bb03-eaf54f315d96\") " pod="openshift-insights/insights-operator-555d9d7885-5d5xw" Jul 17 17:49:48.621892 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.621621 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36b82608-4a35-44da-9af1-6d56c88cb1e2-config\") pod \"console-operator-565b7b569d-kcmzb\" (UID: \"36b82608-4a35-44da-9af1-6d56c88cb1e2\") " pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" Jul 17 17:49:48.622087 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.618600 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4f8df35-139a-4910-866b-e4a5609e5e1d-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-vwvfg\" (UID: \"e4f8df35-139a-4910-866b-e4a5609e5e1d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-vwvfg" Jul 17 17:49:48.622087 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.622080 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36b82608-4a35-44da-9af1-6d56c88cb1e2-trusted-ca\") pod \"console-operator-565b7b569d-kcmzb\" (UID: \"36b82608-4a35-44da-9af1-6d56c88cb1e2\") " pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" Jul 17 17:49:48.623514 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.623449 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b3db565-1f0f-4487-a819-653eb100b9dc-serving-cert\") pod \"service-ca-operator-5bcbc94c78-4khbn\" (UID: \"4b3db565-1f0f-4487-a819-653eb100b9dc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4khbn" Jul 17 17:49:48.623617 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.623581 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f746ad0f-5018-420f-8fc8-6816f0225211-image-registry-private-configuration\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:49:48.624239 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.624216 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4f8df35-139a-4910-866b-e4a5609e5e1d-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-vwvfg\" (UID: \"e4f8df35-139a-4910-866b-e4a5609e5e1d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-vwvfg" Jul 17 17:49:48.624354 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.624258 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/36b82608-4a35-44da-9af1-6d56c88cb1e2-serving-cert\") pod \"console-operator-565b7b569d-kcmzb\" (UID: \"36b82608-4a35-44da-9af1-6d56c88cb1e2\") " pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" Jul 17 17:49:48.625771 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.624583 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f746ad0f-5018-420f-8fc8-6816f0225211-installation-pull-secrets\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:49:48.625771 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.624712 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-stats-auth\") pod \"router-default-56cbf4fbfd-spcrn\" (UID: \"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8\") " pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:49:48.626922 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.626665 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/960e1622-2795-40a6-bb03-eaf54f315d96-serving-cert\") pod \"insights-operator-555d9d7885-5d5xw\" (UID: \"960e1622-2795-40a6-bb03-eaf54f315d96\") " pod="openshift-insights/insights-operator-555d9d7885-5d5xw" Jul 17 17:49:48.626922 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.626800 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-default-certificate\") pod \"router-default-56cbf4fbfd-spcrn\" (UID: \"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8\") " pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:49:48.629490 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.629416 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xthdr\" (UniqueName: \"kubernetes.io/projected/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-kube-api-access-xthdr\") pod \"router-default-56cbf4fbfd-spcrn\" (UID: \"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8\") " pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:49:48.630004 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.629971 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqxl7\" (UniqueName: \"kubernetes.io/projected/e4f8df35-139a-4910-866b-e4a5609e5e1d-kube-api-access-hqxl7\") pod \"kube-storage-version-migrator-operator-7658d9b749-vwvfg\" (UID: \"e4f8df35-139a-4910-866b-e4a5609e5e1d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-vwvfg" Jul 17 17:49:48.631123 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.631093 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmwbp\" (UniqueName: \"kubernetes.io/projected/4b3db565-1f0f-4487-a819-653eb100b9dc-kube-api-access-pmwbp\") pod \"service-ca-operator-5bcbc94c78-4khbn\" (UID: \"4b3db565-1f0f-4487-a819-653eb100b9dc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4khbn" Jul 17 17:49:48.633469 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.633416 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-bound-sa-token\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:49:48.633727 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.633708 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xzqc\" (UniqueName: \"kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-kube-api-access-9xzqc\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:49:48.633727 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.633720 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8jx7\" (UniqueName: \"kubernetes.io/projected/f7bbedb5-767b-4aca-a270-41b0695c2eb2-kube-api-access-x8jx7\") pod \"volume-data-source-validator-78cf4c6f6-tcqx6\" (UID: \"f7bbedb5-767b-4aca-a270-41b0695c2eb2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tcqx6" Jul 17 17:49:48.633885 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.633708 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h59lh\" (UniqueName: \"kubernetes.io/projected/960e1622-2795-40a6-bb03-eaf54f315d96-kube-api-access-h59lh\") pod \"insights-operator-555d9d7885-5d5xw\" (UID: \"960e1622-2795-40a6-bb03-eaf54f315d96\") " pod="openshift-insights/insights-operator-555d9d7885-5d5xw" Jul 17 17:49:48.634068 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.634044 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d5gq\" (UniqueName: \"kubernetes.io/projected/36b82608-4a35-44da-9af1-6d56c88cb1e2-kube-api-access-7d5gq\") pod \"console-operator-565b7b569d-kcmzb\" (UID: \"36b82608-4a35-44da-9af1-6d56c88cb1e2\") " pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" Jul 17 17:49:48.634214 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.634195 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5752d\" (UniqueName: \"kubernetes.io/projected/e0f81ac5-1933-4808-b012-511ceb72f397-kube-api-access-5752d\") pod \"cluster-samples-operator-79b7c55f87-vbm2n\" (UID: \"e0f81ac5-1933-4808-b012-511ceb72f397\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vbm2n" Jul 17 17:49:48.635459 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.635439 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qg4k\" (UniqueName: \"kubernetes.io/projected/734e9676-1625-453c-8752-a60ff53e569b-kube-api-access-2qg4k\") pod \"cluster-monitoring-operator-76cf8966f8-297dl\" (UID: \"734e9676-1625-453c-8752-a60ff53e569b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-297dl" Jul 17 17:49:48.699201 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.699160 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:48.721212 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.721187 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkfdp\" (UniqueName: \"kubernetes.io/projected/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-kube-api-access-bkfdp\") pod \"dns-default-wcffs\" (UID: \"cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703\") " pod="openshift-dns/dns-default-wcffs" Jul 17 17:49:48.721212 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.721215 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7qpl\" (UniqueName: \"kubernetes.io/projected/1b1e2bce-2c51-4d72-a176-c74abc546be6-kube-api-access-k7qpl\") pod \"network-check-source-7bc5b6bf85-kcprj\" (UID: \"1b1e2bce-2c51-4d72-a176-c74abc546be6\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-kcprj" Jul 17 17:49:48.721427 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.721233 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfl6m\" (UniqueName: \"kubernetes.io/projected/b40ec2a7-8dec-4513-80ca-2255cc34c77c-kube-api-access-hfl6m\") pod \"ingress-canary-qwg4s\" (UID: \"b40ec2a7-8dec-4513-80ca-2255cc34c77c\") " pod="openshift-ingress-canary/ingress-canary-qwg4s" Jul 17 17:49:48.721479 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.721423 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-tmp-dir\") pod \"dns-default-wcffs\" (UID: \"cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703\") " pod="openshift-dns/dns-default-wcffs" Jul 17 17:49:48.721525 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.721483 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-config-volume\") pod \"dns-default-wcffs\" (UID: \"cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703\") " pod="openshift-dns/dns-default-wcffs" Jul 17 17:49:48.721572 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.721552 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b40ec2a7-8dec-4513-80ca-2255cc34c77c-cert\") pod \"ingress-canary-qwg4s\" (UID: \"b40ec2a7-8dec-4513-80ca-2255cc34c77c\") " pod="openshift-ingress-canary/ingress-canary-qwg4s" Jul 17 17:49:48.721720 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.721695 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-metrics-tls\") pod \"dns-default-wcffs\" (UID: \"cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703\") " pod="openshift-dns/dns-default-wcffs" Jul 17 17:49:48.721840 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.721829 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-tmp-dir\") pod \"dns-default-wcffs\" (UID: \"cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703\") " pod="openshift-dns/dns-default-wcffs" Jul 17 17:49:48.721878 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:48.721836 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 17:49:48.721931 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:48.721917 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-metrics-tls podName:cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:49.221897223 +0000 UTC m=+36.209113554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-metrics-tls") pod "dns-default-wcffs" (UID: "cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703") : secret "dns-default-metrics-tls" not found Jul 17 17:49:48.722117 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.722077 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-config-volume\") pod \"dns-default-wcffs\" (UID: \"cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703\") " pod="openshift-dns/dns-default-wcffs" Jul 17 17:49:48.724466 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.724444 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b40ec2a7-8dec-4513-80ca-2255cc34c77c-cert\") pod \"ingress-canary-qwg4s\" (UID: \"b40ec2a7-8dec-4513-80ca-2255cc34c77c\") " pod="openshift-ingress-canary/ingress-canary-qwg4s" Jul 17 17:49:48.737252 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.737211 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7qpl\" (UniqueName: \"kubernetes.io/projected/1b1e2bce-2c51-4d72-a176-c74abc546be6-kube-api-access-k7qpl\") pod \"network-check-source-7bc5b6bf85-kcprj\" (UID: \"1b1e2bce-2c51-4d72-a176-c74abc546be6\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-kcprj" Jul 17 17:49:48.737816 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.737735 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkfdp\" (UniqueName: \"kubernetes.io/projected/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-kube-api-access-bkfdp\") pod \"dns-default-wcffs\" (UID: \"cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703\") " pod="openshift-dns/dns-default-wcffs" Jul 17 17:49:48.737939 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.737915 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfl6m\" (UniqueName: \"kubernetes.io/projected/b40ec2a7-8dec-4513-80ca-2255cc34c77c-kube-api-access-hfl6m\") pod \"ingress-canary-qwg4s\" (UID: \"b40ec2a7-8dec-4513-80ca-2255cc34c77c\") " pod="openshift-ingress-canary/ingress-canary-qwg4s" Jul 17 17:49:48.747666 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.747646 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" Jul 17 17:49:48.755125 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.755110 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-vwvfg" Jul 17 17:49:48.766580 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.766429 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4khbn" Jul 17 17:49:48.772693 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.772675 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-5d5xw" Jul 17 17:49:48.793078 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.793060 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tcqx6" Jul 17 17:49:48.799436 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.799399 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:48.815528 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.815510 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-kcprj" Jul 17 17:49:48.822557 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.822536 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qwg4s" Jul 17 17:49:48.998764 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:48.998656 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:49.102202 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:49.102161 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:49.125379 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:49.125351 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0f81ac5-1933-4808-b012-511ceb72f397-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vbm2n\" (UID: \"e0f81ac5-1933-4808-b012-511ceb72f397\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vbm2n" Jul 17 17:49:49.125550 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:49.125395 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-registry-tls\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:49:49.125550 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:49.125498 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 17:49:49.125550 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:49.125511 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b9b7fb9b-v58vp: secret "image-registry-tls" not found Jul 17 17:49:49.125550 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:49.125511 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 17:49:49.125697 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:49.125552 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-service-ca-bundle\") pod \"router-default-56cbf4fbfd-spcrn\" (UID: \"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8\") " pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:49:49.125697 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:49.125560 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-registry-tls podName:f746ad0f-5018-420f-8fc8-6816f0225211 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:50.125541636 +0000 UTC m=+37.112757995 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-registry-tls") pod "image-registry-7b9b7fb9b-v58vp" (UID: "f746ad0f-5018-420f-8fc8-6816f0225211") : secret "image-registry-tls" not found Jul 17 17:49:49.125697 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:49.125609 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0f81ac5-1933-4808-b012-511ceb72f397-samples-operator-tls podName:e0f81ac5-1933-4808-b012-511ceb72f397 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:50.125591127 +0000 UTC m=+37.112807671 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e0f81ac5-1933-4808-b012-511ceb72f397-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vbm2n" (UID: "e0f81ac5-1933-4808-b012-511ceb72f397") : secret "samples-operator-tls" not found Jul 17 17:49:49.125697 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:49.125631 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-metrics-certs\") pod \"router-default-56cbf4fbfd-spcrn\" (UID: \"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8\") " pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:49:49.125839 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:49.125704 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/734e9676-1625-453c-8752-a60ff53e569b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-297dl\" (UID: \"734e9676-1625-453c-8752-a60ff53e569b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-297dl" Jul 17 17:49:49.125839 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:49.125715 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 17:49:49.125839 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:49.125743 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-metrics-certs podName:e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:50.12573131 +0000 UTC m=+37.112947641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-metrics-certs") pod "router-default-56cbf4fbfd-spcrn" (UID: "e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8") : secret "router-metrics-certs-default" not found Jul 17 17:49:49.125839 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:49.125774 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-service-ca-bundle podName:e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:50.125766748 +0000 UTC m=+37.112983076 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-service-ca-bundle") pod "router-default-56cbf4fbfd-spcrn" (UID: "e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8") : configmap references non-existent config key: service-ca.crt Jul 17 17:49:49.125960 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:49.125862 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 17:49:49.125960 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:49.125907 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734e9676-1625-453c-8752-a60ff53e569b-cluster-monitoring-operator-tls podName:734e9676-1625-453c-8752-a60ff53e569b nodeName:}" failed. No retries permitted until 2026-07-17 17:49:50.125893926 +0000 UTC m=+37.113110271 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/734e9676-1625-453c-8752-a60ff53e569b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-297dl" (UID: "734e9676-1625-453c-8752-a60ff53e569b") : secret "cluster-monitoring-operator-tls" not found Jul 17 17:49:49.200238 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:49.200205 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:49.226223 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:49.226178 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-metrics-tls\") pod \"dns-default-wcffs\" (UID: \"cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703\") " pod="openshift-dns/dns-default-wcffs" Jul 17 17:49:49.226370 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:49.226321 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 17:49:49.226426 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:49.226388 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-metrics-tls podName:cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:50.226369517 +0000 UTC m=+37.213585846 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-metrics-tls") pod "dns-default-wcffs" (UID: "cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703") : secret "dns-default-metrics-tls" not found Jul 17 17:49:49.264810 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:49.264712 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:49.367166 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:49.367133 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:49.421815 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:49.421702 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:49.865357 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:49.865038 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:49.879427 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:49.879405 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qwg4s"] Jul 17 17:49:49.886262 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:49.882898 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-vwvfg"] Jul 17 17:49:49.886262 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:49.884623 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-5d5xw"] Jul 17 17:49:49.886262 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:49.886121 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-kcmzb"] Jul 17 17:49:49.893794 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:49.893742 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod960e1622_2795_40a6_bb03_eaf54f315d96.slice/crio-04f35175f252bd5177e30430372745c4ff1610540b00fa8f1891699dcbdd834b WatchSource:0}: Error finding container 04f35175f252bd5177e30430372745c4ff1610540b00fa8f1891699dcbdd834b: Status 404 returned error can't find the container with id 04f35175f252bd5177e30430372745c4ff1610540b00fa8f1891699dcbdd834b Jul 17 17:49:49.896780 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:49.896721 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36b82608_4a35_44da_9af1_6d56c88cb1e2.slice/crio-f9230b0ac30ddbe34129e094c201d34686077af42f1aff8ceb4ce180918c91f8 WatchSource:0}: Error finding container f9230b0ac30ddbe34129e094c201d34686077af42f1aff8ceb4ce180918c91f8: Status 404 returned error can't find the container with id f9230b0ac30ddbe34129e094c201d34686077af42f1aff8ceb4ce180918c91f8 Jul 17 17:49:49.904968 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:49.903294 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tcqx6"] Jul 17 17:49:49.904968 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:49.904704 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4khbn"] Jul 17 17:49:49.912851 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:49.912827 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-kcprj"] Jul 17 17:49:49.917379 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:49.917348 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b1e2bce_2c51_4d72_a176_c74abc546be6.slice/crio-4d11e691aaaa226a700450d44fb71f6f90051c1c2fafb416864b81c5f50c211c WatchSource:0}: Error finding container 4d11e691aaaa226a700450d44fb71f6f90051c1c2fafb416864b81c5f50c211c: Status 404 returned error can't find the container with id 4d11e691aaaa226a700450d44fb71f6f90051c1c2fafb416864b81c5f50c211c Jul 17 17:49:49.918030 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:49.917999 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b3db565_1f0f_4487_a819_653eb100b9dc.slice/crio-d87b97ed3ac4fe504b02d70b01e23a11dbfec0546b24be9b33aeb175dabc84d5 WatchSource:0}: Error finding container d87b97ed3ac4fe504b02d70b01e23a11dbfec0546b24be9b33aeb175dabc84d5: Status 404 returned error can't find the container with id d87b97ed3ac4fe504b02d70b01e23a11dbfec0546b24be9b33aeb175dabc84d5 Jul 17 17:49:49.919454 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:49:49.919400 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7bbedb5_767b_4aca_a270_41b0695c2eb2.slice/crio-bb3122c7f085c45d8e4cb15bbbf8cda96ee2cd9ea2510c3f5b39dd49b2c8b941 WatchSource:0}: Error finding container bb3122c7f085c45d8e4cb15bbbf8cda96ee2cd9ea2510c3f5b39dd49b2c8b941: Status 404 returned error can't find the container with id bb3122c7f085c45d8e4cb15bbbf8cda96ee2cd9ea2510c3f5b39dd49b2c8b941 Jul 17 17:49:49.965620 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:49.965590 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:50.142375 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:50.139090 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-service-ca-bundle\") pod \"router-default-56cbf4fbfd-spcrn\" (UID: \"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8\") " pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:49:50.142375 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:50.139172 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-metrics-certs\") pod \"router-default-56cbf4fbfd-spcrn\" (UID: \"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8\") " pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:49:50.142375 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:50.139271 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/734e9676-1625-453c-8752-a60ff53e569b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-297dl\" (UID: \"734e9676-1625-453c-8752-a60ff53e569b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-297dl" Jul 17 17:49:50.142375 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:50.139367 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0f81ac5-1933-4808-b012-511ceb72f397-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vbm2n\" (UID: \"e0f81ac5-1933-4808-b012-511ceb72f397\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vbm2n" Jul 17 17:49:50.142375 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:50.139420 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-registry-tls\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:49:50.142375 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:50.139590 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 17:49:50.142375 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:50.139604 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b9b7fb9b-v58vp: secret "image-registry-tls" not found Jul 17 17:49:50.142375 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:50.139669 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-registry-tls podName:f746ad0f-5018-420f-8fc8-6816f0225211 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:52.1396511 +0000 UTC m=+39.126867432 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-registry-tls") pod "image-registry-7b9b7fb9b-v58vp" (UID: "f746ad0f-5018-420f-8fc8-6816f0225211") : secret "image-registry-tls" not found Jul 17 17:49:50.142375 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:50.140243 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-service-ca-bundle podName:e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:52.140224998 +0000 UTC m=+39.127441331 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-service-ca-bundle") pod "router-default-56cbf4fbfd-spcrn" (UID: "e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8") : configmap references non-existent config key: service-ca.crt Jul 17 17:49:50.142375 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:50.140342 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 17:49:50.142375 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:50.140384 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-metrics-certs podName:e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:52.140372635 +0000 UTC m=+39.127588980 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-metrics-certs") pod "router-default-56cbf4fbfd-spcrn" (UID: "e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8") : secret "router-metrics-certs-default" not found Jul 17 17:49:50.142375 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:50.140471 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 17:49:50.142375 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:50.140508 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734e9676-1625-453c-8752-a60ff53e569b-cluster-monitoring-operator-tls podName:734e9676-1625-453c-8752-a60ff53e569b nodeName:}" failed. No retries permitted until 2026-07-17 17:49:52.140492386 +0000 UTC m=+39.127708728 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/734e9676-1625-453c-8752-a60ff53e569b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-297dl" (UID: "734e9676-1625-453c-8752-a60ff53e569b") : secret "cluster-monitoring-operator-tls" not found Jul 17 17:49:50.142375 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:50.140571 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 17:49:50.142375 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:50.140605 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0f81ac5-1933-4808-b012-511ceb72f397-samples-operator-tls podName:e0f81ac5-1933-4808-b012-511ceb72f397 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:52.140595917 +0000 UTC m=+39.127812258 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e0f81ac5-1933-4808-b012-511ceb72f397-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vbm2n" (UID: "e0f81ac5-1933-4808-b012-511ceb72f397") : secret "samples-operator-tls" not found Jul 17 17:49:50.239939 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:50.239911 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-metrics-tls\") pod \"dns-default-wcffs\" (UID: \"cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703\") " pod="openshift-dns/dns-default-wcffs" Jul 17 17:49:50.240070 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:50.240053 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 17:49:50.240116 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:50.240107 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-metrics-tls podName:cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:52.240093934 +0000 UTC m=+39.227310262 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-metrics-tls") pod "dns-default-wcffs" (UID: "cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703") : secret "dns-default-metrics-tls" not found Jul 17 17:49:50.279768 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:50.279724 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:50.358977 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:50.358944 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:50.562655 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:50.562569 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:50.634149 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:50.634084 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:50.661490 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:50.661379 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qwg4s" event={"ID":"b40ec2a7-8dec-4513-80ca-2255cc34c77c","Type":"ContainerStarted","Data":"ea8cd16a388f52f2730637d2917b576201c55cbec9423a45dd76124597d23e48"} Jul 17 17:49:50.663357 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:50.663289 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-vwvfg" event={"ID":"e4f8df35-139a-4910-866b-e4a5609e5e1d","Type":"ContainerStarted","Data":"5d2cb3bc80b5a3ae1c59437bfe55f2f9128d2d62726a097875b94aee2db3179b"} Jul 17 17:49:50.665065 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:50.665001 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tcqx6" event={"ID":"f7bbedb5-767b-4aca-a270-41b0695c2eb2","Type":"ContainerStarted","Data":"bb3122c7f085c45d8e4cb15bbbf8cda96ee2cd9ea2510c3f5b39dd49b2c8b941"} Jul 17 17:49:50.671651 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:50.670563 2580 generic.go:356] "Generic (PLEG): container finished" podID="5ea25ecd-4ba5-4c84-8068-d7adfed46344" containerID="eb0cb0691297c63945eb4e7dce87c508bbe535f79512dd8b9218911f936577aa" exitCode=0 Jul 17 17:49:50.671651 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:50.670643 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngvvf" event={"ID":"5ea25ecd-4ba5-4c84-8068-d7adfed46344","Type":"ContainerDied","Data":"eb0cb0691297c63945eb4e7dce87c508bbe535f79512dd8b9218911f936577aa"} Jul 17 17:49:50.673314 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:50.673257 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4khbn" event={"ID":"4b3db565-1f0f-4487-a819-653eb100b9dc","Type":"ContainerStarted","Data":"d87b97ed3ac4fe504b02d70b01e23a11dbfec0546b24be9b33aeb175dabc84d5"} Jul 17 17:49:50.676023 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:50.675041 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-5d5xw" event={"ID":"960e1622-2795-40a6-bb03-eaf54f315d96","Type":"ContainerStarted","Data":"04f35175f252bd5177e30430372745c4ff1610540b00fa8f1891699dcbdd834b"} Jul 17 17:49:50.682153 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:50.682123 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" event={"ID":"36b82608-4a35-44da-9af1-6d56c88cb1e2","Type":"ContainerStarted","Data":"f9230b0ac30ddbe34129e094c201d34686077af42f1aff8ceb4ce180918c91f8"} Jul 17 17:49:50.691800 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:50.691711 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-kcprj" event={"ID":"1b1e2bce-2c51-4d72-a176-c74abc546be6","Type":"ContainerStarted","Data":"4d11e691aaaa226a700450d44fb71f6f90051c1c2fafb416864b81c5f50c211c"} Jul 17 17:49:51.076161 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:51.076078 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:51.471149 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:51.471107 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:51.568399 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:51.568349 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:51.708800 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:51.708154 2580 generic.go:356] "Generic (PLEG): container finished" podID="5ea25ecd-4ba5-4c84-8068-d7adfed46344" containerID="d0b5f7ae772750676f0aa913eea756dcd1f554cbc3ed0c5f3f890bbc874c7f73" exitCode=0 Jul 17 17:49:51.708800 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:51.708239 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngvvf" event={"ID":"5ea25ecd-4ba5-4c84-8068-d7adfed46344","Type":"ContainerDied","Data":"d0b5f7ae772750676f0aa913eea756dcd1f554cbc3ed0c5f3f890bbc874c7f73"} Jul 17 17:49:52.163510 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:52.163478 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0f81ac5-1933-4808-b012-511ceb72f397-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vbm2n\" (UID: \"e0f81ac5-1933-4808-b012-511ceb72f397\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vbm2n" Jul 17 17:49:52.164902 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:52.163541 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-registry-tls\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:49:52.164902 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:52.163593 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-service-ca-bundle\") pod \"router-default-56cbf4fbfd-spcrn\" (UID: \"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8\") " pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:49:52.164902 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:52.163618 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-metrics-certs\") pod \"router-default-56cbf4fbfd-spcrn\" (UID: \"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8\") " pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:49:52.164902 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:52.163681 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/734e9676-1625-453c-8752-a60ff53e569b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-297dl\" (UID: \"734e9676-1625-453c-8752-a60ff53e569b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-297dl" Jul 17 17:49:52.164902 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:52.163862 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 17:49:52.164902 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:52.163926 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734e9676-1625-453c-8752-a60ff53e569b-cluster-monitoring-operator-tls podName:734e9676-1625-453c-8752-a60ff53e569b nodeName:}" failed. No retries permitted until 2026-07-17 17:49:56.163905973 +0000 UTC m=+43.151122304 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/734e9676-1625-453c-8752-a60ff53e569b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-297dl" (UID: "734e9676-1625-453c-8752-a60ff53e569b") : secret "cluster-monitoring-operator-tls" not found Jul 17 17:49:52.164902 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:52.164324 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 17:49:52.164902 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:52.164372 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0f81ac5-1933-4808-b012-511ceb72f397-samples-operator-tls podName:e0f81ac5-1933-4808-b012-511ceb72f397 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:56.164357594 +0000 UTC m=+43.151573929 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e0f81ac5-1933-4808-b012-511ceb72f397-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vbm2n" (UID: "e0f81ac5-1933-4808-b012-511ceb72f397") : secret "samples-operator-tls" not found Jul 17 17:49:52.164902 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:52.164429 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 17:49:52.164902 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:52.164441 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b9b7fb9b-v58vp: secret "image-registry-tls" not found Jul 17 17:49:52.164902 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:52.164475 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-registry-tls podName:f746ad0f-5018-420f-8fc8-6816f0225211 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:56.164463149 +0000 UTC m=+43.151679481 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-registry-tls") pod "image-registry-7b9b7fb9b-v58vp" (UID: "f746ad0f-5018-420f-8fc8-6816f0225211") : secret "image-registry-tls" not found Jul 17 17:49:52.164902 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:52.164536 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-service-ca-bundle podName:e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:56.164527067 +0000 UTC m=+43.151743395 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-service-ca-bundle") pod "router-default-56cbf4fbfd-spcrn" (UID: "e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8") : configmap references non-existent config key: service-ca.crt Jul 17 17:49:52.164902 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:52.164593 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 17:49:52.164902 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:52.164625 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-metrics-certs podName:e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:56.164615101 +0000 UTC m=+43.151831435 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-metrics-certs") pod "router-default-56cbf4fbfd-spcrn" (UID: "e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8") : secret "router-metrics-certs-default" not found Jul 17 17:49:52.264733 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:52.264704 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-metrics-tls\") pod \"dns-default-wcffs\" (UID: \"cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703\") " pod="openshift-dns/dns-default-wcffs" Jul 17 17:49:52.264918 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:52.264900 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 17:49:52.264979 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:52.264967 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-metrics-tls podName:cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:56.264949285 +0000 UTC m=+43.252165617 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-metrics-tls") pod "dns-default-wcffs" (UID: "cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703") : secret "dns-default-metrics-tls" not found Jul 17 17:49:52.317563 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:52.317531 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:52.697673 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:52.697410 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:52.716001 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:52.715967 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngvvf" event={"ID":"5ea25ecd-4ba5-4c84-8068-d7adfed46344","Type":"ContainerStarted","Data":"fef95ce3506421b6bbe29f6c8e414eb4acc5bab61524eac394506bd959c61096"} Jul 17 17:49:52.740600 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:52.740268 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ngvvf" podStartSLOduration=10.272882615 podStartE2EDuration="39.740248181s" totalImagesPullingTime="29.467365566s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:49:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:52.738557546 +0000 UTC m=+39.725773900" watchObservedRunningTime="2026-07-17 17:49:52.740248181 +0000 UTC m=+39.727464531" Jul 17 17:49:52.796148 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:52.796112 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:52.897492 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:52.897451 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:52.971922 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:52.971851 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:53.656683 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:53.656651 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-z8jsg"] Jul 17 17:49:53.673081 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:53.673056 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-z8jsg"] Jul 17 17:49:53.673240 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:53.673147 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-z8jsg" Jul 17 17:49:53.675659 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:53.675632 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-v8bzq\"" Jul 17 17:49:53.675829 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:53.675669 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 17 17:49:53.675829 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:53.675680 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 17 17:49:53.779669 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:53.779637 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8076afd8-cc00-47d5-93a3-8bdd4e37bc45-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-z8jsg\" (UID: \"8076afd8-cc00-47d5-93a3-8bdd4e37bc45\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-z8jsg" Jul 17 17:49:53.780077 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:53.779690 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8076afd8-cc00-47d5-93a3-8bdd4e37bc45-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-z8jsg\" (UID: \"8076afd8-cc00-47d5-93a3-8bdd4e37bc45\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-z8jsg" Jul 17 17:49:53.781280 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:53.781256 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:53.881053 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:53.881015 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8076afd8-cc00-47d5-93a3-8bdd4e37bc45-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-z8jsg\" (UID: \"8076afd8-cc00-47d5-93a3-8bdd4e37bc45\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-z8jsg" Jul 17 17:49:53.881310 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:53.881119 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 17 17:49:53.881310 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:53.881180 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8076afd8-cc00-47d5-93a3-8bdd4e37bc45-networking-console-plugin-cert podName:8076afd8-cc00-47d5-93a3-8bdd4e37bc45 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:54.381165193 +0000 UTC m=+41.368381521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8076afd8-cc00-47d5-93a3-8bdd4e37bc45-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-z8jsg" (UID: "8076afd8-cc00-47d5-93a3-8bdd4e37bc45") : secret "networking-console-plugin-cert" not found Jul 17 17:49:53.881310 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:53.881276 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8076afd8-cc00-47d5-93a3-8bdd4e37bc45-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-z8jsg\" (UID: \"8076afd8-cc00-47d5-93a3-8bdd4e37bc45\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-z8jsg" Jul 17 17:49:53.881966 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:53.881940 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8076afd8-cc00-47d5-93a3-8bdd4e37bc45-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-z8jsg\" (UID: \"8076afd8-cc00-47d5-93a3-8bdd4e37bc45\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-z8jsg" Jul 17 17:49:53.883167 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:53.883140 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:53.983369 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:53.983290 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:54.386092 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:54.386056 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8076afd8-cc00-47d5-93a3-8bdd4e37bc45-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-z8jsg\" (UID: \"8076afd8-cc00-47d5-93a3-8bdd4e37bc45\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-z8jsg" Jul 17 17:49:54.386249 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:54.386199 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 17 17:49:54.386294 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:54.386265 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8076afd8-cc00-47d5-93a3-8bdd4e37bc45-networking-console-plugin-cert podName:8076afd8-cc00-47d5-93a3-8bdd4e37bc45 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:55.386248468 +0000 UTC m=+42.373464798 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8076afd8-cc00-47d5-93a3-8bdd4e37bc45-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-z8jsg" (UID: "8076afd8-cc00-47d5-93a3-8bdd4e37bc45") : secret "networking-console-plugin-cert" not found Jul 17 17:49:54.678176 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:54.678087 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:55.072623 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:55.072585 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:55.174186 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:55.174157 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:55.395356 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:55.395317 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8076afd8-cc00-47d5-93a3-8bdd4e37bc45-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-z8jsg\" (UID: \"8076afd8-cc00-47d5-93a3-8bdd4e37bc45\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-z8jsg" Jul 17 17:49:55.395508 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:55.395492 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 17 17:49:55.395569 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:55.395560 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8076afd8-cc00-47d5-93a3-8bdd4e37bc45-networking-console-plugin-cert podName:8076afd8-cc00-47d5-93a3-8bdd4e37bc45 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:57.395542425 +0000 UTC m=+44.382758756 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8076afd8-cc00-47d5-93a3-8bdd4e37bc45-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-z8jsg" (UID: "8076afd8-cc00-47d5-93a3-8bdd4e37bc45") : secret "networking-console-plugin-cert" not found Jul 17 17:49:56.204804 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:56.204771 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-registry-tls\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:49:56.205225 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:56.204833 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-service-ca-bundle\") pod \"router-default-56cbf4fbfd-spcrn\" (UID: \"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8\") " pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:49:56.205225 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:56.204860 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-metrics-certs\") pod \"router-default-56cbf4fbfd-spcrn\" (UID: \"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8\") " pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:49:56.205225 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:56.204913 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/734e9676-1625-453c-8752-a60ff53e569b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-297dl\" (UID: \"734e9676-1625-453c-8752-a60ff53e569b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-297dl" Jul 17 17:49:56.205225 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:56.204961 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 17:49:56.205225 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:56.204984 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b9b7fb9b-v58vp: secret "image-registry-tls" not found Jul 17 17:49:56.205225 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:56.205009 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0f81ac5-1933-4808-b012-511ceb72f397-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vbm2n\" (UID: \"e0f81ac5-1933-4808-b012-511ceb72f397\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vbm2n" Jul 17 17:49:56.205225 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:56.205032 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-service-ca-bundle podName:e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:04.205013722 +0000 UTC m=+51.192230056 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-service-ca-bundle") pod "router-default-56cbf4fbfd-spcrn" (UID: "e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8") : configmap references non-existent config key: service-ca.crt Jul 17 17:49:56.205225 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:56.205040 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 17:49:56.205225 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:56.205073 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-registry-tls podName:f746ad0f-5018-420f-8fc8-6816f0225211 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:04.205063132 +0000 UTC m=+51.192279479 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-registry-tls") pod "image-registry-7b9b7fb9b-v58vp" (UID: "f746ad0f-5018-420f-8fc8-6816f0225211") : secret "image-registry-tls" not found Jul 17 17:49:56.205225 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:56.205076 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 17:49:56.205225 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:56.205084 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 17:49:56.205225 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:56.205103 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-metrics-certs podName:e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:04.205089271 +0000 UTC m=+51.192305602 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-metrics-certs") pod "router-default-56cbf4fbfd-spcrn" (UID: "e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8") : secret "router-metrics-certs-default" not found Jul 17 17:49:56.205225 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:56.205122 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0f81ac5-1933-4808-b012-511ceb72f397-samples-operator-tls podName:e0f81ac5-1933-4808-b012-511ceb72f397 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:04.20511557 +0000 UTC m=+51.192331898 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e0f81ac5-1933-4808-b012-511ceb72f397-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vbm2n" (UID: "e0f81ac5-1933-4808-b012-511ceb72f397") : secret "samples-operator-tls" not found Jul 17 17:49:56.205225 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:56.205135 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734e9676-1625-453c-8752-a60ff53e569b-cluster-monitoring-operator-tls podName:734e9676-1625-453c-8752-a60ff53e569b nodeName:}" failed. No retries permitted until 2026-07-17 17:50:04.205128606 +0000 UTC m=+51.192344933 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/734e9676-1625-453c-8752-a60ff53e569b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-297dl" (UID: "734e9676-1625-453c-8752-a60ff53e569b") : secret "cluster-monitoring-operator-tls" not found Jul 17 17:49:56.305844 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:56.305813 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-metrics-tls\") pod \"dns-default-wcffs\" (UID: \"cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703\") " pod="openshift-dns/dns-default-wcffs" Jul 17 17:49:56.306016 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:56.305977 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 17:49:56.306089 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:56.306064 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-metrics-tls podName:cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:04.306042155 +0000 UTC m=+51.293258485 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-metrics-tls") pod "dns-default-wcffs" (UID: "cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703") : secret "dns-default-metrics-tls" not found Jul 17 17:49:57.416266 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:57.416237 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8076afd8-cc00-47d5-93a3-8bdd4e37bc45-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-z8jsg\" (UID: \"8076afd8-cc00-47d5-93a3-8bdd4e37bc45\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-z8jsg" Jul 17 17:49:57.416543 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:57.416344 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 17 17:49:57.416543 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:57.416392 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8076afd8-cc00-47d5-93a3-8bdd4e37bc45-networking-console-plugin-cert podName:8076afd8-cc00-47d5-93a3-8bdd4e37bc45 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:01.416380426 +0000 UTC m=+48.403596755 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8076afd8-cc00-47d5-93a3-8bdd4e37bc45-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-z8jsg" (UID: "8076afd8-cc00-47d5-93a3-8bdd4e37bc45") : secret "networking-console-plugin-cert" not found Jul 17 17:49:58.734663 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:58.734622 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qwg4s" event={"ID":"b40ec2a7-8dec-4513-80ca-2255cc34c77c","Type":"ContainerStarted","Data":"3808952b0c4ca90b176e2c8ef0bf3384b78a23dc0553b39e4c7639d5b92a86cb"} Jul 17 17:49:58.736641 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:58.736611 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-vwvfg" event={"ID":"e4f8df35-139a-4910-866b-e4a5609e5e1d","Type":"ContainerStarted","Data":"f33d267e973a54dbebf89b7cdae5c70cf2f7ce718582fb4ff7ba180a6498f0c6"} Jul 17 17:49:58.738210 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:58.738168 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tcqx6" event={"ID":"f7bbedb5-767b-4aca-a270-41b0695c2eb2","Type":"ContainerStarted","Data":"7d5c82e620e4342b1094ac04ae98bbe909912d1ec21f45547051be88a2ba651a"} Jul 17 17:49:58.739790 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:58.739743 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4khbn" event={"ID":"4b3db565-1f0f-4487-a819-653eb100b9dc","Type":"ContainerStarted","Data":"9169ae73955295be24c43a0d308706c178e3dcf9dbfccffca427937188a9bc94"} Jul 17 17:49:58.741324 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:58.741302 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-5d5xw" event={"ID":"960e1622-2795-40a6-bb03-eaf54f315d96","Type":"ContainerStarted","Data":"357189c2c5f06df540d390af8c8ea09058e6bef49c62a11fa02d495bfd927542"} Jul 17 17:49:58.743086 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:58.743065 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kcmzb_36b82608-4a35-44da-9af1-6d56c88cb1e2/console-operator/0.log" Jul 17 17:49:58.743182 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:58.743105 2580 generic.go:356] "Generic (PLEG): container finished" podID="36b82608-4a35-44da-9af1-6d56c88cb1e2" containerID="8ac90b42902779889341d35470d917ab246a66dd9a4c1aba97bca8b3cf25955a" exitCode=255 Jul 17 17:49:58.743182 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:58.743176 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" event={"ID":"36b82608-4a35-44da-9af1-6d56c88cb1e2","Type":"ContainerDied","Data":"8ac90b42902779889341d35470d917ab246a66dd9a4c1aba97bca8b3cf25955a"} Jul 17 17:49:58.743332 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:58.743317 2580 scope.go:117] "RemoveContainer" containerID="8ac90b42902779889341d35470d917ab246a66dd9a4c1aba97bca8b3cf25955a" Jul 17 17:49:58.744977 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:58.744956 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-kcprj" event={"ID":"1b1e2bce-2c51-4d72-a176-c74abc546be6","Type":"ContainerStarted","Data":"15f5d3b6b102b40a511ede83725e9423e9576aaf3024ea8b7b934de84ddf052e"} Jul 17 17:49:58.747799 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:58.747778 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" Jul 17 17:49:58.747881 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:58.747819 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" Jul 17 17:49:58.751704 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:58.751660 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qwg4s" podStartSLOduration=2.927342437 podStartE2EDuration="10.751646561s" totalImagesPullingTime="7.824304124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:49:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:58.751094587 +0000 UTC m=+45.738310940" watchObservedRunningTime="2026-07-17 17:49:58.751646561 +0000 UTC m=+45.738862912" Jul 17 17:49:58.789354 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:58.788038 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-vwvfg" podStartSLOduration=11.976343011 podStartE2EDuration="19.788020167s" totalImagesPullingTime="7.811677156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:58.78743167 +0000 UTC m=+45.774648025" watchObservedRunningTime="2026-07-17 17:49:58.788020167 +0000 UTC m=+45.775236519" Jul 17 17:49:58.823171 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:58.822078 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tcqx6" podStartSLOduration=12.166531173 podStartE2EDuration="19.822056858s" totalImagesPullingTime="7.655525685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:58.803224384 +0000 UTC m=+45.790440746" watchObservedRunningTime="2026-07-17 17:49:58.822056858 +0000 UTC m=+45.809273209" Jul 17 17:49:58.823171 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:58.822169 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-kcprj" podStartSLOduration=12.02069815 podStartE2EDuration="19.822164278s" totalImagesPullingTime="7.801466128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:58.820569239 +0000 UTC m=+45.807785592" watchObservedRunningTime="2026-07-17 17:49:58.822164278 +0000 UTC m=+45.809380631" Jul 17 17:49:58.846788 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:58.846728 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4khbn" podStartSLOduration=12.053873777 podStartE2EDuration="19.846712873s" totalImagesPullingTime="7.792839096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:58.845645463 +0000 UTC m=+45.832861822" watchObservedRunningTime="2026-07-17 17:49:58.846712873 +0000 UTC m=+45.833929222" Jul 17 17:49:58.876013 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:58.875211 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-5d5xw" podStartSLOduration=12.059536913 podStartE2EDuration="19.875192106s" totalImagesPullingTime="7.815655193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:58.875003169 +0000 UTC m=+45.862219520" watchObservedRunningTime="2026-07-17 17:49:58.875192106 +0000 UTC m=+45.862408456" Jul 17 17:49:58.916361 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:58.916279 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:59.009133 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.009030 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kcll6"] Jul 17 17:49:59.012028 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.011941 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:59.022405 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.022213 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kcll6" Jul 17 17:49:59.024322 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.023742 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kcll6"] Jul 17 17:49:59.026658 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.026039 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 17 17:49:59.026658 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.026266 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 17 17:49:59.026658 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.026460 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s6zth\"" Jul 17 17:49:59.036453 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.032921 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwjqs\" (UniqueName: \"kubernetes.io/projected/c351beb9-6176-4e6d-bc0e-65ff5557d85b-kube-api-access-vwjqs\") pod \"insights-runtime-extractor-kcll6\" (UID: \"c351beb9-6176-4e6d-bc0e-65ff5557d85b\") " pod="openshift-insights/insights-runtime-extractor-kcll6" Jul 17 17:49:59.036453 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.032995 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c351beb9-6176-4e6d-bc0e-65ff5557d85b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kcll6\" (UID: \"c351beb9-6176-4e6d-bc0e-65ff5557d85b\") " pod="openshift-insights/insights-runtime-extractor-kcll6" Jul 17 17:49:59.036453 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.033114 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c351beb9-6176-4e6d-bc0e-65ff5557d85b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kcll6\" (UID: \"c351beb9-6176-4e6d-bc0e-65ff5557d85b\") " pod="openshift-insights/insights-runtime-extractor-kcll6" Jul 17 17:49:59.036453 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.033170 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c351beb9-6176-4e6d-bc0e-65ff5557d85b-crio-socket\") pod \"insights-runtime-extractor-kcll6\" (UID: \"c351beb9-6176-4e6d-bc0e-65ff5557d85b\") " pod="openshift-insights/insights-runtime-extractor-kcll6" Jul 17 17:49:59.036453 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.033202 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c351beb9-6176-4e6d-bc0e-65ff5557d85b-data-volume\") pod \"insights-runtime-extractor-kcll6\" (UID: \"c351beb9-6176-4e6d-bc0e-65ff5557d85b\") " pod="openshift-insights/insights-runtime-extractor-kcll6" Jul 17 17:49:59.071380 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.071354 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:59.134346 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.134323 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwjqs\" (UniqueName: \"kubernetes.io/projected/c351beb9-6176-4e6d-bc0e-65ff5557d85b-kube-api-access-vwjqs\") pod \"insights-runtime-extractor-kcll6\" (UID: \"c351beb9-6176-4e6d-bc0e-65ff5557d85b\") " pod="openshift-insights/insights-runtime-extractor-kcll6" Jul 17 17:49:59.134467 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.134368 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c351beb9-6176-4e6d-bc0e-65ff5557d85b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kcll6\" (UID: \"c351beb9-6176-4e6d-bc0e-65ff5557d85b\") " pod="openshift-insights/insights-runtime-extractor-kcll6" Jul 17 17:49:59.134535 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.134468 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c351beb9-6176-4e6d-bc0e-65ff5557d85b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kcll6\" (UID: \"c351beb9-6176-4e6d-bc0e-65ff5557d85b\") " pod="openshift-insights/insights-runtime-extractor-kcll6" Jul 17 17:49:59.134535 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.134525 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c351beb9-6176-4e6d-bc0e-65ff5557d85b-crio-socket\") pod \"insights-runtime-extractor-kcll6\" (UID: \"c351beb9-6176-4e6d-bc0e-65ff5557d85b\") " pod="openshift-insights/insights-runtime-extractor-kcll6" Jul 17 17:49:59.134633 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:59.134548 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 17:49:59.134633 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:59.134605 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c351beb9-6176-4e6d-bc0e-65ff5557d85b-insights-runtime-extractor-tls podName:c351beb9-6176-4e6d-bc0e-65ff5557d85b nodeName:}" failed. No retries permitted until 2026-07-17 17:49:59.634587586 +0000 UTC m=+46.621803914 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c351beb9-6176-4e6d-bc0e-65ff5557d85b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kcll6" (UID: "c351beb9-6176-4e6d-bc0e-65ff5557d85b") : secret "insights-runtime-extractor-tls" not found Jul 17 17:49:59.134742 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.134549 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c351beb9-6176-4e6d-bc0e-65ff5557d85b-data-volume\") pod \"insights-runtime-extractor-kcll6\" (UID: \"c351beb9-6176-4e6d-bc0e-65ff5557d85b\") " pod="openshift-insights/insights-runtime-extractor-kcll6" Jul 17 17:49:59.134830 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:59.134812 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 17:49:59.134883 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:59.134869 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c351beb9-6176-4e6d-bc0e-65ff5557d85b-kube-rbac-proxy-cm podName:c351beb9-6176-4e6d-bc0e-65ff5557d85b nodeName:}" failed. No retries permitted until 2026-07-17 17:49:59.634851896 +0000 UTC m=+46.622068240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c351beb9-6176-4e6d-bc0e-65ff5557d85b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kcll6" (UID: "c351beb9-6176-4e6d-bc0e-65ff5557d85b") : configmap "kube-rbac-proxy" not found Jul 17 17:49:59.134941 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.134878 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c351beb9-6176-4e6d-bc0e-65ff5557d85b-data-volume\") pod \"insights-runtime-extractor-kcll6\" (UID: \"c351beb9-6176-4e6d-bc0e-65ff5557d85b\") " pod="openshift-insights/insights-runtime-extractor-kcll6" Jul 17 17:49:59.134997 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.134962 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c351beb9-6176-4e6d-bc0e-65ff5557d85b-crio-socket\") pod \"insights-runtime-extractor-kcll6\" (UID: \"c351beb9-6176-4e6d-bc0e-65ff5557d85b\") " pod="openshift-insights/insights-runtime-extractor-kcll6" Jul 17 17:49:59.145060 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.145030 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwjqs\" (UniqueName: \"kubernetes.io/projected/c351beb9-6176-4e6d-bc0e-65ff5557d85b-kube-api-access-vwjqs\") pod \"insights-runtime-extractor-kcll6\" (UID: \"c351beb9-6176-4e6d-bc0e-65ff5557d85b\") " pod="openshift-insights/insights-runtime-extractor-kcll6" Jul 17 17:49:59.437319 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.437280 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:59.540704 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.540672 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:49:59.638666 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.638631 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c351beb9-6176-4e6d-bc0e-65ff5557d85b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kcll6\" (UID: \"c351beb9-6176-4e6d-bc0e-65ff5557d85b\") " pod="openshift-insights/insights-runtime-extractor-kcll6" Jul 17 17:49:59.638865 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.638743 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c351beb9-6176-4e6d-bc0e-65ff5557d85b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kcll6\" (UID: \"c351beb9-6176-4e6d-bc0e-65ff5557d85b\") " pod="openshift-insights/insights-runtime-extractor-kcll6" Jul 17 17:49:59.638865 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:59.638790 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 17:49:59.638865 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:59.638850 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c351beb9-6176-4e6d-bc0e-65ff5557d85b-insights-runtime-extractor-tls podName:c351beb9-6176-4e6d-bc0e-65ff5557d85b nodeName:}" failed. No retries permitted until 2026-07-17 17:50:00.638835965 +0000 UTC m=+47.626052293 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c351beb9-6176-4e6d-bc0e-65ff5557d85b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kcll6" (UID: "c351beb9-6176-4e6d-bc0e-65ff5557d85b") : secret "insights-runtime-extractor-tls" not found Jul 17 17:49:59.638999 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:59.638875 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 17:49:59.638999 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:59.638927 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c351beb9-6176-4e6d-bc0e-65ff5557d85b-kube-rbac-proxy-cm podName:c351beb9-6176-4e6d-bc0e-65ff5557d85b nodeName:}" failed. No retries permitted until 2026-07-17 17:50:00.638911055 +0000 UTC m=+47.626127397 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c351beb9-6176-4e6d-bc0e-65ff5557d85b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kcll6" (UID: "c351beb9-6176-4e6d-bc0e-65ff5557d85b") : configmap "kube-rbac-proxy" not found Jul 17 17:49:59.750188 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.750116 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kcmzb_36b82608-4a35-44da-9af1-6d56c88cb1e2/console-operator/1.log" Jul 17 17:49:59.750555 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.750539 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kcmzb_36b82608-4a35-44da-9af1-6d56c88cb1e2/console-operator/0.log" Jul 17 17:49:59.750616 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.750571 2580 generic.go:356] "Generic (PLEG): container finished" podID="36b82608-4a35-44da-9af1-6d56c88cb1e2" containerID="8c92344cc6ddce8df7643be40d9164fae7a0e287ce034749c3a35e874031c8b4" exitCode=255 Jul 17 17:49:59.750708 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.750681 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" event={"ID":"36b82608-4a35-44da-9af1-6d56c88cb1e2","Type":"ContainerDied","Data":"8c92344cc6ddce8df7643be40d9164fae7a0e287ce034749c3a35e874031c8b4"} Jul 17 17:49:59.750789 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.750766 2580 scope.go:117] "RemoveContainer" containerID="8ac90b42902779889341d35470d917ab246a66dd9a4c1aba97bca8b3cf25955a" Jul 17 17:49:59.751054 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:49:59.751029 2580 scope.go:117] "RemoveContainer" containerID="8c92344cc6ddce8df7643be40d9164fae7a0e287ce034749c3a35e874031c8b4" Jul 17 17:49:59.751227 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:49:59.751205 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-kcmzb_openshift-console-operator(36b82608-4a35-44da-9af1-6d56c88cb1e2)\"" pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" podUID="36b82608-4a35-44da-9af1-6d56c88cb1e2" Jul 17 17:50:00.179436 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:00.179395 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:00.232714 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:00.232678 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:00.404211 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:00.404183 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xh7s7_0ac788ff-552c-4ea0-8de1-857bb7e041cf/dns-node-resolver/0.log" Jul 17 17:50:00.436837 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:00.436764 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kjsbf"] Jul 17 17:50:00.465470 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:00.465437 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kjsbf"] Jul 17 17:50:00.465619 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:00.465547 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kjsbf" Jul 17 17:50:00.468659 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:00.468641 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 17 17:50:00.469789 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:00.469769 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 17 17:50:00.469895 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:00.469826 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-pg26v\"" Jul 17 17:50:00.471670 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:00.471645 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:00.524198 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:00.524170 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:00.546626 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:00.546601 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8m7z\" (UniqueName: \"kubernetes.io/projected/4998cf81-b00c-4f06-91e5-056098695a77-kube-api-access-l8m7z\") pod \"migrator-7cc9c7ffd7-kjsbf\" (UID: \"4998cf81-b00c-4f06-91e5-056098695a77\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kjsbf" Jul 17 17:50:00.610164 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:00.610132 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:00.647398 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:00.647366 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8m7z\" (UniqueName: \"kubernetes.io/projected/4998cf81-b00c-4f06-91e5-056098695a77-kube-api-access-l8m7z\") pod \"migrator-7cc9c7ffd7-kjsbf\" (UID: \"4998cf81-b00c-4f06-91e5-056098695a77\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kjsbf" Jul 17 17:50:00.647526 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:00.647419 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c351beb9-6176-4e6d-bc0e-65ff5557d85b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kcll6\" (UID: \"c351beb9-6176-4e6d-bc0e-65ff5557d85b\") " pod="openshift-insights/insights-runtime-extractor-kcll6" Jul 17 17:50:00.647526 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:00.647501 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c351beb9-6176-4e6d-bc0e-65ff5557d85b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kcll6\" (UID: \"c351beb9-6176-4e6d-bc0e-65ff5557d85b\") " pod="openshift-insights/insights-runtime-extractor-kcll6" Jul 17 17:50:00.647603 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:00.647562 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 17:50:00.647603 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:00.647585 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 17:50:00.647680 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:00.647625 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c351beb9-6176-4e6d-bc0e-65ff5557d85b-kube-rbac-proxy-cm podName:c351beb9-6176-4e6d-bc0e-65ff5557d85b nodeName:}" failed. No retries permitted until 2026-07-17 17:50:02.647606854 +0000 UTC m=+49.634823181 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c351beb9-6176-4e6d-bc0e-65ff5557d85b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kcll6" (UID: "c351beb9-6176-4e6d-bc0e-65ff5557d85b") : configmap "kube-rbac-proxy" not found Jul 17 17:50:00.647680 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:00.647639 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c351beb9-6176-4e6d-bc0e-65ff5557d85b-insights-runtime-extractor-tls podName:c351beb9-6176-4e6d-bc0e-65ff5557d85b nodeName:}" failed. No retries permitted until 2026-07-17 17:50:02.647632398 +0000 UTC m=+49.634848726 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c351beb9-6176-4e6d-bc0e-65ff5557d85b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kcll6" (UID: "c351beb9-6176-4e6d-bc0e-65ff5557d85b") : secret "insights-runtime-extractor-tls" not found Jul 17 17:50:00.655686 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:00.655665 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8m7z\" (UniqueName: \"kubernetes.io/projected/4998cf81-b00c-4f06-91e5-056098695a77-kube-api-access-l8m7z\") pod \"migrator-7cc9c7ffd7-kjsbf\" (UID: \"4998cf81-b00c-4f06-91e5-056098695a77\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kjsbf" Jul 17 17:50:00.711381 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:00.711302 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:00.755477 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:00.755453 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kcmzb_36b82608-4a35-44da-9af1-6d56c88cb1e2/console-operator/1.log" Jul 17 17:50:00.755868 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:00.755831 2580 scope.go:117] "RemoveContainer" containerID="8c92344cc6ddce8df7643be40d9164fae7a0e287ce034749c3a35e874031c8b4" Jul 17 17:50:00.755992 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:00.755973 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-kcmzb_openshift-console-operator(36b82608-4a35-44da-9af1-6d56c88cb1e2)\"" pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" podUID="36b82608-4a35-44da-9af1-6d56c88cb1e2" Jul 17 17:50:00.774252 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:00.774228 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kjsbf" Jul 17 17:50:00.889018 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:00.888980 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:00.920450 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:00.920421 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kjsbf"] Jul 17 17:50:00.923502 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:50:00.923476 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4998cf81_b00c_4f06_91e5_056098695a77.slice/crio-263219a65f880396edc0c85f7165f40db29743deb6d06a2a3459fc9de641fecf WatchSource:0}: Error finding container 263219a65f880396edc0c85f7165f40db29743deb6d06a2a3459fc9de641fecf: Status 404 returned error can't find the container with id 263219a65f880396edc0c85f7165f40db29743deb6d06a2a3459fc9de641fecf Jul 17 17:50:00.976409 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:00.976320 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:01.007599 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:01.007572 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jwff2_ed763a53-c3ff-4b3f-98c0-5870995f4a86/node-ca/0.log" Jul 17 17:50:01.081936 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:01.081909 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:01.139240 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:01.139202 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:01.454676 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:01.454641 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8076afd8-cc00-47d5-93a3-8bdd4e37bc45-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-z8jsg\" (UID: \"8076afd8-cc00-47d5-93a3-8bdd4e37bc45\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-z8jsg" Jul 17 17:50:01.454890 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:01.454836 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 17 17:50:01.454968 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:01.454918 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8076afd8-cc00-47d5-93a3-8bdd4e37bc45-networking-console-plugin-cert podName:8076afd8-cc00-47d5-93a3-8bdd4e37bc45 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:09.454898254 +0000 UTC m=+56.442114597 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8076afd8-cc00-47d5-93a3-8bdd4e37bc45-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-z8jsg" (UID: "8076afd8-cc00-47d5-93a3-8bdd4e37bc45") : secret "networking-console-plugin-cert" not found Jul 17 17:50:01.760701 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:01.760615 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kjsbf" event={"ID":"4998cf81-b00c-4f06-91e5-056098695a77","Type":"ContainerStarted","Data":"263219a65f880396edc0c85f7165f40db29743deb6d06a2a3459fc9de641fecf"} Jul 17 17:50:01.803959 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:01.803928 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qwg4s_b40ec2a7-8dec-4513-80ca-2255cc34c77c/serve-healthcheck-canary/0.log" Jul 17 17:50:02.289601 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:02.289565 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:02.347056 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:02.347021 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:02.526171 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:02.526140 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:02.584275 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:02.584247 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:02.666113 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:02.666088 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c351beb9-6176-4e6d-bc0e-65ff5557d85b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kcll6\" (UID: \"c351beb9-6176-4e6d-bc0e-65ff5557d85b\") " pod="openshift-insights/insights-runtime-extractor-kcll6" Jul 17 17:50:02.666202 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:02.666170 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c351beb9-6176-4e6d-bc0e-65ff5557d85b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kcll6\" (UID: \"c351beb9-6176-4e6d-bc0e-65ff5557d85b\") " pod="openshift-insights/insights-runtime-extractor-kcll6" Jul 17 17:50:02.666241 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:02.666230 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 17:50:02.666295 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:02.666285 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c351beb9-6176-4e6d-bc0e-65ff5557d85b-insights-runtime-extractor-tls podName:c351beb9-6176-4e6d-bc0e-65ff5557d85b nodeName:}" failed. No retries permitted until 2026-07-17 17:50:06.666271087 +0000 UTC m=+53.653487419 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c351beb9-6176-4e6d-bc0e-65ff5557d85b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kcll6" (UID: "c351beb9-6176-4e6d-bc0e-65ff5557d85b") : secret "insights-runtime-extractor-tls" not found Jul 17 17:50:02.666556 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:02.666542 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c351beb9-6176-4e6d-bc0e-65ff5557d85b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kcll6\" (UID: \"c351beb9-6176-4e6d-bc0e-65ff5557d85b\") " pod="openshift-insights/insights-runtime-extractor-kcll6" Jul 17 17:50:02.765043 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:02.765011 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kjsbf" event={"ID":"4998cf81-b00c-4f06-91e5-056098695a77","Type":"ContainerStarted","Data":"bdd2dd7828a45494c068e43b116095855816c271bd2c5fec4c5024da49571db0"} Jul 17 17:50:02.765405 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:02.765061 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kjsbf" event={"ID":"4998cf81-b00c-4f06-91e5-056098695a77","Type":"ContainerStarted","Data":"3a5355d80d6383ccd1ceaa0e359b29ddd0e53800251aa8f69c3a36fc4a1ca49f"} Jul 17 17:50:02.779709 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:02.779665 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kjsbf" podStartSLOduration=1.197088329 podStartE2EDuration="2.779651287s" totalImagesPullingTime="1.582562958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:50:02.779179937 +0000 UTC m=+49.766396284" watchObservedRunningTime="2026-07-17 17:50:02.779651287 +0000 UTC m=+49.766867631" Jul 17 17:50:02.849469 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:02.849437 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:02.909425 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:02.909393 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:03.514905 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:03.514833 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:04.279921 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:04.279893 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0f81ac5-1933-4808-b012-511ceb72f397-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vbm2n\" (UID: \"e0f81ac5-1933-4808-b012-511ceb72f397\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vbm2n" Jul 17 17:50:04.280346 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:04.279939 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-registry-tls\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:50:04.280346 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:04.279973 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-service-ca-bundle\") pod \"router-default-56cbf4fbfd-spcrn\" (UID: \"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8\") " pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:50:04.280346 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:04.279988 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-metrics-certs\") pod \"router-default-56cbf4fbfd-spcrn\" (UID: \"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8\") " pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:50:04.280346 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:04.280060 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 17:50:04.280346 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:04.280062 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 17:50:04.280346 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:04.280065 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 17:50:04.280346 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:04.280116 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-metrics-certs podName:e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:20.280096567 +0000 UTC m=+67.267312901 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-metrics-certs") pod "router-default-56cbf4fbfd-spcrn" (UID: "e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8") : secret "router-metrics-certs-default" not found Jul 17 17:50:04.280346 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:04.280122 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b9b7fb9b-v58vp: secret "image-registry-tls" not found Jul 17 17:50:04.280346 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:04.280139 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-service-ca-bundle podName:e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:20.28013224 +0000 UTC m=+67.267348567 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-service-ca-bundle") pod "router-default-56cbf4fbfd-spcrn" (UID: "e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8") : configmap references non-existent config key: service-ca.crt Jul 17 17:50:04.280346 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:04.280158 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0f81ac5-1933-4808-b012-511ceb72f397-samples-operator-tls podName:e0f81ac5-1933-4808-b012-511ceb72f397 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:20.280152351 +0000 UTC m=+67.267368680 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e0f81ac5-1933-4808-b012-511ceb72f397-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vbm2n" (UID: "e0f81ac5-1933-4808-b012-511ceb72f397") : secret "samples-operator-tls" not found Jul 17 17:50:04.280346 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:04.280171 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-registry-tls podName:f746ad0f-5018-420f-8fc8-6816f0225211 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:20.280166535 +0000 UTC m=+67.267382863 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-registry-tls") pod "image-registry-7b9b7fb9b-v58vp" (UID: "f746ad0f-5018-420f-8fc8-6816f0225211") : secret "image-registry-tls" not found Jul 17 17:50:04.280346 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:04.280209 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/734e9676-1625-453c-8752-a60ff53e569b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-297dl\" (UID: \"734e9676-1625-453c-8752-a60ff53e569b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-297dl" Jul 17 17:50:04.280346 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:04.280324 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 17:50:04.280346 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:04.280356 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734e9676-1625-453c-8752-a60ff53e569b-cluster-monitoring-operator-tls podName:734e9676-1625-453c-8752-a60ff53e569b nodeName:}" failed. No retries permitted until 2026-07-17 17:50:20.28034996 +0000 UTC m=+67.267566288 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/734e9676-1625-453c-8752-a60ff53e569b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-297dl" (UID: "734e9676-1625-453c-8752-a60ff53e569b") : secret "cluster-monitoring-operator-tls" not found Jul 17 17:50:04.381002 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:04.380975 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-metrics-tls\") pod \"dns-default-wcffs\" (UID: \"cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703\") " pod="openshift-dns/dns-default-wcffs" Jul 17 17:50:04.381131 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:04.381109 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 17:50:04.381171 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:04.381165 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-metrics-tls podName:cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:20.381150046 +0000 UTC m=+67.368366373 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-metrics-tls") pod "dns-default-wcffs" (UID: "cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703") : secret "dns-default-metrics-tls" not found Jul 17 17:50:05.415941 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:05.415908 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:05.518222 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:05.518187 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:05.616985 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:05.616958 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:05.676426 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:05.676357 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:06.701049 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:06.701005 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c351beb9-6176-4e6d-bc0e-65ff5557d85b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kcll6\" (UID: \"c351beb9-6176-4e6d-bc0e-65ff5557d85b\") " pod="openshift-insights/insights-runtime-extractor-kcll6" Jul 17 17:50:06.701523 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:06.701151 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 17:50:06.701523 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:06.701216 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c351beb9-6176-4e6d-bc0e-65ff5557d85b-insights-runtime-extractor-tls podName:c351beb9-6176-4e6d-bc0e-65ff5557d85b nodeName:}" failed. No retries permitted until 2026-07-17 17:50:14.701201978 +0000 UTC m=+61.688418306 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c351beb9-6176-4e6d-bc0e-65ff5557d85b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kcll6" (UID: "c351beb9-6176-4e6d-bc0e-65ff5557d85b") : secret "insights-runtime-extractor-tls" not found Jul 17 17:50:06.785315 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:06.785286 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:06.886670 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:06.886642 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:07.072903 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:07.072870 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:07.174854 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:07.174828 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:07.283484 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:07.283455 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:07.499169 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:07.499095 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:08.690270 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:08.690238 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:08.748784 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:08.748741 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" Jul 17 17:50:08.748925 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:08.748820 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" Jul 17 17:50:08.749158 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:08.749146 2580 scope.go:117] "RemoveContainer" containerID="8c92344cc6ddce8df7643be40d9164fae7a0e287ce034749c3a35e874031c8b4" Jul 17 17:50:08.749319 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:08.749301 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-kcmzb_openshift-console-operator(36b82608-4a35-44da-9af1-6d56c88cb1e2)\"" pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" podUID="36b82608-4a35-44da-9af1-6d56c88cb1e2" Jul 17 17:50:08.903094 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:08.903064 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:09.087560 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:09.087531 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:09.289223 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:09.289190 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:09.487387 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:09.487312 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:09.524795 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:09.524767 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8076afd8-cc00-47d5-93a3-8bdd4e37bc45-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-z8jsg\" (UID: \"8076afd8-cc00-47d5-93a3-8bdd4e37bc45\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-z8jsg" Jul 17 17:50:09.524920 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:09.524904 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 17 17:50:09.524991 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:09.524978 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8076afd8-cc00-47d5-93a3-8bdd4e37bc45-networking-console-plugin-cert podName:8076afd8-cc00-47d5-93a3-8bdd4e37bc45 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:25.524958851 +0000 UTC m=+72.512175195 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8076afd8-cc00-47d5-93a3-8bdd4e37bc45-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-z8jsg" (UID: "8076afd8-cc00-47d5-93a3-8bdd4e37bc45") : secret "networking-console-plugin-cert" not found Jul 17 17:50:10.289167 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:10.289138 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:10.481890 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:10.481849 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:10.688287 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:10.688257 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:10.744473 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:10.744445 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:11.090289 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:11.090259 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:11.282878 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:11.282848 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:11.382392 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:11.382318 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:11.688723 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:11.688659 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" limit=1024 Jul 17 17:50:14.640882 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:14.640856 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6bnj" Jul 17 17:50:14.770121 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:14.770085 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c351beb9-6176-4e6d-bc0e-65ff5557d85b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kcll6\" (UID: \"c351beb9-6176-4e6d-bc0e-65ff5557d85b\") " pod="openshift-insights/insights-runtime-extractor-kcll6" Jul 17 17:50:14.772431 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:14.772407 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c351beb9-6176-4e6d-bc0e-65ff5557d85b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kcll6\" (UID: \"c351beb9-6176-4e6d-bc0e-65ff5557d85b\") " pod="openshift-insights/insights-runtime-extractor-kcll6" Jul 17 17:50:14.943027 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:14.942944 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s6zth\"" Jul 17 17:50:14.951088 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:14.951073 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kcll6" Jul 17 17:50:15.078377 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:15.078348 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kcll6"] Jul 17 17:50:15.080957 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:50:15.080927 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc351beb9_6176_4e6d_bc0e_65ff5557d85b.slice/crio-9e8010e134d0fbe095eb8fbc0aa303c03ca80cb4ee1b812a4d357b857aaa17c1 WatchSource:0}: Error finding container 9e8010e134d0fbe095eb8fbc0aa303c03ca80cb4ee1b812a4d357b857aaa17c1: Status 404 returned error can't find the container with id 9e8010e134d0fbe095eb8fbc0aa303c03ca80cb4ee1b812a4d357b857aaa17c1 Jul 17 17:50:15.809553 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:15.809468 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kcll6" event={"ID":"c351beb9-6176-4e6d-bc0e-65ff5557d85b","Type":"ContainerStarted","Data":"9e8010e134d0fbe095eb8fbc0aa303c03ca80cb4ee1b812a4d357b857aaa17c1"} Jul 17 17:50:19.111949 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:19.111921 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5c93f78-e5a9-40b3-b394-e495edb54560-metrics-certs\") pod \"network-metrics-daemon-mvwcb\" (UID: \"f5c93f78-e5a9-40b3-b394-e495edb54560\") " pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:50:19.114701 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:19.114677 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 17:50:19.124776 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:19.124734 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5c93f78-e5a9-40b3-b394-e495edb54560-metrics-certs\") pod \"network-metrics-daemon-mvwcb\" (UID: \"f5c93f78-e5a9-40b3-b394-e495edb54560\") " pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:50:19.138363 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:19.138344 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xgrcl\"" Jul 17 17:50:19.146553 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:19.146533 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvwcb" Jul 17 17:50:19.212505 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:19.212475 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/030fdd55-bca5-482e-9b12-0552be384774-original-pull-secret\") pod \"global-pull-secret-syncer-7nlmb\" (UID: \"030fdd55-bca5-482e-9b12-0552be384774\") " pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:50:19.215494 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:19.215468 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 17:50:19.225137 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:19.225116 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/030fdd55-bca5-482e-9b12-0552be384774-original-pull-secret\") pod \"global-pull-secret-syncer-7nlmb\" (UID: \"030fdd55-bca5-482e-9b12-0552be384774\") " pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:50:19.313710 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:19.313676 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78dw2\" (UniqueName: \"kubernetes.io/projected/5c4c1690-71bc-4c37-bc2e-8c73015042b8-kube-api-access-78dw2\") pod \"network-check-target-bpn6w\" (UID: \"5c4c1690-71bc-4c37-bc2e-8c73015042b8\") " pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:50:19.316609 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:19.316583 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78dw2\" (UniqueName: \"kubernetes.io/projected/5c4c1690-71bc-4c37-bc2e-8c73015042b8-kube-api-access-78dw2\") pod \"network-check-target-bpn6w\" (UID: \"5c4c1690-71bc-4c37-bc2e-8c73015042b8\") " pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:50:19.431921 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:19.431841 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nlkcj\"" Jul 17 17:50:19.440124 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:19.440092 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:50:19.441445 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:19.441388 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nlmb" Jul 17 17:50:19.950485 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:19.950459 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bpn6w"] Jul 17 17:50:19.953518 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:50:19.953497 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c4c1690_71bc_4c37_bc2e_8c73015042b8.slice/crio-98377b02bbf12375a5d8b40bb97c471d937ef6739ba6d491eee74c6cd2e499ed WatchSource:0}: Error finding container 98377b02bbf12375a5d8b40bb97c471d937ef6739ba6d491eee74c6cd2e499ed: Status 404 returned error can't find the container with id 98377b02bbf12375a5d8b40bb97c471d937ef6739ba6d491eee74c6cd2e499ed Jul 17 17:50:20.172611 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.172545 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7nlmb"] Jul 17 17:50:20.175735 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:50:20.175704 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod030fdd55_bca5_482e_9b12_0552be384774.slice/crio-7f993fefcb7ffd1d605c94e126649738607b745c5b66552a35de7bfe40d2bce1 WatchSource:0}: Error finding container 7f993fefcb7ffd1d605c94e126649738607b745c5b66552a35de7bfe40d2bce1: Status 404 returned error can't find the container with id 7f993fefcb7ffd1d605c94e126649738607b745c5b66552a35de7bfe40d2bce1 Jul 17 17:50:20.175969 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.175952 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mvwcb"] Jul 17 17:50:20.178935 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:50:20.178914 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5c93f78_e5a9_40b3_b394_e495edb54560.slice/crio-2787e983c3202e3269d20392e895e807ae1bdbb1ea52bfc48178dd248879aa8e WatchSource:0}: Error finding container 2787e983c3202e3269d20392e895e807ae1bdbb1ea52bfc48178dd248879aa8e: Status 404 returned error can't find the container with id 2787e983c3202e3269d20392e895e807ae1bdbb1ea52bfc48178dd248879aa8e Jul 17 17:50:20.324290 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.324254 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-service-ca-bundle\") pod \"router-default-56cbf4fbfd-spcrn\" (UID: \"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8\") " pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:50:20.324290 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.324294 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-metrics-certs\") pod \"router-default-56cbf4fbfd-spcrn\" (UID: \"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8\") " pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:50:20.324508 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.324331 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/734e9676-1625-453c-8752-a60ff53e569b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-297dl\" (UID: \"734e9676-1625-453c-8752-a60ff53e569b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-297dl" Jul 17 17:50:20.324508 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.324404 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0f81ac5-1933-4808-b012-511ceb72f397-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vbm2n\" (UID: \"e0f81ac5-1933-4808-b012-511ceb72f397\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vbm2n" Jul 17 17:50:20.324508 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.324446 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-registry-tls\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:50:20.325203 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.325101 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-service-ca-bundle\") pod \"router-default-56cbf4fbfd-spcrn\" (UID: \"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8\") " pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:50:20.326869 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.326835 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8-metrics-certs\") pod \"router-default-56cbf4fbfd-spcrn\" (UID: \"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8\") " pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:50:20.326977 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.326900 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/734e9676-1625-453c-8752-a60ff53e569b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-297dl\" (UID: \"734e9676-1625-453c-8752-a60ff53e569b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-297dl" Jul 17 17:50:20.326977 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.326957 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-registry-tls\") pod \"image-registry-7b9b7fb9b-v58vp\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:50:20.326977 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.326967 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0f81ac5-1933-4808-b012-511ceb72f397-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vbm2n\" (UID: \"e0f81ac5-1933-4808-b012-511ceb72f397\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vbm2n" Jul 17 17:50:20.425451 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.425372 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-metrics-tls\") pod \"dns-default-wcffs\" (UID: \"cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703\") " pod="openshift-dns/dns-default-wcffs" Jul 17 17:50:20.427955 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.427931 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703-metrics-tls\") pod \"dns-default-wcffs\" (UID: \"cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703\") " pod="openshift-dns/dns-default-wcffs" Jul 17 17:50:20.478453 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.478432 2580 scope.go:117] "RemoveContainer" containerID="8c92344cc6ddce8df7643be40d9164fae7a0e287ce034749c3a35e874031c8b4" Jul 17 17:50:20.533533 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.533509 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-szkls\"" Jul 17 17:50:20.541267 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.541247 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:50:20.582464 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.582433 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-s2sdf\"" Jul 17 17:50:20.589415 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.589376 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gm5xt\"" Jul 17 17:50:20.590834 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.590641 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-297dl" Jul 17 17:50:20.597675 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.597573 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:50:20.603701 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.603663 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9bqzg\"" Jul 17 17:50:20.610046 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.610026 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-66fzz\"" Jul 17 17:50:20.612068 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.612047 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vbm2n" Jul 17 17:50:20.618575 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.618554 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wcffs" Jul 17 17:50:20.711137 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.711035 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b9b7fb9b-v58vp"] Jul 17 17:50:20.717412 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:50:20.717285 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf746ad0f_5018_420f_8fc8_6816f0225211.slice/crio-47f6b8a67658504e2f40ab79bbae7f79af3373d71fad3de892c52d40f2241baa WatchSource:0}: Error finding container 47f6b8a67658504e2f40ab79bbae7f79af3373d71fad3de892c52d40f2241baa: Status 404 returned error can't find the container with id 47f6b8a67658504e2f40ab79bbae7f79af3373d71fad3de892c52d40f2241baa Jul 17 17:50:20.807592 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.806855 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-297dl"] Jul 17 17:50:20.845693 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.845282 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kcmzb_36b82608-4a35-44da-9af1-6d56c88cb1e2/console-operator/2.log" Jul 17 17:50:20.848183 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.847015 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kcmzb_36b82608-4a35-44da-9af1-6d56c88cb1e2/console-operator/1.log" Jul 17 17:50:20.848183 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.847066 2580 generic.go:356] "Generic (PLEG): container finished" podID="36b82608-4a35-44da-9af1-6d56c88cb1e2" containerID="c2ab56b4a1c30d9fcae1ed3e4c5113ab356f909a321ceba61df89a9a3b9a0b1a" exitCode=255 Jul 17 17:50:20.848183 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.847156 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" event={"ID":"36b82608-4a35-44da-9af1-6d56c88cb1e2","Type":"ContainerDied","Data":"c2ab56b4a1c30d9fcae1ed3e4c5113ab356f909a321ceba61df89a9a3b9a0b1a"} Jul 17 17:50:20.848183 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.847209 2580 scope.go:117] "RemoveContainer" containerID="8c92344cc6ddce8df7643be40d9164fae7a0e287ce034749c3a35e874031c8b4" Jul 17 17:50:20.848183 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.847589 2580 scope.go:117] "RemoveContainer" containerID="c2ab56b4a1c30d9fcae1ed3e4c5113ab356f909a321ceba61df89a9a3b9a0b1a" Jul 17 17:50:20.848183 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:20.847839 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-kcmzb_openshift-console-operator(36b82608-4a35-44da-9af1-6d56c88cb1e2)\"" pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" podUID="36b82608-4a35-44da-9af1-6d56c88cb1e2" Jul 17 17:50:20.853270 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.853240 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" event={"ID":"f746ad0f-5018-420f-8fc8-6816f0225211","Type":"ContainerStarted","Data":"47f6b8a67658504e2f40ab79bbae7f79af3373d71fad3de892c52d40f2241baa"} Jul 17 17:50:20.855649 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.855628 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bpn6w" event={"ID":"5c4c1690-71bc-4c37-bc2e-8c73015042b8","Type":"ContainerStarted","Data":"9e678bf68102e22c5dbb3eb76bd5cf0173f69e5da1b9b94e7e46ca94490fa458"} Jul 17 17:50:20.855811 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.855792 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bpn6w" event={"ID":"5c4c1690-71bc-4c37-bc2e-8c73015042b8","Type":"ContainerStarted","Data":"98377b02bbf12375a5d8b40bb97c471d937ef6739ba6d491eee74c6cd2e499ed"} Jul 17 17:50:20.856144 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.856122 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:50:20.857964 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.857945 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kcll6" event={"ID":"c351beb9-6176-4e6d-bc0e-65ff5557d85b","Type":"ContainerStarted","Data":"84a6529ece563d0e30b20d58c45f06ae265fcff8167ef22d21ee2daa482f8919"} Jul 17 17:50:20.859370 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.859345 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mvwcb" event={"ID":"f5c93f78-e5a9-40b3-b394-e495edb54560","Type":"ContainerStarted","Data":"2787e983c3202e3269d20392e895e807ae1bdbb1ea52bfc48178dd248879aa8e"} Jul 17 17:50:20.861230 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.861188 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7nlmb" event={"ID":"030fdd55-bca5-482e-9b12-0552be384774","Type":"ContainerStarted","Data":"7f993fefcb7ffd1d605c94e126649738607b745c5b66552a35de7bfe40d2bce1"} Jul 17 17:50:20.862884 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.862862 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-297dl" event={"ID":"734e9676-1625-453c-8752-a60ff53e569b","Type":"ContainerStarted","Data":"1bba9e6415d7a1bac5b6822c6958c50fa1e64b53796d7e52f723b95d2e97196c"} Jul 17 17:50:20.876478 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.876454 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56cbf4fbfd-spcrn"] Jul 17 17:50:20.880007 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:50:20.879981 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3f24a24_b24f_4d1d_a0cc_5a8d5195c7a8.slice/crio-a64664355667f5453ff203004309e921dbc52a99761d1903d294973d2efea3a3 WatchSource:0}: Error finding container a64664355667f5453ff203004309e921dbc52a99761d1903d294973d2efea3a3: Status 404 returned error can't find the container with id a64664355667f5453ff203004309e921dbc52a99761d1903d294973d2efea3a3 Jul 17 17:50:20.890016 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.887664 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bpn6w" podStartSLOduration=67.887644194 podStartE2EDuration="1m7.887644194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:49:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:50:20.882003713 +0000 UTC m=+67.869220065" watchObservedRunningTime="2026-07-17 17:50:20.887644194 +0000 UTC m=+67.874860552" Jul 17 17:50:20.890016 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.888616 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wcffs"] Jul 17 17:50:20.893464 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:50:20.893410 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf18c0f6_26b5_42e6_b9ec_8cf9b8bbf703.slice/crio-a66bda9ae4316fc80d7e7416ea00f76ec6c227f57bfa108fb0a3cd13f53704fc WatchSource:0}: Error finding container a66bda9ae4316fc80d7e7416ea00f76ec6c227f57bfa108fb0a3cd13f53704fc: Status 404 returned error can't find the container with id a66bda9ae4316fc80d7e7416ea00f76ec6c227f57bfa108fb0a3cd13f53704fc Jul 17 17:50:20.935124 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:20.935057 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vbm2n"] Jul 17 17:50:21.870086 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:21.869959 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kcmzb_36b82608-4a35-44da-9af1-6d56c88cb1e2/console-operator/2.log" Jul 17 17:50:21.872830 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:21.872317 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" event={"ID":"f746ad0f-5018-420f-8fc8-6816f0225211","Type":"ContainerStarted","Data":"46d8a1d5b1f98ecb431948c5d68b14a0cd31916097ca923cfb3dee2c615e6520"} Jul 17 17:50:21.872830 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:21.872567 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:50:21.874250 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:21.874191 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vbm2n" event={"ID":"e0f81ac5-1933-4808-b012-511ceb72f397","Type":"ContainerStarted","Data":"00c0a526a8e76d4c6f3c6500f7384de234868623a55735619750c000ecc4bbef"} Jul 17 17:50:21.876196 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:21.875767 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wcffs" event={"ID":"cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703","Type":"ContainerStarted","Data":"a66bda9ae4316fc80d7e7416ea00f76ec6c227f57bfa108fb0a3cd13f53704fc"} Jul 17 17:50:21.879919 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:21.879840 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" event={"ID":"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8","Type":"ContainerStarted","Data":"137e6f98d9c3508e1a6fcc2e7ac681edffa3c41e07f76d2f69d809f768350d95"} Jul 17 17:50:21.879919 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:21.879875 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" event={"ID":"e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8","Type":"ContainerStarted","Data":"a64664355667f5453ff203004309e921dbc52a99761d1903d294973d2efea3a3"} Jul 17 17:50:21.895620 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:21.895487 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" podStartSLOduration=67.895468719 podStartE2EDuration="1m7.895468719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:49:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:50:21.892814519 +0000 UTC m=+68.880030894" watchObservedRunningTime="2026-07-17 17:50:21.895468719 +0000 UTC m=+68.882685049" Jul 17 17:50:22.598181 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:22.598127 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:50:22.603061 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:22.602877 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:50:22.624155 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:22.624106 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" podStartSLOduration=43.624086608 podStartE2EDuration="43.624086608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:49:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:50:21.911937141 +0000 UTC m=+68.899153492" watchObservedRunningTime="2026-07-17 17:50:22.624086608 +0000 UTC m=+69.611302954" Jul 17 17:50:22.895327 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:22.895291 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mvwcb" event={"ID":"f5c93f78-e5a9-40b3-b394-e495edb54560","Type":"ContainerStarted","Data":"0b7bf64d8bcac77b91c8fdd5aec502ec8f566c8b72a2447766ea048d6359d756"} Jul 17 17:50:22.896327 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:22.896303 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:50:22.897636 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:22.897611 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-56cbf4fbfd-spcrn" Jul 17 17:50:25.571961 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:25.571931 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8076afd8-cc00-47d5-93a3-8bdd4e37bc45-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-z8jsg\" (UID: \"8076afd8-cc00-47d5-93a3-8bdd4e37bc45\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-z8jsg" Jul 17 17:50:25.574769 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:25.574720 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8076afd8-cc00-47d5-93a3-8bdd4e37bc45-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-z8jsg\" (UID: \"8076afd8-cc00-47d5-93a3-8bdd4e37bc45\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-z8jsg" Jul 17 17:50:25.784982 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:25.784913 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-v8bzq\"" Jul 17 17:50:25.792609 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:25.792565 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-z8jsg" Jul 17 17:50:27.770080 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:27.770053 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-z8jsg"] Jul 17 17:50:27.772588 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:50:27.772529 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8076afd8_cc00_47d5_93a3_8bdd4e37bc45.slice/crio-818b289d01769a5824215a950e240438bac05de503cff65d6d60bcf6fc23b5e0 WatchSource:0}: Error finding container 818b289d01769a5824215a950e240438bac05de503cff65d6d60bcf6fc23b5e0: Status 404 returned error can't find the container with id 818b289d01769a5824215a950e240438bac05de503cff65d6d60bcf6fc23b5e0 Jul 17 17:50:27.920890 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:27.920858 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kcll6" event={"ID":"c351beb9-6176-4e6d-bc0e-65ff5557d85b","Type":"ContainerStarted","Data":"ffc025b840d62fdcd06b2b84c2c7983192341458c407426e165effccb73889b4"} Jul 17 17:50:27.923738 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:27.923273 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mvwcb" event={"ID":"f5c93f78-e5a9-40b3-b394-e495edb54560","Type":"ContainerStarted","Data":"e32298e02b0067aa46a62900e96b3897994cd7abef74737e8b7067a124fc78f0"} Jul 17 17:50:27.925096 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:27.925070 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7nlmb" event={"ID":"030fdd55-bca5-482e-9b12-0552be384774","Type":"ContainerStarted","Data":"7023488f0e919180dd4286674c6f371759453e97af5c338a3707cffc94b93f8d"} Jul 17 17:50:27.927971 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:27.927704 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-297dl" event={"ID":"734e9676-1625-453c-8752-a60ff53e569b","Type":"ContainerStarted","Data":"175f0cef74a275cd5198c2e76f01484c4eedc5a42d41bc412d526235bc90f9a1"} Jul 17 17:50:27.929368 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:27.929346 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wcffs" event={"ID":"cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703","Type":"ContainerStarted","Data":"2b1e3194f05dfc925344d9a3ead4f6ef980d4a201dab92d656af4b09250a34b3"} Jul 17 17:50:27.932402 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:27.932377 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-z8jsg" event={"ID":"8076afd8-cc00-47d5-93a3-8bdd4e37bc45","Type":"ContainerStarted","Data":"818b289d01769a5824215a950e240438bac05de503cff65d6d60bcf6fc23b5e0"} Jul 17 17:50:27.934256 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:27.934236 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vbm2n" event={"ID":"e0f81ac5-1933-4808-b012-511ceb72f397","Type":"ContainerStarted","Data":"e8c8d6263f8926a9d80a87038eadec67d34470b234f138f157f7b1bced470689"} Jul 17 17:50:27.940285 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:27.940225 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mvwcb" podStartSLOduration=72.725976675 podStartE2EDuration="1m14.940208695s" totalImagesPullingTime="2.21423202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:50:27.93827292 +0000 UTC m=+74.925489281" watchObservedRunningTime="2026-07-17 17:50:27.940208695 +0000 UTC m=+74.927425046" Jul 17 17:50:27.962638 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:27.962592 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vbm2n" podStartSLOduration=42.373213234 podStartE2EDuration="48.962577505s" totalImagesPullingTime="6.589364271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:50:27.961568706 +0000 UTC m=+74.948785057" watchObservedRunningTime="2026-07-17 17:50:27.962577505 +0000 UTC m=+74.949793855" Jul 17 17:50:27.977011 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:27.976957 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7nlmb" podStartSLOduration=67.531340799 podStartE2EDuration="1m14.976925929s" totalImagesPullingTime="7.44558513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:50:27.976774156 +0000 UTC m=+74.963990528" watchObservedRunningTime="2026-07-17 17:50:27.976925929 +0000 UTC m=+74.964142280" Jul 17 17:50:27.993966 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:27.993875 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-297dl" podStartSLOduration=42.21987428 podStartE2EDuration="48.993858654s" totalImagesPullingTime="6.773984374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:50:27.992219893 +0000 UTC m=+74.979436266" watchObservedRunningTime="2026-07-17 17:50:27.993858654 +0000 UTC m=+74.981075005" Jul 17 17:50:28.237242 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:28.237210 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-qhqhq"] Jul 17 17:50:28.257213 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:28.257139 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-qhqhq"] Jul 17 17:50:28.257363 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:28.257257 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-qhqhq" Jul 17 17:50:28.260116 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:28.259922 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 17 17:50:28.260116 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:28.259995 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-bq42s\"" Jul 17 17:50:28.402998 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:28.402968 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/890b343e-ae97-488b-8f5a-52716583d061-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-qhqhq\" (UID: \"890b343e-ae97-488b-8f5a-52716583d061\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-qhqhq" Jul 17 17:50:28.503962 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:28.503925 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/890b343e-ae97-488b-8f5a-52716583d061-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-qhqhq\" (UID: \"890b343e-ae97-488b-8f5a-52716583d061\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-qhqhq" Jul 17 17:50:28.504140 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:28.504078 2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 17 17:50:28.504200 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:28.504154 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/890b343e-ae97-488b-8f5a-52716583d061-tls-certificates podName:890b343e-ae97-488b-8f5a-52716583d061 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:29.004132608 +0000 UTC m=+75.991348952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/890b343e-ae97-488b-8f5a-52716583d061-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-qhqhq" (UID: "890b343e-ae97-488b-8f5a-52716583d061") : secret "prometheus-operator-admission-webhook-tls" not found Jul 17 17:50:28.748691 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:28.748654 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" Jul 17 17:50:28.748873 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:28.748718 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" Jul 17 17:50:28.749142 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:28.749124 2580 scope.go:117] "RemoveContainer" containerID="c2ab56b4a1c30d9fcae1ed3e4c5113ab356f909a321ceba61df89a9a3b9a0b1a" Jul 17 17:50:28.749306 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:28.749283 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-kcmzb_openshift-console-operator(36b82608-4a35-44da-9af1-6d56c88cb1e2)\"" pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" podUID="36b82608-4a35-44da-9af1-6d56c88cb1e2" Jul 17 17:50:28.942581 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:28.942539 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wcffs" event={"ID":"cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703","Type":"ContainerStarted","Data":"4b0a9ce6c8f38dfe3f781a5742384c44f0c4c9d4dafdc22855977a1f6af6cd37"} Jul 17 17:50:28.943262 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:28.943202 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wcffs" Jul 17 17:50:28.945787 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:28.945283 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vbm2n" event={"ID":"e0f81ac5-1933-4808-b012-511ceb72f397","Type":"ContainerStarted","Data":"bcaca7045a434a7f233681f255bacb40d10b93f1f3b5e63bc68652aa5f13d842"} Jul 17 17:50:28.962210 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:28.962161 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wcffs" podStartSLOduration=34.244933559 podStartE2EDuration="40.962143046s" totalImagesPullingTime="6.717209487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:49:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:50:28.959742759 +0000 UTC m=+75.946959111" watchObservedRunningTime="2026-07-17 17:50:28.962143046 +0000 UTC m=+75.949359397" Jul 17 17:50:29.009435 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:29.009340 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/890b343e-ae97-488b-8f5a-52716583d061-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-qhqhq\" (UID: \"890b343e-ae97-488b-8f5a-52716583d061\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-qhqhq" Jul 17 17:50:29.012607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:29.012581 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/890b343e-ae97-488b-8f5a-52716583d061-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-qhqhq\" (UID: \"890b343e-ae97-488b-8f5a-52716583d061\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-qhqhq" Jul 17 17:50:29.167932 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:29.167900 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-qhqhq" Jul 17 17:50:29.335418 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:29.335249 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-qhqhq"] Jul 17 17:50:29.338090 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:50:29.338057 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod890b343e_ae97_488b_8f5a_52716583d061.slice/crio-aa84e22aba1a60164eb869fa9d7c07fb119fb4ae687ea92abc356fa3360c9d4f WatchSource:0}: Error finding container aa84e22aba1a60164eb869fa9d7c07fb119fb4ae687ea92abc356fa3360c9d4f: Status 404 returned error can't find the container with id aa84e22aba1a60164eb869fa9d7c07fb119fb4ae687ea92abc356fa3360c9d4f Jul 17 17:50:29.950842 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:29.950803 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-qhqhq" event={"ID":"890b343e-ae97-488b-8f5a-52716583d061","Type":"ContainerStarted","Data":"aa84e22aba1a60164eb869fa9d7c07fb119fb4ae687ea92abc356fa3360c9d4f"} Jul 17 17:50:29.952796 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:29.952609 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-z8jsg" event={"ID":"8076afd8-cc00-47d5-93a3-8bdd4e37bc45","Type":"ContainerStarted","Data":"a50a4d94dcec97f47842fca78e2f340ca0ecd6a074629374542eefb4fe8b982b"} Jul 17 17:50:32.968654 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:32.968626 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kcll6" event={"ID":"c351beb9-6176-4e6d-bc0e-65ff5557d85b","Type":"ContainerStarted","Data":"baf1e610178e33c7d8781abbae8fea5de7d42852dfa072a5bbbed5abb6089c81"} Jul 17 17:50:32.970249 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:32.970227 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-qhqhq" event={"ID":"890b343e-ae97-488b-8f5a-52716583d061","Type":"ContainerStarted","Data":"1a4c8dfdff6205365ad8fb06600beaabb0f2b0b7fabc0ed74a2e871cdbd9bbd0"} Jul 17 17:50:32.970461 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:32.970443 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-qhqhq" Jul 17 17:50:32.971795 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:32.971770 2580 patch_prober.go:28] interesting pod/prometheus-operator-admission-webhook-85574b5f49-qhqhq container/prometheus-operator-admission-webhook namespace/openshift-monitoring: Readiness probe status=failure output="Get \"https://10.132.0.21:8443/healthz\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body= Jul 17 17:50:32.971876 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:32.971817 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-qhqhq" podUID="890b343e-ae97-488b-8f5a-52716583d061" containerName="prometheus-operator-admission-webhook" probeResult="failure" output="Get \"https://10.132.0.21:8443/healthz\": dial tcp 10.132.0.21:8443: connect: connection refused" Jul 17 17:50:32.989384 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:32.989333 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-z8jsg" podStartSLOduration=38.226209136 podStartE2EDuration="39.989314988s" totalImagesPullingTime="1.763105852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:50:29.970291094 +0000 UTC m=+76.957507446" watchObservedRunningTime="2026-07-17 17:50:32.989314988 +0000 UTC m=+79.976531339" Jul 17 17:50:32.989970 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:32.989925 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kcll6" podStartSLOduration=18.417820586 podStartE2EDuration="34.989912445s" totalImagesPullingTime="16.572091859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:49:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:50:32.988654925 +0000 UTC m=+79.975871311" watchObservedRunningTime="2026-07-17 17:50:32.989912445 +0000 UTC m=+79.977128796" Jul 17 17:50:33.003956 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:33.003919 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-qhqhq" podStartSLOduration=1.481405721 podStartE2EDuration="5.003905921s" totalImagesPullingTime="3.5225002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:50:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:50:33.002894568 +0000 UTC m=+79.990110921" watchObservedRunningTime="2026-07-17 17:50:33.003905921 +0000 UTC m=+79.991122270" Jul 17 17:50:33.977811 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:33.977783 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-qhqhq" Jul 17 17:50:39.959978 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:39.959846 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wcffs" Jul 17 17:50:40.546034 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:40.545999 2580 patch_prober.go:28] interesting pod/image-registry-7b9b7fb9b-v58vp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 17 17:50:40.546184 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:40.546057 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" podUID="f746ad0f-5018-420f-8fc8-6816f0225211" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 17 17:50:41.478428 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:41.478391 2580 scope.go:117] "RemoveContainer" containerID="c2ab56b4a1c30d9fcae1ed3e4c5113ab356f909a321ceba61df89a9a3b9a0b1a" Jul 17 17:50:42.004745 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:42.004716 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kcmzb_36b82608-4a35-44da-9af1-6d56c88cb1e2/console-operator/2.log" Jul 17 17:50:42.004923 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:42.004849 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" event={"ID":"36b82608-4a35-44da-9af1-6d56c88cb1e2","Type":"ContainerStarted","Data":"ff297c9b45421fd2ef26cfabd61c48461538ba8055ebed2a495bbf89c1d20908"} Jul 17 17:50:42.005146 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:42.005128 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" Jul 17 17:50:42.022569 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:42.022520 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" podStartSLOduration=55.211140277 podStartE2EDuration="1m3.022502122s" totalImagesPullingTime="7.811361845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:50:42.022180517 +0000 UTC m=+89.009396887" watchObservedRunningTime="2026-07-17 17:50:42.022502122 +0000 UTC m=+89.009718472" Jul 17 17:50:42.454807 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:42.454779 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-kcmzb" Jul 17 17:50:42.899930 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:42.899905 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:50:43.624664 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.624626 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nwf4z"] Jul 17 17:50:43.627983 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.627956 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:43.630299 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.630277 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 17 17:50:43.630431 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.630282 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 17 17:50:43.630548 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.630533 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kp4nt\"" Jul 17 17:50:43.631527 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.631509 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 17 17:50:43.631603 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.631527 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 17 17:50:43.716625 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.716593 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86e398f3-8ccc-4fae-9e26-b749a03340b6-node-exporter-tls\") pod \"node-exporter-nwf4z\" (UID: \"86e398f3-8ccc-4fae-9e26-b749a03340b6\") " pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:43.716625 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.716627 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86e398f3-8ccc-4fae-9e26-b749a03340b6-metrics-client-ca\") pod \"node-exporter-nwf4z\" (UID: \"86e398f3-8ccc-4fae-9e26-b749a03340b6\") " pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:43.716856 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.716671 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbz9d\" (UniqueName: \"kubernetes.io/projected/86e398f3-8ccc-4fae-9e26-b749a03340b6-kube-api-access-dbz9d\") pod \"node-exporter-nwf4z\" (UID: \"86e398f3-8ccc-4fae-9e26-b749a03340b6\") " pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:43.716856 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.716730 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/86e398f3-8ccc-4fae-9e26-b749a03340b6-node-exporter-wtmp\") pod \"node-exporter-nwf4z\" (UID: \"86e398f3-8ccc-4fae-9e26-b749a03340b6\") " pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:43.716856 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.716799 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86e398f3-8ccc-4fae-9e26-b749a03340b6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nwf4z\" (UID: \"86e398f3-8ccc-4fae-9e26-b749a03340b6\") " pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:43.716856 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.716827 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86e398f3-8ccc-4fae-9e26-b749a03340b6-sys\") pod \"node-exporter-nwf4z\" (UID: \"86e398f3-8ccc-4fae-9e26-b749a03340b6\") " pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:43.716856 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.716856 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/86e398f3-8ccc-4fae-9e26-b749a03340b6-root\") pod \"node-exporter-nwf4z\" (UID: \"86e398f3-8ccc-4fae-9e26-b749a03340b6\") " pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:43.717097 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.716894 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/86e398f3-8ccc-4fae-9e26-b749a03340b6-node-exporter-accelerators-collector-config\") pod \"node-exporter-nwf4z\" (UID: \"86e398f3-8ccc-4fae-9e26-b749a03340b6\") " pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:43.717097 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.716913 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/86e398f3-8ccc-4fae-9e26-b749a03340b6-node-exporter-textfile\") pod \"node-exporter-nwf4z\" (UID: \"86e398f3-8ccc-4fae-9e26-b749a03340b6\") " pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:43.817793 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.817742 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/86e398f3-8ccc-4fae-9e26-b749a03340b6-node-exporter-wtmp\") pod \"node-exporter-nwf4z\" (UID: \"86e398f3-8ccc-4fae-9e26-b749a03340b6\") " pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:43.817944 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.817802 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86e398f3-8ccc-4fae-9e26-b749a03340b6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nwf4z\" (UID: \"86e398f3-8ccc-4fae-9e26-b749a03340b6\") " pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:43.817944 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.817822 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86e398f3-8ccc-4fae-9e26-b749a03340b6-sys\") pod \"node-exporter-nwf4z\" (UID: \"86e398f3-8ccc-4fae-9e26-b749a03340b6\") " pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:43.817944 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.817850 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/86e398f3-8ccc-4fae-9e26-b749a03340b6-root\") pod \"node-exporter-nwf4z\" (UID: \"86e398f3-8ccc-4fae-9e26-b749a03340b6\") " pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:43.817944 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.817878 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/86e398f3-8ccc-4fae-9e26-b749a03340b6-node-exporter-accelerators-collector-config\") pod \"node-exporter-nwf4z\" (UID: \"86e398f3-8ccc-4fae-9e26-b749a03340b6\") " pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:43.817944 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.817879 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/86e398f3-8ccc-4fae-9e26-b749a03340b6-node-exporter-wtmp\") pod \"node-exporter-nwf4z\" (UID: \"86e398f3-8ccc-4fae-9e26-b749a03340b6\") " pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:43.817944 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.817898 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/86e398f3-8ccc-4fae-9e26-b749a03340b6-node-exporter-textfile\") pod \"node-exporter-nwf4z\" (UID: \"86e398f3-8ccc-4fae-9e26-b749a03340b6\") " pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:43.817944 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.817940 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86e398f3-8ccc-4fae-9e26-b749a03340b6-sys\") pod \"node-exporter-nwf4z\" (UID: \"86e398f3-8ccc-4fae-9e26-b749a03340b6\") " pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:43.818247 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.817958 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/86e398f3-8ccc-4fae-9e26-b749a03340b6-root\") pod \"node-exporter-nwf4z\" (UID: \"86e398f3-8ccc-4fae-9e26-b749a03340b6\") " pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:43.818247 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.817961 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86e398f3-8ccc-4fae-9e26-b749a03340b6-node-exporter-tls\") pod \"node-exporter-nwf4z\" (UID: \"86e398f3-8ccc-4fae-9e26-b749a03340b6\") " pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:43.818247 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.818002 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86e398f3-8ccc-4fae-9e26-b749a03340b6-metrics-client-ca\") pod \"node-exporter-nwf4z\" (UID: \"86e398f3-8ccc-4fae-9e26-b749a03340b6\") " pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:43.818247 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:43.818019 2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 17 17:50:43.818247 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.818032 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbz9d\" (UniqueName: \"kubernetes.io/projected/86e398f3-8ccc-4fae-9e26-b749a03340b6-kube-api-access-dbz9d\") pod \"node-exporter-nwf4z\" (UID: \"86e398f3-8ccc-4fae-9e26-b749a03340b6\") " pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:43.818247 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:50:43.818084 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86e398f3-8ccc-4fae-9e26-b749a03340b6-node-exporter-tls podName:86e398f3-8ccc-4fae-9e26-b749a03340b6 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:44.318062754 +0000 UTC m=+91.305279082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/86e398f3-8ccc-4fae-9e26-b749a03340b6-node-exporter-tls") pod "node-exporter-nwf4z" (UID: "86e398f3-8ccc-4fae-9e26-b749a03340b6") : secret "node-exporter-tls" not found Jul 17 17:50:43.818490 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.818351 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/86e398f3-8ccc-4fae-9e26-b749a03340b6-node-exporter-textfile\") pod \"node-exporter-nwf4z\" (UID: \"86e398f3-8ccc-4fae-9e26-b749a03340b6\") " pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:43.818525 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.818488 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/86e398f3-8ccc-4fae-9e26-b749a03340b6-node-exporter-accelerators-collector-config\") pod \"node-exporter-nwf4z\" (UID: \"86e398f3-8ccc-4fae-9e26-b749a03340b6\") " pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:43.818525 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.818488 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86e398f3-8ccc-4fae-9e26-b749a03340b6-metrics-client-ca\") pod \"node-exporter-nwf4z\" (UID: \"86e398f3-8ccc-4fae-9e26-b749a03340b6\") " pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:43.820321 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.820303 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86e398f3-8ccc-4fae-9e26-b749a03340b6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nwf4z\" (UID: \"86e398f3-8ccc-4fae-9e26-b749a03340b6\") " pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:43.827586 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:43.827556 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbz9d\" (UniqueName: \"kubernetes.io/projected/86e398f3-8ccc-4fae-9e26-b749a03340b6-kube-api-access-dbz9d\") pod \"node-exporter-nwf4z\" (UID: \"86e398f3-8ccc-4fae-9e26-b749a03340b6\") " pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:44.321614 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:44.321572 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86e398f3-8ccc-4fae-9e26-b749a03340b6-node-exporter-tls\") pod \"node-exporter-nwf4z\" (UID: \"86e398f3-8ccc-4fae-9e26-b749a03340b6\") " pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:44.324269 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:44.324249 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86e398f3-8ccc-4fae-9e26-b749a03340b6-node-exporter-tls\") pod \"node-exporter-nwf4z\" (UID: \"86e398f3-8ccc-4fae-9e26-b749a03340b6\") " pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:44.537597 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:44.537563 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nwf4z" Jul 17 17:50:44.550149 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:50:44.550125 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86e398f3_8ccc_4fae_9e26_b749a03340b6.slice/crio-59a373e98709cfbbe1906dfa5dd127b6bb07bf5bd16d233f5bd8eeb11d53804f WatchSource:0}: Error finding container 59a373e98709cfbbe1906dfa5dd127b6bb07bf5bd16d233f5bd8eeb11d53804f: Status 404 returned error can't find the container with id 59a373e98709cfbbe1906dfa5dd127b6bb07bf5bd16d233f5bd8eeb11d53804f Jul 17 17:50:45.018631 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:45.018595 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nwf4z" event={"ID":"86e398f3-8ccc-4fae-9e26-b749a03340b6","Type":"ContainerStarted","Data":"59a373e98709cfbbe1906dfa5dd127b6bb07bf5bd16d233f5bd8eeb11d53804f"} Jul 17 17:50:46.023165 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:46.023134 2580 generic.go:356] "Generic (PLEG): container finished" podID="86e398f3-8ccc-4fae-9e26-b749a03340b6" containerID="f0f7d33d6169aa7e0360bfe8b7e146c86b7ffa68a5ab075962376d8051cf52d9" exitCode=0 Jul 17 17:50:46.023569 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:46.023234 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nwf4z" event={"ID":"86e398f3-8ccc-4fae-9e26-b749a03340b6","Type":"ContainerDied","Data":"f0f7d33d6169aa7e0360bfe8b7e146c86b7ffa68a5ab075962376d8051cf52d9"} Jul 17 17:50:47.029435 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:47.029388 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nwf4z" event={"ID":"86e398f3-8ccc-4fae-9e26-b749a03340b6","Type":"ContainerStarted","Data":"b94743d1534d359b24e38829f1cb59fb542dcb41edb7185085c996be5f5d3976"} Jul 17 17:50:47.029976 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:47.029451 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nwf4z" event={"ID":"86e398f3-8ccc-4fae-9e26-b749a03340b6","Type":"ContainerStarted","Data":"c95f6f5db7aa7c11c13a6b49065cd0c139e346a9c299a542ee7ecc1202c60f3e"} Jul 17 17:50:47.049728 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:47.049686 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nwf4z" podStartSLOduration=3.155217571 podStartE2EDuration="4.049671975s" totalImagesPullingTime="825.109879ms" totalInitContainerRuntime="69.344525ms" isStatefulPod=true podCreationTimestamp="2026-07-17 17:50:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:50:47.047441989 +0000 UTC m=+94.034658339" watchObservedRunningTime="2026-07-17 17:50:47.049671975 +0000 UTC m=+94.036888390" Jul 17 17:50:49.476038 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:49.476007 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b9b7fb9b-v58vp"] Jul 17 17:50:52.898472 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:52.898444 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bpn6w" Jul 17 17:50:57.932888 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:57.932854 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f4dfff9bd-f9zrg"] Jul 17 17:50:57.949605 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:57.949578 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f4dfff9bd-f9zrg"] Jul 17 17:50:57.949770 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:57.949682 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:50:57.952434 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:57.952414 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 17 17:50:57.953498 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:57.953475 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 17 17:50:57.953605 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:57.953565 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 17 17:50:57.953605 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:57.953584 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 17 17:50:57.953605 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:57.953592 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 17 17:50:57.953796 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:57.953620 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ml5rl\"" Jul 17 17:50:57.953796 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:57.953689 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 17 17:50:57.954020 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:57.954003 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 17 17:50:57.957861 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:57.957842 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 17 17:50:58.026209 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:58.026188 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc4f4331-228f-4fae-8c61-46044c9d0423-console-oauth-config\") pod \"console-6f4dfff9bd-f9zrg\" (UID: \"cc4f4331-228f-4fae-8c61-46044c9d0423\") " pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:50:58.026321 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:58.026225 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc4f4331-228f-4fae-8c61-46044c9d0423-console-serving-cert\") pod \"console-6f4dfff9bd-f9zrg\" (UID: \"cc4f4331-228f-4fae-8c61-46044c9d0423\") " pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:50:58.026321 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:58.026242 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rscxl\" (UniqueName: \"kubernetes.io/projected/cc4f4331-228f-4fae-8c61-46044c9d0423-kube-api-access-rscxl\") pod \"console-6f4dfff9bd-f9zrg\" (UID: \"cc4f4331-228f-4fae-8c61-46044c9d0423\") " pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:50:58.026321 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:58.026273 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc4f4331-228f-4fae-8c61-46044c9d0423-console-config\") pod \"console-6f4dfff9bd-f9zrg\" (UID: \"cc4f4331-228f-4fae-8c61-46044c9d0423\") " pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:50:58.026423 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:58.026366 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc4f4331-228f-4fae-8c61-46044c9d0423-trusted-ca-bundle\") pod \"console-6f4dfff9bd-f9zrg\" (UID: \"cc4f4331-228f-4fae-8c61-46044c9d0423\") " pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:50:58.026423 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:58.026386 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc4f4331-228f-4fae-8c61-46044c9d0423-oauth-serving-cert\") pod \"console-6f4dfff9bd-f9zrg\" (UID: \"cc4f4331-228f-4fae-8c61-46044c9d0423\") " pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:50:58.026423 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:58.026407 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc4f4331-228f-4fae-8c61-46044c9d0423-service-ca\") pod \"console-6f4dfff9bd-f9zrg\" (UID: \"cc4f4331-228f-4fae-8c61-46044c9d0423\") " pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:50:58.127403 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:58.127376 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc4f4331-228f-4fae-8c61-46044c9d0423-console-oauth-config\") pod \"console-6f4dfff9bd-f9zrg\" (UID: \"cc4f4331-228f-4fae-8c61-46044c9d0423\") " pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:50:58.127576 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:58.127412 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc4f4331-228f-4fae-8c61-46044c9d0423-console-serving-cert\") pod \"console-6f4dfff9bd-f9zrg\" (UID: \"cc4f4331-228f-4fae-8c61-46044c9d0423\") " pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:50:58.127576 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:58.127429 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rscxl\" (UniqueName: \"kubernetes.io/projected/cc4f4331-228f-4fae-8c61-46044c9d0423-kube-api-access-rscxl\") pod \"console-6f4dfff9bd-f9zrg\" (UID: \"cc4f4331-228f-4fae-8c61-46044c9d0423\") " pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:50:58.127576 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:58.127458 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc4f4331-228f-4fae-8c61-46044c9d0423-console-config\") pod \"console-6f4dfff9bd-f9zrg\" (UID: \"cc4f4331-228f-4fae-8c61-46044c9d0423\") " pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:50:58.127738 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:58.127635 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc4f4331-228f-4fae-8c61-46044c9d0423-trusted-ca-bundle\") pod \"console-6f4dfff9bd-f9zrg\" (UID: \"cc4f4331-228f-4fae-8c61-46044c9d0423\") " pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:50:58.127738 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:58.127669 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc4f4331-228f-4fae-8c61-46044c9d0423-oauth-serving-cert\") pod \"console-6f4dfff9bd-f9zrg\" (UID: \"cc4f4331-228f-4fae-8c61-46044c9d0423\") " pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:50:58.127738 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:58.127698 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc4f4331-228f-4fae-8c61-46044c9d0423-service-ca\") pod \"console-6f4dfff9bd-f9zrg\" (UID: \"cc4f4331-228f-4fae-8c61-46044c9d0423\") " pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:50:58.128270 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:58.128242 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc4f4331-228f-4fae-8c61-46044c9d0423-console-config\") pod \"console-6f4dfff9bd-f9zrg\" (UID: \"cc4f4331-228f-4fae-8c61-46044c9d0423\") " pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:50:58.128486 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:58.128467 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc4f4331-228f-4fae-8c61-46044c9d0423-service-ca\") pod \"console-6f4dfff9bd-f9zrg\" (UID: \"cc4f4331-228f-4fae-8c61-46044c9d0423\") " pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:50:58.128590 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:58.128566 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc4f4331-228f-4fae-8c61-46044c9d0423-oauth-serving-cert\") pod \"console-6f4dfff9bd-f9zrg\" (UID: \"cc4f4331-228f-4fae-8c61-46044c9d0423\") " pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:50:58.128630 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:58.128620 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc4f4331-228f-4fae-8c61-46044c9d0423-trusted-ca-bundle\") pod \"console-6f4dfff9bd-f9zrg\" (UID: \"cc4f4331-228f-4fae-8c61-46044c9d0423\") " pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:50:58.130629 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:58.130612 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc4f4331-228f-4fae-8c61-46044c9d0423-console-oauth-config\") pod \"console-6f4dfff9bd-f9zrg\" (UID: \"cc4f4331-228f-4fae-8c61-46044c9d0423\") " pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:50:58.130708 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:58.130675 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc4f4331-228f-4fae-8c61-46044c9d0423-console-serving-cert\") pod \"console-6f4dfff9bd-f9zrg\" (UID: \"cc4f4331-228f-4fae-8c61-46044c9d0423\") " pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:50:58.135560 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:58.135540 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rscxl\" (UniqueName: \"kubernetes.io/projected/cc4f4331-228f-4fae-8c61-46044c9d0423-kube-api-access-rscxl\") pod \"console-6f4dfff9bd-f9zrg\" (UID: \"cc4f4331-228f-4fae-8c61-46044c9d0423\") " pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:50:58.261398 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:58.261336 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:50:58.402419 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:58.402391 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f4dfff9bd-f9zrg"] Jul 17 17:50:58.405391 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:50:58.405363 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc4f4331_228f_4fae_8c61_46044c9d0423.slice/crio-6f19a4719b4b4371cd0c05a8ae220042c63b9d201c0ad3f17de139502e8d7c0e WatchSource:0}: Error finding container 6f19a4719b4b4371cd0c05a8ae220042c63b9d201c0ad3f17de139502e8d7c0e: Status 404 returned error can't find the container with id 6f19a4719b4b4371cd0c05a8ae220042c63b9d201c0ad3f17de139502e8d7c0e Jul 17 17:50:59.073894 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:50:59.073855 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4dfff9bd-f9zrg" event={"ID":"cc4f4331-228f-4fae-8c61-46044c9d0423","Type":"ContainerStarted","Data":"6f19a4719b4b4371cd0c05a8ae220042c63b9d201c0ad3f17de139502e8d7c0e"} Jul 17 17:51:02.089642 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:02.089603 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4dfff9bd-f9zrg" event={"ID":"cc4f4331-228f-4fae-8c61-46044c9d0423","Type":"ContainerStarted","Data":"41616e7872f1fac1a75e7cd5b3213ba7415aeb22223aa4242ba336d177056506"} Jul 17 17:51:08.262490 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:08.262451 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:51:08.262955 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:08.262514 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:51:08.267404 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:08.267382 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:51:08.284775 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:08.284707 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f4dfff9bd-f9zrg" podStartSLOduration=8.022803605 podStartE2EDuration="11.284694871s" totalImagesPullingTime="3.261891266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:50:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:51:02.107973132 +0000 UTC m=+109.095189481" watchObservedRunningTime="2026-07-17 17:51:08.284694871 +0000 UTC m=+115.271911220" Jul 17 17:51:09.116425 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.116391 2580 generic.go:356] "Generic (PLEG): container finished" podID="e4f8df35-139a-4910-866b-e4a5609e5e1d" containerID="f33d267e973a54dbebf89b7cdae5c70cf2f7ce718582fb4ff7ba180a6498f0c6" exitCode=0 Jul 17 17:51:09.116585 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.116472 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-vwvfg" event={"ID":"e4f8df35-139a-4910-866b-e4a5609e5e1d","Type":"ContainerDied","Data":"f33d267e973a54dbebf89b7cdae5c70cf2f7ce718582fb4ff7ba180a6498f0c6"} Jul 17 17:51:09.116946 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.116926 2580 scope.go:117] "RemoveContainer" containerID="f33d267e973a54dbebf89b7cdae5c70cf2f7ce718582fb4ff7ba180a6498f0c6" Jul 17 17:51:09.120775 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.120741 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:51:09.209524 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.209496 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79964dbccb-kh5qq"] Jul 17 17:51:09.212324 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.212299 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:51:09.222451 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.222427 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79964dbccb-kh5qq"] Jul 17 17:51:09.318253 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.318222 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bb08b65-4e91-4005-a379-d3be6d57f95e-trusted-ca-bundle\") pod \"console-79964dbccb-kh5qq\" (UID: \"4bb08b65-4e91-4005-a379-d3be6d57f95e\") " pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:51:09.318673 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.318260 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4bb08b65-4e91-4005-a379-d3be6d57f95e-console-oauth-config\") pod \"console-79964dbccb-kh5qq\" (UID: \"4bb08b65-4e91-4005-a379-d3be6d57f95e\") " pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:51:09.318673 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.318292 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4bb08b65-4e91-4005-a379-d3be6d57f95e-oauth-serving-cert\") pod \"console-79964dbccb-kh5qq\" (UID: \"4bb08b65-4e91-4005-a379-d3be6d57f95e\") " pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:51:09.318673 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.318348 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4bb08b65-4e91-4005-a379-d3be6d57f95e-service-ca\") pod \"console-79964dbccb-kh5qq\" (UID: \"4bb08b65-4e91-4005-a379-d3be6d57f95e\") " pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:51:09.318673 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.318395 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4bb08b65-4e91-4005-a379-d3be6d57f95e-console-serving-cert\") pod \"console-79964dbccb-kh5qq\" (UID: \"4bb08b65-4e91-4005-a379-d3be6d57f95e\") " pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:51:09.318673 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.318430 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4bb08b65-4e91-4005-a379-d3be6d57f95e-console-config\") pod \"console-79964dbccb-kh5qq\" (UID: \"4bb08b65-4e91-4005-a379-d3be6d57f95e\") " pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:51:09.318673 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.318489 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9lc2\" (UniqueName: \"kubernetes.io/projected/4bb08b65-4e91-4005-a379-d3be6d57f95e-kube-api-access-h9lc2\") pod \"console-79964dbccb-kh5qq\" (UID: \"4bb08b65-4e91-4005-a379-d3be6d57f95e\") " pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:51:09.419849 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.419768 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4bb08b65-4e91-4005-a379-d3be6d57f95e-oauth-serving-cert\") pod \"console-79964dbccb-kh5qq\" (UID: \"4bb08b65-4e91-4005-a379-d3be6d57f95e\") " pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:51:09.419849 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.419803 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4bb08b65-4e91-4005-a379-d3be6d57f95e-service-ca\") pod \"console-79964dbccb-kh5qq\" (UID: \"4bb08b65-4e91-4005-a379-d3be6d57f95e\") " pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:51:09.419849 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.419821 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4bb08b65-4e91-4005-a379-d3be6d57f95e-console-serving-cert\") pod \"console-79964dbccb-kh5qq\" (UID: \"4bb08b65-4e91-4005-a379-d3be6d57f95e\") " pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:51:09.419849 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.419838 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4bb08b65-4e91-4005-a379-d3be6d57f95e-console-config\") pod \"console-79964dbccb-kh5qq\" (UID: \"4bb08b65-4e91-4005-a379-d3be6d57f95e\") " pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:51:09.420152 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.419861 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9lc2\" (UniqueName: \"kubernetes.io/projected/4bb08b65-4e91-4005-a379-d3be6d57f95e-kube-api-access-h9lc2\") pod \"console-79964dbccb-kh5qq\" (UID: \"4bb08b65-4e91-4005-a379-d3be6d57f95e\") " pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:51:09.420152 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.419992 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bb08b65-4e91-4005-a379-d3be6d57f95e-trusted-ca-bundle\") pod \"console-79964dbccb-kh5qq\" (UID: \"4bb08b65-4e91-4005-a379-d3be6d57f95e\") " pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:51:09.420152 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.420034 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4bb08b65-4e91-4005-a379-d3be6d57f95e-console-oauth-config\") pod \"console-79964dbccb-kh5qq\" (UID: \"4bb08b65-4e91-4005-a379-d3be6d57f95e\") " pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:51:09.420608 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.420586 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4bb08b65-4e91-4005-a379-d3be6d57f95e-service-ca\") pod \"console-79964dbccb-kh5qq\" (UID: \"4bb08b65-4e91-4005-a379-d3be6d57f95e\") " pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:51:09.420725 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.420701 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4bb08b65-4e91-4005-a379-d3be6d57f95e-console-config\") pod \"console-79964dbccb-kh5qq\" (UID: \"4bb08b65-4e91-4005-a379-d3be6d57f95e\") " pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:51:09.420843 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.420820 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4bb08b65-4e91-4005-a379-d3be6d57f95e-oauth-serving-cert\") pod \"console-79964dbccb-kh5qq\" (UID: \"4bb08b65-4e91-4005-a379-d3be6d57f95e\") " pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:51:09.421208 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.421187 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bb08b65-4e91-4005-a379-d3be6d57f95e-trusted-ca-bundle\") pod \"console-79964dbccb-kh5qq\" (UID: \"4bb08b65-4e91-4005-a379-d3be6d57f95e\") " pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:51:09.422406 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.422386 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4bb08b65-4e91-4005-a379-d3be6d57f95e-console-serving-cert\") pod \"console-79964dbccb-kh5qq\" (UID: \"4bb08b65-4e91-4005-a379-d3be6d57f95e\") " pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:51:09.422569 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.422553 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4bb08b65-4e91-4005-a379-d3be6d57f95e-console-oauth-config\") pod \"console-79964dbccb-kh5qq\" (UID: \"4bb08b65-4e91-4005-a379-d3be6d57f95e\") " pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:51:09.427542 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.427519 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9lc2\" (UniqueName: \"kubernetes.io/projected/4bb08b65-4e91-4005-a379-d3be6d57f95e-kube-api-access-h9lc2\") pod \"console-79964dbccb-kh5qq\" (UID: \"4bb08b65-4e91-4005-a379-d3be6d57f95e\") " pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:51:09.523291 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.523259 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:51:09.657039 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:09.657005 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79964dbccb-kh5qq"] Jul 17 17:51:09.659113 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:51:09.659082 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bb08b65_4e91_4005_a379_d3be6d57f95e.slice/crio-ce3d8823dfbcd7fc1023bba7b86deb90f2a8cebce027594239e3b2c7a0838a28 WatchSource:0}: Error finding container ce3d8823dfbcd7fc1023bba7b86deb90f2a8cebce027594239e3b2c7a0838a28: Status 404 returned error can't find the container with id ce3d8823dfbcd7fc1023bba7b86deb90f2a8cebce027594239e3b2c7a0838a28 Jul 17 17:51:10.122180 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:10.122140 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79964dbccb-kh5qq" event={"ID":"4bb08b65-4e91-4005-a379-d3be6d57f95e","Type":"ContainerStarted","Data":"50194fd8f9e34209e8776886686961ddfd9fe6965367560cff10e9db0043dc48"} Jul 17 17:51:10.122387 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:10.122195 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79964dbccb-kh5qq" event={"ID":"4bb08b65-4e91-4005-a379-d3be6d57f95e","Type":"ContainerStarted","Data":"ce3d8823dfbcd7fc1023bba7b86deb90f2a8cebce027594239e3b2c7a0838a28"} Jul 17 17:51:10.124045 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:10.124021 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-vwvfg" event={"ID":"e4f8df35-139a-4910-866b-e4a5609e5e1d","Type":"ContainerStarted","Data":"fadb3457db1f8a2525e65e2b48303dd1a8c590284ff667de2bd8dbfe7ee2de20"} Jul 17 17:51:10.186820 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:10.186776 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79964dbccb-kh5qq" podStartSLOduration=1.186745363 podStartE2EDuration="1.186745363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:51:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:51:10.138532194 +0000 UTC m=+117.125748546" watchObservedRunningTime="2026-07-17 17:51:10.186745363 +0000 UTC m=+117.173961713" Jul 17 17:51:14.139579 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.139543 2580 generic.go:356] "Generic (PLEG): container finished" podID="960e1622-2795-40a6-bb03-eaf54f315d96" containerID="357189c2c5f06df540d390af8c8ea09058e6bef49c62a11fa02d495bfd927542" exitCode=0 Jul 17 17:51:14.139999 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.139595 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-5d5xw" event={"ID":"960e1622-2795-40a6-bb03-eaf54f315d96","Type":"ContainerDied","Data":"357189c2c5f06df540d390af8c8ea09058e6bef49c62a11fa02d495bfd927542"} Jul 17 17:51:14.139999 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.139911 2580 scope.go:117] "RemoveContainer" containerID="357189c2c5f06df540d390af8c8ea09058e6bef49c62a11fa02d495bfd927542" Jul 17 17:51:14.503720 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.503625 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" podUID="f746ad0f-5018-420f-8fc8-6816f0225211" containerName="registry" containerID="cri-o://46d8a1d5b1f98ecb431948c5d68b14a0cd31916097ca923cfb3dee2c615e6520" gracePeriod=30 Jul 17 17:51:14.755782 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.755700 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:51:14.867357 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.867326 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f746ad0f-5018-420f-8fc8-6816f0225211-registry-certificates\") pod \"f746ad0f-5018-420f-8fc8-6816f0225211\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " Jul 17 17:51:14.867357 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.867360 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f746ad0f-5018-420f-8fc8-6816f0225211-image-registry-private-configuration\") pod \"f746ad0f-5018-420f-8fc8-6816f0225211\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " Jul 17 17:51:14.867577 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.867394 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f746ad0f-5018-420f-8fc8-6816f0225211-ca-trust-extracted\") pod \"f746ad0f-5018-420f-8fc8-6816f0225211\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " Jul 17 17:51:14.867577 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.867424 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xzqc\" (UniqueName: \"kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-kube-api-access-9xzqc\") pod \"f746ad0f-5018-420f-8fc8-6816f0225211\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " Jul 17 17:51:14.867577 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.867484 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-bound-sa-token\") pod \"f746ad0f-5018-420f-8fc8-6816f0225211\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " Jul 17 17:51:14.867577 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.867514 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f746ad0f-5018-420f-8fc8-6816f0225211-trusted-ca\") pod \"f746ad0f-5018-420f-8fc8-6816f0225211\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " Jul 17 17:51:14.867795 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.867597 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f746ad0f-5018-420f-8fc8-6816f0225211-installation-pull-secrets\") pod \"f746ad0f-5018-420f-8fc8-6816f0225211\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " Jul 17 17:51:14.867795 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.867650 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-registry-tls\") pod \"f746ad0f-5018-420f-8fc8-6816f0225211\" (UID: \"f746ad0f-5018-420f-8fc8-6816f0225211\") " Jul 17 17:51:14.867910 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.867887 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f746ad0f-5018-420f-8fc8-6816f0225211-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f746ad0f-5018-420f-8fc8-6816f0225211" (UID: "f746ad0f-5018-420f-8fc8-6816f0225211"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:51:14.868476 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.868399 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f746ad0f-5018-420f-8fc8-6816f0225211-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f746ad0f-5018-420f-8fc8-6816f0225211" (UID: "f746ad0f-5018-420f-8fc8-6816f0225211"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:51:14.870134 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.870111 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-kube-api-access-9xzqc" (OuterVolumeSpecName: "kube-api-access-9xzqc") pod "f746ad0f-5018-420f-8fc8-6816f0225211" (UID: "f746ad0f-5018-420f-8fc8-6816f0225211"). InnerVolumeSpecName "kube-api-access-9xzqc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:51:14.870305 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.870288 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f746ad0f-5018-420f-8fc8-6816f0225211" (UID: "f746ad0f-5018-420f-8fc8-6816f0225211"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:51:14.870536 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.870510 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f746ad0f-5018-420f-8fc8-6816f0225211-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f746ad0f-5018-420f-8fc8-6816f0225211" (UID: "f746ad0f-5018-420f-8fc8-6816f0225211"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:51:14.870629 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.870593 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f746ad0f-5018-420f-8fc8-6816f0225211-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f746ad0f-5018-420f-8fc8-6816f0225211" (UID: "f746ad0f-5018-420f-8fc8-6816f0225211"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:51:14.870804 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.870789 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f746ad0f-5018-420f-8fc8-6816f0225211" (UID: "f746ad0f-5018-420f-8fc8-6816f0225211"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:51:14.876935 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.876914 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f746ad0f-5018-420f-8fc8-6816f0225211-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f746ad0f-5018-420f-8fc8-6816f0225211" (UID: "f746ad0f-5018-420f-8fc8-6816f0225211"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:51:14.969365 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.969330 2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f746ad0f-5018-420f-8fc8-6816f0225211-registry-certificates\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:51:14.969365 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.969369 2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f746ad0f-5018-420f-8fc8-6816f0225211-image-registry-private-configuration\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:51:14.969577 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.969383 2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f746ad0f-5018-420f-8fc8-6816f0225211-ca-trust-extracted\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:51:14.969577 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.969398 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xzqc\" (UniqueName: \"kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-kube-api-access-9xzqc\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:51:14.969577 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.969413 2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-bound-sa-token\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:51:14.969577 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.969426 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f746ad0f-5018-420f-8fc8-6816f0225211-trusted-ca\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:51:14.969577 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.969448 2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f746ad0f-5018-420f-8fc8-6816f0225211-installation-pull-secrets\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:51:14.969577 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:14.969462 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f746ad0f-5018-420f-8fc8-6816f0225211-registry-tls\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:51:15.144414 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:15.144386 2580 generic.go:356] "Generic (PLEG): container finished" podID="f746ad0f-5018-420f-8fc8-6816f0225211" containerID="46d8a1d5b1f98ecb431948c5d68b14a0cd31916097ca923cfb3dee2c615e6520" exitCode=0 Jul 17 17:51:15.144835 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:15.144435 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" Jul 17 17:51:15.144835 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:15.144490 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" event={"ID":"f746ad0f-5018-420f-8fc8-6816f0225211","Type":"ContainerDied","Data":"46d8a1d5b1f98ecb431948c5d68b14a0cd31916097ca923cfb3dee2c615e6520"} Jul 17 17:51:15.144835 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:15.144568 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b9b7fb9b-v58vp" event={"ID":"f746ad0f-5018-420f-8fc8-6816f0225211","Type":"ContainerDied","Data":"47f6b8a67658504e2f40ab79bbae7f79af3373d71fad3de892c52d40f2241baa"} Jul 17 17:51:15.144835 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:15.144595 2580 scope.go:117] "RemoveContainer" containerID="46d8a1d5b1f98ecb431948c5d68b14a0cd31916097ca923cfb3dee2c615e6520" Jul 17 17:51:15.146477 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:15.146456 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-5d5xw" event={"ID":"960e1622-2795-40a6-bb03-eaf54f315d96","Type":"ContainerStarted","Data":"e68081232c2c08345bd91d9f73f60d4f7e10ed2b18fcf34684ae97f1828df87a"} Jul 17 17:51:15.153170 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:15.153152 2580 scope.go:117] "RemoveContainer" containerID="46d8a1d5b1f98ecb431948c5d68b14a0cd31916097ca923cfb3dee2c615e6520" Jul 17 17:51:15.153417 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:51:15.153399 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46d8a1d5b1f98ecb431948c5d68b14a0cd31916097ca923cfb3dee2c615e6520\": container with ID starting with 46d8a1d5b1f98ecb431948c5d68b14a0cd31916097ca923cfb3dee2c615e6520 not found: ID does not exist" containerID="46d8a1d5b1f98ecb431948c5d68b14a0cd31916097ca923cfb3dee2c615e6520" Jul 17 17:51:15.153493 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:15.153423 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46d8a1d5b1f98ecb431948c5d68b14a0cd31916097ca923cfb3dee2c615e6520"} err="failed to get container status \"46d8a1d5b1f98ecb431948c5d68b14a0cd31916097ca923cfb3dee2c615e6520\": rpc error: code = NotFound desc = could not find container \"46d8a1d5b1f98ecb431948c5d68b14a0cd31916097ca923cfb3dee2c615e6520\": container with ID starting with 46d8a1d5b1f98ecb431948c5d68b14a0cd31916097ca923cfb3dee2c615e6520 not found: ID does not exist" Jul 17 17:51:15.179797 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:15.179761 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b9b7fb9b-v58vp"] Jul 17 17:51:15.185857 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:15.185828 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7b9b7fb9b-v58vp"] Jul 17 17:51:15.482808 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:15.482731 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f746ad0f-5018-420f-8fc8-6816f0225211" path="/var/lib/kubelet/pods/f746ad0f-5018-420f-8fc8-6816f0225211/volumes" Jul 17 17:51:19.524185 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:19.524148 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:51:19.524667 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:19.524212 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:51:19.528997 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:19.528974 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:51:20.171074 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:20.171048 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:51:20.216843 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:20.216808 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f4dfff9bd-f9zrg"] Jul 17 17:51:24.183678 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:24.183643 2580 generic.go:356] "Generic (PLEG): container finished" podID="4b3db565-1f0f-4487-a819-653eb100b9dc" containerID="9169ae73955295be24c43a0d308706c178e3dcf9dbfccffca427937188a9bc94" exitCode=0 Jul 17 17:51:24.184129 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:24.183717 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4khbn" event={"ID":"4b3db565-1f0f-4487-a819-653eb100b9dc","Type":"ContainerDied","Data":"9169ae73955295be24c43a0d308706c178e3dcf9dbfccffca427937188a9bc94"} Jul 17 17:51:24.184129 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:24.184060 2580 scope.go:117] "RemoveContainer" containerID="9169ae73955295be24c43a0d308706c178e3dcf9dbfccffca427937188a9bc94" Jul 17 17:51:25.190099 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:25.190070 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4khbn" event={"ID":"4b3db565-1f0f-4487-a819-653eb100b9dc","Type":"ContainerStarted","Data":"43d5a697e410274bd442024a439242cc6000e0d569cd7a8407e0f3627a4b192b"} Jul 17 17:51:45.239538 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:45.239473 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f4dfff9bd-f9zrg" podUID="cc4f4331-228f-4fae-8c61-46044c9d0423" containerName="console" containerID="cri-o://41616e7872f1fac1a75e7cd5b3213ba7415aeb22223aa4242ba336d177056506" gracePeriod=15 Jul 17 17:51:45.480101 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:45.480077 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:51:45.494207 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:45.494156 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rscxl\" (UniqueName: \"kubernetes.io/projected/cc4f4331-228f-4fae-8c61-46044c9d0423-kube-api-access-rscxl\") pod \"cc4f4331-228f-4fae-8c61-46044c9d0423\" (UID: \"cc4f4331-228f-4fae-8c61-46044c9d0423\") " Jul 17 17:51:45.494207 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:45.494185 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc4f4331-228f-4fae-8c61-46044c9d0423-service-ca\") pod \"cc4f4331-228f-4fae-8c61-46044c9d0423\" (UID: \"cc4f4331-228f-4fae-8c61-46044c9d0423\") " Jul 17 17:51:45.494333 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:45.494236 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc4f4331-228f-4fae-8c61-46044c9d0423-console-serving-cert\") pod \"cc4f4331-228f-4fae-8c61-46044c9d0423\" (UID: \"cc4f4331-228f-4fae-8c61-46044c9d0423\") " Jul 17 17:51:45.494333 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:45.494274 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc4f4331-228f-4fae-8c61-46044c9d0423-oauth-serving-cert\") pod \"cc4f4331-228f-4fae-8c61-46044c9d0423\" (UID: \"cc4f4331-228f-4fae-8c61-46044c9d0423\") " Jul 17 17:51:45.494333 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:45.494301 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc4f4331-228f-4fae-8c61-46044c9d0423-console-config\") pod \"cc4f4331-228f-4fae-8c61-46044c9d0423\" (UID: \"cc4f4331-228f-4fae-8c61-46044c9d0423\") " Jul 17 17:51:45.494333 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:45.494328 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc4f4331-228f-4fae-8c61-46044c9d0423-trusted-ca-bundle\") pod \"cc4f4331-228f-4fae-8c61-46044c9d0423\" (UID: \"cc4f4331-228f-4fae-8c61-46044c9d0423\") " Jul 17 17:51:45.494530 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:45.494406 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc4f4331-228f-4fae-8c61-46044c9d0423-console-oauth-config\") pod \"cc4f4331-228f-4fae-8c61-46044c9d0423\" (UID: \"cc4f4331-228f-4fae-8c61-46044c9d0423\") " Jul 17 17:51:45.494786 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:45.494662 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc4f4331-228f-4fae-8c61-46044c9d0423-service-ca" (OuterVolumeSpecName: "service-ca") pod "cc4f4331-228f-4fae-8c61-46044c9d0423" (UID: "cc4f4331-228f-4fae-8c61-46044c9d0423"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:51:45.494786 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:45.494768 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc4f4331-228f-4fae-8c61-46044c9d0423-console-config" (OuterVolumeSpecName: "console-config") pod "cc4f4331-228f-4fae-8c61-46044c9d0423" (UID: "cc4f4331-228f-4fae-8c61-46044c9d0423"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:51:45.494786 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:45.494666 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc4f4331-228f-4fae-8c61-46044c9d0423-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cc4f4331-228f-4fae-8c61-46044c9d0423" (UID: "cc4f4331-228f-4fae-8c61-46044c9d0423"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:51:45.495184 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:45.494860 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc4f4331-228f-4fae-8c61-46044c9d0423-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cc4f4331-228f-4fae-8c61-46044c9d0423" (UID: "cc4f4331-228f-4fae-8c61-46044c9d0423"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:51:45.496539 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:45.496513 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc4f4331-228f-4fae-8c61-46044c9d0423-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cc4f4331-228f-4fae-8c61-46044c9d0423" (UID: "cc4f4331-228f-4fae-8c61-46044c9d0423"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:51:45.496638 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:45.496561 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc4f4331-228f-4fae-8c61-46044c9d0423-kube-api-access-rscxl" (OuterVolumeSpecName: "kube-api-access-rscxl") pod "cc4f4331-228f-4fae-8c61-46044c9d0423" (UID: "cc4f4331-228f-4fae-8c61-46044c9d0423"). InnerVolumeSpecName "kube-api-access-rscxl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:51:45.496702 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:45.496667 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc4f4331-228f-4fae-8c61-46044c9d0423-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cc4f4331-228f-4fae-8c61-46044c9d0423" (UID: "cc4f4331-228f-4fae-8c61-46044c9d0423"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:51:45.595105 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:45.595078 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rscxl\" (UniqueName: \"kubernetes.io/projected/cc4f4331-228f-4fae-8c61-46044c9d0423-kube-api-access-rscxl\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:51:45.595105 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:45.595106 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc4f4331-228f-4fae-8c61-46044c9d0423-service-ca\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:51:45.595264 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:45.595115 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc4f4331-228f-4fae-8c61-46044c9d0423-console-serving-cert\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:51:45.595264 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:45.595124 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc4f4331-228f-4fae-8c61-46044c9d0423-oauth-serving-cert\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:51:45.595264 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:45.595132 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc4f4331-228f-4fae-8c61-46044c9d0423-console-config\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:51:45.595264 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:45.595141 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc4f4331-228f-4fae-8c61-46044c9d0423-trusted-ca-bundle\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:51:45.595264 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:45.595149 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc4f4331-228f-4fae-8c61-46044c9d0423-console-oauth-config\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:51:46.278883 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:46.278849 2580 generic.go:356] "Generic (PLEG): container finished" podID="cc4f4331-228f-4fae-8c61-46044c9d0423" containerID="41616e7872f1fac1a75e7cd5b3213ba7415aeb22223aa4242ba336d177056506" exitCode=0 Jul 17 17:51:46.279305 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:46.278894 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4dfff9bd-f9zrg" Jul 17 17:51:46.279305 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:46.278912 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4dfff9bd-f9zrg" event={"ID":"cc4f4331-228f-4fae-8c61-46044c9d0423","Type":"ContainerDied","Data":"41616e7872f1fac1a75e7cd5b3213ba7415aeb22223aa4242ba336d177056506"} Jul 17 17:51:46.279305 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:46.278980 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4dfff9bd-f9zrg" event={"ID":"cc4f4331-228f-4fae-8c61-46044c9d0423","Type":"ContainerDied","Data":"6f19a4719b4b4371cd0c05a8ae220042c63b9d201c0ad3f17de139502e8d7c0e"} Jul 17 17:51:46.279305 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:46.279007 2580 scope.go:117] "RemoveContainer" containerID="41616e7872f1fac1a75e7cd5b3213ba7415aeb22223aa4242ba336d177056506" Jul 17 17:51:46.287597 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:46.287578 2580 scope.go:117] "RemoveContainer" containerID="41616e7872f1fac1a75e7cd5b3213ba7415aeb22223aa4242ba336d177056506" Jul 17 17:51:46.287867 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:51:46.287850 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41616e7872f1fac1a75e7cd5b3213ba7415aeb22223aa4242ba336d177056506\": container with ID starting with 41616e7872f1fac1a75e7cd5b3213ba7415aeb22223aa4242ba336d177056506 not found: ID does not exist" containerID="41616e7872f1fac1a75e7cd5b3213ba7415aeb22223aa4242ba336d177056506" Jul 17 17:51:46.287923 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:46.287877 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41616e7872f1fac1a75e7cd5b3213ba7415aeb22223aa4242ba336d177056506"} err="failed to get container status \"41616e7872f1fac1a75e7cd5b3213ba7415aeb22223aa4242ba336d177056506\": rpc error: code = NotFound desc = could not find container \"41616e7872f1fac1a75e7cd5b3213ba7415aeb22223aa4242ba336d177056506\": container with ID starting with 41616e7872f1fac1a75e7cd5b3213ba7415aeb22223aa4242ba336d177056506 not found: ID does not exist" Jul 17 17:51:46.298451 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:46.298431 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f4dfff9bd-f9zrg"] Jul 17 17:51:46.302092 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:46.302073 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f4dfff9bd-f9zrg"] Jul 17 17:51:47.483322 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:51:47.483288 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc4f4331-228f-4fae-8c61-46044c9d0423" path="/var/lib/kubelet/pods/cc4f4331-228f-4fae-8c61-46044c9d0423/volumes" Jul 17 17:52:06.844218 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:06.844145 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-556cccc675-vhwbs"] Jul 17 17:52:06.844716 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:06.844480 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc4f4331-228f-4fae-8c61-46044c9d0423" containerName="console" Jul 17 17:52:06.844716 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:06.844495 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc4f4331-228f-4fae-8c61-46044c9d0423" containerName="console" Jul 17 17:52:06.844716 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:06.844510 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f746ad0f-5018-420f-8fc8-6816f0225211" containerName="registry" Jul 17 17:52:06.844716 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:06.844517 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f746ad0f-5018-420f-8fc8-6816f0225211" containerName="registry" Jul 17 17:52:06.844716 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:06.844591 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f746ad0f-5018-420f-8fc8-6816f0225211" containerName="registry" Jul 17 17:52:06.844716 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:06.844603 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc4f4331-228f-4fae-8c61-46044c9d0423" containerName="console" Jul 17 17:52:06.847867 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:06.847840 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:52:06.861346 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:06.861319 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-556cccc675-vhwbs"] Jul 17 17:52:06.948835 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:06.948804 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d5fae60-0776-497b-9bd3-c6ace0481494-trusted-ca-bundle\") pod \"console-556cccc675-vhwbs\" (UID: \"7d5fae60-0776-497b-9bd3-c6ace0481494\") " pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:52:06.948982 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:06.948841 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d5fae60-0776-497b-9bd3-c6ace0481494-oauth-serving-cert\") pod \"console-556cccc675-vhwbs\" (UID: \"7d5fae60-0776-497b-9bd3-c6ace0481494\") " pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:52:06.948982 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:06.948861 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d5fae60-0776-497b-9bd3-c6ace0481494-console-config\") pod \"console-556cccc675-vhwbs\" (UID: \"7d5fae60-0776-497b-9bd3-c6ace0481494\") " pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:52:06.948982 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:06.948950 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d5fae60-0776-497b-9bd3-c6ace0481494-console-oauth-config\") pod \"console-556cccc675-vhwbs\" (UID: \"7d5fae60-0776-497b-9bd3-c6ace0481494\") " pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:52:06.948982 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:06.948980 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6f5q\" (UniqueName: \"kubernetes.io/projected/7d5fae60-0776-497b-9bd3-c6ace0481494-kube-api-access-b6f5q\") pod \"console-556cccc675-vhwbs\" (UID: \"7d5fae60-0776-497b-9bd3-c6ace0481494\") " pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:52:06.949111 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:06.949016 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d5fae60-0776-497b-9bd3-c6ace0481494-console-serving-cert\") pod \"console-556cccc675-vhwbs\" (UID: \"7d5fae60-0776-497b-9bd3-c6ace0481494\") " pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:52:06.949111 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:06.949040 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d5fae60-0776-497b-9bd3-c6ace0481494-service-ca\") pod \"console-556cccc675-vhwbs\" (UID: \"7d5fae60-0776-497b-9bd3-c6ace0481494\") " pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:52:07.049805 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:07.049744 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d5fae60-0776-497b-9bd3-c6ace0481494-console-serving-cert\") pod \"console-556cccc675-vhwbs\" (UID: \"7d5fae60-0776-497b-9bd3-c6ace0481494\") " pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:52:07.049983 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:07.049821 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d5fae60-0776-497b-9bd3-c6ace0481494-service-ca\") pod \"console-556cccc675-vhwbs\" (UID: \"7d5fae60-0776-497b-9bd3-c6ace0481494\") " pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:52:07.049983 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:07.049857 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d5fae60-0776-497b-9bd3-c6ace0481494-trusted-ca-bundle\") pod \"console-556cccc675-vhwbs\" (UID: \"7d5fae60-0776-497b-9bd3-c6ace0481494\") " pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:52:07.049983 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:07.049886 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d5fae60-0776-497b-9bd3-c6ace0481494-oauth-serving-cert\") pod \"console-556cccc675-vhwbs\" (UID: \"7d5fae60-0776-497b-9bd3-c6ace0481494\") " pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:52:07.049983 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:07.049908 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d5fae60-0776-497b-9bd3-c6ace0481494-console-config\") pod \"console-556cccc675-vhwbs\" (UID: \"7d5fae60-0776-497b-9bd3-c6ace0481494\") " pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:52:07.049983 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:07.049958 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d5fae60-0776-497b-9bd3-c6ace0481494-console-oauth-config\") pod \"console-556cccc675-vhwbs\" (UID: \"7d5fae60-0776-497b-9bd3-c6ace0481494\") " pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:52:07.050221 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:07.049986 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6f5q\" (UniqueName: \"kubernetes.io/projected/7d5fae60-0776-497b-9bd3-c6ace0481494-kube-api-access-b6f5q\") pod \"console-556cccc675-vhwbs\" (UID: \"7d5fae60-0776-497b-9bd3-c6ace0481494\") " pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:52:07.050700 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:07.050630 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d5fae60-0776-497b-9bd3-c6ace0481494-service-ca\") pod \"console-556cccc675-vhwbs\" (UID: \"7d5fae60-0776-497b-9bd3-c6ace0481494\") " pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:52:07.050700 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:07.050630 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d5fae60-0776-497b-9bd3-c6ace0481494-oauth-serving-cert\") pod \"console-556cccc675-vhwbs\" (UID: \"7d5fae60-0776-497b-9bd3-c6ace0481494\") " pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:52:07.050700 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:07.050712 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d5fae60-0776-497b-9bd3-c6ace0481494-console-config\") pod \"console-556cccc675-vhwbs\" (UID: \"7d5fae60-0776-497b-9bd3-c6ace0481494\") " pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:52:07.051045 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:07.050800 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d5fae60-0776-497b-9bd3-c6ace0481494-trusted-ca-bundle\") pod \"console-556cccc675-vhwbs\" (UID: \"7d5fae60-0776-497b-9bd3-c6ace0481494\") " pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:52:07.052384 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:07.052361 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d5fae60-0776-497b-9bd3-c6ace0481494-console-serving-cert\") pod \"console-556cccc675-vhwbs\" (UID: \"7d5fae60-0776-497b-9bd3-c6ace0481494\") " pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:52:07.052481 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:07.052464 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d5fae60-0776-497b-9bd3-c6ace0481494-console-oauth-config\") pod \"console-556cccc675-vhwbs\" (UID: \"7d5fae60-0776-497b-9bd3-c6ace0481494\") " pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:52:07.057799 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:07.057778 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6f5q\" (UniqueName: \"kubernetes.io/projected/7d5fae60-0776-497b-9bd3-c6ace0481494-kube-api-access-b6f5q\") pod \"console-556cccc675-vhwbs\" (UID: \"7d5fae60-0776-497b-9bd3-c6ace0481494\") " pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:52:07.159001 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:07.158926 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:52:07.288988 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:07.288957 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-556cccc675-vhwbs"] Jul 17 17:52:07.292317 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:52:07.292280 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d5fae60_0776_497b_9bd3_c6ace0481494.slice/crio-c8ddd845052dcb0b7d5ae96d75c22115b83cd1ec2c41f2951495ec4fbe359250 WatchSource:0}: Error finding container c8ddd845052dcb0b7d5ae96d75c22115b83cd1ec2c41f2951495ec4fbe359250: Status 404 returned error can't find the container with id c8ddd845052dcb0b7d5ae96d75c22115b83cd1ec2c41f2951495ec4fbe359250 Jul 17 17:52:07.359432 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:07.359401 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-556cccc675-vhwbs" event={"ID":"7d5fae60-0776-497b-9bd3-c6ace0481494","Type":"ContainerStarted","Data":"3be117a20c83067d3357fb7ee1e08efe01b1879d7b53e5ae82f94669ecc02a04"} Jul 17 17:52:07.359544 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:07.359460 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-556cccc675-vhwbs" event={"ID":"7d5fae60-0776-497b-9bd3-c6ace0481494","Type":"ContainerStarted","Data":"c8ddd845052dcb0b7d5ae96d75c22115b83cd1ec2c41f2951495ec4fbe359250"} Jul 17 17:52:07.376937 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:07.376895 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-556cccc675-vhwbs" podStartSLOduration=1.376879811 podStartE2EDuration="1.376879811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:52:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:52:07.376855445 +0000 UTC m=+174.364071811" watchObservedRunningTime="2026-07-17 17:52:07.376879811 +0000 UTC m=+174.364096161" Jul 17 17:52:17.159843 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:17.159799 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:52:17.160277 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:17.160065 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:52:17.164715 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:17.164698 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:52:17.399099 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:17.399069 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:52:17.444521 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:17.444456 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79964dbccb-kh5qq"] Jul 17 17:52:42.473406 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:42.473336 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-79964dbccb-kh5qq" podUID="4bb08b65-4e91-4005-a379-d3be6d57f95e" containerName="console" containerID="cri-o://50194fd8f9e34209e8776886686961ddfd9fe6965367560cff10e9db0043dc48" gracePeriod=15 Jul 17 17:52:42.728245 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:42.728191 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:52:42.823077 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:42.823048 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9lc2\" (UniqueName: \"kubernetes.io/projected/4bb08b65-4e91-4005-a379-d3be6d57f95e-kube-api-access-h9lc2\") pod \"4bb08b65-4e91-4005-a379-d3be6d57f95e\" (UID: \"4bb08b65-4e91-4005-a379-d3be6d57f95e\") " Jul 17 17:52:42.823226 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:42.823107 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4bb08b65-4e91-4005-a379-d3be6d57f95e-service-ca\") pod \"4bb08b65-4e91-4005-a379-d3be6d57f95e\" (UID: \"4bb08b65-4e91-4005-a379-d3be6d57f95e\") " Jul 17 17:52:42.823226 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:42.823127 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4bb08b65-4e91-4005-a379-d3be6d57f95e-oauth-serving-cert\") pod \"4bb08b65-4e91-4005-a379-d3be6d57f95e\" (UID: \"4bb08b65-4e91-4005-a379-d3be6d57f95e\") " Jul 17 17:52:42.823226 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:42.823152 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bb08b65-4e91-4005-a379-d3be6d57f95e-trusted-ca-bundle\") pod \"4bb08b65-4e91-4005-a379-d3be6d57f95e\" (UID: \"4bb08b65-4e91-4005-a379-d3be6d57f95e\") " Jul 17 17:52:42.823226 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:42.823170 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4bb08b65-4e91-4005-a379-d3be6d57f95e-console-serving-cert\") pod \"4bb08b65-4e91-4005-a379-d3be6d57f95e\" (UID: \"4bb08b65-4e91-4005-a379-d3be6d57f95e\") " Jul 17 17:52:42.823226 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:42.823183 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4bb08b65-4e91-4005-a379-d3be6d57f95e-console-config\") pod \"4bb08b65-4e91-4005-a379-d3be6d57f95e\" (UID: \"4bb08b65-4e91-4005-a379-d3be6d57f95e\") " Jul 17 17:52:42.823226 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:42.823213 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4bb08b65-4e91-4005-a379-d3be6d57f95e-console-oauth-config\") pod \"4bb08b65-4e91-4005-a379-d3be6d57f95e\" (UID: \"4bb08b65-4e91-4005-a379-d3be6d57f95e\") " Jul 17 17:52:42.823662 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:42.823630 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bb08b65-4e91-4005-a379-d3be6d57f95e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4bb08b65-4e91-4005-a379-d3be6d57f95e" (UID: "4bb08b65-4e91-4005-a379-d3be6d57f95e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:52:42.823662 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:42.823640 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bb08b65-4e91-4005-a379-d3be6d57f95e-console-config" (OuterVolumeSpecName: "console-config") pod "4bb08b65-4e91-4005-a379-d3be6d57f95e" (UID: "4bb08b65-4e91-4005-a379-d3be6d57f95e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:52:42.823833 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:42.823646 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bb08b65-4e91-4005-a379-d3be6d57f95e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4bb08b65-4e91-4005-a379-d3be6d57f95e" (UID: "4bb08b65-4e91-4005-a379-d3be6d57f95e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:52:42.823833 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:42.823671 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bb08b65-4e91-4005-a379-d3be6d57f95e-service-ca" (OuterVolumeSpecName: "service-ca") pod "4bb08b65-4e91-4005-a379-d3be6d57f95e" (UID: "4bb08b65-4e91-4005-a379-d3be6d57f95e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:52:42.825327 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:42.825306 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bb08b65-4e91-4005-a379-d3be6d57f95e-kube-api-access-h9lc2" (OuterVolumeSpecName: "kube-api-access-h9lc2") pod "4bb08b65-4e91-4005-a379-d3be6d57f95e" (UID: "4bb08b65-4e91-4005-a379-d3be6d57f95e"). InnerVolumeSpecName "kube-api-access-h9lc2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:52:42.825432 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:42.825411 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bb08b65-4e91-4005-a379-d3be6d57f95e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4bb08b65-4e91-4005-a379-d3be6d57f95e" (UID: "4bb08b65-4e91-4005-a379-d3be6d57f95e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:52:42.825501 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:42.825430 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bb08b65-4e91-4005-a379-d3be6d57f95e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4bb08b65-4e91-4005-a379-d3be6d57f95e" (UID: "4bb08b65-4e91-4005-a379-d3be6d57f95e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:52:42.924133 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:42.924102 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9lc2\" (UniqueName: \"kubernetes.io/projected/4bb08b65-4e91-4005-a379-d3be6d57f95e-kube-api-access-h9lc2\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:52:42.924133 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:42.924127 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4bb08b65-4e91-4005-a379-d3be6d57f95e-service-ca\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:52:42.924133 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:42.924136 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4bb08b65-4e91-4005-a379-d3be6d57f95e-oauth-serving-cert\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:52:42.924336 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:42.924144 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bb08b65-4e91-4005-a379-d3be6d57f95e-trusted-ca-bundle\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:52:42.924336 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:42.924153 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4bb08b65-4e91-4005-a379-d3be6d57f95e-console-serving-cert\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:52:42.924336 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:42.924162 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4bb08b65-4e91-4005-a379-d3be6d57f95e-console-config\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:52:42.924336 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:42.924169 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4bb08b65-4e91-4005-a379-d3be6d57f95e-console-oauth-config\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:52:43.492650 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:43.492625 2580 generic.go:356] "Generic (PLEG): container finished" podID="4bb08b65-4e91-4005-a379-d3be6d57f95e" containerID="50194fd8f9e34209e8776886686961ddfd9fe6965367560cff10e9db0043dc48" exitCode=0 Jul 17 17:52:43.492979 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:43.492663 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79964dbccb-kh5qq" Jul 17 17:52:43.492979 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:43.492699 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79964dbccb-kh5qq" event={"ID":"4bb08b65-4e91-4005-a379-d3be6d57f95e","Type":"ContainerDied","Data":"50194fd8f9e34209e8776886686961ddfd9fe6965367560cff10e9db0043dc48"} Jul 17 17:52:43.492979 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:43.492734 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79964dbccb-kh5qq" event={"ID":"4bb08b65-4e91-4005-a379-d3be6d57f95e","Type":"ContainerDied","Data":"ce3d8823dfbcd7fc1023bba7b86deb90f2a8cebce027594239e3b2c7a0838a28"} Jul 17 17:52:43.492979 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:43.492767 2580 scope.go:117] "RemoveContainer" containerID="50194fd8f9e34209e8776886686961ddfd9fe6965367560cff10e9db0043dc48" Jul 17 17:52:43.500903 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:43.500885 2580 scope.go:117] "RemoveContainer" containerID="50194fd8f9e34209e8776886686961ddfd9fe6965367560cff10e9db0043dc48" Jul 17 17:52:43.501142 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:52:43.501125 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50194fd8f9e34209e8776886686961ddfd9fe6965367560cff10e9db0043dc48\": container with ID starting with 50194fd8f9e34209e8776886686961ddfd9fe6965367560cff10e9db0043dc48 not found: ID does not exist" containerID="50194fd8f9e34209e8776886686961ddfd9fe6965367560cff10e9db0043dc48" Jul 17 17:52:43.501204 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:43.501154 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50194fd8f9e34209e8776886686961ddfd9fe6965367560cff10e9db0043dc48"} err="failed to get container status \"50194fd8f9e34209e8776886686961ddfd9fe6965367560cff10e9db0043dc48\": rpc error: code = NotFound desc = could not find container \"50194fd8f9e34209e8776886686961ddfd9fe6965367560cff10e9db0043dc48\": container with ID starting with 50194fd8f9e34209e8776886686961ddfd9fe6965367560cff10e9db0043dc48 not found: ID does not exist" Jul 17 17:52:43.508548 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:43.508525 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79964dbccb-kh5qq"] Jul 17 17:52:43.512477 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:43.512457 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79964dbccb-kh5qq"] Jul 17 17:52:45.482508 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:52:45.482471 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bb08b65-4e91-4005-a379-d3be6d57f95e" path="/var/lib/kubelet/pods/4bb08b65-4e91-4005-a379-d3be6d57f95e/volumes" Jul 17 17:53:04.335600 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:04.335562 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p"] Jul 17 17:53:04.336048 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:04.335889 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bb08b65-4e91-4005-a379-d3be6d57f95e" containerName="console" Jul 17 17:53:04.336048 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:04.335901 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bb08b65-4e91-4005-a379-d3be6d57f95e" containerName="console" Jul 17 17:53:04.336048 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:04.335948 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bb08b65-4e91-4005-a379-d3be6d57f95e" containerName="console" Jul 17 17:53:04.338998 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:04.338982 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p" Jul 17 17:53:04.341722 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:04.341698 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 17 17:53:04.342822 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:04.342800 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dgc9q\"" Jul 17 17:53:04.342898 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:04.342800 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 17 17:53:04.346883 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:04.346864 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p"] Jul 17 17:53:04.482169 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:04.482142 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/392c5884-cb6f-4484-b664-e0c80dfd08ae-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p\" (UID: \"392c5884-cb6f-4484-b664-e0c80dfd08ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p" Jul 17 17:53:04.482328 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:04.482195 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbh85\" (UniqueName: \"kubernetes.io/projected/392c5884-cb6f-4484-b664-e0c80dfd08ae-kube-api-access-wbh85\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p\" (UID: \"392c5884-cb6f-4484-b664-e0c80dfd08ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p" Jul 17 17:53:04.482328 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:04.482238 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/392c5884-cb6f-4484-b664-e0c80dfd08ae-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p\" (UID: \"392c5884-cb6f-4484-b664-e0c80dfd08ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p" Jul 17 17:53:04.583038 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:04.583008 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/392c5884-cb6f-4484-b664-e0c80dfd08ae-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p\" (UID: \"392c5884-cb6f-4484-b664-e0c80dfd08ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p" Jul 17 17:53:04.583201 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:04.583073 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/392c5884-cb6f-4484-b664-e0c80dfd08ae-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p\" (UID: \"392c5884-cb6f-4484-b664-e0c80dfd08ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p" Jul 17 17:53:04.583201 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:04.583107 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbh85\" (UniqueName: \"kubernetes.io/projected/392c5884-cb6f-4484-b664-e0c80dfd08ae-kube-api-access-wbh85\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p\" (UID: \"392c5884-cb6f-4484-b664-e0c80dfd08ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p" Jul 17 17:53:04.583412 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:04.583392 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/392c5884-cb6f-4484-b664-e0c80dfd08ae-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p\" (UID: \"392c5884-cb6f-4484-b664-e0c80dfd08ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p" Jul 17 17:53:04.583479 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:04.583417 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/392c5884-cb6f-4484-b664-e0c80dfd08ae-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p\" (UID: \"392c5884-cb6f-4484-b664-e0c80dfd08ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p" Jul 17 17:53:04.592227 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:04.592173 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbh85\" (UniqueName: \"kubernetes.io/projected/392c5884-cb6f-4484-b664-e0c80dfd08ae-kube-api-access-wbh85\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p\" (UID: \"392c5884-cb6f-4484-b664-e0c80dfd08ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p" Jul 17 17:53:04.648115 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:04.648095 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p" Jul 17 17:53:04.775192 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:04.775023 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p"] Jul 17 17:53:04.777710 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:53:04.777683 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod392c5884_cb6f_4484_b664_e0c80dfd08ae.slice/crio-232ee2b2867ff2d449c27249f678649190d59589536dbacb6076c4371620d6c2 WatchSource:0}: Error finding container 232ee2b2867ff2d449c27249f678649190d59589536dbacb6076c4371620d6c2: Status 404 returned error can't find the container with id 232ee2b2867ff2d449c27249f678649190d59589536dbacb6076c4371620d6c2 Jul 17 17:53:05.578079 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:05.578044 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p" event={"ID":"392c5884-cb6f-4484-b664-e0c80dfd08ae","Type":"ContainerStarted","Data":"232ee2b2867ff2d449c27249f678649190d59589536dbacb6076c4371620d6c2"} Jul 17 17:53:11.605800 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:11.605738 2580 generic.go:356] "Generic (PLEG): container finished" podID="392c5884-cb6f-4484-b664-e0c80dfd08ae" containerID="e8de9ca3e43dabc703934d27980b092e9c25f56d14ba5e13173ea6488f7a8a00" exitCode=0 Jul 17 17:53:11.606217 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:11.605825 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p" event={"ID":"392c5884-cb6f-4484-b664-e0c80dfd08ae","Type":"ContainerDied","Data":"e8de9ca3e43dabc703934d27980b092e9c25f56d14ba5e13173ea6488f7a8a00"} Jul 17 17:53:13.614953 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:13.614916 2580 generic.go:356] "Generic (PLEG): container finished" podID="392c5884-cb6f-4484-b664-e0c80dfd08ae" containerID="3aaa352d0418a7490182894b6883d30087c451c7d095cf158d04b44d8c52b97f" exitCode=0 Jul 17 17:53:13.615281 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:13.614962 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p" event={"ID":"392c5884-cb6f-4484-b664-e0c80dfd08ae","Type":"ContainerDied","Data":"3aaa352d0418a7490182894b6883d30087c451c7d095cf158d04b44d8c52b97f"} Jul 17 17:53:21.647622 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:21.647590 2580 generic.go:356] "Generic (PLEG): container finished" podID="392c5884-cb6f-4484-b664-e0c80dfd08ae" containerID="f5229d5cfb4bcac0198c0047d6685e7afdc448eea6538f4fafbecc291b39cf77" exitCode=0 Jul 17 17:53:21.648164 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:21.647667 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p" event={"ID":"392c5884-cb6f-4484-b664-e0c80dfd08ae","Type":"ContainerDied","Data":"f5229d5cfb4bcac0198c0047d6685e7afdc448eea6538f4fafbecc291b39cf77"} Jul 17 17:53:22.774280 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:22.774256 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p" Jul 17 17:53:22.832022 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:22.831996 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/392c5884-cb6f-4484-b664-e0c80dfd08ae-util\") pod \"392c5884-cb6f-4484-b664-e0c80dfd08ae\" (UID: \"392c5884-cb6f-4484-b664-e0c80dfd08ae\") " Jul 17 17:53:22.832145 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:22.832040 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbh85\" (UniqueName: \"kubernetes.io/projected/392c5884-cb6f-4484-b664-e0c80dfd08ae-kube-api-access-wbh85\") pod \"392c5884-cb6f-4484-b664-e0c80dfd08ae\" (UID: \"392c5884-cb6f-4484-b664-e0c80dfd08ae\") " Jul 17 17:53:22.832145 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:22.832062 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/392c5884-cb6f-4484-b664-e0c80dfd08ae-bundle\") pod \"392c5884-cb6f-4484-b664-e0c80dfd08ae\" (UID: \"392c5884-cb6f-4484-b664-e0c80dfd08ae\") " Jul 17 17:53:22.832702 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:22.832673 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/392c5884-cb6f-4484-b664-e0c80dfd08ae-bundle" (OuterVolumeSpecName: "bundle") pod "392c5884-cb6f-4484-b664-e0c80dfd08ae" (UID: "392c5884-cb6f-4484-b664-e0c80dfd08ae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:53:22.834302 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:22.834270 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/392c5884-cb6f-4484-b664-e0c80dfd08ae-kube-api-access-wbh85" (OuterVolumeSpecName: "kube-api-access-wbh85") pod "392c5884-cb6f-4484-b664-e0c80dfd08ae" (UID: "392c5884-cb6f-4484-b664-e0c80dfd08ae"). InnerVolumeSpecName "kube-api-access-wbh85". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:53:22.837085 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:22.837064 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/392c5884-cb6f-4484-b664-e0c80dfd08ae-util" (OuterVolumeSpecName: "util") pod "392c5884-cb6f-4484-b664-e0c80dfd08ae" (UID: "392c5884-cb6f-4484-b664-e0c80dfd08ae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:53:22.933184 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:22.933093 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/392c5884-cb6f-4484-b664-e0c80dfd08ae-util\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:53:22.933184 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:22.933126 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbh85\" (UniqueName: \"kubernetes.io/projected/392c5884-cb6f-4484-b664-e0c80dfd08ae-kube-api-access-wbh85\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:53:22.933184 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:22.933140 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/392c5884-cb6f-4484-b664-e0c80dfd08ae-bundle\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:53:23.656179 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:23.656147 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p" event={"ID":"392c5884-cb6f-4484-b664-e0c80dfd08ae","Type":"ContainerDied","Data":"232ee2b2867ff2d449c27249f678649190d59589536dbacb6076c4371620d6c2"} Jul 17 17:53:23.656179 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:23.656172 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mxm7p" Jul 17 17:53:23.656373 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:23.656190 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="232ee2b2867ff2d449c27249f678649190d59589536dbacb6076c4371620d6c2" Jul 17 17:53:27.307519 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:27.307486 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2rhg5"] Jul 17 17:53:27.307892 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:27.307798 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="392c5884-cb6f-4484-b664-e0c80dfd08ae" containerName="pull" Jul 17 17:53:27.307892 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:27.307809 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="392c5884-cb6f-4484-b664-e0c80dfd08ae" containerName="pull" Jul 17 17:53:27.307892 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:27.307822 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="392c5884-cb6f-4484-b664-e0c80dfd08ae" containerName="util" Jul 17 17:53:27.307892 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:27.307827 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="392c5884-cb6f-4484-b664-e0c80dfd08ae" containerName="util" Jul 17 17:53:27.307892 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:27.307840 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="392c5884-cb6f-4484-b664-e0c80dfd08ae" containerName="extract" Jul 17 17:53:27.307892 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:27.307845 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="392c5884-cb6f-4484-b664-e0c80dfd08ae" containerName="extract" Jul 17 17:53:27.307892 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:27.307895 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="392c5884-cb6f-4484-b664-e0c80dfd08ae" containerName="extract" Jul 17 17:53:27.342206 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:27.342171 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2rhg5"] Jul 17 17:53:27.342348 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:27.342261 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2rhg5" Jul 17 17:53:27.345739 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:27.345718 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-cw9z7\"" Jul 17 17:53:27.345883 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:27.345761 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 17 17:53:27.345883 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:27.345792 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 17 17:53:27.466503 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:27.466476 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c17d7f5-e74b-48f4-ba63-089eb3e1ddbc-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-2rhg5\" (UID: \"6c17d7f5-e74b-48f4-ba63-089eb3e1ddbc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2rhg5" Jul 17 17:53:27.466656 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:27.466514 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg2pt\" (UniqueName: \"kubernetes.io/projected/6c17d7f5-e74b-48f4-ba63-089eb3e1ddbc-kube-api-access-vg2pt\") pod \"cert-manager-operator-controller-manager-55c444bf86-2rhg5\" (UID: \"6c17d7f5-e74b-48f4-ba63-089eb3e1ddbc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2rhg5" Jul 17 17:53:27.567040 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:27.567013 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c17d7f5-e74b-48f4-ba63-089eb3e1ddbc-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-2rhg5\" (UID: \"6c17d7f5-e74b-48f4-ba63-089eb3e1ddbc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2rhg5" Jul 17 17:53:27.567178 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:27.567054 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg2pt\" (UniqueName: \"kubernetes.io/projected/6c17d7f5-e74b-48f4-ba63-089eb3e1ddbc-kube-api-access-vg2pt\") pod \"cert-manager-operator-controller-manager-55c444bf86-2rhg5\" (UID: \"6c17d7f5-e74b-48f4-ba63-089eb3e1ddbc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2rhg5" Jul 17 17:53:27.567393 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:27.567375 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c17d7f5-e74b-48f4-ba63-089eb3e1ddbc-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-2rhg5\" (UID: \"6c17d7f5-e74b-48f4-ba63-089eb3e1ddbc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2rhg5" Jul 17 17:53:27.575473 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:27.575442 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg2pt\" (UniqueName: \"kubernetes.io/projected/6c17d7f5-e74b-48f4-ba63-089eb3e1ddbc-kube-api-access-vg2pt\") pod \"cert-manager-operator-controller-manager-55c444bf86-2rhg5\" (UID: \"6c17d7f5-e74b-48f4-ba63-089eb3e1ddbc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2rhg5" Jul 17 17:53:27.651521 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:27.651495 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2rhg5" Jul 17 17:53:27.801318 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:27.801239 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2rhg5"] Jul 17 17:53:27.803986 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:53:27.803950 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c17d7f5_e74b_48f4_ba63_089eb3e1ddbc.slice/crio-274ad94b7954e4b9553067bd2e236c7210d74d616fd34dbf7abb7c548849c1cc WatchSource:0}: Error finding container 274ad94b7954e4b9553067bd2e236c7210d74d616fd34dbf7abb7c548849c1cc: Status 404 returned error can't find the container with id 274ad94b7954e4b9553067bd2e236c7210d74d616fd34dbf7abb7c548849c1cc Jul 17 17:53:28.677454 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:28.677419 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2rhg5" event={"ID":"6c17d7f5-e74b-48f4-ba63-089eb3e1ddbc","Type":"ContainerStarted","Data":"274ad94b7954e4b9553067bd2e236c7210d74d616fd34dbf7abb7c548849c1cc"} Jul 17 17:53:30.687363 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:30.687326 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2rhg5" event={"ID":"6c17d7f5-e74b-48f4-ba63-089eb3e1ddbc","Type":"ContainerStarted","Data":"8898e787a11b6c898880060425b58ef4c47974e4857d234fa252d61228d86196"} Jul 17 17:53:30.708869 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:30.708818 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2rhg5" podStartSLOduration=1.5673662720000001 podStartE2EDuration="3.708801823s" totalImagesPullingTime="2.141435551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:53:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:53:30.706563375 +0000 UTC m=+257.693779724" watchObservedRunningTime="2026-07-17 17:53:30.708801823 +0000 UTC m=+257.696018173" Jul 17 17:53:31.644288 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:31.644260 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb"] Jul 17 17:53:31.665506 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:31.665467 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb"] Jul 17 17:53:31.665645 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:31.665576 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb" Jul 17 17:53:31.668287 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:31.668268 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dgc9q\"" Jul 17 17:53:31.668430 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:31.668269 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 17 17:53:31.669423 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:31.669405 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 17 17:53:31.697541 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:31.697515 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8878ad5f-0dff-4357-8094-05bb97c8e19b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb\" (UID: \"8878ad5f-0dff-4357-8094-05bb97c8e19b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb" Jul 17 17:53:31.697847 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:31.697546 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8878ad5f-0dff-4357-8094-05bb97c8e19b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb\" (UID: \"8878ad5f-0dff-4357-8094-05bb97c8e19b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb" Jul 17 17:53:31.697847 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:31.697580 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq5jc\" (UniqueName: \"kubernetes.io/projected/8878ad5f-0dff-4357-8094-05bb97c8e19b-kube-api-access-pq5jc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb\" (UID: \"8878ad5f-0dff-4357-8094-05bb97c8e19b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb" Jul 17 17:53:31.798560 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:31.798524 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8878ad5f-0dff-4357-8094-05bb97c8e19b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb\" (UID: \"8878ad5f-0dff-4357-8094-05bb97c8e19b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb" Jul 17 17:53:31.798560 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:31.798559 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8878ad5f-0dff-4357-8094-05bb97c8e19b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb\" (UID: \"8878ad5f-0dff-4357-8094-05bb97c8e19b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb" Jul 17 17:53:31.798824 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:31.798582 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq5jc\" (UniqueName: \"kubernetes.io/projected/8878ad5f-0dff-4357-8094-05bb97c8e19b-kube-api-access-pq5jc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb\" (UID: \"8878ad5f-0dff-4357-8094-05bb97c8e19b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb" Jul 17 17:53:31.798902 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:31.798883 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8878ad5f-0dff-4357-8094-05bb97c8e19b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb\" (UID: \"8878ad5f-0dff-4357-8094-05bb97c8e19b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb" Jul 17 17:53:31.798975 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:31.798957 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8878ad5f-0dff-4357-8094-05bb97c8e19b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb\" (UID: \"8878ad5f-0dff-4357-8094-05bb97c8e19b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb" Jul 17 17:53:31.807134 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:31.807118 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq5jc\" (UniqueName: \"kubernetes.io/projected/8878ad5f-0dff-4357-8094-05bb97c8e19b-kube-api-access-pq5jc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb\" (UID: \"8878ad5f-0dff-4357-8094-05bb97c8e19b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb" Jul 17 17:53:31.974608 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:31.974543 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb" Jul 17 17:53:32.145080 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:32.145055 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb"] Jul 17 17:53:32.147331 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:53:32.147305 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8878ad5f_0dff_4357_8094_05bb97c8e19b.slice/crio-0a0b66671d070cd667e844f92fed5c61388bed4da84e81c9a47636e05e20e25c WatchSource:0}: Error finding container 0a0b66671d070cd667e844f92fed5c61388bed4da84e81c9a47636e05e20e25c: Status 404 returned error can't find the container with id 0a0b66671d070cd667e844f92fed5c61388bed4da84e81c9a47636e05e20e25c Jul 17 17:53:32.697609 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:32.697575 2580 generic.go:356] "Generic (PLEG): container finished" podID="8878ad5f-0dff-4357-8094-05bb97c8e19b" containerID="0a36703aaab01a976fe870717a73eb5bd4a9cb717b82a5e7c2e428d75431b2d9" exitCode=0 Jul 17 17:53:32.698135 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:32.697669 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb" event={"ID":"8878ad5f-0dff-4357-8094-05bb97c8e19b","Type":"ContainerDied","Data":"0a36703aaab01a976fe870717a73eb5bd4a9cb717b82a5e7c2e428d75431b2d9"} Jul 17 17:53:32.698135 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:32.697726 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb" event={"ID":"8878ad5f-0dff-4357-8094-05bb97c8e19b","Type":"ContainerStarted","Data":"0a0b66671d070cd667e844f92fed5c61388bed4da84e81c9a47636e05e20e25c"} Jul 17 17:53:33.546278 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:33.546248 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dtqht"] Jul 17 17:53:33.556833 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:33.556804 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dtqht"] Jul 17 17:53:33.556957 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:33.556905 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dtqht" Jul 17 17:53:33.559446 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:33.559423 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 17 17:53:33.560693 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:33.560673 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 17 17:53:33.560804 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:33.560683 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-x96qz\"" Jul 17 17:53:33.610840 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:33.610814 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/634a1535-68f7-4d41-82e4-c1c22f5d1f40-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dtqht\" (UID: \"634a1535-68f7-4d41-82e4-c1c22f5d1f40\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dtqht" Jul 17 17:53:33.610956 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:33.610853 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkbg5\" (UniqueName: \"kubernetes.io/projected/634a1535-68f7-4d41-82e4-c1c22f5d1f40-kube-api-access-xkbg5\") pod \"cert-manager-cainjector-559cdd8c87-dtqht\" (UID: \"634a1535-68f7-4d41-82e4-c1c22f5d1f40\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dtqht" Jul 17 17:53:33.711814 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:33.711782 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/634a1535-68f7-4d41-82e4-c1c22f5d1f40-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dtqht\" (UID: \"634a1535-68f7-4d41-82e4-c1c22f5d1f40\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dtqht" Jul 17 17:53:33.712191 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:33.711822 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkbg5\" (UniqueName: \"kubernetes.io/projected/634a1535-68f7-4d41-82e4-c1c22f5d1f40-kube-api-access-xkbg5\") pod \"cert-manager-cainjector-559cdd8c87-dtqht\" (UID: \"634a1535-68f7-4d41-82e4-c1c22f5d1f40\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dtqht" Jul 17 17:53:33.720234 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:33.720211 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/634a1535-68f7-4d41-82e4-c1c22f5d1f40-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dtqht\" (UID: \"634a1535-68f7-4d41-82e4-c1c22f5d1f40\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dtqht" Jul 17 17:53:33.720430 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:33.720411 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkbg5\" (UniqueName: \"kubernetes.io/projected/634a1535-68f7-4d41-82e4-c1c22f5d1f40-kube-api-access-xkbg5\") pod \"cert-manager-cainjector-559cdd8c87-dtqht\" (UID: \"634a1535-68f7-4d41-82e4-c1c22f5d1f40\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dtqht" Jul 17 17:53:33.875439 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:33.875410 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dtqht" Jul 17 17:53:34.028425 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:34.028398 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dtqht"] Jul 17 17:53:34.031440 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:53:34.031411 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod634a1535_68f7_4d41_82e4_c1c22f5d1f40.slice/crio-77d9afc5d0b75ac1316d718652a229e161fee3d3bf146f0cd66e0e153277b811 WatchSource:0}: Error finding container 77d9afc5d0b75ac1316d718652a229e161fee3d3bf146f0cd66e0e153277b811: Status 404 returned error can't find the container with id 77d9afc5d0b75ac1316d718652a229e161fee3d3bf146f0cd66e0e153277b811 Jul 17 17:53:34.708402 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:34.708315 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dtqht" event={"ID":"634a1535-68f7-4d41-82e4-c1c22f5d1f40","Type":"ContainerStarted","Data":"77d9afc5d0b75ac1316d718652a229e161fee3d3bf146f0cd66e0e153277b811"} Jul 17 17:53:36.725894 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:36.725850 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dtqht" event={"ID":"634a1535-68f7-4d41-82e4-c1c22f5d1f40","Type":"ContainerStarted","Data":"de6cbab78edac64574389ca85ce7401558759562ae30ccd611fa005fdaaf976b"} Jul 17 17:53:36.742706 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:36.742657 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dtqht" podStartSLOduration=1.2763593850000001 podStartE2EDuration="3.742644026s" totalImagesPullingTime="2.466284641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:53:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:53:36.740840288 +0000 UTC m=+263.728056639" watchObservedRunningTime="2026-07-17 17:53:36.742644026 +0000 UTC m=+263.729860376" Jul 17 17:53:42.153166 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:42.153130 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-c2x9t"] Jul 17 17:53:42.155155 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:42.155138 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-c2x9t" Jul 17 17:53:42.157735 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:42.157709 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-zmmkf\"" Jul 17 17:53:42.165404 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:42.165385 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-c2x9t"] Jul 17 17:53:42.284414 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:42.284385 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tktc\" (UniqueName: \"kubernetes.io/projected/af03f084-4d18-4d64-8a52-9b37262e823e-kube-api-access-9tktc\") pod \"cert-manager-55b4d954d5-c2x9t\" (UID: \"af03f084-4d18-4d64-8a52-9b37262e823e\") " pod="cert-manager/cert-manager-55b4d954d5-c2x9t" Jul 17 17:53:42.284568 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:42.284423 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af03f084-4d18-4d64-8a52-9b37262e823e-bound-sa-token\") pod \"cert-manager-55b4d954d5-c2x9t\" (UID: \"af03f084-4d18-4d64-8a52-9b37262e823e\") " pod="cert-manager/cert-manager-55b4d954d5-c2x9t" Jul 17 17:53:42.385348 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:42.385316 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tktc\" (UniqueName: \"kubernetes.io/projected/af03f084-4d18-4d64-8a52-9b37262e823e-kube-api-access-9tktc\") pod \"cert-manager-55b4d954d5-c2x9t\" (UID: \"af03f084-4d18-4d64-8a52-9b37262e823e\") " pod="cert-manager/cert-manager-55b4d954d5-c2x9t" Jul 17 17:53:42.385509 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:42.385356 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af03f084-4d18-4d64-8a52-9b37262e823e-bound-sa-token\") pod \"cert-manager-55b4d954d5-c2x9t\" (UID: \"af03f084-4d18-4d64-8a52-9b37262e823e\") " pod="cert-manager/cert-manager-55b4d954d5-c2x9t" Jul 17 17:53:42.393601 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:42.393573 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af03f084-4d18-4d64-8a52-9b37262e823e-bound-sa-token\") pod \"cert-manager-55b4d954d5-c2x9t\" (UID: \"af03f084-4d18-4d64-8a52-9b37262e823e\") " pod="cert-manager/cert-manager-55b4d954d5-c2x9t" Jul 17 17:53:42.393715 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:42.393673 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tktc\" (UniqueName: \"kubernetes.io/projected/af03f084-4d18-4d64-8a52-9b37262e823e-kube-api-access-9tktc\") pod \"cert-manager-55b4d954d5-c2x9t\" (UID: \"af03f084-4d18-4d64-8a52-9b37262e823e\") " pod="cert-manager/cert-manager-55b4d954d5-c2x9t" Jul 17 17:53:42.464612 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:42.464538 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-c2x9t" Jul 17 17:53:42.594938 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:42.594914 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-c2x9t"] Jul 17 17:53:42.597205 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:53:42.597180 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf03f084_4d18_4d64_8a52_9b37262e823e.slice/crio-5e951d56291cb77fe70831a4f84800178358210fb7ffc15da5715889727f6a41 WatchSource:0}: Error finding container 5e951d56291cb77fe70831a4f84800178358210fb7ffc15da5715889727f6a41: Status 404 returned error can't find the container with id 5e951d56291cb77fe70831a4f84800178358210fb7ffc15da5715889727f6a41 Jul 17 17:53:42.751908 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:42.751818 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-c2x9t" event={"ID":"af03f084-4d18-4d64-8a52-9b37262e823e","Type":"ContainerStarted","Data":"165ec2c27755f8074584524cff08ec9caea3a1a142188522bb887ca82625e0e3"} Jul 17 17:53:42.751908 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:42.751864 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-c2x9t" event={"ID":"af03f084-4d18-4d64-8a52-9b37262e823e","Type":"ContainerStarted","Data":"5e951d56291cb77fe70831a4f84800178358210fb7ffc15da5715889727f6a41"} Jul 17 17:53:42.768716 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:42.768649 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-c2x9t" podStartSLOduration=0.768635367 podStartE2EDuration="768.635367ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:53:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:53:42.76739171 +0000 UTC m=+269.754608059" watchObservedRunningTime="2026-07-17 17:53:42.768635367 +0000 UTC m=+269.755851716" Jul 17 17:53:48.782691 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:48.782656 2580 generic.go:356] "Generic (PLEG): container finished" podID="8878ad5f-0dff-4357-8094-05bb97c8e19b" containerID="86d8699c3a3bb5e5f30efb2a8b46b86e7b65edc5c10a4fad43e7dcccb1cd1f7d" exitCode=0 Jul 17 17:53:48.783243 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:48.782725 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb" event={"ID":"8878ad5f-0dff-4357-8094-05bb97c8e19b","Type":"ContainerDied","Data":"86d8699c3a3bb5e5f30efb2a8b46b86e7b65edc5c10a4fad43e7dcccb1cd1f7d"} Jul 17 17:53:49.788578 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:49.788540 2580 generic.go:356] "Generic (PLEG): container finished" podID="8878ad5f-0dff-4357-8094-05bb97c8e19b" containerID="040995a033e9a8139411e8c3ed2e67d6e363dd6ec4c19a903ccc1fcebd3fcd54" exitCode=0 Jul 17 17:53:49.788957 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:49.788626 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb" event={"ID":"8878ad5f-0dff-4357-8094-05bb97c8e19b","Type":"ContainerDied","Data":"040995a033e9a8139411e8c3ed2e67d6e363dd6ec4c19a903ccc1fcebd3fcd54"} Jul 17 17:53:50.917022 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:50.916996 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb" Jul 17 17:53:51.056223 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:51.056135 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8878ad5f-0dff-4357-8094-05bb97c8e19b-bundle\") pod \"8878ad5f-0dff-4357-8094-05bb97c8e19b\" (UID: \"8878ad5f-0dff-4357-8094-05bb97c8e19b\") " Jul 17 17:53:51.056387 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:51.056245 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pq5jc\" (UniqueName: \"kubernetes.io/projected/8878ad5f-0dff-4357-8094-05bb97c8e19b-kube-api-access-pq5jc\") pod \"8878ad5f-0dff-4357-8094-05bb97c8e19b\" (UID: \"8878ad5f-0dff-4357-8094-05bb97c8e19b\") " Jul 17 17:53:51.056387 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:51.056275 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8878ad5f-0dff-4357-8094-05bb97c8e19b-util\") pod \"8878ad5f-0dff-4357-8094-05bb97c8e19b\" (UID: \"8878ad5f-0dff-4357-8094-05bb97c8e19b\") " Jul 17 17:53:51.056602 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:51.056571 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8878ad5f-0dff-4357-8094-05bb97c8e19b-bundle" (OuterVolumeSpecName: "bundle") pod "8878ad5f-0dff-4357-8094-05bb97c8e19b" (UID: "8878ad5f-0dff-4357-8094-05bb97c8e19b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:53:51.058450 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:51.058429 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8878ad5f-0dff-4357-8094-05bb97c8e19b-kube-api-access-pq5jc" (OuterVolumeSpecName: "kube-api-access-pq5jc") pod "8878ad5f-0dff-4357-8094-05bb97c8e19b" (UID: "8878ad5f-0dff-4357-8094-05bb97c8e19b"). InnerVolumeSpecName "kube-api-access-pq5jc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:53:51.060734 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:51.060710 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8878ad5f-0dff-4357-8094-05bb97c8e19b-util" (OuterVolumeSpecName: "util") pod "8878ad5f-0dff-4357-8094-05bb97c8e19b" (UID: "8878ad5f-0dff-4357-8094-05bb97c8e19b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:53:51.157135 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:51.157107 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8878ad5f-0dff-4357-8094-05bb97c8e19b-bundle\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:53:51.157135 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:51.157134 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pq5jc\" (UniqueName: \"kubernetes.io/projected/8878ad5f-0dff-4357-8094-05bb97c8e19b-kube-api-access-pq5jc\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:53:51.157276 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:51.157148 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8878ad5f-0dff-4357-8094-05bb97c8e19b-util\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:53:51.799624 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:51.799549 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb" Jul 17 17:53:51.799624 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:51.799575 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qnkb" event={"ID":"8878ad5f-0dff-4357-8094-05bb97c8e19b","Type":"ContainerDied","Data":"0a0b66671d070cd667e844f92fed5c61388bed4da84e81c9a47636e05e20e25c"} Jul 17 17:53:51.799624 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:53:51.799616 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a0b66671d070cd667e844f92fed5c61388bed4da84e81c9a47636e05e20e25c" Jul 17 17:54:01.050461 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:01.050426 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7"] Jul 17 17:54:01.050954 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:01.050721 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8878ad5f-0dff-4357-8094-05bb97c8e19b" containerName="pull" Jul 17 17:54:01.050954 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:01.050731 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8878ad5f-0dff-4357-8094-05bb97c8e19b" containerName="pull" Jul 17 17:54:01.050954 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:01.050761 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8878ad5f-0dff-4357-8094-05bb97c8e19b" containerName="util" Jul 17 17:54:01.050954 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:01.050767 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8878ad5f-0dff-4357-8094-05bb97c8e19b" containerName="util" Jul 17 17:54:01.050954 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:01.050778 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8878ad5f-0dff-4357-8094-05bb97c8e19b" containerName="extract" Jul 17 17:54:01.050954 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:01.050784 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8878ad5f-0dff-4357-8094-05bb97c8e19b" containerName="extract" Jul 17 17:54:01.050954 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:01.050839 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8878ad5f-0dff-4357-8094-05bb97c8e19b" containerName="extract" Jul 17 17:54:01.056435 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:01.056418 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7" Jul 17 17:54:01.059408 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:01.059383 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 17 17:54:01.059408 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:01.059401 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dgc9q\"" Jul 17 17:54:01.060453 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:01.060435 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 17 17:54:01.062936 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:01.062916 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7"] Jul 17 17:54:01.242606 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:01.242567 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7d91b0f-71c5-42fc-b5f9-841fb914e7a9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7\" (UID: \"b7d91b0f-71c5-42fc-b5f9-841fb914e7a9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7" Jul 17 17:54:01.242797 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:01.242639 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7d91b0f-71c5-42fc-b5f9-841fb914e7a9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7\" (UID: \"b7d91b0f-71c5-42fc-b5f9-841fb914e7a9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7" Jul 17 17:54:01.242797 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:01.242668 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g758\" (UniqueName: \"kubernetes.io/projected/b7d91b0f-71c5-42fc-b5f9-841fb914e7a9-kube-api-access-7g758\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7\" (UID: \"b7d91b0f-71c5-42fc-b5f9-841fb914e7a9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7" Jul 17 17:54:01.343639 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:01.343602 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7d91b0f-71c5-42fc-b5f9-841fb914e7a9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7\" (UID: \"b7d91b0f-71c5-42fc-b5f9-841fb914e7a9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7" Jul 17 17:54:01.343830 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:01.343665 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7d91b0f-71c5-42fc-b5f9-841fb914e7a9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7\" (UID: \"b7d91b0f-71c5-42fc-b5f9-841fb914e7a9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7" Jul 17 17:54:01.343830 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:01.343688 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g758\" (UniqueName: \"kubernetes.io/projected/b7d91b0f-71c5-42fc-b5f9-841fb914e7a9-kube-api-access-7g758\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7\" (UID: \"b7d91b0f-71c5-42fc-b5f9-841fb914e7a9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7" Jul 17 17:54:01.344065 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:01.343988 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7d91b0f-71c5-42fc-b5f9-841fb914e7a9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7\" (UID: \"b7d91b0f-71c5-42fc-b5f9-841fb914e7a9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7" Jul 17 17:54:01.344065 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:01.344035 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7d91b0f-71c5-42fc-b5f9-841fb914e7a9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7\" (UID: \"b7d91b0f-71c5-42fc-b5f9-841fb914e7a9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7" Jul 17 17:54:01.351404 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:01.351378 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g758\" (UniqueName: \"kubernetes.io/projected/b7d91b0f-71c5-42fc-b5f9-841fb914e7a9-kube-api-access-7g758\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7\" (UID: \"b7d91b0f-71c5-42fc-b5f9-841fb914e7a9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7" Jul 17 17:54:01.366392 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:01.366373 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7" Jul 17 17:54:01.497602 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:01.497580 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7"] Jul 17 17:54:01.499585 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:54:01.499561 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7d91b0f_71c5_42fc_b5f9_841fb914e7a9.slice/crio-f13988a31a61dc488b00df45821eb0675b1e61b5a7038e23a314b1a9be9c4eb2 WatchSource:0}: Error finding container f13988a31a61dc488b00df45821eb0675b1e61b5a7038e23a314b1a9be9c4eb2: Status 404 returned error can't find the container with id f13988a31a61dc488b00df45821eb0675b1e61b5a7038e23a314b1a9be9c4eb2 Jul 17 17:54:01.843806 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:01.843744 2580 generic.go:356] "Generic (PLEG): container finished" podID="b7d91b0f-71c5-42fc-b5f9-841fb914e7a9" containerID="fe4e5779997ba33bc606d6a9055329c6b50fedb1af12eedbcc03d9f4f7eff8b2" exitCode=0 Jul 17 17:54:01.843806 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:01.843809 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7" event={"ID":"b7d91b0f-71c5-42fc-b5f9-841fb914e7a9","Type":"ContainerDied","Data":"fe4e5779997ba33bc606d6a9055329c6b50fedb1af12eedbcc03d9f4f7eff8b2"} Jul 17 17:54:01.844004 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:01.843875 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7" event={"ID":"b7d91b0f-71c5-42fc-b5f9-841fb914e7a9","Type":"ContainerStarted","Data":"f13988a31a61dc488b00df45821eb0675b1e61b5a7038e23a314b1a9be9c4eb2"} Jul 17 17:54:02.850506 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:02.850471 2580 generic.go:356] "Generic (PLEG): container finished" podID="b7d91b0f-71c5-42fc-b5f9-841fb914e7a9" containerID="6982e3ebcb10a1063878b28d10cdfca22f1afa703efd7e730286f0dfaaff1180" exitCode=0 Jul 17 17:54:02.850905 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:02.850516 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7" event={"ID":"b7d91b0f-71c5-42fc-b5f9-841fb914e7a9","Type":"ContainerDied","Data":"6982e3ebcb10a1063878b28d10cdfca22f1afa703efd7e730286f0dfaaff1180"} Jul 17 17:54:03.857251 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:03.857220 2580 generic.go:356] "Generic (PLEG): container finished" podID="b7d91b0f-71c5-42fc-b5f9-841fb914e7a9" containerID="6290a20600af538a7c5bce858c16a9aa59050fdc761136f0c1a7bd797eeb0b76" exitCode=0 Jul 17 17:54:03.857631 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:03.857298 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7" event={"ID":"b7d91b0f-71c5-42fc-b5f9-841fb914e7a9","Type":"ContainerDied","Data":"6290a20600af538a7c5bce858c16a9aa59050fdc761136f0c1a7bd797eeb0b76"} Jul 17 17:54:04.989886 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:04.989862 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7" Jul 17 17:54:05.080592 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.080565 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7d91b0f-71c5-42fc-b5f9-841fb914e7a9-bundle\") pod \"b7d91b0f-71c5-42fc-b5f9-841fb914e7a9\" (UID: \"b7d91b0f-71c5-42fc-b5f9-841fb914e7a9\") " Jul 17 17:54:05.080773 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.080601 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7d91b0f-71c5-42fc-b5f9-841fb914e7a9-util\") pod \"b7d91b0f-71c5-42fc-b5f9-841fb914e7a9\" (UID: \"b7d91b0f-71c5-42fc-b5f9-841fb914e7a9\") " Jul 17 17:54:05.080773 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.080633 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7g758\" (UniqueName: \"kubernetes.io/projected/b7d91b0f-71c5-42fc-b5f9-841fb914e7a9-kube-api-access-7g758\") pod \"b7d91b0f-71c5-42fc-b5f9-841fb914e7a9\" (UID: \"b7d91b0f-71c5-42fc-b5f9-841fb914e7a9\") " Jul 17 17:54:05.081381 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.081352 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7d91b0f-71c5-42fc-b5f9-841fb914e7a9-bundle" (OuterVolumeSpecName: "bundle") pod "b7d91b0f-71c5-42fc-b5f9-841fb914e7a9" (UID: "b7d91b0f-71c5-42fc-b5f9-841fb914e7a9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:54:05.082839 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.082818 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7d91b0f-71c5-42fc-b5f9-841fb914e7a9-kube-api-access-7g758" (OuterVolumeSpecName: "kube-api-access-7g758") pod "b7d91b0f-71c5-42fc-b5f9-841fb914e7a9" (UID: "b7d91b0f-71c5-42fc-b5f9-841fb914e7a9"). InnerVolumeSpecName "kube-api-access-7g758". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:54:05.087484 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.087460 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7d91b0f-71c5-42fc-b5f9-841fb914e7a9-util" (OuterVolumeSpecName: "util") pod "b7d91b0f-71c5-42fc-b5f9-841fb914e7a9" (UID: "b7d91b0f-71c5-42fc-b5f9-841fb914e7a9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:54:05.181266 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.181206 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7g758\" (UniqueName: \"kubernetes.io/projected/b7d91b0f-71c5-42fc-b5f9-841fb914e7a9-kube-api-access-7g758\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:54:05.181266 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.181230 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7d91b0f-71c5-42fc-b5f9-841fb914e7a9-bundle\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:54:05.181266 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.181239 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7d91b0f-71c5-42fc-b5f9-841fb914e7a9-util\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:54:05.505838 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.505807 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6568db77d8-t75c4"] Jul 17 17:54:05.506097 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.506086 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7d91b0f-71c5-42fc-b5f9-841fb914e7a9" containerName="extract" Jul 17 17:54:05.506139 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.506099 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7d91b0f-71c5-42fc-b5f9-841fb914e7a9" containerName="extract" Jul 17 17:54:05.506139 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.506110 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7d91b0f-71c5-42fc-b5f9-841fb914e7a9" containerName="util" Jul 17 17:54:05.506139 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.506115 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7d91b0f-71c5-42fc-b5f9-841fb914e7a9" containerName="util" Jul 17 17:54:05.506139 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.506122 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7d91b0f-71c5-42fc-b5f9-841fb914e7a9" containerName="pull" Jul 17 17:54:05.506139 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.506127 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7d91b0f-71c5-42fc-b5f9-841fb914e7a9" containerName="pull" Jul 17 17:54:05.506287 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.506174 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7d91b0f-71c5-42fc-b5f9-841fb914e7a9" containerName="extract" Jul 17 17:54:05.508971 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.508955 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6568db77d8-t75c4" Jul 17 17:54:05.511670 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.511648 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 17 17:54:05.511794 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.511688 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 17 17:54:05.511794 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.511769 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 17 17:54:05.512915 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.512890 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jzlsr\"" Jul 17 17:54:05.512986 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.512890 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 17 17:54:05.513048 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.513005 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 17 17:54:05.524708 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.524684 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6568db77d8-t75c4"] Jul 17 17:54:05.583330 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.583302 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d9bc4dff-32a6-4117-9b46-3380a2209f2b-metrics-cert\") pod \"lws-controller-manager-6568db77d8-t75c4\" (UID: \"d9bc4dff-32a6-4117-9b46-3380a2209f2b\") " pod="openshift-lws-operator/lws-controller-manager-6568db77d8-t75c4" Jul 17 17:54:05.583458 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.583342 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9bc4dff-32a6-4117-9b46-3380a2209f2b-cert\") pod \"lws-controller-manager-6568db77d8-t75c4\" (UID: \"d9bc4dff-32a6-4117-9b46-3380a2209f2b\") " pod="openshift-lws-operator/lws-controller-manager-6568db77d8-t75c4" Jul 17 17:54:05.583458 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.583365 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d9bc4dff-32a6-4117-9b46-3380a2209f2b-manager-config\") pod \"lws-controller-manager-6568db77d8-t75c4\" (UID: \"d9bc4dff-32a6-4117-9b46-3380a2209f2b\") " pod="openshift-lws-operator/lws-controller-manager-6568db77d8-t75c4" Jul 17 17:54:05.583458 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.583444 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msfln\" (UniqueName: \"kubernetes.io/projected/d9bc4dff-32a6-4117-9b46-3380a2209f2b-kube-api-access-msfln\") pod \"lws-controller-manager-6568db77d8-t75c4\" (UID: \"d9bc4dff-32a6-4117-9b46-3380a2209f2b\") " pod="openshift-lws-operator/lws-controller-manager-6568db77d8-t75c4" Jul 17 17:54:05.683850 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.683821 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9bc4dff-32a6-4117-9b46-3380a2209f2b-cert\") pod \"lws-controller-manager-6568db77d8-t75c4\" (UID: \"d9bc4dff-32a6-4117-9b46-3380a2209f2b\") " pod="openshift-lws-operator/lws-controller-manager-6568db77d8-t75c4" Jul 17 17:54:05.683993 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.683860 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d9bc4dff-32a6-4117-9b46-3380a2209f2b-manager-config\") pod \"lws-controller-manager-6568db77d8-t75c4\" (UID: \"d9bc4dff-32a6-4117-9b46-3380a2209f2b\") " pod="openshift-lws-operator/lws-controller-manager-6568db77d8-t75c4" Jul 17 17:54:05.683993 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.683901 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msfln\" (UniqueName: \"kubernetes.io/projected/d9bc4dff-32a6-4117-9b46-3380a2209f2b-kube-api-access-msfln\") pod \"lws-controller-manager-6568db77d8-t75c4\" (UID: \"d9bc4dff-32a6-4117-9b46-3380a2209f2b\") " pod="openshift-lws-operator/lws-controller-manager-6568db77d8-t75c4" Jul 17 17:54:05.683993 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.683923 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d9bc4dff-32a6-4117-9b46-3380a2209f2b-metrics-cert\") pod \"lws-controller-manager-6568db77d8-t75c4\" (UID: \"d9bc4dff-32a6-4117-9b46-3380a2209f2b\") " pod="openshift-lws-operator/lws-controller-manager-6568db77d8-t75c4" Jul 17 17:54:05.684663 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.684603 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d9bc4dff-32a6-4117-9b46-3380a2209f2b-manager-config\") pod \"lws-controller-manager-6568db77d8-t75c4\" (UID: \"d9bc4dff-32a6-4117-9b46-3380a2209f2b\") " pod="openshift-lws-operator/lws-controller-manager-6568db77d8-t75c4" Jul 17 17:54:05.686429 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.686406 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d9bc4dff-32a6-4117-9b46-3380a2209f2b-metrics-cert\") pod \"lws-controller-manager-6568db77d8-t75c4\" (UID: \"d9bc4dff-32a6-4117-9b46-3380a2209f2b\") " pod="openshift-lws-operator/lws-controller-manager-6568db77d8-t75c4" Jul 17 17:54:05.686602 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.686581 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9bc4dff-32a6-4117-9b46-3380a2209f2b-cert\") pod \"lws-controller-manager-6568db77d8-t75c4\" (UID: \"d9bc4dff-32a6-4117-9b46-3380a2209f2b\") " pod="openshift-lws-operator/lws-controller-manager-6568db77d8-t75c4" Jul 17 17:54:05.693063 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.693041 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msfln\" (UniqueName: \"kubernetes.io/projected/d9bc4dff-32a6-4117-9b46-3380a2209f2b-kube-api-access-msfln\") pod \"lws-controller-manager-6568db77d8-t75c4\" (UID: \"d9bc4dff-32a6-4117-9b46-3380a2209f2b\") " pod="openshift-lws-operator/lws-controller-manager-6568db77d8-t75c4" Jul 17 17:54:05.818117 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.818088 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6568db77d8-t75c4" Jul 17 17:54:05.876174 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.876140 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7" event={"ID":"b7d91b0f-71c5-42fc-b5f9-841fb914e7a9","Type":"ContainerDied","Data":"f13988a31a61dc488b00df45821eb0675b1e61b5a7038e23a314b1a9be9c4eb2"} Jul 17 17:54:05.876174 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.876159 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg5gd7" Jul 17 17:54:05.876376 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.876211 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f13988a31a61dc488b00df45821eb0675b1e61b5a7038e23a314b1a9be9c4eb2" Jul 17 17:54:05.955510 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:05.955483 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6568db77d8-t75c4"] Jul 17 17:54:05.957735 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:54:05.957712 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9bc4dff_32a6_4117_9b46_3380a2209f2b.slice/crio-ce0ed5890c8962b0a9461906847e6ae4414d17206f43ba5bca53a691423379f4 WatchSource:0}: Error finding container ce0ed5890c8962b0a9461906847e6ae4414d17206f43ba5bca53a691423379f4: Status 404 returned error can't find the container with id ce0ed5890c8962b0a9461906847e6ae4414d17206f43ba5bca53a691423379f4 Jul 17 17:54:06.882223 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:06.882190 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6568db77d8-t75c4" event={"ID":"d9bc4dff-32a6-4117-9b46-3380a2209f2b","Type":"ContainerStarted","Data":"ce0ed5890c8962b0a9461906847e6ae4414d17206f43ba5bca53a691423379f4"} Jul 17 17:54:07.888123 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:07.888028 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6568db77d8-t75c4" event={"ID":"d9bc4dff-32a6-4117-9b46-3380a2209f2b","Type":"ContainerStarted","Data":"a1f9ce4ea6f17eededd7cef703a61b33990d86239defd16497b2828a74a39cf9"} Jul 17 17:54:07.888486 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:07.888128 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6568db77d8-t75c4" Jul 17 17:54:07.907215 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:07.907169 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6568db77d8-t75c4" podStartSLOduration=1.251652658 podStartE2EDuration="2.907155563s" totalImagesPullingTime="1.655502905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:54:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:54:07.906063497 +0000 UTC m=+294.893279848" watchObservedRunningTime="2026-07-17 17:54:07.907155563 +0000 UTC m=+294.894371912" Jul 17 17:54:13.362288 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:13.362257 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kcmzb_36b82608-4a35-44da-9af1-6d56c88cb1e2/console-operator/2.log" Jul 17 17:54:13.363680 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:13.363653 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kcmzb_36b82608-4a35-44da-9af1-6d56c88cb1e2/console-operator/2.log" Jul 17 17:54:13.373211 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:13.373191 2580 kubelet.go:1648] "Image garbage collection succeeded" Jul 17 17:54:16.046971 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:16.046941 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-cndbb"] Jul 17 17:54:16.050056 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:16.050041 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-cndbb" Jul 17 17:54:16.054004 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:16.053981 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 17 17:54:16.054296 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:16.054276 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 17 17:54:16.054488 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:16.054465 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 17 17:54:16.054610 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:16.054531 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 17 17:54:16.054849 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:16.054831 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xc9bm\"" Jul 17 17:54:16.059978 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:16.059958 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3011a067-30d8-4661-bb56-f748b7bf344b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-cndbb\" (UID: \"3011a067-30d8-4661-bb56-f748b7bf344b\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-cndbb" Jul 17 17:54:16.060065 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:16.059986 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3011a067-30d8-4661-bb56-f748b7bf344b-tmp\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-cndbb\" (UID: \"3011a067-30d8-4661-bb56-f748b7bf344b\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-cndbb" Jul 17 17:54:16.060065 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:16.060011 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3011a067-30d8-4661-bb56-f748b7bf344b-webhook-cert\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-cndbb\" (UID: \"3011a067-30d8-4661-bb56-f748b7bf344b\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-cndbb" Jul 17 17:54:16.060134 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:16.060091 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96zwx\" (UniqueName: \"kubernetes.io/projected/3011a067-30d8-4661-bb56-f748b7bf344b-kube-api-access-96zwx\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-cndbb\" (UID: \"3011a067-30d8-4661-bb56-f748b7bf344b\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-cndbb" Jul 17 17:54:16.060179 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:16.060133 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3011a067-30d8-4661-bb56-f748b7bf344b-manifests\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-cndbb\" (UID: \"3011a067-30d8-4661-bb56-f748b7bf344b\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-cndbb" Jul 17 17:54:16.134099 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:16.134075 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-cndbb"] Jul 17 17:54:16.160463 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:16.160436 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3011a067-30d8-4661-bb56-f748b7bf344b-webhook-cert\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-cndbb\" (UID: \"3011a067-30d8-4661-bb56-f748b7bf344b\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-cndbb" Jul 17 17:54:16.160557 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:16.160491 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96zwx\" (UniqueName: \"kubernetes.io/projected/3011a067-30d8-4661-bb56-f748b7bf344b-kube-api-access-96zwx\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-cndbb\" (UID: \"3011a067-30d8-4661-bb56-f748b7bf344b\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-cndbb" Jul 17 17:54:16.160557 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:16.160524 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3011a067-30d8-4661-bb56-f748b7bf344b-manifests\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-cndbb\" (UID: \"3011a067-30d8-4661-bb56-f748b7bf344b\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-cndbb" Jul 17 17:54:16.160557 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:16.160549 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3011a067-30d8-4661-bb56-f748b7bf344b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-cndbb\" (UID: \"3011a067-30d8-4661-bb56-f748b7bf344b\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-cndbb" Jul 17 17:54:16.160723 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:16.160571 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3011a067-30d8-4661-bb56-f748b7bf344b-tmp\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-cndbb\" (UID: \"3011a067-30d8-4661-bb56-f748b7bf344b\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-cndbb" Jul 17 17:54:16.161012 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:16.160992 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3011a067-30d8-4661-bb56-f748b7bf344b-manifests\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-cndbb\" (UID: \"3011a067-30d8-4661-bb56-f748b7bf344b\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-cndbb" Jul 17 17:54:16.162993 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:16.162975 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3011a067-30d8-4661-bb56-f748b7bf344b-tmp\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-cndbb\" (UID: \"3011a067-30d8-4661-bb56-f748b7bf344b\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-cndbb" Jul 17 17:54:16.163217 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:16.163194 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3011a067-30d8-4661-bb56-f748b7bf344b-webhook-cert\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-cndbb\" (UID: \"3011a067-30d8-4661-bb56-f748b7bf344b\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-cndbb" Jul 17 17:54:16.163264 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:16.163239 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3011a067-30d8-4661-bb56-f748b7bf344b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-cndbb\" (UID: \"3011a067-30d8-4661-bb56-f748b7bf344b\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-cndbb" Jul 17 17:54:16.174948 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:16.174926 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96zwx\" (UniqueName: \"kubernetes.io/projected/3011a067-30d8-4661-bb56-f748b7bf344b-kube-api-access-96zwx\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-cndbb\" (UID: \"3011a067-30d8-4661-bb56-f748b7bf344b\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-cndbb" Jul 17 17:54:16.361107 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:16.361081 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-cndbb" Jul 17 17:54:16.496528 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:16.496504 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-cndbb"] Jul 17 17:54:16.498404 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:54:16.498377 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3011a067_30d8_4661_bb56_f748b7bf344b.slice/crio-07dad50c81ac0d9b17af6992a8066d9316a0d41614037586f660ab50ad1d6d11 WatchSource:0}: Error finding container 07dad50c81ac0d9b17af6992a8066d9316a0d41614037586f660ab50ad1d6d11: Status 404 returned error can't find the container with id 07dad50c81ac0d9b17af6992a8066d9316a0d41614037586f660ab50ad1d6d11 Jul 17 17:54:16.500238 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:16.500220 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 17:54:16.928810 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:16.928776 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-cndbb" event={"ID":"3011a067-30d8-4661-bb56-f748b7bf344b","Type":"ContainerStarted","Data":"07dad50c81ac0d9b17af6992a8066d9316a0d41614037586f660ab50ad1d6d11"} Jul 17 17:54:18.895830 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:18.895798 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6568db77d8-t75c4" Jul 17 17:54:19.945442 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:19.945412 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-cndbb" event={"ID":"3011a067-30d8-4661-bb56-f748b7bf344b","Type":"ContainerStarted","Data":"c0a4bb59340c1170212e4755d3d96ce42e18ff7e27a70311bdc4245787c4bf71"} Jul 17 17:54:20.951666 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:20.951630 2580 generic.go:356] "Generic (PLEG): container finished" podID="3011a067-30d8-4661-bb56-f748b7bf344b" containerID="c0a4bb59340c1170212e4755d3d96ce42e18ff7e27a70311bdc4245787c4bf71" exitCode=0 Jul 17 17:54:20.952129 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:20.951716 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-cndbb" event={"ID":"3011a067-30d8-4661-bb56-f748b7bf344b","Type":"ContainerDied","Data":"c0a4bb59340c1170212e4755d3d96ce42e18ff7e27a70311bdc4245787c4bf71"} Jul 17 17:54:21.959166 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:21.959125 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-cndbb" event={"ID":"3011a067-30d8-4661-bb56-f748b7bf344b","Type":"ContainerStarted","Data":"5142a0e94f4f092198df1238725e60c4c0b20102f46afd2a8c577c867b109642"} Jul 17 17:54:21.959627 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:21.959336 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-cndbb" Jul 17 17:54:21.979503 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:21.979458 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-cndbb" podStartSLOduration=1.710807534 podStartE2EDuration="5.979445177s" totalImagesPullingTime="3.224904953s" totalInitContainerRuntime="1.04373269s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:54:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:54:21.977967666 +0000 UTC m=+308.965184016" watchObservedRunningTime="2026-07-17 17:54:21.979445177 +0000 UTC m=+308.966661526" Jul 17 17:54:32.966621 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:32.966594 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-cndbb" Jul 17 17:54:42.753494 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.753448 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h"] Jul 17 17:54:42.759168 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.759149 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" Jul 17 17:54:42.763504 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.763482 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-klb54\"" Jul 17 17:54:42.763906 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.763855 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 17 17:54:42.764034 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.763905 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 17 17:54:42.764034 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.764000 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 17 17:54:42.764151 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.764119 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 17 17:54:42.789186 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.789161 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h"] Jul 17 17:54:42.875270 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.875236 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/72d99cfc-2662-4715-9319-a76c4a2a8f85-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-llz6h\" (UID: \"72d99cfc-2662-4715-9319-a76c4a2a8f85\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" Jul 17 17:54:42.875270 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.875272 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/72d99cfc-2662-4715-9319-a76c4a2a8f85-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-llz6h\" (UID: \"72d99cfc-2662-4715-9319-a76c4a2a8f85\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" Jul 17 17:54:42.875522 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.875296 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/72d99cfc-2662-4715-9319-a76c4a2a8f85-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-llz6h\" (UID: \"72d99cfc-2662-4715-9319-a76c4a2a8f85\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" Jul 17 17:54:42.875522 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.875350 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/72d99cfc-2662-4715-9319-a76c4a2a8f85-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-llz6h\" (UID: \"72d99cfc-2662-4715-9319-a76c4a2a8f85\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" Jul 17 17:54:42.875522 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.875418 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72d99cfc-2662-4715-9319-a76c4a2a8f85-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-llz6h\" (UID: \"72d99cfc-2662-4715-9319-a76c4a2a8f85\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" Jul 17 17:54:42.875522 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.875479 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/72d99cfc-2662-4715-9319-a76c4a2a8f85-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-llz6h\" (UID: \"72d99cfc-2662-4715-9319-a76c4a2a8f85\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" Jul 17 17:54:42.875664 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.875538 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25gdg\" (UniqueName: \"kubernetes.io/projected/72d99cfc-2662-4715-9319-a76c4a2a8f85-kube-api-access-25gdg\") pod \"istiod-openshift-gateway-94bb8fbfd-llz6h\" (UID: \"72d99cfc-2662-4715-9319-a76c4a2a8f85\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" Jul 17 17:54:42.976179 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.976143 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/72d99cfc-2662-4715-9319-a76c4a2a8f85-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-llz6h\" (UID: \"72d99cfc-2662-4715-9319-a76c4a2a8f85\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" Jul 17 17:54:42.976179 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.976178 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25gdg\" (UniqueName: \"kubernetes.io/projected/72d99cfc-2662-4715-9319-a76c4a2a8f85-kube-api-access-25gdg\") pod \"istiod-openshift-gateway-94bb8fbfd-llz6h\" (UID: \"72d99cfc-2662-4715-9319-a76c4a2a8f85\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" Jul 17 17:54:42.976431 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.976206 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/72d99cfc-2662-4715-9319-a76c4a2a8f85-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-llz6h\" (UID: \"72d99cfc-2662-4715-9319-a76c4a2a8f85\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" Jul 17 17:54:42.976431 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.976329 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/72d99cfc-2662-4715-9319-a76c4a2a8f85-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-llz6h\" (UID: \"72d99cfc-2662-4715-9319-a76c4a2a8f85\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" Jul 17 17:54:42.976431 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.976374 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/72d99cfc-2662-4715-9319-a76c4a2a8f85-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-llz6h\" (UID: \"72d99cfc-2662-4715-9319-a76c4a2a8f85\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" Jul 17 17:54:42.976431 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.976403 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/72d99cfc-2662-4715-9319-a76c4a2a8f85-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-llz6h\" (UID: \"72d99cfc-2662-4715-9319-a76c4a2a8f85\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" Jul 17 17:54:42.976640 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.976444 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72d99cfc-2662-4715-9319-a76c4a2a8f85-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-llz6h\" (UID: \"72d99cfc-2662-4715-9319-a76c4a2a8f85\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" Jul 17 17:54:42.976897 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.976871 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/72d99cfc-2662-4715-9319-a76c4a2a8f85-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-llz6h\" (UID: \"72d99cfc-2662-4715-9319-a76c4a2a8f85\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" Jul 17 17:54:42.978625 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.978591 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/72d99cfc-2662-4715-9319-a76c4a2a8f85-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-llz6h\" (UID: \"72d99cfc-2662-4715-9319-a76c4a2a8f85\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" Jul 17 17:54:42.978845 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.978825 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/72d99cfc-2662-4715-9319-a76c4a2a8f85-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-llz6h\" (UID: \"72d99cfc-2662-4715-9319-a76c4a2a8f85\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" Jul 17 17:54:42.979300 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.979280 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/72d99cfc-2662-4715-9319-a76c4a2a8f85-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-llz6h\" (UID: \"72d99cfc-2662-4715-9319-a76c4a2a8f85\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" Jul 17 17:54:42.979432 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.979408 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/72d99cfc-2662-4715-9319-a76c4a2a8f85-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-llz6h\" (UID: \"72d99cfc-2662-4715-9319-a76c4a2a8f85\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" Jul 17 17:54:42.984453 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.984428 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72d99cfc-2662-4715-9319-a76c4a2a8f85-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-llz6h\" (UID: \"72d99cfc-2662-4715-9319-a76c4a2a8f85\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" Jul 17 17:54:42.984570 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:42.984552 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25gdg\" (UniqueName: \"kubernetes.io/projected/72d99cfc-2662-4715-9319-a76c4a2a8f85-kube-api-access-25gdg\") pod \"istiod-openshift-gateway-94bb8fbfd-llz6h\" (UID: \"72d99cfc-2662-4715-9319-a76c4a2a8f85\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" Jul 17 17:54:43.069185 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:43.069154 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" Jul 17 17:54:43.215393 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:43.215366 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h"] Jul 17 17:54:43.217342 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:54:43.217291 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72d99cfc_2662_4715_9319_a76c4a2a8f85.slice/crio-74f86b4ddbb7a83e7945fbc67f9304a5b6fa6741be39e20fecfb5138bcaba70b WatchSource:0}: Error finding container 74f86b4ddbb7a83e7945fbc67f9304a5b6fa6741be39e20fecfb5138bcaba70b: Status 404 returned error can't find the container with id 74f86b4ddbb7a83e7945fbc67f9304a5b6fa6741be39e20fecfb5138bcaba70b Jul 17 17:54:44.069155 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:44.069117 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" event={"ID":"72d99cfc-2662-4715-9319-a76c4a2a8f85","Type":"ContainerStarted","Data":"74f86b4ddbb7a83e7945fbc67f9304a5b6fa6741be39e20fecfb5138bcaba70b"} Jul 17 17:54:45.505085 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:45.505052 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 17:54:45.505321 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:45.505111 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 17:54:46.082412 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:46.082363 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" event={"ID":"72d99cfc-2662-4715-9319-a76c4a2a8f85","Type":"ContainerStarted","Data":"13c05075cc6445b6a9033531b010c4fdfb9ebd28f3a25dc88eceea7793c52468"} Jul 17 17:54:46.082588 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:46.082572 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" Jul 17 17:54:46.084465 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:46.084435 2580 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-llz6h container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 17 17:54:46.084593 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:46.084486 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" podUID="72d99cfc-2662-4715-9319-a76c4a2a8f85" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 17 17:54:46.126596 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:46.126549 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" podStartSLOduration=1.841925764 podStartE2EDuration="4.126535463s" totalImagesPullingTime="2.284609699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:54:46.123884764 +0000 UTC m=+333.111101135" watchObservedRunningTime="2026-07-17 17:54:46.126535463 +0000 UTC m=+333.113751813" Jul 17 17:54:47.087699 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:54:47.087668 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-llz6h" Jul 17 17:55:52.113533 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.113495 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb"] Jul 17 17:55:52.116957 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.116940 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb" Jul 17 17:55:52.119337 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.119315 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 17 17:55:52.120534 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.120516 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 17 17:55:52.120640 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.120516 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-45nzb\"" Jul 17 17:55:52.125563 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.125538 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb"] Jul 17 17:55:52.245615 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.245590 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcfjw\" (UniqueName: \"kubernetes.io/projected/620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8-kube-api-access-zcfjw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb\" (UID: \"620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb" Jul 17 17:55:52.245732 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.245628 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb\" (UID: \"620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb" Jul 17 17:55:52.245732 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.245656 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb\" (UID: \"620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb" Jul 17 17:55:52.346912 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.346868 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcfjw\" (UniqueName: \"kubernetes.io/projected/620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8-kube-api-access-zcfjw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb\" (UID: \"620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb" Jul 17 17:55:52.346912 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.346923 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb\" (UID: \"620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb" Jul 17 17:55:52.347112 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.346949 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb\" (UID: \"620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb" Jul 17 17:55:52.347287 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.347273 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb\" (UID: \"620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb" Jul 17 17:55:52.347326 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.347302 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb\" (UID: \"620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb" Jul 17 17:55:52.355540 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.355515 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcfjw\" (UniqueName: \"kubernetes.io/projected/620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8-kube-api-access-zcfjw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb\" (UID: \"620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb" Jul 17 17:55:52.426932 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.426875 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb" Jul 17 17:55:52.558075 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.558048 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb"] Jul 17 17:55:52.561302 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:55:52.561274 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod620e53ee_0a8c_4e6d_b2b7_77529f9ce1e8.slice/crio-d88b45875bef8a5c938a7b0ca08584c524c0a560665a2486b20d4cbb862e4478 WatchSource:0}: Error finding container d88b45875bef8a5c938a7b0ca08584c524c0a560665a2486b20d4cbb862e4478: Status 404 returned error can't find the container with id d88b45875bef8a5c938a7b0ca08584c524c0a560665a2486b20d4cbb862e4478 Jul 17 17:55:52.708717 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.708647 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp"] Jul 17 17:55:52.712011 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.711989 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp" Jul 17 17:55:52.720136 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.720113 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp"] Jul 17 17:55:52.850447 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.850408 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqkj5\" (UniqueName: \"kubernetes.io/projected/e2cb8de7-9425-42e9-a2a9-5a811e4757d5-kube-api-access-bqkj5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp\" (UID: \"e2cb8de7-9425-42e9-a2a9-5a811e4757d5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp" Jul 17 17:55:52.850616 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.850481 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2cb8de7-9425-42e9-a2a9-5a811e4757d5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp\" (UID: \"e2cb8de7-9425-42e9-a2a9-5a811e4757d5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp" Jul 17 17:55:52.850616 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.850522 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2cb8de7-9425-42e9-a2a9-5a811e4757d5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp\" (UID: \"e2cb8de7-9425-42e9-a2a9-5a811e4757d5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp" Jul 17 17:55:52.951208 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.951172 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqkj5\" (UniqueName: \"kubernetes.io/projected/e2cb8de7-9425-42e9-a2a9-5a811e4757d5-kube-api-access-bqkj5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp\" (UID: \"e2cb8de7-9425-42e9-a2a9-5a811e4757d5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp" Jul 17 17:55:52.951384 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.951237 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2cb8de7-9425-42e9-a2a9-5a811e4757d5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp\" (UID: \"e2cb8de7-9425-42e9-a2a9-5a811e4757d5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp" Jul 17 17:55:52.951384 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.951270 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2cb8de7-9425-42e9-a2a9-5a811e4757d5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp\" (UID: \"e2cb8de7-9425-42e9-a2a9-5a811e4757d5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp" Jul 17 17:55:52.951594 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.951578 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2cb8de7-9425-42e9-a2a9-5a811e4757d5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp\" (UID: \"e2cb8de7-9425-42e9-a2a9-5a811e4757d5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp" Jul 17 17:55:52.951632 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.951605 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2cb8de7-9425-42e9-a2a9-5a811e4757d5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp\" (UID: \"e2cb8de7-9425-42e9-a2a9-5a811e4757d5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp" Jul 17 17:55:52.960101 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:52.960039 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqkj5\" (UniqueName: \"kubernetes.io/projected/e2cb8de7-9425-42e9-a2a9-5a811e4757d5-kube-api-access-bqkj5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp\" (UID: \"e2cb8de7-9425-42e9-a2a9-5a811e4757d5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp" Jul 17 17:55:53.024339 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.024310 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp" Jul 17 17:55:53.153719 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.153694 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp"] Jul 17 17:55:53.155398 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:55:53.155377 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2cb8de7_9425_42e9_a2a9_5a811e4757d5.slice/crio-fadb11052381c745e24763ae1c0a3966c016950f7d847a0d317adb33a4f41090 WatchSource:0}: Error finding container fadb11052381c745e24763ae1c0a3966c016950f7d847a0d317adb33a4f41090: Status 404 returned error can't find the container with id fadb11052381c745e24763ae1c0a3966c016950f7d847a0d317adb33a4f41090 Jul 17 17:55:53.308673 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.308641 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq"] Jul 17 17:55:53.311950 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.311934 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq" Jul 17 17:55:53.319870 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.319849 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq"] Jul 17 17:55:53.391867 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.391837 2580 generic.go:356] "Generic (PLEG): container finished" podID="620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8" containerID="5906b46a7928bf9b153fdead96e5305868dd57d8d045b287e301571315222afd" exitCode=0 Jul 17 17:55:53.392001 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.391925 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb" event={"ID":"620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8","Type":"ContainerDied","Data":"5906b46a7928bf9b153fdead96e5305868dd57d8d045b287e301571315222afd"} Jul 17 17:55:53.392001 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.391970 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb" event={"ID":"620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8","Type":"ContainerStarted","Data":"d88b45875bef8a5c938a7b0ca08584c524c0a560665a2486b20d4cbb862e4478"} Jul 17 17:55:53.393513 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.393492 2580 generic.go:356] "Generic (PLEG): container finished" podID="e2cb8de7-9425-42e9-a2a9-5a811e4757d5" containerID="2221ce86287c5961439d649ee0fdacfaf85e9b33e46afdc1e3ae16405dffb783" exitCode=0 Jul 17 17:55:53.393606 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.393573 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp" event={"ID":"e2cb8de7-9425-42e9-a2a9-5a811e4757d5","Type":"ContainerDied","Data":"2221ce86287c5961439d649ee0fdacfaf85e9b33e46afdc1e3ae16405dffb783"} Jul 17 17:55:53.393646 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.393607 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp" event={"ID":"e2cb8de7-9425-42e9-a2a9-5a811e4757d5","Type":"ContainerStarted","Data":"fadb11052381c745e24763ae1c0a3966c016950f7d847a0d317adb33a4f41090"} Jul 17 17:55:53.456467 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.456447 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aeb74a36-67b5-45b7-be9b-60029d5e1bef-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq\" (UID: \"aeb74a36-67b5-45b7-be9b-60029d5e1bef\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq" Jul 17 17:55:53.456577 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.456492 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7z8p\" (UniqueName: \"kubernetes.io/projected/aeb74a36-67b5-45b7-be9b-60029d5e1bef-kube-api-access-x7z8p\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq\" (UID: \"aeb74a36-67b5-45b7-be9b-60029d5e1bef\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq" Jul 17 17:55:53.456577 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.456533 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aeb74a36-67b5-45b7-be9b-60029d5e1bef-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq\" (UID: \"aeb74a36-67b5-45b7-be9b-60029d5e1bef\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq" Jul 17 17:55:53.557587 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.557514 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aeb74a36-67b5-45b7-be9b-60029d5e1bef-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq\" (UID: \"aeb74a36-67b5-45b7-be9b-60029d5e1bef\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq" Jul 17 17:55:53.557715 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.557596 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7z8p\" (UniqueName: \"kubernetes.io/projected/aeb74a36-67b5-45b7-be9b-60029d5e1bef-kube-api-access-x7z8p\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq\" (UID: \"aeb74a36-67b5-45b7-be9b-60029d5e1bef\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq" Jul 17 17:55:53.557715 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.557658 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aeb74a36-67b5-45b7-be9b-60029d5e1bef-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq\" (UID: \"aeb74a36-67b5-45b7-be9b-60029d5e1bef\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq" Jul 17 17:55:53.558127 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.558098 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aeb74a36-67b5-45b7-be9b-60029d5e1bef-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq\" (UID: \"aeb74a36-67b5-45b7-be9b-60029d5e1bef\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq" Jul 17 17:55:53.558202 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.558109 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aeb74a36-67b5-45b7-be9b-60029d5e1bef-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq\" (UID: \"aeb74a36-67b5-45b7-be9b-60029d5e1bef\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq" Jul 17 17:55:53.566110 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.566090 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7z8p\" (UniqueName: \"kubernetes.io/projected/aeb74a36-67b5-45b7-be9b-60029d5e1bef-kube-api-access-x7z8p\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq\" (UID: \"aeb74a36-67b5-45b7-be9b-60029d5e1bef\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq" Jul 17 17:55:53.621270 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.621250 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq" Jul 17 17:55:53.717165 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.717132 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s"] Jul 17 17:55:53.721466 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.721444 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s" Jul 17 17:55:53.728397 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.728342 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s"] Jul 17 17:55:53.754401 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.754382 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq"] Jul 17 17:55:53.756436 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:55:53.756411 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeb74a36_67b5_45b7_be9b_60029d5e1bef.slice/crio-eda9970f43f7355af2c404dd4350b3c2248640a7fd09bfa5358f09d5878d93ac WatchSource:0}: Error finding container eda9970f43f7355af2c404dd4350b3c2248640a7fd09bfa5358f09d5878d93ac: Status 404 returned error can't find the container with id eda9970f43f7355af2c404dd4350b3c2248640a7fd09bfa5358f09d5878d93ac Jul 17 17:55:53.860584 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.860556 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkjdt\" (UniqueName: \"kubernetes.io/projected/b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f-kube-api-access-tkjdt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s\" (UID: \"b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s" Jul 17 17:55:53.860684 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.860596 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s\" (UID: \"b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s" Jul 17 17:55:53.860684 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.860638 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s\" (UID: \"b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s" Jul 17 17:55:53.961882 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.961852 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s\" (UID: \"b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s" Jul 17 17:55:53.961991 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.961912 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkjdt\" (UniqueName: \"kubernetes.io/projected/b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f-kube-api-access-tkjdt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s\" (UID: \"b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s" Jul 17 17:55:53.961991 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.961933 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s\" (UID: \"b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s" Jul 17 17:55:53.962245 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.962223 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s\" (UID: \"b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s" Jul 17 17:55:53.962306 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.962253 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s\" (UID: \"b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s" Jul 17 17:55:53.970565 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:53.970538 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkjdt\" (UniqueName: \"kubernetes.io/projected/b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f-kube-api-access-tkjdt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s\" (UID: \"b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s" Jul 17 17:55:54.035203 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:54.035184 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s" Jul 17 17:55:54.175460 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:54.175437 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s"] Jul 17 17:55:54.201823 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:55:54.201792 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8a9fb3f_e595_45b1_85fe_f6aa5cb7165f.slice/crio-ad84d2443f5d2cc92cc309fb4ce580f5a4f2ed8404f64ae5f82cb4934c989ff8 WatchSource:0}: Error finding container ad84d2443f5d2cc92cc309fb4ce580f5a4f2ed8404f64ae5f82cb4934c989ff8: Status 404 returned error can't find the container with id ad84d2443f5d2cc92cc309fb4ce580f5a4f2ed8404f64ae5f82cb4934c989ff8 Jul 17 17:55:54.399985 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:54.399959 2580 generic.go:356] "Generic (PLEG): container finished" podID="e2cb8de7-9425-42e9-a2a9-5a811e4757d5" containerID="1ead72e6f092c30c2acdb03c8dd55ced0bb85fe346a1ca4a407c702e17b6b57f" exitCode=0 Jul 17 17:55:54.400104 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:54.400051 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp" event={"ID":"e2cb8de7-9425-42e9-a2a9-5a811e4757d5","Type":"ContainerDied","Data":"1ead72e6f092c30c2acdb03c8dd55ced0bb85fe346a1ca4a407c702e17b6b57f"} Jul 17 17:55:54.401589 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:54.401568 2580 generic.go:356] "Generic (PLEG): container finished" podID="aeb74a36-67b5-45b7-be9b-60029d5e1bef" containerID="9ccdf33a7051b94d681861bce5c103d3fd3c3f1fa80d9dc19a4bba85bd69cfe8" exitCode=0 Jul 17 17:55:54.401665 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:54.401649 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq" event={"ID":"aeb74a36-67b5-45b7-be9b-60029d5e1bef","Type":"ContainerDied","Data":"9ccdf33a7051b94d681861bce5c103d3fd3c3f1fa80d9dc19a4bba85bd69cfe8"} Jul 17 17:55:54.401719 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:54.401689 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq" event={"ID":"aeb74a36-67b5-45b7-be9b-60029d5e1bef","Type":"ContainerStarted","Data":"eda9970f43f7355af2c404dd4350b3c2248640a7fd09bfa5358f09d5878d93ac"} Jul 17 17:55:54.403217 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:54.403193 2580 generic.go:356] "Generic (PLEG): container finished" podID="b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f" containerID="fcef66425d09fd10ea9614004276973209c473d7f291f0a0a76881c2b43f1e9c" exitCode=0 Jul 17 17:55:54.403324 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:54.403275 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s" event={"ID":"b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f","Type":"ContainerDied","Data":"fcef66425d09fd10ea9614004276973209c473d7f291f0a0a76881c2b43f1e9c"} Jul 17 17:55:54.403394 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:54.403325 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s" event={"ID":"b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f","Type":"ContainerStarted","Data":"ad84d2443f5d2cc92cc309fb4ce580f5a4f2ed8404f64ae5f82cb4934c989ff8"} Jul 17 17:55:54.405218 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:54.405143 2580 generic.go:356] "Generic (PLEG): container finished" podID="620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8" containerID="fd338b8e482cafff22e9c924bafa86146f69fb81335ca552d8019e4e08c32671" exitCode=0 Jul 17 17:55:54.405218 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:54.405181 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb" event={"ID":"620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8","Type":"ContainerDied","Data":"fd338b8e482cafff22e9c924bafa86146f69fb81335ca552d8019e4e08c32671"} Jul 17 17:55:55.411722 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:55.411692 2580 generic.go:356] "Generic (PLEG): container finished" podID="e2cb8de7-9425-42e9-a2a9-5a811e4757d5" containerID="bb2101f29dfe97b835b0ad496c455c8759af09797baac11e886176c893348600" exitCode=0 Jul 17 17:55:55.412092 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:55.411789 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp" event={"ID":"e2cb8de7-9425-42e9-a2a9-5a811e4757d5","Type":"ContainerDied","Data":"bb2101f29dfe97b835b0ad496c455c8759af09797baac11e886176c893348600"} Jul 17 17:55:55.413645 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:55.413623 2580 generic.go:356] "Generic (PLEG): container finished" podID="b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f" containerID="afc7d78a2d3c897c6bc620e38e0f49e93e697f297b3fc37eb0dddbdb990c165a" exitCode=0 Jul 17 17:55:55.413742 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:55.413699 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s" event={"ID":"b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f","Type":"ContainerDied","Data":"afc7d78a2d3c897c6bc620e38e0f49e93e697f297b3fc37eb0dddbdb990c165a"} Jul 17 17:55:55.415772 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:55.415723 2580 generic.go:356] "Generic (PLEG): container finished" podID="620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8" containerID="47a9ea5c826b6db49d9fc9d8fc433c740a225c7c45649ac5f046f409de3586a6" exitCode=0 Jul 17 17:55:55.415871 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:55.415783 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb" event={"ID":"620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8","Type":"ContainerDied","Data":"47a9ea5c826b6db49d9fc9d8fc433c740a225c7c45649ac5f046f409de3586a6"} Jul 17 17:55:56.421703 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:56.421666 2580 generic.go:356] "Generic (PLEG): container finished" podID="aeb74a36-67b5-45b7-be9b-60029d5e1bef" containerID="74328abd9d22b8376dcdd3f07b64423372cb580a215606eeb2ebe5877a6ce438" exitCode=0 Jul 17 17:55:56.422131 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:56.421744 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq" event={"ID":"aeb74a36-67b5-45b7-be9b-60029d5e1bef","Type":"ContainerDied","Data":"74328abd9d22b8376dcdd3f07b64423372cb580a215606eeb2ebe5877a6ce438"} Jul 17 17:55:56.424091 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:56.424069 2580 generic.go:356] "Generic (PLEG): container finished" podID="b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f" containerID="64f550fe475d7f7c964bccec01cf147124eab80f34ba5757658c163032ca4fce" exitCode=0 Jul 17 17:55:56.424198 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:56.424153 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s" event={"ID":"b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f","Type":"ContainerDied","Data":"64f550fe475d7f7c964bccec01cf147124eab80f34ba5757658c163032ca4fce"} Jul 17 17:55:56.630040 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:56.630016 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb" Jul 17 17:55:56.632785 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:56.632765 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp" Jul 17 17:55:56.795271 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:56.795187 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8-util\") pod \"620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8\" (UID: \"620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8\") " Jul 17 17:55:56.795271 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:56.795232 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8-bundle\") pod \"620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8\" (UID: \"620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8\") " Jul 17 17:55:56.795492 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:56.795301 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcfjw\" (UniqueName: \"kubernetes.io/projected/620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8-kube-api-access-zcfjw\") pod \"620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8\" (UID: \"620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8\") " Jul 17 17:55:56.795492 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:56.795343 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqkj5\" (UniqueName: \"kubernetes.io/projected/e2cb8de7-9425-42e9-a2a9-5a811e4757d5-kube-api-access-bqkj5\") pod \"e2cb8de7-9425-42e9-a2a9-5a811e4757d5\" (UID: \"e2cb8de7-9425-42e9-a2a9-5a811e4757d5\") " Jul 17 17:55:56.795492 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:56.795382 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2cb8de7-9425-42e9-a2a9-5a811e4757d5-util\") pod \"e2cb8de7-9425-42e9-a2a9-5a811e4757d5\" (UID: \"e2cb8de7-9425-42e9-a2a9-5a811e4757d5\") " Jul 17 17:55:56.795492 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:56.795405 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2cb8de7-9425-42e9-a2a9-5a811e4757d5-bundle\") pod \"e2cb8de7-9425-42e9-a2a9-5a811e4757d5\" (UID: \"e2cb8de7-9425-42e9-a2a9-5a811e4757d5\") " Jul 17 17:55:56.795972 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:56.795941 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8-bundle" (OuterVolumeSpecName: "bundle") pod "620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8" (UID: "620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:55:56.796098 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:56.795966 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2cb8de7-9425-42e9-a2a9-5a811e4757d5-bundle" (OuterVolumeSpecName: "bundle") pod "e2cb8de7-9425-42e9-a2a9-5a811e4757d5" (UID: "e2cb8de7-9425-42e9-a2a9-5a811e4757d5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:55:56.798297 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:56.798273 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8-kube-api-access-zcfjw" (OuterVolumeSpecName: "kube-api-access-zcfjw") pod "620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8" (UID: "620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8"). InnerVolumeSpecName "kube-api-access-zcfjw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:55:56.798383 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:56.798316 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2cb8de7-9425-42e9-a2a9-5a811e4757d5-kube-api-access-bqkj5" (OuterVolumeSpecName: "kube-api-access-bqkj5") pod "e2cb8de7-9425-42e9-a2a9-5a811e4757d5" (UID: "e2cb8de7-9425-42e9-a2a9-5a811e4757d5"). InnerVolumeSpecName "kube-api-access-bqkj5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:55:56.800647 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:56.800626 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8-util" (OuterVolumeSpecName: "util") pod "620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8" (UID: "620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:55:56.802410 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:56.802384 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2cb8de7-9425-42e9-a2a9-5a811e4757d5-util" (OuterVolumeSpecName: "util") pod "e2cb8de7-9425-42e9-a2a9-5a811e4757d5" (UID: "e2cb8de7-9425-42e9-a2a9-5a811e4757d5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:55:56.896457 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:56.896430 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcfjw\" (UniqueName: \"kubernetes.io/projected/620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8-kube-api-access-zcfjw\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:55:56.896457 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:56.896454 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqkj5\" (UniqueName: \"kubernetes.io/projected/e2cb8de7-9425-42e9-a2a9-5a811e4757d5-kube-api-access-bqkj5\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:55:56.896611 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:56.896463 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2cb8de7-9425-42e9-a2a9-5a811e4757d5-util\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:55:56.896611 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:56.896472 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2cb8de7-9425-42e9-a2a9-5a811e4757d5-bundle\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:55:56.896611 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:56.896479 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8-util\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:55:56.896611 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:56.896486 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8-bundle\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:55:57.431043 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:57.431015 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb" Jul 17 17:55:57.431451 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:57.431040 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb" event={"ID":"620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8","Type":"ContainerDied","Data":"d88b45875bef8a5c938a7b0ca08584c524c0a560665a2486b20d4cbb862e4478"} Jul 17 17:55:57.431451 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:57.431132 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d88b45875bef8a5c938a7b0ca08584c524c0a560665a2486b20d4cbb862e4478" Jul 17 17:55:57.433002 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:57.432982 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp" Jul 17 17:55:57.433137 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:57.433008 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp" event={"ID":"e2cb8de7-9425-42e9-a2a9-5a811e4757d5","Type":"ContainerDied","Data":"fadb11052381c745e24763ae1c0a3966c016950f7d847a0d317adb33a4f41090"} Jul 17 17:55:57.433137 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:57.433046 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fadb11052381c745e24763ae1c0a3966c016950f7d847a0d317adb33a4f41090" Jul 17 17:55:57.435182 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:57.435162 2580 generic.go:356] "Generic (PLEG): container finished" podID="aeb74a36-67b5-45b7-be9b-60029d5e1bef" containerID="bf3e42075fc41d733900e3d81f29e3c3d43cd23103342cc5e10a091cab338fac" exitCode=0 Jul 17 17:55:57.435298 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:57.435222 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq" event={"ID":"aeb74a36-67b5-45b7-be9b-60029d5e1bef","Type":"ContainerDied","Data":"bf3e42075fc41d733900e3d81f29e3c3d43cd23103342cc5e10a091cab338fac"} Jul 17 17:55:57.564845 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:57.564822 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s" Jul 17 17:55:57.700989 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:57.700906 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f-util\") pod \"b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f\" (UID: \"b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f\") " Jul 17 17:55:57.700989 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:57.700937 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f-bundle\") pod \"b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f\" (UID: \"b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f\") " Jul 17 17:55:57.700989 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:57.700967 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkjdt\" (UniqueName: \"kubernetes.io/projected/b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f-kube-api-access-tkjdt\") pod \"b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f\" (UID: \"b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f\") " Jul 17 17:55:57.701507 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:57.701485 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f-bundle" (OuterVolumeSpecName: "bundle") pod "b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f" (UID: "b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:55:57.703285 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:57.703263 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f-kube-api-access-tkjdt" (OuterVolumeSpecName: "kube-api-access-tkjdt") pod "b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f" (UID: "b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f"). InnerVolumeSpecName "kube-api-access-tkjdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:55:57.706196 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:57.706174 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f-util" (OuterVolumeSpecName: "util") pod "b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f" (UID: "b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:55:57.801582 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:57.801553 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f-util\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:55:57.801582 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:57.801578 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f-bundle\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:55:57.801582 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:57.801588 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkjdt\" (UniqueName: \"kubernetes.io/projected/b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f-kube-api-access-tkjdt\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:55:58.442416 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:58.442389 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s" Jul 17 17:55:58.442416 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:58.442407 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s" event={"ID":"b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f","Type":"ContainerDied","Data":"ad84d2443f5d2cc92cc309fb4ce580f5a4f2ed8404f64ae5f82cb4934c989ff8"} Jul 17 17:55:58.442907 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:58.442449 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ad84d2443f5d2cc92cc309fb4ce580f5a4f2ed8404f64ae5f82cb4934c989ff8" Jul 17 17:55:58.567807 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:58.567783 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq" Jul 17 17:55:58.710836 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:58.710764 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aeb74a36-67b5-45b7-be9b-60029d5e1bef-util\") pod \"aeb74a36-67b5-45b7-be9b-60029d5e1bef\" (UID: \"aeb74a36-67b5-45b7-be9b-60029d5e1bef\") " Jul 17 17:55:58.710956 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:58.710845 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aeb74a36-67b5-45b7-be9b-60029d5e1bef-bundle\") pod \"aeb74a36-67b5-45b7-be9b-60029d5e1bef\" (UID: \"aeb74a36-67b5-45b7-be9b-60029d5e1bef\") " Jul 17 17:55:58.710956 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:58.710877 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7z8p\" (UniqueName: \"kubernetes.io/projected/aeb74a36-67b5-45b7-be9b-60029d5e1bef-kube-api-access-x7z8p\") pod \"aeb74a36-67b5-45b7-be9b-60029d5e1bef\" (UID: \"aeb74a36-67b5-45b7-be9b-60029d5e1bef\") " Jul 17 17:55:58.711315 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:58.711285 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeb74a36-67b5-45b7-be9b-60029d5e1bef-bundle" (OuterVolumeSpecName: "bundle") pod "aeb74a36-67b5-45b7-be9b-60029d5e1bef" (UID: "aeb74a36-67b5-45b7-be9b-60029d5e1bef"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:55:58.713157 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:58.713133 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeb74a36-67b5-45b7-be9b-60029d5e1bef-kube-api-access-x7z8p" (OuterVolumeSpecName: "kube-api-access-x7z8p") pod "aeb74a36-67b5-45b7-be9b-60029d5e1bef" (UID: "aeb74a36-67b5-45b7-be9b-60029d5e1bef"). InnerVolumeSpecName "kube-api-access-x7z8p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:55:58.716112 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:58.716080 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeb74a36-67b5-45b7-be9b-60029d5e1bef-util" (OuterVolumeSpecName: "util") pod "aeb74a36-67b5-45b7-be9b-60029d5e1bef" (UID: "aeb74a36-67b5-45b7-be9b-60029d5e1bef"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:55:58.811722 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:58.811687 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aeb74a36-67b5-45b7-be9b-60029d5e1bef-bundle\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:55:58.811722 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:58.811720 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7z8p\" (UniqueName: \"kubernetes.io/projected/aeb74a36-67b5-45b7-be9b-60029d5e1bef-kube-api-access-x7z8p\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:55:58.811722 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:58.811731 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aeb74a36-67b5-45b7-be9b-60029d5e1bef-util\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:55:59.449259 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:59.449228 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq" event={"ID":"aeb74a36-67b5-45b7-be9b-60029d5e1bef","Type":"ContainerDied","Data":"eda9970f43f7355af2c404dd4350b3c2248640a7fd09bfa5358f09d5878d93ac"} Jul 17 17:55:59.449259 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:59.449260 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq" Jul 17 17:55:59.449712 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:55:59.449273 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eda9970f43f7355af2c404dd4350b3c2248640a7fd09bfa5358f09d5878d93ac" Jul 17 17:56:21.122046 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:21.122011 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-556cccc675-vhwbs"] Jul 17 17:56:46.146640 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.146543 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-556cccc675-vhwbs" podUID="7d5fae60-0776-497b-9bd3-c6ace0481494" containerName="console" containerID="cri-o://3be117a20c83067d3357fb7ee1e08efe01b1879d7b53e5ae82f94669ecc02a04" gracePeriod=15 Jul 17 17:56:46.392350 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.392326 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:56:46.483332 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.483258 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d5fae60-0776-497b-9bd3-c6ace0481494-console-config\") pod \"7d5fae60-0776-497b-9bd3-c6ace0481494\" (UID: \"7d5fae60-0776-497b-9bd3-c6ace0481494\") " Jul 17 17:56:46.483332 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.483301 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d5fae60-0776-497b-9bd3-c6ace0481494-console-serving-cert\") pod \"7d5fae60-0776-497b-9bd3-c6ace0481494\" (UID: \"7d5fae60-0776-497b-9bd3-c6ace0481494\") " Jul 17 17:56:46.483520 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.483337 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d5fae60-0776-497b-9bd3-c6ace0481494-console-oauth-config\") pod \"7d5fae60-0776-497b-9bd3-c6ace0481494\" (UID: \"7d5fae60-0776-497b-9bd3-c6ace0481494\") " Jul 17 17:56:46.483520 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.483367 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d5fae60-0776-497b-9bd3-c6ace0481494-oauth-serving-cert\") pod \"7d5fae60-0776-497b-9bd3-c6ace0481494\" (UID: \"7d5fae60-0776-497b-9bd3-c6ace0481494\") " Jul 17 17:56:46.483520 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.483410 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d5fae60-0776-497b-9bd3-c6ace0481494-service-ca\") pod \"7d5fae60-0776-497b-9bd3-c6ace0481494\" (UID: \"7d5fae60-0776-497b-9bd3-c6ace0481494\") " Jul 17 17:56:46.483520 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.483474 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d5fae60-0776-497b-9bd3-c6ace0481494-trusted-ca-bundle\") pod \"7d5fae60-0776-497b-9bd3-c6ace0481494\" (UID: \"7d5fae60-0776-497b-9bd3-c6ace0481494\") " Jul 17 17:56:46.483520 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.483514 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6f5q\" (UniqueName: \"kubernetes.io/projected/7d5fae60-0776-497b-9bd3-c6ace0481494-kube-api-access-b6f5q\") pod \"7d5fae60-0776-497b-9bd3-c6ace0481494\" (UID: \"7d5fae60-0776-497b-9bd3-c6ace0481494\") " Jul 17 17:56:46.483787 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.483734 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d5fae60-0776-497b-9bd3-c6ace0481494-console-config" (OuterVolumeSpecName: "console-config") pod "7d5fae60-0776-497b-9bd3-c6ace0481494" (UID: "7d5fae60-0776-497b-9bd3-c6ace0481494"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:56:46.483895 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.483861 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d5fae60-0776-497b-9bd3-c6ace0481494-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7d5fae60-0776-497b-9bd3-c6ace0481494" (UID: "7d5fae60-0776-497b-9bd3-c6ace0481494"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:56:46.483959 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.483917 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d5fae60-0776-497b-9bd3-c6ace0481494-service-ca" (OuterVolumeSpecName: "service-ca") pod "7d5fae60-0776-497b-9bd3-c6ace0481494" (UID: "7d5fae60-0776-497b-9bd3-c6ace0481494"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:56:46.483959 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.483923 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d5fae60-0776-497b-9bd3-c6ace0481494-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7d5fae60-0776-497b-9bd3-c6ace0481494" (UID: "7d5fae60-0776-497b-9bd3-c6ace0481494"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:56:46.485614 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.485589 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d5fae60-0776-497b-9bd3-c6ace0481494-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7d5fae60-0776-497b-9bd3-c6ace0481494" (UID: "7d5fae60-0776-497b-9bd3-c6ace0481494"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:56:46.485730 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.485708 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d5fae60-0776-497b-9bd3-c6ace0481494-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7d5fae60-0776-497b-9bd3-c6ace0481494" (UID: "7d5fae60-0776-497b-9bd3-c6ace0481494"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:56:46.485812 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.485738 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d5fae60-0776-497b-9bd3-c6ace0481494-kube-api-access-b6f5q" (OuterVolumeSpecName: "kube-api-access-b6f5q") pod "7d5fae60-0776-497b-9bd3-c6ace0481494" (UID: "7d5fae60-0776-497b-9bd3-c6ace0481494"). InnerVolumeSpecName "kube-api-access-b6f5q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:56:46.584942 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.584914 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d5fae60-0776-497b-9bd3-c6ace0481494-service-ca\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:56:46.585027 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.584945 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d5fae60-0776-497b-9bd3-c6ace0481494-trusted-ca-bundle\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:56:46.585027 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.584960 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6f5q\" (UniqueName: \"kubernetes.io/projected/7d5fae60-0776-497b-9bd3-c6ace0481494-kube-api-access-b6f5q\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:56:46.585027 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.584973 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d5fae60-0776-497b-9bd3-c6ace0481494-console-config\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:56:46.585027 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.584986 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d5fae60-0776-497b-9bd3-c6ace0481494-console-serving-cert\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:56:46.585027 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.584998 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d5fae60-0776-497b-9bd3-c6ace0481494-console-oauth-config\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:56:46.585027 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.585010 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d5fae60-0776-497b-9bd3-c6ace0481494-oauth-serving-cert\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:56:46.677894 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.677862 2580 generic.go:356] "Generic (PLEG): container finished" podID="7d5fae60-0776-497b-9bd3-c6ace0481494" containerID="3be117a20c83067d3357fb7ee1e08efe01b1879d7b53e5ae82f94669ecc02a04" exitCode=0 Jul 17 17:56:46.677995 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.677910 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-556cccc675-vhwbs" Jul 17 17:56:46.677995 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.677937 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-556cccc675-vhwbs" event={"ID":"7d5fae60-0776-497b-9bd3-c6ace0481494","Type":"ContainerDied","Data":"3be117a20c83067d3357fb7ee1e08efe01b1879d7b53e5ae82f94669ecc02a04"} Jul 17 17:56:46.677995 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.677982 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-556cccc675-vhwbs" event={"ID":"7d5fae60-0776-497b-9bd3-c6ace0481494","Type":"ContainerDied","Data":"c8ddd845052dcb0b7d5ae96d75c22115b83cd1ec2c41f2951495ec4fbe359250"} Jul 17 17:56:46.678092 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.678009 2580 scope.go:117] "RemoveContainer" containerID="3be117a20c83067d3357fb7ee1e08efe01b1879d7b53e5ae82f94669ecc02a04" Jul 17 17:56:46.687048 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.687027 2580 scope.go:117] "RemoveContainer" containerID="3be117a20c83067d3357fb7ee1e08efe01b1879d7b53e5ae82f94669ecc02a04" Jul 17 17:56:46.687275 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:56:46.687257 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3be117a20c83067d3357fb7ee1e08efe01b1879d7b53e5ae82f94669ecc02a04\": container with ID starting with 3be117a20c83067d3357fb7ee1e08efe01b1879d7b53e5ae82f94669ecc02a04 not found: ID does not exist" containerID="3be117a20c83067d3357fb7ee1e08efe01b1879d7b53e5ae82f94669ecc02a04" Jul 17 17:56:46.687319 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.687284 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3be117a20c83067d3357fb7ee1e08efe01b1879d7b53e5ae82f94669ecc02a04"} err="failed to get container status \"3be117a20c83067d3357fb7ee1e08efe01b1879d7b53e5ae82f94669ecc02a04\": rpc error: code = NotFound desc = could not find container \"3be117a20c83067d3357fb7ee1e08efe01b1879d7b53e5ae82f94669ecc02a04\": container with ID starting with 3be117a20c83067d3357fb7ee1e08efe01b1879d7b53e5ae82f94669ecc02a04 not found: ID does not exist" Jul 17 17:56:46.698947 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.698925 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-556cccc675-vhwbs"] Jul 17 17:56:46.702397 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:46.702379 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-556cccc675-vhwbs"] Jul 17 17:56:47.483550 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:56:47.483519 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d5fae60-0776-497b-9bd3-c6ace0481494" path="/var/lib/kubelet/pods/7d5fae60-0776-497b-9bd3-c6ace0481494/volumes" Jul 17 17:57:27.337717 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.337680 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lxzzt"] Jul 17 17:57:27.338220 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338043 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeb74a36-67b5-45b7-be9b-60029d5e1bef" containerName="util" Jul 17 17:57:27.338220 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338056 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeb74a36-67b5-45b7-be9b-60029d5e1bef" containerName="util" Jul 17 17:57:27.338220 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338069 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2cb8de7-9425-42e9-a2a9-5a811e4757d5" containerName="util" Jul 17 17:57:27.338220 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338076 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2cb8de7-9425-42e9-a2a9-5a811e4757d5" containerName="util" Jul 17 17:57:27.338220 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338089 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d5fae60-0776-497b-9bd3-c6ace0481494" containerName="console" Jul 17 17:57:27.338220 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338097 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d5fae60-0776-497b-9bd3-c6ace0481494" containerName="console" Jul 17 17:57:27.338220 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338114 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f" containerName="util" Jul 17 17:57:27.338220 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338126 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f" containerName="util" Jul 17 17:57:27.338220 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338139 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8" containerName="util" Jul 17 17:57:27.338220 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338145 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8" containerName="util" Jul 17 17:57:27.338220 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338150 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2cb8de7-9425-42e9-a2a9-5a811e4757d5" containerName="extract" Jul 17 17:57:27.338220 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338155 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2cb8de7-9425-42e9-a2a9-5a811e4757d5" containerName="extract" Jul 17 17:57:27.338220 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338162 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f" containerName="pull" Jul 17 17:57:27.338220 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338167 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f" containerName="pull" Jul 17 17:57:27.338220 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338174 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8" containerName="pull" Jul 17 17:57:27.338220 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338179 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8" containerName="pull" Jul 17 17:57:27.338220 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338188 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f" containerName="extract" Jul 17 17:57:27.338220 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338193 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f" containerName="extract" Jul 17 17:57:27.338220 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338201 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeb74a36-67b5-45b7-be9b-60029d5e1bef" containerName="pull" Jul 17 17:57:27.338220 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338208 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeb74a36-67b5-45b7-be9b-60029d5e1bef" containerName="pull" Jul 17 17:57:27.338220 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338216 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeb74a36-67b5-45b7-be9b-60029d5e1bef" containerName="extract" Jul 17 17:57:27.338220 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338221 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeb74a36-67b5-45b7-be9b-60029d5e1bef" containerName="extract" Jul 17 17:57:27.338220 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338230 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8" containerName="extract" Jul 17 17:57:27.339005 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338235 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8" containerName="extract" Jul 17 17:57:27.339005 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338242 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2cb8de7-9425-42e9-a2a9-5a811e4757d5" containerName="pull" Jul 17 17:57:27.339005 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338255 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2cb8de7-9425-42e9-a2a9-5a811e4757d5" containerName="pull" Jul 17 17:57:27.339005 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338343 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="aeb74a36-67b5-45b7-be9b-60029d5e1bef" containerName="extract" Jul 17 17:57:27.339005 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338352 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2cb8de7-9425-42e9-a2a9-5a811e4757d5" containerName="extract" Jul 17 17:57:27.339005 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338361 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d5fae60-0776-497b-9bd3-c6ace0481494" containerName="console" Jul 17 17:57:27.339005 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338372 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f" containerName="extract" Jul 17 17:57:27.339005 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.338382 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8" containerName="extract" Jul 17 17:57:27.342508 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.342492 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lxzzt" Jul 17 17:57:27.345188 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.345163 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 17 17:57:27.345319 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.345192 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 17 17:57:27.345472 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.345456 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-45nzb\"" Jul 17 17:57:27.346417 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.346400 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 17 17:57:27.351678 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.351655 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lxzzt"] Jul 17 17:57:27.397992 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.397970 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnr67\" (UniqueName: \"kubernetes.io/projected/0e2e79cf-ce3e-4bb8-8876-e1449f80affa-kube-api-access-fnr67\") pod \"limitador-limitador-64c94fd64f-lxzzt\" (UID: \"0e2e79cf-ce3e-4bb8-8876-e1449f80affa\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lxzzt" Jul 17 17:57:27.398113 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.398007 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0e2e79cf-ce3e-4bb8-8876-e1449f80affa-config-file\") pod \"limitador-limitador-64c94fd64f-lxzzt\" (UID: \"0e2e79cf-ce3e-4bb8-8876-e1449f80affa\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lxzzt" Jul 17 17:57:27.442478 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.442446 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lxzzt"] Jul 17 17:57:27.500627 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.500587 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnr67\" (UniqueName: \"kubernetes.io/projected/0e2e79cf-ce3e-4bb8-8876-e1449f80affa-kube-api-access-fnr67\") pod \"limitador-limitador-64c94fd64f-lxzzt\" (UID: \"0e2e79cf-ce3e-4bb8-8876-e1449f80affa\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lxzzt" Jul 17 17:57:27.500821 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.500680 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0e2e79cf-ce3e-4bb8-8876-e1449f80affa-config-file\") pod \"limitador-limitador-64c94fd64f-lxzzt\" (UID: \"0e2e79cf-ce3e-4bb8-8876-e1449f80affa\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lxzzt" Jul 17 17:57:27.502772 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.502731 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0e2e79cf-ce3e-4bb8-8876-e1449f80affa-config-file\") pod \"limitador-limitador-64c94fd64f-lxzzt\" (UID: \"0e2e79cf-ce3e-4bb8-8876-e1449f80affa\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lxzzt" Jul 17 17:57:27.510343 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.510322 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnr67\" (UniqueName: \"kubernetes.io/projected/0e2e79cf-ce3e-4bb8-8876-e1449f80affa-kube-api-access-fnr67\") pod \"limitador-limitador-64c94fd64f-lxzzt\" (UID: \"0e2e79cf-ce3e-4bb8-8876-e1449f80affa\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lxzzt" Jul 17 17:57:27.653255 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.653174 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lxzzt" Jul 17 17:57:27.787565 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.787537 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lxzzt"] Jul 17 17:57:27.789275 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:57:27.789249 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e2e79cf_ce3e_4bb8_8876_e1449f80affa.slice/crio-d5f6d219c51cd6cb4855792106f95d0b504415de8c8e10a0c24854670943ee43 WatchSource:0}: Error finding container d5f6d219c51cd6cb4855792106f95d0b504415de8c8e10a0c24854670943ee43: Status 404 returned error can't find the container with id d5f6d219c51cd6cb4855792106f95d0b504415de8c8e10a0c24854670943ee43 Jul 17 17:57:27.887976 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:27.887945 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lxzzt" event={"ID":"0e2e79cf-ce3e-4bb8-8876-e1449f80affa","Type":"ContainerStarted","Data":"d5f6d219c51cd6cb4855792106f95d0b504415de8c8e10a0c24854670943ee43"} Jul 17 17:57:30.905456 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:30.905418 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lxzzt" event={"ID":"0e2e79cf-ce3e-4bb8-8876-e1449f80affa","Type":"ContainerStarted","Data":"ac724e936692837f6f70db85e9a933bcf679aefb100e38e9f9b42c7b784e967b"} Jul 17 17:57:30.905885 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:30.905491 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-lxzzt" Jul 17 17:57:30.922714 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:30.922657 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-lxzzt" podStartSLOduration=1.312427814 podStartE2EDuration="3.922641006s" totalImagesPullingTime="2.610213192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:57:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:57:30.921372273 +0000 UTC m=+497.908588623" watchObservedRunningTime="2026-07-17 17:57:30.922641006 +0000 UTC m=+497.909857416" Jul 17 17:57:41.911558 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:41.911526 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-lxzzt" Jul 17 17:57:42.206458 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:42.206380 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lxzzt"] Jul 17 17:57:42.206632 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:42.206607 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-lxzzt" podUID="0e2e79cf-ce3e-4bb8-8876-e1449f80affa" containerName="limitador" containerID="cri-o://ac724e936692837f6f70db85e9a933bcf679aefb100e38e9f9b42c7b784e967b" gracePeriod=30 Jul 17 17:57:42.747025 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:42.747000 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lxzzt" Jul 17 17:57:42.819956 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:42.819927 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0e2e79cf-ce3e-4bb8-8876-e1449f80affa-config-file\") pod \"0e2e79cf-ce3e-4bb8-8876-e1449f80affa\" (UID: \"0e2e79cf-ce3e-4bb8-8876-e1449f80affa\") " Jul 17 17:57:42.820103 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:42.819979 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnr67\" (UniqueName: \"kubernetes.io/projected/0e2e79cf-ce3e-4bb8-8876-e1449f80affa-kube-api-access-fnr67\") pod \"0e2e79cf-ce3e-4bb8-8876-e1449f80affa\" (UID: \"0e2e79cf-ce3e-4bb8-8876-e1449f80affa\") " Jul 17 17:57:42.820269 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:42.820245 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e2e79cf-ce3e-4bb8-8876-e1449f80affa-config-file" (OuterVolumeSpecName: "config-file") pod "0e2e79cf-ce3e-4bb8-8876-e1449f80affa" (UID: "0e2e79cf-ce3e-4bb8-8876-e1449f80affa"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:57:42.822103 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:42.822078 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e2e79cf-ce3e-4bb8-8876-e1449f80affa-kube-api-access-fnr67" (OuterVolumeSpecName: "kube-api-access-fnr67") pod "0e2e79cf-ce3e-4bb8-8876-e1449f80affa" (UID: "0e2e79cf-ce3e-4bb8-8876-e1449f80affa"). InnerVolumeSpecName "kube-api-access-fnr67". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:57:42.921257 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:42.921229 2580 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0e2e79cf-ce3e-4bb8-8876-e1449f80affa-config-file\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:57:42.921257 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:42.921254 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnr67\" (UniqueName: \"kubernetes.io/projected/0e2e79cf-ce3e-4bb8-8876-e1449f80affa-kube-api-access-fnr67\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:57:42.969784 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:42.969729 2580 generic.go:356] "Generic (PLEG): container finished" podID="0e2e79cf-ce3e-4bb8-8876-e1449f80affa" containerID="ac724e936692837f6f70db85e9a933bcf679aefb100e38e9f9b42c7b784e967b" exitCode=0 Jul 17 17:57:42.969937 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:42.969791 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lxzzt" Jul 17 17:57:42.969937 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:42.969824 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lxzzt" event={"ID":"0e2e79cf-ce3e-4bb8-8876-e1449f80affa","Type":"ContainerDied","Data":"ac724e936692837f6f70db85e9a933bcf679aefb100e38e9f9b42c7b784e967b"} Jul 17 17:57:42.969937 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:42.969889 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lxzzt" event={"ID":"0e2e79cf-ce3e-4bb8-8876-e1449f80affa","Type":"ContainerDied","Data":"d5f6d219c51cd6cb4855792106f95d0b504415de8c8e10a0c24854670943ee43"} Jul 17 17:57:42.969937 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:42.969912 2580 scope.go:117] "RemoveContainer" containerID="ac724e936692837f6f70db85e9a933bcf679aefb100e38e9f9b42c7b784e967b" Jul 17 17:57:42.978676 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:42.978659 2580 scope.go:117] "RemoveContainer" containerID="ac724e936692837f6f70db85e9a933bcf679aefb100e38e9f9b42c7b784e967b" Jul 17 17:57:42.978942 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:57:42.978926 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac724e936692837f6f70db85e9a933bcf679aefb100e38e9f9b42c7b784e967b\": container with ID starting with ac724e936692837f6f70db85e9a933bcf679aefb100e38e9f9b42c7b784e967b not found: ID does not exist" containerID="ac724e936692837f6f70db85e9a933bcf679aefb100e38e9f9b42c7b784e967b" Jul 17 17:57:42.978989 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:42.978952 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac724e936692837f6f70db85e9a933bcf679aefb100e38e9f9b42c7b784e967b"} err="failed to get container status \"ac724e936692837f6f70db85e9a933bcf679aefb100e38e9f9b42c7b784e967b\": rpc error: code = NotFound desc = could not find container \"ac724e936692837f6f70db85e9a933bcf679aefb100e38e9f9b42c7b784e967b\": container with ID starting with ac724e936692837f6f70db85e9a933bcf679aefb100e38e9f9b42c7b784e967b not found: ID does not exist" Jul 17 17:57:42.993432 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:42.993411 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lxzzt"] Jul 17 17:57:42.996652 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:42.996628 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lxzzt"] Jul 17 17:57:43.483303 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:43.483270 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e2e79cf-ce3e-4bb8-8876-e1449f80affa" path="/var/lib/kubelet/pods/0e2e79cf-ce3e-4bb8-8876-e1449f80affa/volumes" Jul 17 17:57:48.204055 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:48.204024 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vsfc9"] Jul 17 17:57:48.204607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:48.204329 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e2e79cf-ce3e-4bb8-8876-e1449f80affa" containerName="limitador" Jul 17 17:57:48.204607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:48.204339 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e2e79cf-ce3e-4bb8-8876-e1449f80affa" containerName="limitador" Jul 17 17:57:48.204607 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:48.204408 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e2e79cf-ce3e-4bb8-8876-e1449f80affa" containerName="limitador" Jul 17 17:57:48.208474 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:48.208451 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vsfc9" Jul 17 17:57:48.211144 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:48.211118 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 17 17:57:48.212814 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:48.212527 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-dwq2h\"" Jul 17 17:57:48.212951 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:48.212913 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 17 17:57:48.213266 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:48.213140 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 17 17:57:48.217565 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:48.217540 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vsfc9"] Jul 17 17:57:48.260385 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:48.260356 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk48n\" (UniqueName: \"kubernetes.io/projected/426fa52e-3e5f-46dc-9592-5798beaa3874-kube-api-access-zk48n\") pod \"postgres-69fb4594cf-vsfc9\" (UID: \"426fa52e-3e5f-46dc-9592-5798beaa3874\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vsfc9" Jul 17 17:57:48.260490 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:48.260392 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/426fa52e-3e5f-46dc-9592-5798beaa3874-data\") pod \"postgres-69fb4594cf-vsfc9\" (UID: \"426fa52e-3e5f-46dc-9592-5798beaa3874\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vsfc9" Jul 17 17:57:48.361206 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:48.361183 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk48n\" (UniqueName: \"kubernetes.io/projected/426fa52e-3e5f-46dc-9592-5798beaa3874-kube-api-access-zk48n\") pod \"postgres-69fb4594cf-vsfc9\" (UID: \"426fa52e-3e5f-46dc-9592-5798beaa3874\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vsfc9" Jul 17 17:57:48.361307 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:48.361213 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/426fa52e-3e5f-46dc-9592-5798beaa3874-data\") pod \"postgres-69fb4594cf-vsfc9\" (UID: \"426fa52e-3e5f-46dc-9592-5798beaa3874\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vsfc9" Jul 17 17:57:48.361564 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:48.361549 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/426fa52e-3e5f-46dc-9592-5798beaa3874-data\") pod \"postgres-69fb4594cf-vsfc9\" (UID: \"426fa52e-3e5f-46dc-9592-5798beaa3874\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vsfc9" Jul 17 17:57:48.369584 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:48.369561 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk48n\" (UniqueName: \"kubernetes.io/projected/426fa52e-3e5f-46dc-9592-5798beaa3874-kube-api-access-zk48n\") pod \"postgres-69fb4594cf-vsfc9\" (UID: \"426fa52e-3e5f-46dc-9592-5798beaa3874\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vsfc9" Jul 17 17:57:48.525032 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:48.524960 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vsfc9" Jul 17 17:57:48.653828 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:48.653800 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vsfc9"] Jul 17 17:57:48.655718 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:57:48.655691 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod426fa52e_3e5f_46dc_9592_5798beaa3874.slice/crio-7e2679813b59526cf76fc42c56da1592bab83a18fcfdd6205987994e359c3cb9 WatchSource:0}: Error finding container 7e2679813b59526cf76fc42c56da1592bab83a18fcfdd6205987994e359c3cb9: Status 404 returned error can't find the container with id 7e2679813b59526cf76fc42c56da1592bab83a18fcfdd6205987994e359c3cb9 Jul 17 17:57:49.000766 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:49.000727 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vsfc9" event={"ID":"426fa52e-3e5f-46dc-9592-5798beaa3874","Type":"ContainerStarted","Data":"7e2679813b59526cf76fc42c56da1592bab83a18fcfdd6205987994e359c3cb9"} Jul 17 17:57:54.032382 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:54.032298 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vsfc9" event={"ID":"426fa52e-3e5f-46dc-9592-5798beaa3874","Type":"ContainerStarted","Data":"26b5bc96dd72be0061a29efab989abed920b1d54138da19acfcdbf36e9046b10"} Jul 17 17:57:54.032717 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:54.032418 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vsfc9" Jul 17 17:57:54.050855 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:57:54.050721 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vsfc9" podStartSLOduration=1.024327016 podStartE2EDuration="6.050708581s" totalImagesPullingTime="5.026381565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:57:54.049230525 +0000 UTC m=+521.036446902" watchObservedRunningTime="2026-07-17 17:57:54.050708581 +0000 UTC m=+521.037924937" Jul 17 17:58:00.067200 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:00.067168 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vsfc9" Jul 17 17:58:07.831510 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:07.831432 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-99c859fb6-7pkl4"] Jul 17 17:58:07.834883 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:07.834863 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-99c859fb6-7pkl4" Jul 17 17:58:07.837506 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:07.837478 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 17 17:58:07.837581 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:07.837511 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 17 17:58:07.837581 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:07.837560 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-2497n\"" Jul 17 17:58:07.843993 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:07.843970 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-99c859fb6-7pkl4"] Jul 17 17:58:07.922100 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:07.922068 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/691effcc-b677-4eb0-b748-273a1ba942f1-webhook-cert\") pod \"maas-controller-99c859fb6-7pkl4\" (UID: \"691effcc-b677-4eb0-b748-273a1ba942f1\") " pod="opendatahub/maas-controller-99c859fb6-7pkl4" Jul 17 17:58:07.922262 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:07.922108 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhkzb\" (UniqueName: \"kubernetes.io/projected/691effcc-b677-4eb0-b748-273a1ba942f1-kube-api-access-vhkzb\") pod \"maas-controller-99c859fb6-7pkl4\" (UID: \"691effcc-b677-4eb0-b748-273a1ba942f1\") " pod="opendatahub/maas-controller-99c859fb6-7pkl4" Jul 17 17:58:08.009591 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:08.009551 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c77fb6b4b-9g2zz"] Jul 17 17:58:08.013089 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:08.013066 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c77fb6b4b-9g2zz" Jul 17 17:58:08.021417 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:08.021393 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c77fb6b4b-9g2zz"] Jul 17 17:58:08.023524 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:08.023499 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhkzb\" (UniqueName: \"kubernetes.io/projected/691effcc-b677-4eb0-b748-273a1ba942f1-kube-api-access-vhkzb\") pod \"maas-controller-99c859fb6-7pkl4\" (UID: \"691effcc-b677-4eb0-b748-273a1ba942f1\") " pod="opendatahub/maas-controller-99c859fb6-7pkl4" Jul 17 17:58:08.023656 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:08.023637 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/691effcc-b677-4eb0-b748-273a1ba942f1-webhook-cert\") pod \"maas-controller-99c859fb6-7pkl4\" (UID: \"691effcc-b677-4eb0-b748-273a1ba942f1\") " pod="opendatahub/maas-controller-99c859fb6-7pkl4" Jul 17 17:58:08.026448 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:08.026426 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/691effcc-b677-4eb0-b748-273a1ba942f1-webhook-cert\") pod \"maas-controller-99c859fb6-7pkl4\" (UID: \"691effcc-b677-4eb0-b748-273a1ba942f1\") " pod="opendatahub/maas-controller-99c859fb6-7pkl4" Jul 17 17:58:08.035380 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:08.035357 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhkzb\" (UniqueName: \"kubernetes.io/projected/691effcc-b677-4eb0-b748-273a1ba942f1-kube-api-access-vhkzb\") pod \"maas-controller-99c859fb6-7pkl4\" (UID: \"691effcc-b677-4eb0-b748-273a1ba942f1\") " pod="opendatahub/maas-controller-99c859fb6-7pkl4" Jul 17 17:58:08.124423 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:08.124340 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/559520c0-75ab-49ed-b112-c1932a24ebbe-webhook-cert\") pod \"maas-controller-5c77fb6b4b-9g2zz\" (UID: \"559520c0-75ab-49ed-b112-c1932a24ebbe\") " pod="opendatahub/maas-controller-5c77fb6b4b-9g2zz" Jul 17 17:58:08.124423 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:08.124394 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5wsl\" (UniqueName: \"kubernetes.io/projected/559520c0-75ab-49ed-b112-c1932a24ebbe-kube-api-access-k5wsl\") pod \"maas-controller-5c77fb6b4b-9g2zz\" (UID: \"559520c0-75ab-49ed-b112-c1932a24ebbe\") " pod="opendatahub/maas-controller-5c77fb6b4b-9g2zz" Jul 17 17:58:08.146302 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:08.146279 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-99c859fb6-7pkl4" Jul 17 17:58:08.225860 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:08.225829 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5wsl\" (UniqueName: \"kubernetes.io/projected/559520c0-75ab-49ed-b112-c1932a24ebbe-kube-api-access-k5wsl\") pod \"maas-controller-5c77fb6b4b-9g2zz\" (UID: \"559520c0-75ab-49ed-b112-c1932a24ebbe\") " pod="opendatahub/maas-controller-5c77fb6b4b-9g2zz" Jul 17 17:58:08.225999 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:08.225910 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/559520c0-75ab-49ed-b112-c1932a24ebbe-webhook-cert\") pod \"maas-controller-5c77fb6b4b-9g2zz\" (UID: \"559520c0-75ab-49ed-b112-c1932a24ebbe\") " pod="opendatahub/maas-controller-5c77fb6b4b-9g2zz" Jul 17 17:58:08.228845 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:08.228484 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/559520c0-75ab-49ed-b112-c1932a24ebbe-webhook-cert\") pod \"maas-controller-5c77fb6b4b-9g2zz\" (UID: \"559520c0-75ab-49ed-b112-c1932a24ebbe\") " pod="opendatahub/maas-controller-5c77fb6b4b-9g2zz" Jul 17 17:58:08.234534 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:08.234506 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5wsl\" (UniqueName: \"kubernetes.io/projected/559520c0-75ab-49ed-b112-c1932a24ebbe-kube-api-access-k5wsl\") pod \"maas-controller-5c77fb6b4b-9g2zz\" (UID: \"559520c0-75ab-49ed-b112-c1932a24ebbe\") " pod="opendatahub/maas-controller-5c77fb6b4b-9g2zz" Jul 17 17:58:08.283769 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:08.283720 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-99c859fb6-7pkl4"] Jul 17 17:58:08.285647 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:58:08.285621 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod691effcc_b677_4eb0_b748_273a1ba942f1.slice/crio-fcb73445f6321956de506f896450de3d025750a73f6928203227acdf28b67d36 WatchSource:0}: Error finding container fcb73445f6321956de506f896450de3d025750a73f6928203227acdf28b67d36: Status 404 returned error can't find the container with id fcb73445f6321956de506f896450de3d025750a73f6928203227acdf28b67d36 Jul 17 17:58:08.324375 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:08.324345 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c77fb6b4b-9g2zz" Jul 17 17:58:08.462396 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:08.462371 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c77fb6b4b-9g2zz"] Jul 17 17:58:08.464317 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:58:08.464283 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod559520c0_75ab_49ed_b112_c1932a24ebbe.slice/crio-49090a3877976fead9a133ce70743701023b98fa53e4c64a40b28986fec72d36 WatchSource:0}: Error finding container 49090a3877976fead9a133ce70743701023b98fa53e4c64a40b28986fec72d36: Status 404 returned error can't find the container with id 49090a3877976fead9a133ce70743701023b98fa53e4c64a40b28986fec72d36 Jul 17 17:58:09.117015 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:09.116923 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c77fb6b4b-9g2zz" event={"ID":"559520c0-75ab-49ed-b112-c1932a24ebbe","Type":"ContainerStarted","Data":"49090a3877976fead9a133ce70743701023b98fa53e4c64a40b28986fec72d36"} Jul 17 17:58:09.118815 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:09.118717 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-99c859fb6-7pkl4" event={"ID":"691effcc-b677-4eb0-b748-273a1ba942f1","Type":"ContainerStarted","Data":"fcb73445f6321956de506f896450de3d025750a73f6928203227acdf28b67d36"} Jul 17 17:58:11.130680 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:11.130645 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c77fb6b4b-9g2zz" event={"ID":"559520c0-75ab-49ed-b112-c1932a24ebbe","Type":"ContainerStarted","Data":"149488a9bdce5315706d580d312a9cc97863e6c3ec9e9dbca40ebd0217aaaac2"} Jul 17 17:58:11.131327 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:11.130709 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c77fb6b4b-9g2zz" Jul 17 17:58:11.132285 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:11.132260 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-99c859fb6-7pkl4" event={"ID":"691effcc-b677-4eb0-b748-273a1ba942f1","Type":"ContainerStarted","Data":"25a890bfd2f800b167a6472ec8e9211cdb1c82d1a4be5f616d18e8c3a1c4b955"} Jul 17 17:58:11.132439 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:11.132386 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-99c859fb6-7pkl4" Jul 17 17:58:11.147206 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:11.147160 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c77fb6b4b-9g2zz" podStartSLOduration=1.579387105 podStartE2EDuration="4.147141927s" totalImagesPullingTime="2.567754822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:58:11.145941272 +0000 UTC m=+538.133157639" watchObservedRunningTime="2026-07-17 17:58:11.147141927 +0000 UTC m=+538.134358279" Jul 17 17:58:11.162138 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:11.162091 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-99c859fb6-7pkl4" podStartSLOduration=1.405332952 podStartE2EDuration="4.162075194s" totalImagesPullingTime="2.756742242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:58:11.161827588 +0000 UTC m=+538.149043956" watchObservedRunningTime="2026-07-17 17:58:11.162075194 +0000 UTC m=+538.149291543" Jul 17 17:58:22.140222 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:22.140188 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c77fb6b4b-9g2zz" Jul 17 17:58:22.140632 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:22.140261 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-99c859fb6-7pkl4" Jul 17 17:58:22.201516 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:22.201482 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-99c859fb6-7pkl4"] Jul 17 17:58:22.201700 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:22.201669 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-99c859fb6-7pkl4" podUID="691effcc-b677-4eb0-b748-273a1ba942f1" containerName="manager" containerID="cri-o://25a890bfd2f800b167a6472ec8e9211cdb1c82d1a4be5f616d18e8c3a1c4b955" gracePeriod=30 Jul 17 17:58:22.439431 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:22.439405 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-99c859fb6-7pkl4" Jul 17 17:58:22.543669 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:22.543641 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/691effcc-b677-4eb0-b748-273a1ba942f1-webhook-cert\") pod \"691effcc-b677-4eb0-b748-273a1ba942f1\" (UID: \"691effcc-b677-4eb0-b748-273a1ba942f1\") " Jul 17 17:58:22.543837 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:22.543739 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhkzb\" (UniqueName: \"kubernetes.io/projected/691effcc-b677-4eb0-b748-273a1ba942f1-kube-api-access-vhkzb\") pod \"691effcc-b677-4eb0-b748-273a1ba942f1\" (UID: \"691effcc-b677-4eb0-b748-273a1ba942f1\") " Jul 17 17:58:22.545798 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:22.545771 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/691effcc-b677-4eb0-b748-273a1ba942f1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "691effcc-b677-4eb0-b748-273a1ba942f1" (UID: "691effcc-b677-4eb0-b748-273a1ba942f1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:58:22.545980 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:22.545955 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/691effcc-b677-4eb0-b748-273a1ba942f1-kube-api-access-vhkzb" (OuterVolumeSpecName: "kube-api-access-vhkzb") pod "691effcc-b677-4eb0-b748-273a1ba942f1" (UID: "691effcc-b677-4eb0-b748-273a1ba942f1"). InnerVolumeSpecName "kube-api-access-vhkzb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:58:22.644698 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:22.644663 2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/691effcc-b677-4eb0-b748-273a1ba942f1-webhook-cert\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:58:22.644698 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:22.644689 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhkzb\" (UniqueName: \"kubernetes.io/projected/691effcc-b677-4eb0-b748-273a1ba942f1-kube-api-access-vhkzb\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 17:58:23.196874 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:23.196842 2580 generic.go:356] "Generic (PLEG): container finished" podID="691effcc-b677-4eb0-b748-273a1ba942f1" containerID="25a890bfd2f800b167a6472ec8e9211cdb1c82d1a4be5f616d18e8c3a1c4b955" exitCode=0 Jul 17 17:58:23.197328 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:23.196885 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-99c859fb6-7pkl4" Jul 17 17:58:23.197328 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:23.196933 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-99c859fb6-7pkl4" event={"ID":"691effcc-b677-4eb0-b748-273a1ba942f1","Type":"ContainerDied","Data":"25a890bfd2f800b167a6472ec8e9211cdb1c82d1a4be5f616d18e8c3a1c4b955"} Jul 17 17:58:23.197328 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:23.196992 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-99c859fb6-7pkl4" event={"ID":"691effcc-b677-4eb0-b748-273a1ba942f1","Type":"ContainerDied","Data":"fcb73445f6321956de506f896450de3d025750a73f6928203227acdf28b67d36"} Jul 17 17:58:23.197328 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:23.197025 2580 scope.go:117] "RemoveContainer" containerID="25a890bfd2f800b167a6472ec8e9211cdb1c82d1a4be5f616d18e8c3a1c4b955" Jul 17 17:58:23.206408 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:23.206263 2580 scope.go:117] "RemoveContainer" containerID="25a890bfd2f800b167a6472ec8e9211cdb1c82d1a4be5f616d18e8c3a1c4b955" Jul 17 17:58:23.206526 ip-10-0-135-140 kubenswrapper[2580]: E0717 17:58:23.206508 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25a890bfd2f800b167a6472ec8e9211cdb1c82d1a4be5f616d18e8c3a1c4b955\": container with ID starting with 25a890bfd2f800b167a6472ec8e9211cdb1c82d1a4be5f616d18e8c3a1c4b955 not found: ID does not exist" containerID="25a890bfd2f800b167a6472ec8e9211cdb1c82d1a4be5f616d18e8c3a1c4b955" Jul 17 17:58:23.206565 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:23.206534 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25a890bfd2f800b167a6472ec8e9211cdb1c82d1a4be5f616d18e8c3a1c4b955"} err="failed to get container status \"25a890bfd2f800b167a6472ec8e9211cdb1c82d1a4be5f616d18e8c3a1c4b955\": rpc error: code = NotFound desc = could not find container \"25a890bfd2f800b167a6472ec8e9211cdb1c82d1a4be5f616d18e8c3a1c4b955\": container with ID starting with 25a890bfd2f800b167a6472ec8e9211cdb1c82d1a4be5f616d18e8c3a1c4b955 not found: ID does not exist" Jul 17 17:58:23.218359 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:23.218334 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-99c859fb6-7pkl4"] Jul 17 17:58:23.222035 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:23.222016 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-99c859fb6-7pkl4"] Jul 17 17:58:23.489255 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:23.489177 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="691effcc-b677-4eb0-b748-273a1ba942f1" path="/var/lib/kubelet/pods/691effcc-b677-4eb0-b748-273a1ba942f1/volumes" Jul 17 17:58:44.555352 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:44.555317 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-86c4f86d59-95c2p"] Jul 17 17:58:44.555838 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:44.555818 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="691effcc-b677-4eb0-b748-273a1ba942f1" containerName="manager" Jul 17 17:58:44.555838 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:44.555833 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="691effcc-b677-4eb0-b748-273a1ba942f1" containerName="manager" Jul 17 17:58:44.555938 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:44.555905 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="691effcc-b677-4eb0-b748-273a1ba942f1" containerName="manager" Jul 17 17:58:44.560840 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:44.560822 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-86c4f86d59-95c2p" Jul 17 17:58:44.563883 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:44.563864 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 17 17:58:44.563999 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:44.563870 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-pkvnd\"" Jul 17 17:58:44.571235 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:44.571217 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-86c4f86d59-95c2p"] Jul 17 17:58:44.617523 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:44.617498 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84f8a59b-3f84-463e-ac52-cc7897224ab8-openshift-service-ca\") pod \"maas-api-86c4f86d59-95c2p\" (UID: \"84f8a59b-3f84-463e-ac52-cc7897224ab8\") " pod="odh-ai-gateway-infra/maas-api-86c4f86d59-95c2p" Jul 17 17:58:44.617643 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:44.617552 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84f8a59b-3f84-463e-ac52-cc7897224ab8-maas-api-tls\") pod \"maas-api-86c4f86d59-95c2p\" (UID: \"84f8a59b-3f84-463e-ac52-cc7897224ab8\") " pod="odh-ai-gateway-infra/maas-api-86c4f86d59-95c2p" Jul 17 17:58:44.617643 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:44.617575 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sm97\" (UniqueName: \"kubernetes.io/projected/84f8a59b-3f84-463e-ac52-cc7897224ab8-kube-api-access-6sm97\") pod \"maas-api-86c4f86d59-95c2p\" (UID: \"84f8a59b-3f84-463e-ac52-cc7897224ab8\") " pod="odh-ai-gateway-infra/maas-api-86c4f86d59-95c2p" Jul 17 17:58:44.718964 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:44.718927 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84f8a59b-3f84-463e-ac52-cc7897224ab8-maas-api-tls\") pod \"maas-api-86c4f86d59-95c2p\" (UID: \"84f8a59b-3f84-463e-ac52-cc7897224ab8\") " pod="odh-ai-gateway-infra/maas-api-86c4f86d59-95c2p" Jul 17 17:58:44.719150 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:44.719020 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sm97\" (UniqueName: \"kubernetes.io/projected/84f8a59b-3f84-463e-ac52-cc7897224ab8-kube-api-access-6sm97\") pod \"maas-api-86c4f86d59-95c2p\" (UID: \"84f8a59b-3f84-463e-ac52-cc7897224ab8\") " pod="odh-ai-gateway-infra/maas-api-86c4f86d59-95c2p" Jul 17 17:58:44.719222 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:44.719152 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84f8a59b-3f84-463e-ac52-cc7897224ab8-openshift-service-ca\") pod \"maas-api-86c4f86d59-95c2p\" (UID: \"84f8a59b-3f84-463e-ac52-cc7897224ab8\") " pod="odh-ai-gateway-infra/maas-api-86c4f86d59-95c2p" Jul 17 17:58:44.720043 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:44.720017 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84f8a59b-3f84-463e-ac52-cc7897224ab8-openshift-service-ca\") pod \"maas-api-86c4f86d59-95c2p\" (UID: \"84f8a59b-3f84-463e-ac52-cc7897224ab8\") " pod="odh-ai-gateway-infra/maas-api-86c4f86d59-95c2p" Jul 17 17:58:44.722209 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:44.722184 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84f8a59b-3f84-463e-ac52-cc7897224ab8-maas-api-tls\") pod \"maas-api-86c4f86d59-95c2p\" (UID: \"84f8a59b-3f84-463e-ac52-cc7897224ab8\") " pod="odh-ai-gateway-infra/maas-api-86c4f86d59-95c2p" Jul 17 17:58:44.726856 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:44.726834 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sm97\" (UniqueName: \"kubernetes.io/projected/84f8a59b-3f84-463e-ac52-cc7897224ab8-kube-api-access-6sm97\") pod \"maas-api-86c4f86d59-95c2p\" (UID: \"84f8a59b-3f84-463e-ac52-cc7897224ab8\") " pod="odh-ai-gateway-infra/maas-api-86c4f86d59-95c2p" Jul 17 17:58:44.871979 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:44.871938 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-86c4f86d59-95c2p" Jul 17 17:58:45.022399 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:45.022204 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-86c4f86d59-95c2p"] Jul 17 17:58:45.024729 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:58:45.024697 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84f8a59b_3f84_463e_ac52_cc7897224ab8.slice/crio-a4b6d0ca8e2627935c287f64e90d0f1b1bc43fed7e387f0e64dbc5c79903c3dc WatchSource:0}: Error finding container a4b6d0ca8e2627935c287f64e90d0f1b1bc43fed7e387f0e64dbc5c79903c3dc: Status 404 returned error can't find the container with id a4b6d0ca8e2627935c287f64e90d0f1b1bc43fed7e387f0e64dbc5c79903c3dc Jul 17 17:58:45.033221 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:45.033199 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-fzbr9"] Jul 17 17:58:45.037459 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:45.037439 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-fzbr9" Jul 17 17:58:45.040007 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:45.039984 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 17 17:58:45.040305 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:45.040285 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-ggssl\"" Jul 17 17:58:45.047087 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:45.047065 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-fzbr9"] Jul 17 17:58:45.123242 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:45.123156 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8bst\" (UniqueName: \"kubernetes.io/projected/a1cb1641-f574-4c14-96c4-683d35e40c0f-kube-api-access-j8bst\") pod \"payload-processing-5bf47cd988-fzbr9\" (UID: \"a1cb1641-f574-4c14-96c4-683d35e40c0f\") " pod="openshift-ingress/payload-processing-5bf47cd988-fzbr9" Jul 17 17:58:45.123386 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:45.123333 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1cb1641-f574-4c14-96c4-683d35e40c0f-plugins-config-volume\") pod \"payload-processing-5bf47cd988-fzbr9\" (UID: \"a1cb1641-f574-4c14-96c4-683d35e40c0f\") " pod="openshift-ingress/payload-processing-5bf47cd988-fzbr9" Jul 17 17:58:45.223915 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:45.223887 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1cb1641-f574-4c14-96c4-683d35e40c0f-plugins-config-volume\") pod \"payload-processing-5bf47cd988-fzbr9\" (UID: \"a1cb1641-f574-4c14-96c4-683d35e40c0f\") " pod="openshift-ingress/payload-processing-5bf47cd988-fzbr9" Jul 17 17:58:45.224081 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:45.223931 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8bst\" (UniqueName: \"kubernetes.io/projected/a1cb1641-f574-4c14-96c4-683d35e40c0f-kube-api-access-j8bst\") pod \"payload-processing-5bf47cd988-fzbr9\" (UID: \"a1cb1641-f574-4c14-96c4-683d35e40c0f\") " pod="openshift-ingress/payload-processing-5bf47cd988-fzbr9" Jul 17 17:58:45.224707 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:45.224683 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1cb1641-f574-4c14-96c4-683d35e40c0f-plugins-config-volume\") pod \"payload-processing-5bf47cd988-fzbr9\" (UID: \"a1cb1641-f574-4c14-96c4-683d35e40c0f\") " pod="openshift-ingress/payload-processing-5bf47cd988-fzbr9" Jul 17 17:58:45.233247 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:45.233222 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8bst\" (UniqueName: \"kubernetes.io/projected/a1cb1641-f574-4c14-96c4-683d35e40c0f-kube-api-access-j8bst\") pod \"payload-processing-5bf47cd988-fzbr9\" (UID: \"a1cb1641-f574-4c14-96c4-683d35e40c0f\") " pod="openshift-ingress/payload-processing-5bf47cd988-fzbr9" Jul 17 17:58:45.306645 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:45.306609 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-86c4f86d59-95c2p" event={"ID":"84f8a59b-3f84-463e-ac52-cc7897224ab8","Type":"ContainerStarted","Data":"a4b6d0ca8e2627935c287f64e90d0f1b1bc43fed7e387f0e64dbc5c79903c3dc"} Jul 17 17:58:45.351146 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:45.351114 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-fzbr9" Jul 17 17:58:45.497723 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:45.497694 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-fzbr9"] Jul 17 17:58:45.499098 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:58:45.499071 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1cb1641_f574_4c14_96c4_683d35e40c0f.slice/crio-a668bd6afa8ce83e4c663185485dc67373db07f2916a052df07881a79e880f32 WatchSource:0}: Error finding container a668bd6afa8ce83e4c663185485dc67373db07f2916a052df07881a79e880f32: Status 404 returned error can't find the container with id a668bd6afa8ce83e4c663185485dc67373db07f2916a052df07881a79e880f32 Jul 17 17:58:46.316055 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:46.316010 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-fzbr9" event={"ID":"a1cb1641-f574-4c14-96c4-683d35e40c0f","Type":"ContainerStarted","Data":"a668bd6afa8ce83e4c663185485dc67373db07f2916a052df07881a79e880f32"} Jul 17 17:58:47.322533 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:47.322443 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-86c4f86d59-95c2p" event={"ID":"84f8a59b-3f84-463e-ac52-cc7897224ab8","Type":"ContainerStarted","Data":"7568d6b557f9ec38a4b3125e0a74ea092eec7ab3b8f20a408ed6f7e95dba4935"} Jul 17 17:58:47.322533 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:47.322515 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-86c4f86d59-95c2p" Jul 17 17:58:47.324162 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:47.324137 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-fzbr9" event={"ID":"a1cb1641-f574-4c14-96c4-683d35e40c0f","Type":"ContainerStarted","Data":"035f471a029b46560c966a03f325dd4099426e2e159f53695a52e53bd65db091"} Jul 17 17:58:47.324453 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:47.324262 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-fzbr9" Jul 17 17:58:47.338710 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:47.338668 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-86c4f86d59-95c2p" podStartSLOduration=1.618856888 podStartE2EDuration="3.338654415s" totalImagesPullingTime="1.719797527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:58:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:58:47.337773065 +0000 UTC m=+574.324989434" watchObservedRunningTime="2026-07-17 17:58:47.338654415 +0000 UTC m=+574.325870764" Jul 17 17:58:47.352963 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:47.352917 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-fzbr9" podStartSLOduration=0.741830028 podStartE2EDuration="2.352903341s" totalImagesPullingTime="1.611073313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:58:47.351222367 +0000 UTC m=+574.338438737" watchObservedRunningTime="2026-07-17 17:58:47.352903341 +0000 UTC m=+574.340119734" Jul 17 17:58:53.334509 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:53.334482 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-86c4f86d59-95c2p" Jul 17 17:58:58.331322 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:58:58.331287 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-fzbr9" Jul 17 17:59:10.408666 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:10.408630 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4"] Jul 17 17:59:10.412188 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:10.412172 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4" Jul 17 17:59:10.415971 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:10.415924 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 17 17:59:10.415971 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:10.415955 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 17 17:59:10.415971 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:10.415962 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 17 17:59:10.416218 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:10.416006 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fv28k\"" Jul 17 17:59:10.422408 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:10.422388 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4"] Jul 17 17:59:10.533502 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:10.533461 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9e3f2dd-1d54-41c9-a0cc-decf8db520ed-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9hr4\" (UID: \"d9e3f2dd-1d54-41c9-a0cc-decf8db520ed\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4" Jul 17 17:59:10.533502 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:10.533505 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9e3f2dd-1d54-41c9-a0cc-decf8db520ed-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9hr4\" (UID: \"d9e3f2dd-1d54-41c9-a0cc-decf8db520ed\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4" Jul 17 17:59:10.533768 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:10.533571 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9e3f2dd-1d54-41c9-a0cc-decf8db520ed-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9hr4\" (UID: \"d9e3f2dd-1d54-41c9-a0cc-decf8db520ed\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4" Jul 17 17:59:10.533768 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:10.533651 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9e3f2dd-1d54-41c9-a0cc-decf8db520ed-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9hr4\" (UID: \"d9e3f2dd-1d54-41c9-a0cc-decf8db520ed\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4" Jul 17 17:59:10.533768 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:10.533677 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9e3f2dd-1d54-41c9-a0cc-decf8db520ed-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9hr4\" (UID: \"d9e3f2dd-1d54-41c9-a0cc-decf8db520ed\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4" Jul 17 17:59:10.533768 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:10.533725 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n578\" (UniqueName: \"kubernetes.io/projected/d9e3f2dd-1d54-41c9-a0cc-decf8db520ed-kube-api-access-8n578\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9hr4\" (UID: \"d9e3f2dd-1d54-41c9-a0cc-decf8db520ed\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4" Jul 17 17:59:10.634429 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:10.634392 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9e3f2dd-1d54-41c9-a0cc-decf8db520ed-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9hr4\" (UID: \"d9e3f2dd-1d54-41c9-a0cc-decf8db520ed\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4" Jul 17 17:59:10.634429 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:10.634430 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9e3f2dd-1d54-41c9-a0cc-decf8db520ed-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9hr4\" (UID: \"d9e3f2dd-1d54-41c9-a0cc-decf8db520ed\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4" Jul 17 17:59:10.634662 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:10.634455 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9e3f2dd-1d54-41c9-a0cc-decf8db520ed-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9hr4\" (UID: \"d9e3f2dd-1d54-41c9-a0cc-decf8db520ed\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4" Jul 17 17:59:10.634662 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:10.634506 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9e3f2dd-1d54-41c9-a0cc-decf8db520ed-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9hr4\" (UID: \"d9e3f2dd-1d54-41c9-a0cc-decf8db520ed\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4" Jul 17 17:59:10.634662 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:10.634533 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9e3f2dd-1d54-41c9-a0cc-decf8db520ed-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9hr4\" (UID: \"d9e3f2dd-1d54-41c9-a0cc-decf8db520ed\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4" Jul 17 17:59:10.634662 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:10.634582 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n578\" (UniqueName: \"kubernetes.io/projected/d9e3f2dd-1d54-41c9-a0cc-decf8db520ed-kube-api-access-8n578\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9hr4\" (UID: \"d9e3f2dd-1d54-41c9-a0cc-decf8db520ed\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4" Jul 17 17:59:10.634908 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:10.634863 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9e3f2dd-1d54-41c9-a0cc-decf8db520ed-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9hr4\" (UID: \"d9e3f2dd-1d54-41c9-a0cc-decf8db520ed\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4" Jul 17 17:59:10.634908 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:10.634877 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9e3f2dd-1d54-41c9-a0cc-decf8db520ed-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9hr4\" (UID: \"d9e3f2dd-1d54-41c9-a0cc-decf8db520ed\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4" Jul 17 17:59:10.635003 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:10.634955 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9e3f2dd-1d54-41c9-a0cc-decf8db520ed-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9hr4\" (UID: \"d9e3f2dd-1d54-41c9-a0cc-decf8db520ed\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4" Jul 17 17:59:10.636834 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:10.636811 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9e3f2dd-1d54-41c9-a0cc-decf8db520ed-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9hr4\" (UID: \"d9e3f2dd-1d54-41c9-a0cc-decf8db520ed\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4" Jul 17 17:59:10.637139 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:10.637118 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9e3f2dd-1d54-41c9-a0cc-decf8db520ed-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9hr4\" (UID: \"d9e3f2dd-1d54-41c9-a0cc-decf8db520ed\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4" Jul 17 17:59:10.642327 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:10.642302 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n578\" (UniqueName: \"kubernetes.io/projected/d9e3f2dd-1d54-41c9-a0cc-decf8db520ed-kube-api-access-8n578\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9hr4\" (UID: \"d9e3f2dd-1d54-41c9-a0cc-decf8db520ed\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4" Jul 17 17:59:10.722542 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:10.722473 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4" Jul 17 17:59:10.856420 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:10.856394 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4"] Jul 17 17:59:10.858443 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:59:10.858405 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9e3f2dd_1d54_41c9_a0cc_decf8db520ed.slice/crio-2cf94ed5ef6b6888fc5efe6bc3540c2d2495d5392954d9924cf50ae3b2d4a8f7 WatchSource:0}: Error finding container 2cf94ed5ef6b6888fc5efe6bc3540c2d2495d5392954d9924cf50ae3b2d4a8f7: Status 404 returned error can't find the container with id 2cf94ed5ef6b6888fc5efe6bc3540c2d2495d5392954d9924cf50ae3b2d4a8f7 Jul 17 17:59:11.457239 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:11.457202 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4" event={"ID":"d9e3f2dd-1d54-41c9-a0cc-decf8db520ed","Type":"ContainerStarted","Data":"2cf94ed5ef6b6888fc5efe6bc3540c2d2495d5392954d9924cf50ae3b2d4a8f7"} Jul 17 17:59:12.465183 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:12.465150 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4" event={"ID":"d9e3f2dd-1d54-41c9-a0cc-decf8db520ed","Type":"ContainerStarted","Data":"9df10cdd84117718de792579707f8a045ea5d99659b49858db21c60a7a2acb9b"} Jul 17 17:59:12.483540 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:12.483494 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4" podStartSLOduration=1.45883873 podStartE2EDuration="2.483477181s" totalImagesPullingTime="1.024638451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:59:12.482276771 +0000 UTC m=+599.469493141" watchObservedRunningTime="2026-07-17 17:59:12.483477181 +0000 UTC m=+599.470693531" Jul 17 17:59:13.400622 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:13.400596 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kcmzb_36b82608-4a35-44da-9af1-6d56c88cb1e2/console-operator/2.log" Jul 17 17:59:13.401353 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:13.401332 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kcmzb_36b82608-4a35-44da-9af1-6d56c88cb1e2/console-operator/2.log" Jul 17 17:59:20.722638 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:20.722606 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4" Jul 17 17:59:20.726483 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:20.722690 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4" Jul 17 17:59:20.734804 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:20.734783 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4" Jul 17 17:59:21.520289 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:21.520255 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9hr4" Jul 17 17:59:23.111406 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:23.111371 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9"] Jul 17 17:59:23.115643 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:23.115623 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9" Jul 17 17:59:23.118435 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:23.118410 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 17 17:59:23.124447 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:23.124424 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9"] Jul 17 17:59:23.245257 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:23.245227 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c8d8425-8279-4415-9ddf-b8666182abeb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9\" (UID: \"9c8d8425-8279-4415-9ddf-b8666182abeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9" Jul 17 17:59:23.245257 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:23.245261 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c8d8425-8279-4415-9ddf-b8666182abeb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9\" (UID: \"9c8d8425-8279-4415-9ddf-b8666182abeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9" Jul 17 17:59:23.245506 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:23.245362 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c8d8425-8279-4415-9ddf-b8666182abeb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9\" (UID: \"9c8d8425-8279-4415-9ddf-b8666182abeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9" Jul 17 17:59:23.245506 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:23.245393 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c8d8425-8279-4415-9ddf-b8666182abeb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9\" (UID: \"9c8d8425-8279-4415-9ddf-b8666182abeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9" Jul 17 17:59:23.245506 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:23.245415 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcjtn\" (UniqueName: \"kubernetes.io/projected/9c8d8425-8279-4415-9ddf-b8666182abeb-kube-api-access-qcjtn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9\" (UID: \"9c8d8425-8279-4415-9ddf-b8666182abeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9" Jul 17 17:59:23.245506 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:23.245491 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c8d8425-8279-4415-9ddf-b8666182abeb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9\" (UID: \"9c8d8425-8279-4415-9ddf-b8666182abeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9" Jul 17 17:59:23.346088 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:23.346058 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c8d8425-8279-4415-9ddf-b8666182abeb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9\" (UID: \"9c8d8425-8279-4415-9ddf-b8666182abeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9" Jul 17 17:59:23.346242 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:23.346106 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c8d8425-8279-4415-9ddf-b8666182abeb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9\" (UID: \"9c8d8425-8279-4415-9ddf-b8666182abeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9" Jul 17 17:59:23.346242 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:23.346126 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcjtn\" (UniqueName: \"kubernetes.io/projected/9c8d8425-8279-4415-9ddf-b8666182abeb-kube-api-access-qcjtn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9\" (UID: \"9c8d8425-8279-4415-9ddf-b8666182abeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9" Jul 17 17:59:23.346242 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:23.346161 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c8d8425-8279-4415-9ddf-b8666182abeb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9\" (UID: \"9c8d8425-8279-4415-9ddf-b8666182abeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9" Jul 17 17:59:23.346242 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:23.346218 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c8d8425-8279-4415-9ddf-b8666182abeb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9\" (UID: \"9c8d8425-8279-4415-9ddf-b8666182abeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9" Jul 17 17:59:23.346242 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:23.346241 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c8d8425-8279-4415-9ddf-b8666182abeb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9\" (UID: \"9c8d8425-8279-4415-9ddf-b8666182abeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9" Jul 17 17:59:23.346519 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:23.346480 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c8d8425-8279-4415-9ddf-b8666182abeb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9\" (UID: \"9c8d8425-8279-4415-9ddf-b8666182abeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9" Jul 17 17:59:23.346578 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:23.346552 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c8d8425-8279-4415-9ddf-b8666182abeb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9\" (UID: \"9c8d8425-8279-4415-9ddf-b8666182abeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9" Jul 17 17:59:23.346653 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:23.346629 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c8d8425-8279-4415-9ddf-b8666182abeb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9\" (UID: \"9c8d8425-8279-4415-9ddf-b8666182abeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9" Jul 17 17:59:23.348614 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:23.348594 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c8d8425-8279-4415-9ddf-b8666182abeb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9\" (UID: \"9c8d8425-8279-4415-9ddf-b8666182abeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9" Jul 17 17:59:23.348775 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:23.348684 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c8d8425-8279-4415-9ddf-b8666182abeb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9\" (UID: \"9c8d8425-8279-4415-9ddf-b8666182abeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9" Jul 17 17:59:23.354042 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:23.354022 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcjtn\" (UniqueName: \"kubernetes.io/projected/9c8d8425-8279-4415-9ddf-b8666182abeb-kube-api-access-qcjtn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9\" (UID: \"9c8d8425-8279-4415-9ddf-b8666182abeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9" Jul 17 17:59:23.427181 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:23.427122 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9" Jul 17 17:59:23.566779 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:23.566732 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9"] Jul 17 17:59:23.569797 ip-10-0-135-140 kubenswrapper[2580]: W0717 17:59:23.569768 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c8d8425_8279_4415_9ddf_b8666182abeb.slice/crio-a2c175d34d4eeeeb953845f3a281149ed14fd2ddd297292e1f2dfc430b5acedb WatchSource:0}: Error finding container a2c175d34d4eeeeb953845f3a281149ed14fd2ddd297292e1f2dfc430b5acedb: Status 404 returned error can't find the container with id a2c175d34d4eeeeb953845f3a281149ed14fd2ddd297292e1f2dfc430b5acedb Jul 17 17:59:23.571263 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:23.571243 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 17:59:24.525963 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:24.525924 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9" event={"ID":"9c8d8425-8279-4415-9ddf-b8666182abeb","Type":"ContainerStarted","Data":"4064fd8ed8a004636d9be19cbc39ff02ac5e458ff2a7f6ae97682ff7dcce717e"} Jul 17 17:59:24.526334 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:24.525975 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9" event={"ID":"9c8d8425-8279-4415-9ddf-b8666182abeb","Type":"ContainerStarted","Data":"a2c175d34d4eeeeb953845f3a281149ed14fd2ddd297292e1f2dfc430b5acedb"} Jul 17 17:59:24.545660 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:24.545607 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9" podStartSLOduration=1.378940125 podStartE2EDuration="1.54559216s" totalImagesPullingTime="166.652035ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:59:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:59:24.543101782 +0000 UTC m=+611.530318132" watchObservedRunningTime="2026-07-17 17:59:24.54559216 +0000 UTC m=+611.532808509" Jul 17 17:59:33.427708 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:33.427674 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9" Jul 17 17:59:33.428140 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:33.427778 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9" Jul 17 17:59:33.440291 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:33.440266 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9" Jul 17 17:59:33.583341 ip-10-0-135-140 kubenswrapper[2580]: I0717 17:59:33.583308 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9" Jul 17 18:01:19.752008 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:01:19.751805 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c77fb6b4b-9g2zz"] Jul 17 18:01:19.752469 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:01:19.752053 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5c77fb6b4b-9g2zz" podUID="559520c0-75ab-49ed-b112-c1932a24ebbe" containerName="manager" containerID="cri-o://149488a9bdce5315706d580d312a9cc97863e6c3ec9e9dbca40ebd0217aaaac2" gracePeriod=30 Jul 17 18:01:20.002766 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:01:20.002696 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c77fb6b4b-9g2zz" Jul 17 18:01:20.108073 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:01:20.108036 2580 generic.go:356] "Generic (PLEG): container finished" podID="559520c0-75ab-49ed-b112-c1932a24ebbe" containerID="149488a9bdce5315706d580d312a9cc97863e6c3ec9e9dbca40ebd0217aaaac2" exitCode=0 Jul 17 18:01:20.108073 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:01:20.108079 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c77fb6b4b-9g2zz" Jul 17 18:01:20.108341 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:01:20.108118 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c77fb6b4b-9g2zz" event={"ID":"559520c0-75ab-49ed-b112-c1932a24ebbe","Type":"ContainerDied","Data":"149488a9bdce5315706d580d312a9cc97863e6c3ec9e9dbca40ebd0217aaaac2"} Jul 17 18:01:20.108341 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:01:20.108184 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c77fb6b4b-9g2zz" event={"ID":"559520c0-75ab-49ed-b112-c1932a24ebbe","Type":"ContainerDied","Data":"49090a3877976fead9a133ce70743701023b98fa53e4c64a40b28986fec72d36"} Jul 17 18:01:20.108341 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:01:20.108214 2580 scope.go:117] "RemoveContainer" containerID="149488a9bdce5315706d580d312a9cc97863e6c3ec9e9dbca40ebd0217aaaac2" Jul 17 18:01:20.117462 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:01:20.117442 2580 scope.go:117] "RemoveContainer" containerID="149488a9bdce5315706d580d312a9cc97863e6c3ec9e9dbca40ebd0217aaaac2" Jul 17 18:01:20.117701 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:01:20.117684 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"149488a9bdce5315706d580d312a9cc97863e6c3ec9e9dbca40ebd0217aaaac2\": container with ID starting with 149488a9bdce5315706d580d312a9cc97863e6c3ec9e9dbca40ebd0217aaaac2 not found: ID does not exist" containerID="149488a9bdce5315706d580d312a9cc97863e6c3ec9e9dbca40ebd0217aaaac2" Jul 17 18:01:20.117764 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:01:20.117712 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"149488a9bdce5315706d580d312a9cc97863e6c3ec9e9dbca40ebd0217aaaac2"} err="failed to get container status \"149488a9bdce5315706d580d312a9cc97863e6c3ec9e9dbca40ebd0217aaaac2\": rpc error: code = NotFound desc = could not find container \"149488a9bdce5315706d580d312a9cc97863e6c3ec9e9dbca40ebd0217aaaac2\": container with ID starting with 149488a9bdce5315706d580d312a9cc97863e6c3ec9e9dbca40ebd0217aaaac2 not found: ID does not exist" Jul 17 18:01:20.134000 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:01:20.133975 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5wsl\" (UniqueName: \"kubernetes.io/projected/559520c0-75ab-49ed-b112-c1932a24ebbe-kube-api-access-k5wsl\") pod \"559520c0-75ab-49ed-b112-c1932a24ebbe\" (UID: \"559520c0-75ab-49ed-b112-c1932a24ebbe\") " Jul 17 18:01:20.134111 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:01:20.134082 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/559520c0-75ab-49ed-b112-c1932a24ebbe-webhook-cert\") pod \"559520c0-75ab-49ed-b112-c1932a24ebbe\" (UID: \"559520c0-75ab-49ed-b112-c1932a24ebbe\") " Jul 17 18:01:20.136057 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:01:20.136025 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/559520c0-75ab-49ed-b112-c1932a24ebbe-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "559520c0-75ab-49ed-b112-c1932a24ebbe" (UID: "559520c0-75ab-49ed-b112-c1932a24ebbe"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:01:20.136168 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:01:20.136149 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/559520c0-75ab-49ed-b112-c1932a24ebbe-kube-api-access-k5wsl" (OuterVolumeSpecName: "kube-api-access-k5wsl") pod "559520c0-75ab-49ed-b112-c1932a24ebbe" (UID: "559520c0-75ab-49ed-b112-c1932a24ebbe"). InnerVolumeSpecName "kube-api-access-k5wsl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:01:20.235450 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:01:20.235422 2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/559520c0-75ab-49ed-b112-c1932a24ebbe-webhook-cert\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 18:01:20.235450 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:01:20.235447 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5wsl\" (UniqueName: \"kubernetes.io/projected/559520c0-75ab-49ed-b112-c1932a24ebbe-kube-api-access-k5wsl\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 18:01:20.429680 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:01:20.429654 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c77fb6b4b-9g2zz"] Jul 17 18:01:20.433376 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:01:20.433352 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c77fb6b4b-9g2zz"] Jul 17 18:01:21.484703 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:01:21.484673 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="559520c0-75ab-49ed-b112-c1932a24ebbe" path="/var/lib/kubelet/pods/559520c0-75ab-49ed-b112-c1932a24ebbe/volumes" Jul 17 18:02:21.294384 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:21.294350 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c77fb6b4b-sbg44"] Jul 17 18:02:21.294812 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:21.294712 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="559520c0-75ab-49ed-b112-c1932a24ebbe" containerName="manager" Jul 17 18:02:21.294812 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:21.294725 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="559520c0-75ab-49ed-b112-c1932a24ebbe" containerName="manager" Jul 17 18:02:21.294812 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:21.294808 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="559520c0-75ab-49ed-b112-c1932a24ebbe" containerName="manager" Jul 17 18:02:21.299193 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:21.299172 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c77fb6b4b-sbg44" Jul 17 18:02:21.303909 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:21.303878 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-2497n\"" Jul 17 18:02:21.305654 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:21.305626 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 17 18:02:21.305813 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:21.305797 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 17 18:02:21.330464 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:21.330441 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c77fb6b4b-sbg44"] Jul 17 18:02:21.453976 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:21.453942 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1262f6f9-8158-43a4-aefa-a100b02e4d9d-webhook-cert\") pod \"maas-controller-5c77fb6b4b-sbg44\" (UID: \"1262f6f9-8158-43a4-aefa-a100b02e4d9d\") " pod="opendatahub/maas-controller-5c77fb6b4b-sbg44" Jul 17 18:02:21.454153 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:21.453990 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hslbb\" (UniqueName: \"kubernetes.io/projected/1262f6f9-8158-43a4-aefa-a100b02e4d9d-kube-api-access-hslbb\") pod \"maas-controller-5c77fb6b4b-sbg44\" (UID: \"1262f6f9-8158-43a4-aefa-a100b02e4d9d\") " pod="opendatahub/maas-controller-5c77fb6b4b-sbg44" Jul 17 18:02:21.555326 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:21.555238 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1262f6f9-8158-43a4-aefa-a100b02e4d9d-webhook-cert\") pod \"maas-controller-5c77fb6b4b-sbg44\" (UID: \"1262f6f9-8158-43a4-aefa-a100b02e4d9d\") " pod="opendatahub/maas-controller-5c77fb6b4b-sbg44" Jul 17 18:02:21.555326 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:21.555286 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hslbb\" (UniqueName: \"kubernetes.io/projected/1262f6f9-8158-43a4-aefa-a100b02e4d9d-kube-api-access-hslbb\") pod \"maas-controller-5c77fb6b4b-sbg44\" (UID: \"1262f6f9-8158-43a4-aefa-a100b02e4d9d\") " pod="opendatahub/maas-controller-5c77fb6b4b-sbg44" Jul 17 18:02:21.557819 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:21.557799 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1262f6f9-8158-43a4-aefa-a100b02e4d9d-webhook-cert\") pod \"maas-controller-5c77fb6b4b-sbg44\" (UID: \"1262f6f9-8158-43a4-aefa-a100b02e4d9d\") " pod="opendatahub/maas-controller-5c77fb6b4b-sbg44" Jul 17 18:02:21.564170 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:21.564152 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hslbb\" (UniqueName: \"kubernetes.io/projected/1262f6f9-8158-43a4-aefa-a100b02e4d9d-kube-api-access-hslbb\") pod \"maas-controller-5c77fb6b4b-sbg44\" (UID: \"1262f6f9-8158-43a4-aefa-a100b02e4d9d\") " pod="opendatahub/maas-controller-5c77fb6b4b-sbg44" Jul 17 18:02:21.609183 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:21.609159 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c77fb6b4b-sbg44" Jul 17 18:02:21.745259 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:21.745232 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c77fb6b4b-sbg44"] Jul 17 18:02:21.747323 ip-10-0-135-140 kubenswrapper[2580]: W0717 18:02:21.747288 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1262f6f9_8158_43a4_aefa_a100b02e4d9d.slice/crio-59b3315c202c899514f75419cc7852bc23a9f7d91b09a4983521db9563973aae WatchSource:0}: Error finding container 59b3315c202c899514f75419cc7852bc23a9f7d91b09a4983521db9563973aae: Status 404 returned error can't find the container with id 59b3315c202c899514f75419cc7852bc23a9f7d91b09a4983521db9563973aae Jul 17 18:02:22.426445 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:22.426407 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c77fb6b4b-sbg44" event={"ID":"1262f6f9-8158-43a4-aefa-a100b02e4d9d","Type":"ContainerStarted","Data":"080e7e01371174b9eb4acd21a874f6c528e154a63daa42762ed712d96a6fbac3"} Jul 17 18:02:22.426859 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:22.426498 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c77fb6b4b-sbg44" event={"ID":"1262f6f9-8158-43a4-aefa-a100b02e4d9d","Type":"ContainerStarted","Data":"59b3315c202c899514f75419cc7852bc23a9f7d91b09a4983521db9563973aae"} Jul 17 18:02:22.426859 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:22.426528 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c77fb6b4b-sbg44" Jul 17 18:02:22.444064 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:22.443989 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c77fb6b4b-sbg44" podStartSLOduration=0.887058144 podStartE2EDuration="1.443973117s" totalImagesPullingTime="556.914973ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:02:22.44236914 +0000 UTC m=+789.429585514" watchObservedRunningTime="2026-07-17 18:02:22.443973117 +0000 UTC m=+789.431189466" Jul 17 18:02:33.434399 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:33.434366 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c77fb6b4b-sbg44" Jul 17 18:02:38.089244 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:38.089163 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c77fb6b4b-sbg44"] Jul 17 18:02:38.089705 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:38.089391 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5c77fb6b4b-sbg44" podUID="1262f6f9-8158-43a4-aefa-a100b02e4d9d" containerName="manager" containerID="cri-o://080e7e01371174b9eb4acd21a874f6c528e154a63daa42762ed712d96a6fbac3" gracePeriod=30 Jul 17 18:02:38.338015 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:38.337992 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c77fb6b4b-sbg44" Jul 17 18:02:38.397838 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:38.397737 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1262f6f9-8158-43a4-aefa-a100b02e4d9d-webhook-cert\") pod \"1262f6f9-8158-43a4-aefa-a100b02e4d9d\" (UID: \"1262f6f9-8158-43a4-aefa-a100b02e4d9d\") " Jul 17 18:02:38.398026 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:38.397846 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hslbb\" (UniqueName: \"kubernetes.io/projected/1262f6f9-8158-43a4-aefa-a100b02e4d9d-kube-api-access-hslbb\") pod \"1262f6f9-8158-43a4-aefa-a100b02e4d9d\" (UID: \"1262f6f9-8158-43a4-aefa-a100b02e4d9d\") " Jul 17 18:02:38.400017 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:38.399986 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1262f6f9-8158-43a4-aefa-a100b02e4d9d-kube-api-access-hslbb" (OuterVolumeSpecName: "kube-api-access-hslbb") pod "1262f6f9-8158-43a4-aefa-a100b02e4d9d" (UID: "1262f6f9-8158-43a4-aefa-a100b02e4d9d"). InnerVolumeSpecName "kube-api-access-hslbb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:02:38.400130 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:38.400096 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1262f6f9-8158-43a4-aefa-a100b02e4d9d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1262f6f9-8158-43a4-aefa-a100b02e4d9d" (UID: "1262f6f9-8158-43a4-aefa-a100b02e4d9d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:02:38.498834 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:38.498796 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hslbb\" (UniqueName: \"kubernetes.io/projected/1262f6f9-8158-43a4-aefa-a100b02e4d9d-kube-api-access-hslbb\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 18:02:38.498834 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:38.498828 2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1262f6f9-8158-43a4-aefa-a100b02e4d9d-webhook-cert\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 18:02:38.512480 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:38.512439 2580 generic.go:356] "Generic (PLEG): container finished" podID="1262f6f9-8158-43a4-aefa-a100b02e4d9d" containerID="080e7e01371174b9eb4acd21a874f6c528e154a63daa42762ed712d96a6fbac3" exitCode=0 Jul 17 18:02:38.512604 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:38.512490 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c77fb6b4b-sbg44" Jul 17 18:02:38.512604 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:38.512522 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c77fb6b4b-sbg44" event={"ID":"1262f6f9-8158-43a4-aefa-a100b02e4d9d","Type":"ContainerDied","Data":"080e7e01371174b9eb4acd21a874f6c528e154a63daa42762ed712d96a6fbac3"} Jul 17 18:02:38.512604 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:38.512572 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c77fb6b4b-sbg44" event={"ID":"1262f6f9-8158-43a4-aefa-a100b02e4d9d","Type":"ContainerDied","Data":"59b3315c202c899514f75419cc7852bc23a9f7d91b09a4983521db9563973aae"} Jul 17 18:02:38.512604 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:38.512595 2580 scope.go:117] "RemoveContainer" containerID="080e7e01371174b9eb4acd21a874f6c528e154a63daa42762ed712d96a6fbac3" Jul 17 18:02:38.522119 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:38.522099 2580 scope.go:117] "RemoveContainer" containerID="080e7e01371174b9eb4acd21a874f6c528e154a63daa42762ed712d96a6fbac3" Jul 17 18:02:38.522367 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:02:38.522350 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"080e7e01371174b9eb4acd21a874f6c528e154a63daa42762ed712d96a6fbac3\": container with ID starting with 080e7e01371174b9eb4acd21a874f6c528e154a63daa42762ed712d96a6fbac3 not found: ID does not exist" containerID="080e7e01371174b9eb4acd21a874f6c528e154a63daa42762ed712d96a6fbac3" Jul 17 18:02:38.522418 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:38.522376 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"080e7e01371174b9eb4acd21a874f6c528e154a63daa42762ed712d96a6fbac3"} err="failed to get container status \"080e7e01371174b9eb4acd21a874f6c528e154a63daa42762ed712d96a6fbac3\": rpc error: code = NotFound desc = could not find container \"080e7e01371174b9eb4acd21a874f6c528e154a63daa42762ed712d96a6fbac3\": container with ID starting with 080e7e01371174b9eb4acd21a874f6c528e154a63daa42762ed712d96a6fbac3 not found: ID does not exist" Jul 17 18:02:38.533440 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:38.533415 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c77fb6b4b-sbg44"] Jul 17 18:02:38.537048 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:38.537027 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c77fb6b4b-sbg44"] Jul 17 18:02:39.367972 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:39.367939 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c77fb6b4b-5zxkf"] Jul 17 18:02:39.368334 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:39.368268 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1262f6f9-8158-43a4-aefa-a100b02e4d9d" containerName="manager" Jul 17 18:02:39.368334 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:39.368279 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1262f6f9-8158-43a4-aefa-a100b02e4d9d" containerName="manager" Jul 17 18:02:39.368405 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:39.368349 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1262f6f9-8158-43a4-aefa-a100b02e4d9d" containerName="manager" Jul 17 18:02:39.372625 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:39.372606 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c77fb6b4b-5zxkf" Jul 17 18:02:39.376614 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:39.376587 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 17 18:02:39.376770 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:39.376623 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 17 18:02:39.376770 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:39.376587 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-2497n\"" Jul 17 18:02:39.379635 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:39.379613 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c77fb6b4b-5zxkf"] Jul 17 18:02:39.406643 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:39.406616 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrc5f\" (UniqueName: \"kubernetes.io/projected/5afbec6f-f189-4c3d-b205-03d41af8485e-kube-api-access-zrc5f\") pod \"maas-controller-5c77fb6b4b-5zxkf\" (UID: \"5afbec6f-f189-4c3d-b205-03d41af8485e\") " pod="opendatahub/maas-controller-5c77fb6b4b-5zxkf" Jul 17 18:02:39.406777 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:39.406669 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5afbec6f-f189-4c3d-b205-03d41af8485e-webhook-cert\") pod \"maas-controller-5c77fb6b4b-5zxkf\" (UID: \"5afbec6f-f189-4c3d-b205-03d41af8485e\") " pod="opendatahub/maas-controller-5c77fb6b4b-5zxkf" Jul 17 18:02:39.484281 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:39.484254 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1262f6f9-8158-43a4-aefa-a100b02e4d9d" path="/var/lib/kubelet/pods/1262f6f9-8158-43a4-aefa-a100b02e4d9d/volumes" Jul 17 18:02:39.507804 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:39.507784 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5afbec6f-f189-4c3d-b205-03d41af8485e-webhook-cert\") pod \"maas-controller-5c77fb6b4b-5zxkf\" (UID: \"5afbec6f-f189-4c3d-b205-03d41af8485e\") " pod="opendatahub/maas-controller-5c77fb6b4b-5zxkf" Jul 17 18:02:39.507897 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:39.507843 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrc5f\" (UniqueName: \"kubernetes.io/projected/5afbec6f-f189-4c3d-b205-03d41af8485e-kube-api-access-zrc5f\") pod \"maas-controller-5c77fb6b4b-5zxkf\" (UID: \"5afbec6f-f189-4c3d-b205-03d41af8485e\") " pod="opendatahub/maas-controller-5c77fb6b4b-5zxkf" Jul 17 18:02:39.510286 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:39.510268 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5afbec6f-f189-4c3d-b205-03d41af8485e-webhook-cert\") pod \"maas-controller-5c77fb6b4b-5zxkf\" (UID: \"5afbec6f-f189-4c3d-b205-03d41af8485e\") " pod="opendatahub/maas-controller-5c77fb6b4b-5zxkf" Jul 17 18:02:39.515907 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:39.515877 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrc5f\" (UniqueName: \"kubernetes.io/projected/5afbec6f-f189-4c3d-b205-03d41af8485e-kube-api-access-zrc5f\") pod \"maas-controller-5c77fb6b4b-5zxkf\" (UID: \"5afbec6f-f189-4c3d-b205-03d41af8485e\") " pod="opendatahub/maas-controller-5c77fb6b4b-5zxkf" Jul 17 18:02:39.685296 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:39.685206 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c77fb6b4b-5zxkf" Jul 17 18:02:39.823951 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:39.823920 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c77fb6b4b-5zxkf"] Jul 17 18:02:39.824565 ip-10-0-135-140 kubenswrapper[2580]: W0717 18:02:39.824541 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5afbec6f_f189_4c3d_b205_03d41af8485e.slice/crio-2436069a344f2a4d484d2d246e4942222e0ed372ee3985266480ae31b0f5f6a4 WatchSource:0}: Error finding container 2436069a344f2a4d484d2d246e4942222e0ed372ee3985266480ae31b0f5f6a4: Status 404 returned error can't find the container with id 2436069a344f2a4d484d2d246e4942222e0ed372ee3985266480ae31b0f5f6a4 Jul 17 18:02:40.525811 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:40.525713 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c77fb6b4b-5zxkf" event={"ID":"5afbec6f-f189-4c3d-b205-03d41af8485e","Type":"ContainerStarted","Data":"69fe379a6e6d0a60b3353b450a4d6eb4d5de67ac9554a5572873f1977fe4b28b"} Jul 17 18:02:40.525811 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:40.525784 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c77fb6b4b-5zxkf" event={"ID":"5afbec6f-f189-4c3d-b205-03d41af8485e","Type":"ContainerStarted","Data":"2436069a344f2a4d484d2d246e4942222e0ed372ee3985266480ae31b0f5f6a4"} Jul 17 18:02:40.526231 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:40.525919 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c77fb6b4b-5zxkf" Jul 17 18:02:40.545445 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:40.545399 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c77fb6b4b-5zxkf" podStartSLOduration=1.130499709 podStartE2EDuration="1.545385259s" totalImagesPullingTime="414.88555ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:02:40.54221971 +0000 UTC m=+807.529436062" watchObservedRunningTime="2026-07-17 18:02:40.545385259 +0000 UTC m=+807.532601661" Jul 17 18:02:51.533584 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:02:51.533550 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c77fb6b4b-5zxkf" Jul 17 18:04:13.441670 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:04:13.441593 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kcmzb_36b82608-4a35-44da-9af1-6d56c88cb1e2/console-operator/2.log" Jul 17 18:04:13.444378 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:04:13.444358 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kcmzb_36b82608-4a35-44da-9af1-6d56c88cb1e2/console-operator/2.log" Jul 17 18:09:13.475102 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:09:13.475076 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kcmzb_36b82608-4a35-44da-9af1-6d56c88cb1e2/console-operator/2.log" Jul 17 18:09:13.479311 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:09:13.479289 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kcmzb_36b82608-4a35-44da-9af1-6d56c88cb1e2/console-operator/2.log" Jul 17 18:14:13.509920 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:13.509886 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kcmzb_36b82608-4a35-44da-9af1-6d56c88cb1e2/console-operator/2.log" Jul 17 18:14:13.514871 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:13.514846 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kcmzb_36b82608-4a35-44da-9af1-6d56c88cb1e2/console-operator/2.log" Jul 17 18:14:47.685531 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:47.685494 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp"] Jul 17 18:14:47.689461 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:47.689432 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" Jul 17 18:14:47.691851 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:47.691829 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-284e9f2b-serving-cert\"" Jul 17 18:14:47.701000 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:47.700972 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp"] Jul 17 18:14:47.765076 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:47.765046 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75c86a5c-ab7b-4c64-8279-c39773422204-maas-api-tls\") pod \"maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp\" (UID: \"75c86a5c-ab7b-4c64-8279-c39773422204\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" Jul 17 18:14:47.765076 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:47.765081 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75c86a5c-ab7b-4c64-8279-c39773422204-openshift-service-ca\") pod \"maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp\" (UID: \"75c86a5c-ab7b-4c64-8279-c39773422204\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" Jul 17 18:14:47.765278 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:47.765112 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cswd4\" (UniqueName: \"kubernetes.io/projected/75c86a5c-ab7b-4c64-8279-c39773422204-kube-api-access-cswd4\") pod \"maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp\" (UID: \"75c86a5c-ab7b-4c64-8279-c39773422204\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" Jul 17 18:14:47.866145 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:47.866109 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75c86a5c-ab7b-4c64-8279-c39773422204-maas-api-tls\") pod \"maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp\" (UID: \"75c86a5c-ab7b-4c64-8279-c39773422204\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" Jul 17 18:14:47.866309 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:47.866170 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75c86a5c-ab7b-4c64-8279-c39773422204-openshift-service-ca\") pod \"maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp\" (UID: \"75c86a5c-ab7b-4c64-8279-c39773422204\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" Jul 17 18:14:47.866309 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:14:47.866195 2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-serving-cert: secret "maas-api-e2e-ait-284e9f2b-serving-cert" not found Jul 17 18:14:47.866309 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:47.866221 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cswd4\" (UniqueName: \"kubernetes.io/projected/75c86a5c-ab7b-4c64-8279-c39773422204-kube-api-access-cswd4\") pod \"maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp\" (UID: \"75c86a5c-ab7b-4c64-8279-c39773422204\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" Jul 17 18:14:47.866309 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:14:47.866254 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c86a5c-ab7b-4c64-8279-c39773422204-maas-api-tls podName:75c86a5c-ab7b-4c64-8279-c39773422204 nodeName:}" failed. No retries permitted until 2026-07-17 18:14:48.366234476 +0000 UTC m=+1535.353450804 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/75c86a5c-ab7b-4c64-8279-c39773422204-maas-api-tls") pod "maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" (UID: "75c86a5c-ab7b-4c64-8279-c39773422204") : secret "maas-api-e2e-ait-284e9f2b-serving-cert" not found Jul 17 18:14:47.866810 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:47.866791 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75c86a5c-ab7b-4c64-8279-c39773422204-openshift-service-ca\") pod \"maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp\" (UID: \"75c86a5c-ab7b-4c64-8279-c39773422204\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" Jul 17 18:14:47.875032 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:47.875011 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cswd4\" (UniqueName: \"kubernetes.io/projected/75c86a5c-ab7b-4c64-8279-c39773422204-kube-api-access-cswd4\") pod \"maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp\" (UID: \"75c86a5c-ab7b-4c64-8279-c39773422204\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" Jul 17 18:14:48.370406 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:48.370366 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75c86a5c-ab7b-4c64-8279-c39773422204-maas-api-tls\") pod \"maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp\" (UID: \"75c86a5c-ab7b-4c64-8279-c39773422204\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" Jul 17 18:14:48.372919 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:48.372901 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75c86a5c-ab7b-4c64-8279-c39773422204-maas-api-tls\") pod \"maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp\" (UID: \"75c86a5c-ab7b-4c64-8279-c39773422204\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" Jul 17 18:14:48.602097 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:48.602069 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" Jul 17 18:14:48.741370 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:48.741342 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp"] Jul 17 18:14:48.743223 ip-10-0-135-140 kubenswrapper[2580]: W0717 18:14:48.743192 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75c86a5c_ab7b_4c64_8279_c39773422204.slice/crio-7276c1c235d6b9104f8a160ea15b1484a224d80cc8c203605f6d84721a30c6f0 WatchSource:0}: Error finding container 7276c1c235d6b9104f8a160ea15b1484a224d80cc8c203605f6d84721a30c6f0: Status 404 returned error can't find the container with id 7276c1c235d6b9104f8a160ea15b1484a224d80cc8c203605f6d84721a30c6f0 Jul 17 18:14:48.745123 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:48.745106 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 18:14:49.268949 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:49.268917 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" event={"ID":"75c86a5c-ab7b-4c64-8279-c39773422204","Type":"ContainerStarted","Data":"7276c1c235d6b9104f8a160ea15b1484a224d80cc8c203605f6d84721a30c6f0"} Jul 17 18:14:50.275235 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:50.275202 2580 generic.go:356] "Generic (PLEG): container finished" podID="75c86a5c-ab7b-4c64-8279-c39773422204" containerID="26fe37af1fd7e11887355710c7f011d59a1550a2e38e1e23847397417b0a9236" exitCode=1 Jul 17 18:14:50.275617 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:50.275300 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" event={"ID":"75c86a5c-ab7b-4c64-8279-c39773422204","Type":"ContainerDied","Data":"26fe37af1fd7e11887355710c7f011d59a1550a2e38e1e23847397417b0a9236"} Jul 17 18:14:50.275617 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:50.275504 2580 scope.go:117] "RemoveContainer" containerID="26fe37af1fd7e11887355710c7f011d59a1550a2e38e1e23847397417b0a9236" Jul 17 18:14:51.282605 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:51.282507 2580 generic.go:356] "Generic (PLEG): container finished" podID="75c86a5c-ab7b-4c64-8279-c39773422204" containerID="4669c6c545a1ca2d3752255aa3d074efc17aacbc75b62b2860725a0f7f17a5d2" exitCode=1 Jul 17 18:14:51.282605 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:51.282573 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" event={"ID":"75c86a5c-ab7b-4c64-8279-c39773422204","Type":"ContainerDied","Data":"4669c6c545a1ca2d3752255aa3d074efc17aacbc75b62b2860725a0f7f17a5d2"} Jul 17 18:14:51.283074 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:51.282631 2580 scope.go:117] "RemoveContainer" containerID="26fe37af1fd7e11887355710c7f011d59a1550a2e38e1e23847397417b0a9236" Jul 17 18:14:51.283074 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:51.282860 2580 scope.go:117] "RemoveContainer" containerID="4669c6c545a1ca2d3752255aa3d074efc17aacbc75b62b2860725a0f7f17a5d2" Jul 17 18:14:51.283154 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:14:51.283101 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp_odh-ai-gateway-infra(75c86a5c-ab7b-4c64-8279-c39773422204)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" Jul 17 18:14:52.289582 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:52.289553 2580 scope.go:117] "RemoveContainer" containerID="4669c6c545a1ca2d3752255aa3d074efc17aacbc75b62b2860725a0f7f17a5d2" Jul 17 18:14:52.290077 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:14:52.289729 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp_odh-ai-gateway-infra(75c86a5c-ab7b-4c64-8279-c39773422204)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" Jul 17 18:14:53.602915 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:53.602884 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" Jul 17 18:14:53.603290 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:53.603246 2580 scope.go:117] "RemoveContainer" containerID="4669c6c545a1ca2d3752255aa3d074efc17aacbc75b62b2860725a0f7f17a5d2" Jul 17 18:14:53.603430 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:14:53.603411 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp_odh-ai-gateway-infra(75c86a5c-ab7b-4c64-8279-c39773422204)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" Jul 17 18:14:58.602445 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:58.602414 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" Jul 17 18:14:58.602838 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:14:58.602780 2580 scope.go:117] "RemoveContainer" containerID="4669c6c545a1ca2d3752255aa3d074efc17aacbc75b62b2860725a0f7f17a5d2" Jul 17 18:14:58.602966 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:14:58.602946 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp_odh-ai-gateway-infra(75c86a5c-ab7b-4c64-8279-c39773422204)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" Jul 17 18:15:14.478180 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:15:14.478150 2580 scope.go:117] "RemoveContainer" containerID="4669c6c545a1ca2d3752255aa3d074efc17aacbc75b62b2860725a0f7f17a5d2" Jul 17 18:15:15.405644 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:15:15.405613 2580 generic.go:356] "Generic (PLEG): container finished" podID="75c86a5c-ab7b-4c64-8279-c39773422204" containerID="eb1704907d0bc1f66f453630433c50ef7a602b9412beaed910a4447b32c35fb6" exitCode=1 Jul 17 18:15:15.405823 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:15:15.405667 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" event={"ID":"75c86a5c-ab7b-4c64-8279-c39773422204","Type":"ContainerDied","Data":"eb1704907d0bc1f66f453630433c50ef7a602b9412beaed910a4447b32c35fb6"} Jul 17 18:15:15.405823 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:15:15.405721 2580 scope.go:117] "RemoveContainer" containerID="4669c6c545a1ca2d3752255aa3d074efc17aacbc75b62b2860725a0f7f17a5d2" Jul 17 18:15:15.406091 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:15:15.406072 2580 scope.go:117] "RemoveContainer" containerID="eb1704907d0bc1f66f453630433c50ef7a602b9412beaed910a4447b32c35fb6" Jul 17 18:15:15.406297 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:15:15.406276 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp_odh-ai-gateway-infra(75c86a5c-ab7b-4c64-8279-c39773422204)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" Jul 17 18:15:18.602429 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:15:18.602381 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" Jul 17 18:15:18.602859 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:15:18.602454 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" Jul 17 18:15:18.602859 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:15:18.602786 2580 scope.go:117] "RemoveContainer" containerID="eb1704907d0bc1f66f453630433c50ef7a602b9412beaed910a4447b32c35fb6" Jul 17 18:15:18.602980 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:15:18.602959 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp_odh-ai-gateway-infra(75c86a5c-ab7b-4c64-8279-c39773422204)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" Jul 17 18:15:30.478864 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:15:30.478834 2580 scope.go:117] "RemoveContainer" containerID="eb1704907d0bc1f66f453630433c50ef7a602b9412beaed910a4447b32c35fb6" Jul 17 18:15:30.479342 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:15:30.479011 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp_odh-ai-gateway-infra(75c86a5c-ab7b-4c64-8279-c39773422204)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" Jul 17 18:15:44.478915 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:15:44.478884 2580 scope.go:117] "RemoveContainer" containerID="eb1704907d0bc1f66f453630433c50ef7a602b9412beaed910a4447b32c35fb6" Jul 17 18:15:45.580127 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:15:45.580089 2580 generic.go:356] "Generic (PLEG): container finished" podID="75c86a5c-ab7b-4c64-8279-c39773422204" containerID="2d6556983046fc88a9e13d5bbec50e2056a455e11a2eabb68d4630b4845f888d" exitCode=1 Jul 17 18:15:45.580537 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:15:45.580145 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" event={"ID":"75c86a5c-ab7b-4c64-8279-c39773422204","Type":"ContainerDied","Data":"2d6556983046fc88a9e13d5bbec50e2056a455e11a2eabb68d4630b4845f888d"} Jul 17 18:15:45.580537 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:15:45.580215 2580 scope.go:117] "RemoveContainer" containerID="eb1704907d0bc1f66f453630433c50ef7a602b9412beaed910a4447b32c35fb6" Jul 17 18:15:45.580537 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:15:45.580508 2580 scope.go:117] "RemoveContainer" containerID="2d6556983046fc88a9e13d5bbec50e2056a455e11a2eabb68d4630b4845f888d" Jul 17 18:15:45.580715 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:15:45.580696 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp_odh-ai-gateway-infra(75c86a5c-ab7b-4c64-8279-c39773422204)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" Jul 17 18:15:48.602693 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:15:48.602660 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" Jul 17 18:15:48.603156 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:15:48.602714 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" Jul 17 18:15:48.603156 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:15:48.603036 2580 scope.go:117] "RemoveContainer" containerID="2d6556983046fc88a9e13d5bbec50e2056a455e11a2eabb68d4630b4845f888d" Jul 17 18:15:48.603256 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:15:48.603193 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp_odh-ai-gateway-infra(75c86a5c-ab7b-4c64-8279-c39773422204)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" Jul 17 18:16:00.478896 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:16:00.478864 2580 scope.go:117] "RemoveContainer" containerID="2d6556983046fc88a9e13d5bbec50e2056a455e11a2eabb68d4630b4845f888d" Jul 17 18:16:00.479276 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:16:00.479039 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp_odh-ai-gateway-infra(75c86a5c-ab7b-4c64-8279-c39773422204)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" Jul 17 18:16:15.478425 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:16:15.478338 2580 scope.go:117] "RemoveContainer" containerID="2d6556983046fc88a9e13d5bbec50e2056a455e11a2eabb68d4630b4845f888d" Jul 17 18:16:15.478998 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:16:15.478547 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp_odh-ai-gateway-infra(75c86a5c-ab7b-4c64-8279-c39773422204)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" Jul 17 18:16:30.478285 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:16:30.478255 2580 scope.go:117] "RemoveContainer" containerID="2d6556983046fc88a9e13d5bbec50e2056a455e11a2eabb68d4630b4845f888d" Jul 17 18:16:31.821292 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:16:31.821257 2580 generic.go:356] "Generic (PLEG): container finished" podID="75c86a5c-ab7b-4c64-8279-c39773422204" containerID="25522a765ea3cda9d4dcc71e047448a55a4e1a134ec440189c829dfe3c22c25b" exitCode=1 Jul 17 18:16:31.821709 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:16:31.821331 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" event={"ID":"75c86a5c-ab7b-4c64-8279-c39773422204","Type":"ContainerDied","Data":"25522a765ea3cda9d4dcc71e047448a55a4e1a134ec440189c829dfe3c22c25b"} Jul 17 18:16:31.821709 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:16:31.821393 2580 scope.go:117] "RemoveContainer" containerID="2d6556983046fc88a9e13d5bbec50e2056a455e11a2eabb68d4630b4845f888d" Jul 17 18:16:31.821895 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:16:31.821772 2580 scope.go:117] "RemoveContainer" containerID="25522a765ea3cda9d4dcc71e047448a55a4e1a134ec440189c829dfe3c22c25b" Jul 17 18:16:31.821985 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:16:31.821961 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp_odh-ai-gateway-infra(75c86a5c-ab7b-4c64-8279-c39773422204)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" Jul 17 18:16:33.602365 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:16:33.602336 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" Jul 17 18:16:33.602799 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:16:33.602660 2580 scope.go:117] "RemoveContainer" containerID="25522a765ea3cda9d4dcc71e047448a55a4e1a134ec440189c829dfe3c22c25b" Jul 17 18:16:33.602898 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:16:33.602878 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp_odh-ai-gateway-infra(75c86a5c-ab7b-4c64-8279-c39773422204)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" Jul 17 18:16:38.602681 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:16:38.602643 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" Jul 17 18:16:38.603065 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:16:38.603044 2580 scope.go:117] "RemoveContainer" containerID="25522a765ea3cda9d4dcc71e047448a55a4e1a134ec440189c829dfe3c22c25b" Jul 17 18:16:38.603240 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:16:38.603220 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp_odh-ai-gateway-infra(75c86a5c-ab7b-4c64-8279-c39773422204)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" Jul 17 18:16:53.481717 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:16:53.481683 2580 scope.go:117] "RemoveContainer" containerID="25522a765ea3cda9d4dcc71e047448a55a4e1a134ec440189c829dfe3c22c25b" Jul 17 18:16:53.482234 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:16:53.481906 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp_odh-ai-gateway-infra(75c86a5c-ab7b-4c64-8279-c39773422204)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" Jul 17 18:17:05.490192 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:17:05.490165 2580 scope.go:117] "RemoveContainer" containerID="25522a765ea3cda9d4dcc71e047448a55a4e1a134ec440189c829dfe3c22c25b" Jul 17 18:17:05.490596 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:17:05.490336 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp_odh-ai-gateway-infra(75c86a5c-ab7b-4c64-8279-c39773422204)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" Jul 17 18:17:18.478690 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:17:18.478660 2580 scope.go:117] "RemoveContainer" containerID="25522a765ea3cda9d4dcc71e047448a55a4e1a134ec440189c829dfe3c22c25b" Jul 17 18:17:18.479140 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:17:18.478880 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp_odh-ai-gateway-infra(75c86a5c-ab7b-4c64-8279-c39773422204)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" Jul 17 18:17:31.478633 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:17:31.478602 2580 scope.go:117] "RemoveContainer" containerID="25522a765ea3cda9d4dcc71e047448a55a4e1a134ec440189c829dfe3c22c25b" Jul 17 18:17:31.479129 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:17:31.478811 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp_odh-ai-gateway-infra(75c86a5c-ab7b-4c64-8279-c39773422204)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" Jul 17 18:17:45.485115 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:17:45.485033 2580 scope.go:117] "RemoveContainer" containerID="25522a765ea3cda9d4dcc71e047448a55a4e1a134ec440189c829dfe3c22c25b" Jul 17 18:17:45.485552 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:17:45.485285 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp_odh-ai-gateway-infra(75c86a5c-ab7b-4c64-8279-c39773422204)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" Jul 17 18:17:58.076766 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:17:58.076716 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp"] Jul 17 18:17:58.211789 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:17:58.211715 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" Jul 17 18:17:58.278310 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:17:58.278277 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" Jul 17 18:17:58.278460 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:17:58.278272 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp" event={"ID":"75c86a5c-ab7b-4c64-8279-c39773422204","Type":"ContainerDied","Data":"7276c1c235d6b9104f8a160ea15b1484a224d80cc8c203605f6d84721a30c6f0"} Jul 17 18:17:58.278460 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:17:58.278412 2580 scope.go:117] "RemoveContainer" containerID="25522a765ea3cda9d4dcc71e047448a55a4e1a134ec440189c829dfe3c22c25b" Jul 17 18:17:58.293360 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:17:58.293341 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75c86a5c-ab7b-4c64-8279-c39773422204-maas-api-tls\") pod \"75c86a5c-ab7b-4c64-8279-c39773422204\" (UID: \"75c86a5c-ab7b-4c64-8279-c39773422204\") " Jul 17 18:17:58.293449 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:17:58.293437 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cswd4\" (UniqueName: \"kubernetes.io/projected/75c86a5c-ab7b-4c64-8279-c39773422204-kube-api-access-cswd4\") pod \"75c86a5c-ab7b-4c64-8279-c39773422204\" (UID: \"75c86a5c-ab7b-4c64-8279-c39773422204\") " Jul 17 18:17:58.293508 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:17:58.293476 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75c86a5c-ab7b-4c64-8279-c39773422204-openshift-service-ca\") pod \"75c86a5c-ab7b-4c64-8279-c39773422204\" (UID: \"75c86a5c-ab7b-4c64-8279-c39773422204\") " Jul 17 18:17:58.293882 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:17:58.293858 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75c86a5c-ab7b-4c64-8279-c39773422204-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "75c86a5c-ab7b-4c64-8279-c39773422204" (UID: "75c86a5c-ab7b-4c64-8279-c39773422204"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:17:58.295791 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:17:58.295737 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75c86a5c-ab7b-4c64-8279-c39773422204-kube-api-access-cswd4" (OuterVolumeSpecName: "kube-api-access-cswd4") pod "75c86a5c-ab7b-4c64-8279-c39773422204" (UID: "75c86a5c-ab7b-4c64-8279-c39773422204"). InnerVolumeSpecName "kube-api-access-cswd4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:17:58.295879 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:17:58.295805 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75c86a5c-ab7b-4c64-8279-c39773422204-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "75c86a5c-ab7b-4c64-8279-c39773422204" (UID: "75c86a5c-ab7b-4c64-8279-c39773422204"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:17:58.394873 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:17:58.394845 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cswd4\" (UniqueName: \"kubernetes.io/projected/75c86a5c-ab7b-4c64-8279-c39773422204-kube-api-access-cswd4\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 18:17:58.394873 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:17:58.394869 2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75c86a5c-ab7b-4c64-8279-c39773422204-openshift-service-ca\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 18:17:58.395012 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:17:58.394879 2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75c86a5c-ab7b-4c64-8279-c39773422204-maas-api-tls\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 18:17:58.601973 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:17:58.601949 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp"] Jul 17 18:17:58.609603 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:17:58.608176 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-284e9f2b-584cc8848b-x9nqp"] Jul 17 18:17:59.484879 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:17:59.484845 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" path="/var/lib/kubelet/pods/75c86a5c-ab7b-4c64-8279-c39773422204/volumes" Jul 17 18:18:06.042866 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:06.042829 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn"] Jul 17 18:18:06.043459 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:06.043403 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" containerName="maas-api" Jul 17 18:18:06.043459 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:06.043461 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" containerName="maas-api" Jul 17 18:18:06.043641 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:06.043480 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" containerName="maas-api" Jul 17 18:18:06.043641 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:06.043489 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" containerName="maas-api" Jul 17 18:18:06.043641 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:06.043511 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" containerName="maas-api" Jul 17 18:18:06.043641 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:06.043553 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" containerName="maas-api" Jul 17 18:18:06.043641 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:06.043571 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" containerName="maas-api" Jul 17 18:18:06.043641 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:06.043580 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" containerName="maas-api" Jul 17 18:18:06.044000 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:06.043741 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" containerName="maas-api" Jul 17 18:18:06.044000 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:06.043778 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" containerName="maas-api" Jul 17 18:18:06.044000 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:06.043793 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" containerName="maas-api" Jul 17 18:18:06.044000 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:06.043802 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" containerName="maas-api" Jul 17 18:18:06.048127 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:06.048110 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" Jul 17 18:18:06.051281 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:06.051257 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-db09a830-serving-cert\"" Jul 17 18:18:06.054297 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:06.054270 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn"] Jul 17 18:18:06.161194 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:06.161158 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hsgr\" (UniqueName: \"kubernetes.io/projected/8c65363c-0e0f-4487-9e43-33966c10e3a1-kube-api-access-9hsgr\") pod \"maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn\" (UID: \"8c65363c-0e0f-4487-9e43-33966c10e3a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" Jul 17 18:18:06.161369 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:06.161202 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c65363c-0e0f-4487-9e43-33966c10e3a1-openshift-service-ca\") pod \"maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn\" (UID: \"8c65363c-0e0f-4487-9e43-33966c10e3a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" Jul 17 18:18:06.161369 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:06.161312 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c65363c-0e0f-4487-9e43-33966c10e3a1-maas-api-tls\") pod \"maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn\" (UID: \"8c65363c-0e0f-4487-9e43-33966c10e3a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" Jul 17 18:18:06.261794 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:06.261734 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c65363c-0e0f-4487-9e43-33966c10e3a1-maas-api-tls\") pod \"maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn\" (UID: \"8c65363c-0e0f-4487-9e43-33966c10e3a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" Jul 17 18:18:06.261977 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:06.261827 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hsgr\" (UniqueName: \"kubernetes.io/projected/8c65363c-0e0f-4487-9e43-33966c10e3a1-kube-api-access-9hsgr\") pod \"maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn\" (UID: \"8c65363c-0e0f-4487-9e43-33966c10e3a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" Jul 17 18:18:06.261977 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:06.261856 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c65363c-0e0f-4487-9e43-33966c10e3a1-openshift-service-ca\") pod \"maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn\" (UID: \"8c65363c-0e0f-4487-9e43-33966c10e3a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" Jul 17 18:18:06.262568 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:06.262501 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c65363c-0e0f-4487-9e43-33966c10e3a1-openshift-service-ca\") pod \"maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn\" (UID: \"8c65363c-0e0f-4487-9e43-33966c10e3a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" Jul 17 18:18:06.264388 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:06.264365 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c65363c-0e0f-4487-9e43-33966c10e3a1-maas-api-tls\") pod \"maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn\" (UID: \"8c65363c-0e0f-4487-9e43-33966c10e3a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" Jul 17 18:18:06.271951 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:06.271924 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hsgr\" (UniqueName: \"kubernetes.io/projected/8c65363c-0e0f-4487-9e43-33966c10e3a1-kube-api-access-9hsgr\") pod \"maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn\" (UID: \"8c65363c-0e0f-4487-9e43-33966c10e3a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" Jul 17 18:18:06.361292 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:06.361235 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" Jul 17 18:18:06.500988 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:06.500958 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn"] Jul 17 18:18:06.502504 ip-10-0-135-140 kubenswrapper[2580]: W0717 18:18:06.502467 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c65363c_0e0f_4487_9e43_33966c10e3a1.slice/crio-3dafdd09b1cdb093efc010db5ba25b19c678f27f63c53aa7a1d05710365e3974 WatchSource:0}: Error finding container 3dafdd09b1cdb093efc010db5ba25b19c678f27f63c53aa7a1d05710365e3974: Status 404 returned error can't find the container with id 3dafdd09b1cdb093efc010db5ba25b19c678f27f63c53aa7a1d05710365e3974 Jul 17 18:18:07.325905 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:07.325873 2580 generic.go:356] "Generic (PLEG): container finished" podID="8c65363c-0e0f-4487-9e43-33966c10e3a1" containerID="cc42af2427aefdf20d84eb1a98d8c29f5d9b1b61d819a0dc874060f4ed1ee89a" exitCode=1 Jul 17 18:18:07.326306 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:07.325948 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" event={"ID":"8c65363c-0e0f-4487-9e43-33966c10e3a1","Type":"ContainerDied","Data":"cc42af2427aefdf20d84eb1a98d8c29f5d9b1b61d819a0dc874060f4ed1ee89a"} Jul 17 18:18:07.326306 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:07.325994 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" event={"ID":"8c65363c-0e0f-4487-9e43-33966c10e3a1","Type":"ContainerStarted","Data":"3dafdd09b1cdb093efc010db5ba25b19c678f27f63c53aa7a1d05710365e3974"} Jul 17 18:18:07.326306 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:07.326275 2580 scope.go:117] "RemoveContainer" containerID="cc42af2427aefdf20d84eb1a98d8c29f5d9b1b61d819a0dc874060f4ed1ee89a" Jul 17 18:18:08.333325 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:08.333298 2580 generic.go:356] "Generic (PLEG): container finished" podID="8c65363c-0e0f-4487-9e43-33966c10e3a1" containerID="297fb738853a9dc911254bf2186f1a599be875ce1e8a2c3f85ca3b6f60828616" exitCode=1 Jul 17 18:18:08.333802 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:08.333356 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" event={"ID":"8c65363c-0e0f-4487-9e43-33966c10e3a1","Type":"ContainerDied","Data":"297fb738853a9dc911254bf2186f1a599be875ce1e8a2c3f85ca3b6f60828616"} Jul 17 18:18:08.333802 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:08.333412 2580 scope.go:117] "RemoveContainer" containerID="cc42af2427aefdf20d84eb1a98d8c29f5d9b1b61d819a0dc874060f4ed1ee89a" Jul 17 18:18:08.333802 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:08.333645 2580 scope.go:117] "RemoveContainer" containerID="297fb738853a9dc911254bf2186f1a599be875ce1e8a2c3f85ca3b6f60828616" Jul 17 18:18:08.333962 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:18:08.333904 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn_odh-ai-gateway-infra(8c65363c-0e0f-4487-9e43-33966c10e3a1)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" podUID="8c65363c-0e0f-4487-9e43-33966c10e3a1" Jul 17 18:18:09.340838 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:09.340808 2580 scope.go:117] "RemoveContainer" containerID="297fb738853a9dc911254bf2186f1a599be875ce1e8a2c3f85ca3b6f60828616" Jul 17 18:18:09.341214 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:18:09.341010 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn_odh-ai-gateway-infra(8c65363c-0e0f-4487-9e43-33966c10e3a1)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" podUID="8c65363c-0e0f-4487-9e43-33966c10e3a1" Jul 17 18:18:11.361668 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:11.361638 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" Jul 17 18:18:11.362083 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:11.362028 2580 scope.go:117] "RemoveContainer" containerID="297fb738853a9dc911254bf2186f1a599be875ce1e8a2c3f85ca3b6f60828616" Jul 17 18:18:11.362212 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:18:11.362192 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn_odh-ai-gateway-infra(8c65363c-0e0f-4487-9e43-33966c10e3a1)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" podUID="8c65363c-0e0f-4487-9e43-33966c10e3a1" Jul 17 18:18:16.361709 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:16.361672 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" Jul 17 18:18:16.362146 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:16.362105 2580 scope.go:117] "RemoveContainer" containerID="297fb738853a9dc911254bf2186f1a599be875ce1e8a2c3f85ca3b6f60828616" Jul 17 18:18:16.362341 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:18:16.362312 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn_odh-ai-gateway-infra(8c65363c-0e0f-4487-9e43-33966c10e3a1)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" podUID="8c65363c-0e0f-4487-9e43-33966c10e3a1" Jul 17 18:18:28.478803 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:28.478744 2580 scope.go:117] "RemoveContainer" containerID="297fb738853a9dc911254bf2186f1a599be875ce1e8a2c3f85ca3b6f60828616" Jul 17 18:18:29.448015 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:29.447938 2580 generic.go:356] "Generic (PLEG): container finished" podID="8c65363c-0e0f-4487-9e43-33966c10e3a1" containerID="c7b940a400c8fa5a315a1a1b2fa0c35f6598b7da59cee014f6423515a13d7e36" exitCode=1 Jul 17 18:18:29.448168 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:29.448013 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" event={"ID":"8c65363c-0e0f-4487-9e43-33966c10e3a1","Type":"ContainerDied","Data":"c7b940a400c8fa5a315a1a1b2fa0c35f6598b7da59cee014f6423515a13d7e36"} Jul 17 18:18:29.448168 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:29.448122 2580 scope.go:117] "RemoveContainer" containerID="297fb738853a9dc911254bf2186f1a599be875ce1e8a2c3f85ca3b6f60828616" Jul 17 18:18:29.448472 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:29.448454 2580 scope.go:117] "RemoveContainer" containerID="c7b940a400c8fa5a315a1a1b2fa0c35f6598b7da59cee014f6423515a13d7e36" Jul 17 18:18:29.448715 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:18:29.448692 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn_odh-ai-gateway-infra(8c65363c-0e0f-4487-9e43-33966c10e3a1)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" podUID="8c65363c-0e0f-4487-9e43-33966c10e3a1" Jul 17 18:18:31.361770 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:31.361724 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" Jul 17 18:18:31.362168 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:31.362109 2580 scope.go:117] "RemoveContainer" containerID="c7b940a400c8fa5a315a1a1b2fa0c35f6598b7da59cee014f6423515a13d7e36" Jul 17 18:18:31.362298 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:18:31.362278 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn_odh-ai-gateway-infra(8c65363c-0e0f-4487-9e43-33966c10e3a1)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" podUID="8c65363c-0e0f-4487-9e43-33966c10e3a1" Jul 17 18:18:36.361580 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:36.361515 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" Jul 17 18:18:36.362185 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:36.361958 2580 scope.go:117] "RemoveContainer" containerID="c7b940a400c8fa5a315a1a1b2fa0c35f6598b7da59cee014f6423515a13d7e36" Jul 17 18:18:36.362185 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:18:36.362130 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn_odh-ai-gateway-infra(8c65363c-0e0f-4487-9e43-33966c10e3a1)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" podUID="8c65363c-0e0f-4487-9e43-33966c10e3a1" Jul 17 18:18:49.484332 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:49.484301 2580 scope.go:117] "RemoveContainer" containerID="c7b940a400c8fa5a315a1a1b2fa0c35f6598b7da59cee014f6423515a13d7e36" Jul 17 18:18:50.556206 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:50.556118 2580 generic.go:356] "Generic (PLEG): container finished" podID="8c65363c-0e0f-4487-9e43-33966c10e3a1" containerID="3d81eb9f9e24c00a5a939c474f95a3bd2ad9b0b74b735d721658ddc456783f71" exitCode=1 Jul 17 18:18:50.556206 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:50.556192 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" event={"ID":"8c65363c-0e0f-4487-9e43-33966c10e3a1","Type":"ContainerDied","Data":"3d81eb9f9e24c00a5a939c474f95a3bd2ad9b0b74b735d721658ddc456783f71"} Jul 17 18:18:50.556731 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:50.556251 2580 scope.go:117] "RemoveContainer" containerID="c7b940a400c8fa5a315a1a1b2fa0c35f6598b7da59cee014f6423515a13d7e36" Jul 17 18:18:50.556731 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:50.556587 2580 scope.go:117] "RemoveContainer" containerID="3d81eb9f9e24c00a5a939c474f95a3bd2ad9b0b74b735d721658ddc456783f71" Jul 17 18:18:50.556880 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:18:50.556838 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn_odh-ai-gateway-infra(8c65363c-0e0f-4487-9e43-33966c10e3a1)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" podUID="8c65363c-0e0f-4487-9e43-33966c10e3a1" Jul 17 18:18:51.362236 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:51.362196 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" Jul 17 18:18:51.563354 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:51.563325 2580 scope.go:117] "RemoveContainer" containerID="3d81eb9f9e24c00a5a939c474f95a3bd2ad9b0b74b735d721658ddc456783f71" Jul 17 18:18:51.563779 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:18:51.563478 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn_odh-ai-gateway-infra(8c65363c-0e0f-4487-9e43-33966c10e3a1)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" podUID="8c65363c-0e0f-4487-9e43-33966c10e3a1" Jul 17 18:18:56.362046 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:56.362010 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" Jul 17 18:18:56.362462 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:18:56.362403 2580 scope.go:117] "RemoveContainer" containerID="3d81eb9f9e24c00a5a939c474f95a3bd2ad9b0b74b735d721658ddc456783f71" Jul 17 18:18:56.362626 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:18:56.362604 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn_odh-ai-gateway-infra(8c65363c-0e0f-4487-9e43-33966c10e3a1)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" podUID="8c65363c-0e0f-4487-9e43-33966c10e3a1" Jul 17 18:19:07.478323 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:07.478248 2580 scope.go:117] "RemoveContainer" containerID="3d81eb9f9e24c00a5a939c474f95a3bd2ad9b0b74b735d721658ddc456783f71" Jul 17 18:19:07.478778 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:19:07.478410 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn_odh-ai-gateway-infra(8c65363c-0e0f-4487-9e43-33966c10e3a1)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" podUID="8c65363c-0e0f-4487-9e43-33966c10e3a1" Jul 17 18:19:13.546594 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:13.546564 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kcmzb_36b82608-4a35-44da-9af1-6d56c88cb1e2/console-operator/2.log" Jul 17 18:19:13.551634 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:13.551614 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kcmzb_36b82608-4a35-44da-9af1-6d56c88cb1e2/console-operator/2.log" Jul 17 18:19:16.406496 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:16.406465 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn"] Jul 17 18:19:16.535948 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:16.535924 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" Jul 17 18:19:16.662805 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:16.662677 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hsgr\" (UniqueName: \"kubernetes.io/projected/8c65363c-0e0f-4487-9e43-33966c10e3a1-kube-api-access-9hsgr\") pod \"8c65363c-0e0f-4487-9e43-33966c10e3a1\" (UID: \"8c65363c-0e0f-4487-9e43-33966c10e3a1\") " Jul 17 18:19:16.662805 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:16.662728 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c65363c-0e0f-4487-9e43-33966c10e3a1-maas-api-tls\") pod \"8c65363c-0e0f-4487-9e43-33966c10e3a1\" (UID: \"8c65363c-0e0f-4487-9e43-33966c10e3a1\") " Jul 17 18:19:16.662805 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:16.662786 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c65363c-0e0f-4487-9e43-33966c10e3a1-openshift-service-ca\") pod \"8c65363c-0e0f-4487-9e43-33966c10e3a1\" (UID: \"8c65363c-0e0f-4487-9e43-33966c10e3a1\") " Jul 17 18:19:16.663196 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:16.663168 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c65363c-0e0f-4487-9e43-33966c10e3a1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8c65363c-0e0f-4487-9e43-33966c10e3a1" (UID: "8c65363c-0e0f-4487-9e43-33966c10e3a1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:19:16.664960 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:16.664938 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c65363c-0e0f-4487-9e43-33966c10e3a1-kube-api-access-9hsgr" (OuterVolumeSpecName: "kube-api-access-9hsgr") pod "8c65363c-0e0f-4487-9e43-33966c10e3a1" (UID: "8c65363c-0e0f-4487-9e43-33966c10e3a1"). InnerVolumeSpecName "kube-api-access-9hsgr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:19:16.665041 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:16.664998 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c65363c-0e0f-4487-9e43-33966c10e3a1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8c65363c-0e0f-4487-9e43-33966c10e3a1" (UID: "8c65363c-0e0f-4487-9e43-33966c10e3a1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:19:16.690799 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:16.690777 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" Jul 17 18:19:16.690898 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:16.690793 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn" event={"ID":"8c65363c-0e0f-4487-9e43-33966c10e3a1","Type":"ContainerDied","Data":"3dafdd09b1cdb093efc010db5ba25b19c678f27f63c53aa7a1d05710365e3974"} Jul 17 18:19:16.690898 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:16.690863 2580 scope.go:117] "RemoveContainer" containerID="3d81eb9f9e24c00a5a939c474f95a3bd2ad9b0b74b735d721658ddc456783f71" Jul 17 18:19:16.712579 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:16.712559 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn"] Jul 17 18:19:16.716101 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:16.716079 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-db09a830-744bcc8b9b-f4mhn"] Jul 17 18:19:16.764013 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:16.763987 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hsgr\" (UniqueName: \"kubernetes.io/projected/8c65363c-0e0f-4487-9e43-33966c10e3a1-kube-api-access-9hsgr\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 18:19:16.764013 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:16.764012 2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c65363c-0e0f-4487-9e43-33966c10e3a1-maas-api-tls\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 18:19:16.764149 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:16.764027 2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c65363c-0e0f-4487-9e43-33966c10e3a1-openshift-service-ca\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 18:19:17.484079 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:17.484001 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c65363c-0e0f-4487-9e43-33966c10e3a1" path="/var/lib/kubelet/pods/8c65363c-0e0f-4487-9e43-33966c10e3a1/volumes" Jul 17 18:19:23.888643 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:23.888603 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk"] Jul 17 18:19:23.889215 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:23.889046 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c65363c-0e0f-4487-9e43-33966c10e3a1" containerName="maas-api" Jul 17 18:19:23.889215 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:23.889065 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c65363c-0e0f-4487-9e43-33966c10e3a1" containerName="maas-api" Jul 17 18:19:23.889215 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:23.889080 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c65363c-0e0f-4487-9e43-33966c10e3a1" containerName="maas-api" Jul 17 18:19:23.889215 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:23.889086 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c65363c-0e0f-4487-9e43-33966c10e3a1" containerName="maas-api" Jul 17 18:19:23.889215 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:23.889098 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" containerName="maas-api" Jul 17 18:19:23.889215 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:23.889108 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" containerName="maas-api" Jul 17 18:19:23.889215 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:23.889121 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c65363c-0e0f-4487-9e43-33966c10e3a1" containerName="maas-api" Jul 17 18:19:23.889215 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:23.889129 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c65363c-0e0f-4487-9e43-33966c10e3a1" containerName="maas-api" Jul 17 18:19:23.889572 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:23.889239 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c65363c-0e0f-4487-9e43-33966c10e3a1" containerName="maas-api" Jul 17 18:19:23.889572 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:23.889255 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c65363c-0e0f-4487-9e43-33966c10e3a1" containerName="maas-api" Jul 17 18:19:23.889572 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:23.889264 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="75c86a5c-ab7b-4c64-8279-c39773422204" containerName="maas-api" Jul 17 18:19:23.889572 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:23.889274 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c65363c-0e0f-4487-9e43-33966c10e3a1" containerName="maas-api" Jul 17 18:19:23.893882 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:23.893863 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" Jul 17 18:19:23.896673 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:23.896643 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-ad85eda1-serving-cert\"" Jul 17 18:19:23.909137 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:23.909118 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk"] Jul 17 18:19:24.022525 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:24.022490 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9945cfe-3475-47ac-acda-0a4f393fd858-maas-api-tls\") pod \"maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk\" (UID: \"b9945cfe-3475-47ac-acda-0a4f393fd858\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" Jul 17 18:19:24.022525 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:24.022526 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9945cfe-3475-47ac-acda-0a4f393fd858-openshift-service-ca\") pod \"maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk\" (UID: \"b9945cfe-3475-47ac-acda-0a4f393fd858\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" Jul 17 18:19:24.022734 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:24.022559 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9dqd\" (UniqueName: \"kubernetes.io/projected/b9945cfe-3475-47ac-acda-0a4f393fd858-kube-api-access-j9dqd\") pod \"maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk\" (UID: \"b9945cfe-3475-47ac-acda-0a4f393fd858\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" Jul 17 18:19:24.123643 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:24.123607 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9945cfe-3475-47ac-acda-0a4f393fd858-openshift-service-ca\") pod \"maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk\" (UID: \"b9945cfe-3475-47ac-acda-0a4f393fd858\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" Jul 17 18:19:24.123643 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:24.123648 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9dqd\" (UniqueName: \"kubernetes.io/projected/b9945cfe-3475-47ac-acda-0a4f393fd858-kube-api-access-j9dqd\") pod \"maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk\" (UID: \"b9945cfe-3475-47ac-acda-0a4f393fd858\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" Jul 17 18:19:24.123919 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:24.123734 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9945cfe-3475-47ac-acda-0a4f393fd858-maas-api-tls\") pod \"maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk\" (UID: \"b9945cfe-3475-47ac-acda-0a4f393fd858\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" Jul 17 18:19:24.124317 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:24.124292 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9945cfe-3475-47ac-acda-0a4f393fd858-openshift-service-ca\") pod \"maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk\" (UID: \"b9945cfe-3475-47ac-acda-0a4f393fd858\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" Jul 17 18:19:24.126323 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:24.126301 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9945cfe-3475-47ac-acda-0a4f393fd858-maas-api-tls\") pod \"maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk\" (UID: \"b9945cfe-3475-47ac-acda-0a4f393fd858\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" Jul 17 18:19:24.131871 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:24.131848 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9dqd\" (UniqueName: \"kubernetes.io/projected/b9945cfe-3475-47ac-acda-0a4f393fd858-kube-api-access-j9dqd\") pod \"maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk\" (UID: \"b9945cfe-3475-47ac-acda-0a4f393fd858\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" Jul 17 18:19:24.206417 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:24.206353 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" Jul 17 18:19:24.342399 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:24.342372 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk"] Jul 17 18:19:24.344256 ip-10-0-135-140 kubenswrapper[2580]: W0717 18:19:24.344227 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9945cfe_3475_47ac_acda_0a4f393fd858.slice/crio-13a7c764cf0ff2d4b662410ee511d8c3b6d670922172eed6600f06c453588757 WatchSource:0}: Error finding container 13a7c764cf0ff2d4b662410ee511d8c3b6d670922172eed6600f06c453588757: Status 404 returned error can't find the container with id 13a7c764cf0ff2d4b662410ee511d8c3b6d670922172eed6600f06c453588757 Jul 17 18:19:24.735951 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:24.735916 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" event={"ID":"b9945cfe-3475-47ac-acda-0a4f393fd858","Type":"ContainerStarted","Data":"13a7c764cf0ff2d4b662410ee511d8c3b6d670922172eed6600f06c453588757"} Jul 17 18:19:25.742347 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:25.742316 2580 generic.go:356] "Generic (PLEG): container finished" podID="b9945cfe-3475-47ac-acda-0a4f393fd858" containerID="19f666ddd35bc0fb4a2b8950f66f6428267c2a628c1bddc4ff7a32dbd7615a59" exitCode=1 Jul 17 18:19:25.742773 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:25.742382 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" event={"ID":"b9945cfe-3475-47ac-acda-0a4f393fd858","Type":"ContainerDied","Data":"19f666ddd35bc0fb4a2b8950f66f6428267c2a628c1bddc4ff7a32dbd7615a59"} Jul 17 18:19:25.742773 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:25.742617 2580 scope.go:117] "RemoveContainer" containerID="19f666ddd35bc0fb4a2b8950f66f6428267c2a628c1bddc4ff7a32dbd7615a59" Jul 17 18:19:26.749439 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:26.749353 2580 generic.go:356] "Generic (PLEG): container finished" podID="b9945cfe-3475-47ac-acda-0a4f393fd858" containerID="6f4b836d509c2d5d1ddaf3d4b5ae1aa90d9545ef2eb8a8b037ecd4391f353756" exitCode=1 Jul 17 18:19:26.749439 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:26.749397 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" event={"ID":"b9945cfe-3475-47ac-acda-0a4f393fd858","Type":"ContainerDied","Data":"6f4b836d509c2d5d1ddaf3d4b5ae1aa90d9545ef2eb8a8b037ecd4391f353756"} Jul 17 18:19:26.749884 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:26.749443 2580 scope.go:117] "RemoveContainer" containerID="19f666ddd35bc0fb4a2b8950f66f6428267c2a628c1bddc4ff7a32dbd7615a59" Jul 17 18:19:26.749884 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:26.749689 2580 scope.go:117] "RemoveContainer" containerID="6f4b836d509c2d5d1ddaf3d4b5ae1aa90d9545ef2eb8a8b037ecd4391f353756" Jul 17 18:19:26.749966 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:19:26.749915 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:19:27.756174 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:27.756149 2580 scope.go:117] "RemoveContainer" containerID="6f4b836d509c2d5d1ddaf3d4b5ae1aa90d9545ef2eb8a8b037ecd4391f353756" Jul 17 18:19:27.756578 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:19:27.756329 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:19:29.206624 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:29.206591 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" Jul 17 18:19:29.207139 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:29.207092 2580 scope.go:117] "RemoveContainer" containerID="6f4b836d509c2d5d1ddaf3d4b5ae1aa90d9545ef2eb8a8b037ecd4391f353756" Jul 17 18:19:29.207322 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:19:29.207297 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:19:34.207261 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:34.207222 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" Jul 17 18:19:34.207737 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:34.207693 2580 scope.go:117] "RemoveContainer" containerID="6f4b836d509c2d5d1ddaf3d4b5ae1aa90d9545ef2eb8a8b037ecd4391f353756" Jul 17 18:19:34.207989 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:19:34.207965 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:19:45.479223 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:45.479194 2580 scope.go:117] "RemoveContainer" containerID="6f4b836d509c2d5d1ddaf3d4b5ae1aa90d9545ef2eb8a8b037ecd4391f353756" Jul 17 18:19:45.853325 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:45.853297 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" event={"ID":"b9945cfe-3475-47ac-acda-0a4f393fd858","Type":"ContainerStarted","Data":"0fec42733a8b9af5626015864122df2d3277f515966f4651ae103cf2e86a3236"} Jul 17 18:19:45.853532 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:45.853513 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" Jul 17 18:19:45.873479 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:45.873425 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podStartSLOduration=21.775285791 podStartE2EDuration="22.873406428s" totalImagesPullingTime="1.098120637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:19:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:19:45.870335895 +0000 UTC m=+1832.857552256" watchObservedRunningTime="2026-07-17 18:19:45.873406428 +0000 UTC m=+1832.860622781" Jul 17 18:19:46.859663 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:46.859625 2580 generic.go:356] "Generic (PLEG): container finished" podID="b9945cfe-3475-47ac-acda-0a4f393fd858" containerID="0fec42733a8b9af5626015864122df2d3277f515966f4651ae103cf2e86a3236" exitCode=1 Jul 17 18:19:46.860124 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:46.859685 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" event={"ID":"b9945cfe-3475-47ac-acda-0a4f393fd858","Type":"ContainerDied","Data":"0fec42733a8b9af5626015864122df2d3277f515966f4651ae103cf2e86a3236"} Jul 17 18:19:46.860124 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:46.859769 2580 scope.go:117] "RemoveContainer" containerID="6f4b836d509c2d5d1ddaf3d4b5ae1aa90d9545ef2eb8a8b037ecd4391f353756" Jul 17 18:19:46.860124 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:46.859929 2580 scope.go:117] "RemoveContainer" containerID="0fec42733a8b9af5626015864122df2d3277f515966f4651ae103cf2e86a3236" Jul 17 18:19:46.860239 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:19:46.860167 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:19:47.866561 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:47.866534 2580 scope.go:117] "RemoveContainer" containerID="0fec42733a8b9af5626015864122df2d3277f515966f4651ae103cf2e86a3236" Jul 17 18:19:47.866943 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:19:47.866704 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:19:54.206656 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:54.206604 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" Jul 17 18:19:54.207111 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:19:54.207025 2580 scope.go:117] "RemoveContainer" containerID="0fec42733a8b9af5626015864122df2d3277f515966f4651ae103cf2e86a3236" Jul 17 18:19:54.207209 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:19:54.207189 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:20:08.479312 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:20:08.479278 2580 scope.go:117] "RemoveContainer" containerID="0fec42733a8b9af5626015864122df2d3277f515966f4651ae103cf2e86a3236" Jul 17 18:20:08.479739 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:20:08.479535 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 18:20:09.982682 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:20:09.982647 2580 generic.go:356] "Generic (PLEG): container finished" podID="b9945cfe-3475-47ac-acda-0a4f393fd858" containerID="b08660764ba215403485ccb4625bc81bebc2770fa2ef9d6ff8fd6270f11c2729" exitCode=1 Jul 17 18:20:09.983172 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:20:09.982714 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" event={"ID":"b9945cfe-3475-47ac-acda-0a4f393fd858","Type":"ContainerDied","Data":"b08660764ba215403485ccb4625bc81bebc2770fa2ef9d6ff8fd6270f11c2729"} Jul 17 18:20:09.983172 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:20:09.982801 2580 scope.go:117] "RemoveContainer" containerID="0fec42733a8b9af5626015864122df2d3277f515966f4651ae103cf2e86a3236" Jul 17 18:20:09.983172 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:20:09.983117 2580 scope.go:117] "RemoveContainer" containerID="b08660764ba215403485ccb4625bc81bebc2770fa2ef9d6ff8fd6270f11c2729" Jul 17 18:20:09.983374 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:20:09.983350 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:20:10.854272 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:20:10.854239 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" Jul 17 18:20:10.989515 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:20:10.989484 2580 scope.go:117] "RemoveContainer" containerID="b08660764ba215403485ccb4625bc81bebc2770fa2ef9d6ff8fd6270f11c2729" Jul 17 18:20:10.989906 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:20:10.989677 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:20:14.206861 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:20:14.206825 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" Jul 17 18:20:14.207274 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:20:14.207213 2580 scope.go:117] "RemoveContainer" containerID="b08660764ba215403485ccb4625bc81bebc2770fa2ef9d6ff8fd6270f11c2729" Jul 17 18:20:14.207407 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:20:14.207387 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:20:28.478350 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:20:28.478324 2580 scope.go:117] "RemoveContainer" containerID="b08660764ba215403485ccb4625bc81bebc2770fa2ef9d6ff8fd6270f11c2729" Jul 17 18:20:28.478807 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:20:28.478497 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:20:41.479284 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:20:41.479204 2580 scope.go:117] "RemoveContainer" containerID="b08660764ba215403485ccb4625bc81bebc2770fa2ef9d6ff8fd6270f11c2729" Jul 17 18:20:41.479660 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:20:41.479381 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:20:54.478981 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:20:54.478945 2580 scope.go:117] "RemoveContainer" containerID="b08660764ba215403485ccb4625bc81bebc2770fa2ef9d6ff8fd6270f11c2729" Jul 17 18:20:55.212900 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:20:55.212816 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" event={"ID":"b9945cfe-3475-47ac-acda-0a4f393fd858","Type":"ContainerStarted","Data":"565c3f26896bca9be186924e1668908a030b4398a1c4024dd4d71c59663c4aaa"} Jul 17 18:20:55.213046 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:20:55.213019 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" Jul 17 18:20:56.220186 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:20:56.220152 2580 generic.go:356] "Generic (PLEG): container finished" podID="b9945cfe-3475-47ac-acda-0a4f393fd858" containerID="565c3f26896bca9be186924e1668908a030b4398a1c4024dd4d71c59663c4aaa" exitCode=1 Jul 17 18:20:56.220606 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:20:56.220232 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" event={"ID":"b9945cfe-3475-47ac-acda-0a4f393fd858","Type":"ContainerDied","Data":"565c3f26896bca9be186924e1668908a030b4398a1c4024dd4d71c59663c4aaa"} Jul 17 18:20:56.220606 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:20:56.220321 2580 scope.go:117] "RemoveContainer" containerID="b08660764ba215403485ccb4625bc81bebc2770fa2ef9d6ff8fd6270f11c2729" Jul 17 18:20:56.220606 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:20:56.220570 2580 scope.go:117] "RemoveContainer" containerID="565c3f26896bca9be186924e1668908a030b4398a1c4024dd4d71c59663c4aaa" Jul 17 18:20:56.220812 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:20:56.220790 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:20:57.227037 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:20:57.227009 2580 scope.go:117] "RemoveContainer" containerID="565c3f26896bca9be186924e1668908a030b4398a1c4024dd4d71c59663c4aaa" Jul 17 18:20:57.227505 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:20:57.227241 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:21:04.207243 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:21:04.207193 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" Jul 17 18:21:04.207665 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:21:04.207592 2580 scope.go:117] "RemoveContainer" containerID="565c3f26896bca9be186924e1668908a030b4398a1c4024dd4d71c59663c4aaa" Jul 17 18:21:04.207808 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:21:04.207786 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:21:16.478485 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:21:16.478454 2580 scope.go:117] "RemoveContainer" containerID="565c3f26896bca9be186924e1668908a030b4398a1c4024dd4d71c59663c4aaa" Jul 17 18:21:16.479087 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:21:16.478643 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:21:27.478816 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:21:27.478782 2580 scope.go:117] "RemoveContainer" containerID="565c3f26896bca9be186924e1668908a030b4398a1c4024dd4d71c59663c4aaa" Jul 17 18:21:27.479205 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:21:27.478974 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:21:39.478853 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:21:39.478820 2580 scope.go:117] "RemoveContainer" containerID="565c3f26896bca9be186924e1668908a030b4398a1c4024dd4d71c59663c4aaa" Jul 17 18:21:39.479254 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:21:39.478994 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:21:50.478899 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:21:50.478863 2580 scope.go:117] "RemoveContainer" containerID="565c3f26896bca9be186924e1668908a030b4398a1c4024dd4d71c59663c4aaa" Jul 17 18:21:50.479350 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:21:50.479029 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:22:03.480179 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:22:03.480152 2580 scope.go:117] "RemoveContainer" containerID="565c3f26896bca9be186924e1668908a030b4398a1c4024dd4d71c59663c4aaa" Jul 17 18:22:03.480590 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:22:03.480314 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:22:17.478968 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:22:17.478887 2580 scope.go:117] "RemoveContainer" containerID="565c3f26896bca9be186924e1668908a030b4398a1c4024dd4d71c59663c4aaa" Jul 17 18:22:18.634328 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:22:18.634297 2580 generic.go:356] "Generic (PLEG): container finished" podID="b9945cfe-3475-47ac-acda-0a4f393fd858" containerID="4ec107c4f92deab5a4c4574c39284e77608f35ded853d1f5914e0b34303c9a10" exitCode=1 Jul 17 18:22:18.634740 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:22:18.634353 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" event={"ID":"b9945cfe-3475-47ac-acda-0a4f393fd858","Type":"ContainerDied","Data":"4ec107c4f92deab5a4c4574c39284e77608f35ded853d1f5914e0b34303c9a10"} Jul 17 18:22:18.634740 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:22:18.634410 2580 scope.go:117] "RemoveContainer" containerID="565c3f26896bca9be186924e1668908a030b4398a1c4024dd4d71c59663c4aaa" Jul 17 18:22:18.634855 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:22:18.634798 2580 scope.go:117] "RemoveContainer" containerID="4ec107c4f92deab5a4c4574c39284e77608f35ded853d1f5914e0b34303c9a10" Jul 17 18:22:18.635023 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:22:18.635000 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:22:20.213897 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:22:20.213857 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" Jul 17 18:22:20.214303 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:22:20.214220 2580 scope.go:117] "RemoveContainer" containerID="4ec107c4f92deab5a4c4574c39284e77608f35ded853d1f5914e0b34303c9a10" Jul 17 18:22:20.214395 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:22:20.214376 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:22:24.207021 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:22:24.206989 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" Jul 17 18:22:24.207483 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:22:24.207334 2580 scope.go:117] "RemoveContainer" containerID="4ec107c4f92deab5a4c4574c39284e77608f35ded853d1f5914e0b34303c9a10" Jul 17 18:22:24.207541 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:22:24.207481 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:22:39.478970 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:22:39.478939 2580 scope.go:117] "RemoveContainer" containerID="4ec107c4f92deab5a4c4574c39284e77608f35ded853d1f5914e0b34303c9a10" Jul 17 18:22:39.479368 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:22:39.479098 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:22:52.478648 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:22:52.478615 2580 scope.go:117] "RemoveContainer" containerID="4ec107c4f92deab5a4c4574c39284e77608f35ded853d1f5914e0b34303c9a10" Jul 17 18:22:52.479076 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:22:52.478833 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:23:05.478673 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:23:05.478637 2580 scope.go:117] "RemoveContainer" containerID="4ec107c4f92deab5a4c4574c39284e77608f35ded853d1f5914e0b34303c9a10" Jul 17 18:23:05.479244 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:23:05.478810 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:23:18.479052 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:23:18.479015 2580 scope.go:117] "RemoveContainer" containerID="4ec107c4f92deab5a4c4574c39284e77608f35ded853d1f5914e0b34303c9a10" Jul 17 18:23:18.479517 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:23:18.479259 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:23:29.479150 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:23:29.479111 2580 scope.go:117] "RemoveContainer" containerID="4ec107c4f92deab5a4c4574c39284e77608f35ded853d1f5914e0b34303c9a10" Jul 17 18:23:29.479652 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:23:29.479287 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:23:42.478526 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:23:42.478451 2580 scope.go:117] "RemoveContainer" containerID="4ec107c4f92deab5a4c4574c39284e77608f35ded853d1f5914e0b34303c9a10" Jul 17 18:23:42.478923 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:23:42.478638 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:23:54.478178 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:23:54.478147 2580 scope.go:117] "RemoveContainer" containerID="4ec107c4f92deab5a4c4574c39284e77608f35ded853d1f5914e0b34303c9a10" Jul 17 18:23:54.478632 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:23:54.478378 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:24:09.479163 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:24:09.479134 2580 scope.go:117] "RemoveContainer" containerID="4ec107c4f92deab5a4c4574c39284e77608f35ded853d1f5914e0b34303c9a10" Jul 17 18:24:09.479634 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:24:09.479330 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:24:13.581934 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:24:13.581897 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kcmzb_36b82608-4a35-44da-9af1-6d56c88cb1e2/console-operator/2.log" Jul 17 18:24:13.591739 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:24:13.591717 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kcmzb_36b82608-4a35-44da-9af1-6d56c88cb1e2/console-operator/2.log" Jul 17 18:24:21.478932 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:24:21.478900 2580 scope.go:117] "RemoveContainer" containerID="4ec107c4f92deab5a4c4574c39284e77608f35ded853d1f5914e0b34303c9a10" Jul 17 18:24:21.479310 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:24:21.479071 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:24:33.480528 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:24:33.480498 2580 scope.go:117] "RemoveContainer" containerID="4ec107c4f92deab5a4c4574c39284e77608f35ded853d1f5914e0b34303c9a10" Jul 17 18:24:33.481027 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:24:33.480691 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:24:47.478901 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:24:47.478863 2580 scope.go:117] "RemoveContainer" containerID="4ec107c4f92deab5a4c4574c39284e77608f35ded853d1f5914e0b34303c9a10" Jul 17 18:24:47.479520 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:24:47.479102 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:25:00.478535 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:00.478501 2580 scope.go:117] "RemoveContainer" containerID="4ec107c4f92deab5a4c4574c39284e77608f35ded853d1f5914e0b34303c9a10" Jul 17 18:25:01.469246 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:01.469154 2580 generic.go:356] "Generic (PLEG): container finished" podID="b9945cfe-3475-47ac-acda-0a4f393fd858" containerID="3fed0ac97925e0f52b471c63442591e059d9b966fc0be42436e3093921d29dbb" exitCode=1 Jul 17 18:25:01.469246 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:01.469214 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" event={"ID":"b9945cfe-3475-47ac-acda-0a4f393fd858","Type":"ContainerDied","Data":"3fed0ac97925e0f52b471c63442591e059d9b966fc0be42436e3093921d29dbb"} Jul 17 18:25:01.469501 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:01.469265 2580 scope.go:117] "RemoveContainer" containerID="4ec107c4f92deab5a4c4574c39284e77608f35ded853d1f5914e0b34303c9a10" Jul 17 18:25:01.469648 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:01.469630 2580 scope.go:117] "RemoveContainer" containerID="3fed0ac97925e0f52b471c63442591e059d9b966fc0be42436e3093921d29dbb" Jul 17 18:25:01.469903 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:25:01.469875 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:25:04.207305 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:04.207273 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" Jul 17 18:25:04.207720 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:04.207636 2580 scope.go:117] "RemoveContainer" containerID="3fed0ac97925e0f52b471c63442591e059d9b966fc0be42436e3093921d29dbb" Jul 17 18:25:04.207857 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:25:04.207827 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:25:05.213126 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:05.213090 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" Jul 17 18:25:05.213640 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:05.213565 2580 scope.go:117] "RemoveContainer" containerID="3fed0ac97925e0f52b471c63442591e059d9b966fc0be42436e3093921d29dbb" Jul 17 18:25:05.213824 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:25:05.213798 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:25:16.478296 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:16.478262 2580 scope.go:117] "RemoveContainer" containerID="3fed0ac97925e0f52b471c63442591e059d9b966fc0be42436e3093921d29dbb" Jul 17 18:25:16.478674 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:25:16.478440 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:25:27.479334 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:27.479298 2580 scope.go:117] "RemoveContainer" containerID="3fed0ac97925e0f52b471c63442591e059d9b966fc0be42436e3093921d29dbb" Jul 17 18:25:27.479855 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:25:27.479466 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk_odh-ai-gateway-infra(b9945cfe-3475-47ac-acda-0a4f393fd858)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" Jul 17 18:25:34.696370 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:34.696332 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk"] Jul 17 18:25:34.826484 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:34.826461 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" Jul 17 18:25:34.934001 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:34.933966 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9945cfe-3475-47ac-acda-0a4f393fd858-maas-api-tls\") pod \"b9945cfe-3475-47ac-acda-0a4f393fd858\" (UID: \"b9945cfe-3475-47ac-acda-0a4f393fd858\") " Jul 17 18:25:34.934170 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:34.934055 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9945cfe-3475-47ac-acda-0a4f393fd858-openshift-service-ca\") pod \"b9945cfe-3475-47ac-acda-0a4f393fd858\" (UID: \"b9945cfe-3475-47ac-acda-0a4f393fd858\") " Jul 17 18:25:34.934170 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:34.934090 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9dqd\" (UniqueName: \"kubernetes.io/projected/b9945cfe-3475-47ac-acda-0a4f393fd858-kube-api-access-j9dqd\") pod \"b9945cfe-3475-47ac-acda-0a4f393fd858\" (UID: \"b9945cfe-3475-47ac-acda-0a4f393fd858\") " Jul 17 18:25:34.934437 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:34.934411 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9945cfe-3475-47ac-acda-0a4f393fd858-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b9945cfe-3475-47ac-acda-0a4f393fd858" (UID: "b9945cfe-3475-47ac-acda-0a4f393fd858"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:25:34.936177 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:34.936150 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9945cfe-3475-47ac-acda-0a4f393fd858-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b9945cfe-3475-47ac-acda-0a4f393fd858" (UID: "b9945cfe-3475-47ac-acda-0a4f393fd858"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:25:34.936297 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:34.936277 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9945cfe-3475-47ac-acda-0a4f393fd858-kube-api-access-j9dqd" (OuterVolumeSpecName: "kube-api-access-j9dqd") pod "b9945cfe-3475-47ac-acda-0a4f393fd858" (UID: "b9945cfe-3475-47ac-acda-0a4f393fd858"). InnerVolumeSpecName "kube-api-access-j9dqd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:25:35.035436 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:35.035406 2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9945cfe-3475-47ac-acda-0a4f393fd858-maas-api-tls\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 18:25:35.035436 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:35.035433 2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9945cfe-3475-47ac-acda-0a4f393fd858-openshift-service-ca\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 18:25:35.035627 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:35.035445 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9dqd\" (UniqueName: \"kubernetes.io/projected/b9945cfe-3475-47ac-acda-0a4f393fd858-kube-api-access-j9dqd\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 18:25:35.651309 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:35.651281 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" Jul 17 18:25:35.651469 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:35.651280 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk" event={"ID":"b9945cfe-3475-47ac-acda-0a4f393fd858","Type":"ContainerDied","Data":"13a7c764cf0ff2d4b662410ee511d8c3b6d670922172eed6600f06c453588757"} Jul 17 18:25:35.651469 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:35.651427 2580 scope.go:117] "RemoveContainer" containerID="3fed0ac97925e0f52b471c63442591e059d9b966fc0be42436e3093921d29dbb" Jul 17 18:25:35.669654 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:35.669630 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk"] Jul 17 18:25:35.671664 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:35.671643 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ad85eda1-789989d96f-9cpsk"] Jul 17 18:25:37.489581 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:37.485810 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" path="/var/lib/kubelet/pods/b9945cfe-3475-47ac-acda-0a4f393fd858/volumes" Jul 17 18:25:46.664558 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:46.664516 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5c77fb6b4b-5zxkf_5afbec6f-f189-4c3d-b205-03d41af8485e/manager/0.log" Jul 17 18:25:47.122607 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:47.122577 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cc99fdf4f-cndbb_3011a067-30d8-4661-bb56-f748b7bf344b/copy-manifests/0.log" Jul 17 18:25:47.134618 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:47.134593 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cc99fdf4f-cndbb_3011a067-30d8-4661-bb56-f748b7bf344b/manager/0.log" Jul 17 18:25:47.578783 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:47.578722 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-86c4f86d59-95c2p_84f8a59b-3f84-463e-ac52-cc7897224ab8/maas-api/0.log" Jul 17 18:25:48.004680 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:48.004588 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-vsfc9_426fa52e-3e5f-46dc-9592-5798beaa3874/postgres/0.log" Jul 17 18:25:48.765124 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:48.765094 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq_aeb74a36-67b5-45b7-be9b-60029d5e1bef/extract/0.log" Jul 17 18:25:48.771719 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:48.771697 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq_aeb74a36-67b5-45b7-be9b-60029d5e1bef/util/0.log" Jul 17 18:25:48.777939 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:48.777924 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq_aeb74a36-67b5-45b7-be9b-60029d5e1bef/pull/0.log" Jul 17 18:25:48.884223 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:48.884201 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp_e2cb8de7-9425-42e9-a2a9-5a811e4757d5/util/0.log" Jul 17 18:25:48.890281 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:48.890264 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp_e2cb8de7-9425-42e9-a2a9-5a811e4757d5/pull/0.log" Jul 17 18:25:48.896352 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:48.896330 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp_e2cb8de7-9425-42e9-a2a9-5a811e4757d5/extract/0.log" Jul 17 18:25:48.997612 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:48.997593 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb_620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8/util/0.log" Jul 17 18:25:49.003155 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:49.003137 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb_620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8/pull/0.log" Jul 17 18:25:49.008513 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:49.008499 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb_620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8/extract/0.log" Jul 17 18:25:49.116682 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:49.116653 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s_b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f/util/0.log" Jul 17 18:25:49.122961 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:49.122941 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s_b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f/pull/0.log" Jul 17 18:25:49.128820 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:49.128804 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s_b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f/extract/0.log" Jul 17 18:25:50.539995 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:50.539962 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-llz6h_72d99cfc-2662-4715-9319-a76c4a2a8f85/discovery/0.log" Jul 17 18:25:51.141992 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:51.141962 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-fzbr9_a1cb1641-f574-4c14-96c4-683d35e40c0f/payload-processing/0.log" Jul 17 18:25:51.267028 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:51.266990 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56cbf4fbfd-spcrn_e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8/router/0.log" Jul 17 18:25:51.723717 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:51.723691 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-f9hr4_d9e3f2dd-1d54-41c9-a0cc-decf8db520ed/main/0.log" Jul 17 18:25:51.946207 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:51.946180 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnf4q9_9c8d8425-8279-4415-9ddf-b8666182abeb/main/0.log" Jul 17 18:25:59.280028 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:59.279996 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4"] Jul 17 18:25:59.280547 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:59.280354 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" containerName="maas-api" Jul 17 18:25:59.280547 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:59.280365 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" containerName="maas-api" Jul 17 18:25:59.280547 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:59.280379 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" containerName="maas-api" Jul 17 18:25:59.280547 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:59.280385 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" containerName="maas-api" Jul 17 18:25:59.280547 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:59.280396 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" containerName="maas-api" Jul 17 18:25:59.280547 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:59.280404 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" containerName="maas-api" Jul 17 18:25:59.280547 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:59.280413 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" containerName="maas-api" Jul 17 18:25:59.280547 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:59.280419 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" containerName="maas-api" Jul 17 18:25:59.280547 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:59.280438 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c65363c-0e0f-4487-9e43-33966c10e3a1" containerName="maas-api" Jul 17 18:25:59.280547 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:59.280444 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c65363c-0e0f-4487-9e43-33966c10e3a1" containerName="maas-api" Jul 17 18:25:59.280547 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:59.280492 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" containerName="maas-api" Jul 17 18:25:59.280547 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:59.280499 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" containerName="maas-api" Jul 17 18:25:59.280547 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:59.280505 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" containerName="maas-api" Jul 17 18:25:59.280547 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:59.280512 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c65363c-0e0f-4487-9e43-33966c10e3a1" containerName="maas-api" Jul 17 18:25:59.280547 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:59.280518 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" containerName="maas-api" Jul 17 18:25:59.280547 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:59.280523 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" containerName="maas-api" Jul 17 18:25:59.280547 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:59.280529 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" containerName="maas-api" Jul 17 18:25:59.283530 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:59.283513 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4" Jul 17 18:25:59.286237 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:59.286216 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2dpsm\"" Jul 17 18:25:59.291535 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:59.291502 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4"] Jul 17 18:25:59.436986 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:59.436951 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1b066cc-b55f-446f-8e1c-4e3c13507d1f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4\" (UID: \"f1b066cc-b55f-446f-8e1c-4e3c13507d1f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4" Jul 17 18:25:59.537559 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:59.537482 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1b066cc-b55f-446f-8e1c-4e3c13507d1f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4\" (UID: \"f1b066cc-b55f-446f-8e1c-4e3c13507d1f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4" Jul 17 18:25:59.538286 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:59.538260 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1b066cc-b55f-446f-8e1c-4e3c13507d1f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4\" (UID: \"f1b066cc-b55f-446f-8e1c-4e3c13507d1f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4" Jul 17 18:25:59.595135 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:59.595108 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4" Jul 17 18:25:59.728162 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:59.728136 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4"] Jul 17 18:25:59.730276 ip-10-0-135-140 kubenswrapper[2580]: W0717 18:25:59.730243 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1b066cc_b55f_446f_8e1c_4e3c13507d1f.slice/crio-4d8e7f133da95c43cfb82885387aa77306a735e6b24a393dc08a4f6ee4efd551 WatchSource:0}: Error finding container 4d8e7f133da95c43cfb82885387aa77306a735e6b24a393dc08a4f6ee4efd551: Status 404 returned error can't find the container with id 4d8e7f133da95c43cfb82885387aa77306a735e6b24a393dc08a4f6ee4efd551 Jul 17 18:25:59.732231 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:59.732211 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 18:25:59.778964 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:25:59.778934 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4" event={"ID":"f1b066cc-b55f-446f-8e1c-4e3c13507d1f","Type":"ContainerStarted","Data":"4d8e7f133da95c43cfb82885387aa77306a735e6b24a393dc08a4f6ee4efd551"} Jul 17 18:26:00.888460 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:00.888434 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7nlmb_030fdd55-bca5-482e-9b12-0552be384774/global-pull-secret-syncer/0.log" Jul 17 18:26:00.981560 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:00.981520 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pkgcs_12d7cf3a-4015-4324-b26f-db47d30161b2/konnectivity-agent/0.log" Jul 17 18:26:01.038206 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:01.038174 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-140.ec2.internal_2e8d81a968918cba8978dd311f485be1/haproxy/0.log" Jul 17 18:26:02.800544 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:02.800509 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4" event={"ID":"f1b066cc-b55f-446f-8e1c-4e3c13507d1f","Type":"ContainerStarted","Data":"2fd17fed37b24125f0da840e9cb5d46e9c3c4fe6dee5131fec35671e5236a72b"} Jul 17 18:26:02.817774 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:02.817698 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4" podStartSLOduration=1.333563048 podStartE2EDuration="3.817675969s" totalImagesPullingTime="2.484112921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:26:02.815664621 +0000 UTC m=+2209.802880972" watchObservedRunningTime="2026-07-17 18:26:02.817675969 +0000 UTC m=+2209.804892322" Jul 17 18:26:03.808215 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:03.808174 2580 generic.go:356] "Generic (PLEG): container finished" podID="f1b066cc-b55f-446f-8e1c-4e3c13507d1f" containerID="2fd17fed37b24125f0da840e9cb5d46e9c3c4fe6dee5131fec35671e5236a72b" exitCode=6 Jul 17 18:26:03.808619 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:03.808261 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4" event={"ID":"f1b066cc-b55f-446f-8e1c-4e3c13507d1f","Type":"ContainerDied","Data":"2fd17fed37b24125f0da840e9cb5d46e9c3c4fe6dee5131fec35671e5236a72b"} Jul 17 18:26:03.808619 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:03.808431 2580 scope.go:117] "RemoveContainer" containerID="2fd17fed37b24125f0da840e9cb5d46e9c3c4fe6dee5131fec35671e5236a72b" Jul 17 18:26:04.815907 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:04.815872 2580 generic.go:356] "Generic (PLEG): container finished" podID="f1b066cc-b55f-446f-8e1c-4e3c13507d1f" containerID="9e0951179b7eac56664c410f3875c3b36f49a15855f09c7dff810e10674397cb" exitCode=6 Jul 17 18:26:04.816306 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:04.815916 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4" event={"ID":"f1b066cc-b55f-446f-8e1c-4e3c13507d1f","Type":"ContainerDied","Data":"9e0951179b7eac56664c410f3875c3b36f49a15855f09c7dff810e10674397cb"} Jul 17 18:26:04.816306 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:04.815976 2580 scope.go:117] "RemoveContainer" containerID="2fd17fed37b24125f0da840e9cb5d46e9c3c4fe6dee5131fec35671e5236a72b" Jul 17 18:26:04.816306 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:04.816176 2580 scope.go:117] "RemoveContainer" containerID="9e0951179b7eac56664c410f3875c3b36f49a15855f09c7dff810e10674397cb" Jul 17 18:26:04.816453 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:26:04.816393 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4_odh-ai-gateway-infra(f1b066cc-b55f-446f-8e1c-4e3c13507d1f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4" podUID="f1b066cc-b55f-446f-8e1c-4e3c13507d1f" Jul 17 18:26:05.432146 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:05.432119 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq_aeb74a36-67b5-45b7-be9b-60029d5e1bef/extract/0.log" Jul 17 18:26:05.458354 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:05.458331 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq_aeb74a36-67b5-45b7-be9b-60029d5e1bef/util/0.log" Jul 17 18:26:05.505661 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:05.505633 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kqnzq_aeb74a36-67b5-45b7-be9b-60029d5e1bef/pull/0.log" Jul 17 18:26:05.552653 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:05.552627 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp_e2cb8de7-9425-42e9-a2a9-5a811e4757d5/extract/0.log" Jul 17 18:26:05.579391 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:05.579367 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp_e2cb8de7-9425-42e9-a2a9-5a811e4757d5/util/0.log" Jul 17 18:26:05.604449 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:05.604418 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kg6fp_e2cb8de7-9425-42e9-a2a9-5a811e4757d5/pull/0.log" Jul 17 18:26:05.636525 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:05.636486 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb_620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8/extract/0.log" Jul 17 18:26:05.657145 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:05.657126 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb_620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8/util/0.log" Jul 17 18:26:05.687808 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:05.687717 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9cdb_620e53ee-0a8c-4e6d-b2b7-77529f9ce1e8/pull/0.log" Jul 17 18:26:05.722553 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:05.722529 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s_b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f/extract/0.log" Jul 17 18:26:05.745611 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:05.745588 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s_b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f/util/0.log" Jul 17 18:26:05.767888 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:05.767863 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2n6s_b8a9fb3f-e595-45b1-85fe-f6aa5cb7165f/pull/0.log" Jul 17 18:26:05.822893 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:05.822876 2580 scope.go:117] "RemoveContainer" containerID="9e0951179b7eac56664c410f3875c3b36f49a15855f09c7dff810e10674397cb" Jul 17 18:26:05.823206 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:26:05.823078 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4_odh-ai-gateway-infra(f1b066cc-b55f-446f-8e1c-4e3c13507d1f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4" podUID="f1b066cc-b55f-446f-8e1c-4e3c13507d1f" Jul 17 18:26:08.574720 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:08.574685 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-297dl_734e9676-1625-453c-8752-a60ff53e569b/cluster-monitoring-operator/0.log" Jul 17 18:26:08.874175 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:08.874100 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nwf4z_86e398f3-8ccc-4fae-9e26-b749a03340b6/node-exporter/0.log" Jul 17 18:26:08.899882 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:08.899857 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nwf4z_86e398f3-8ccc-4fae-9e26-b749a03340b6/kube-rbac-proxy/0.log" Jul 17 18:26:08.926736 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:08.926707 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nwf4z_86e398f3-8ccc-4fae-9e26-b749a03340b6/init-textfile/0.log" Jul 17 18:26:09.377057 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:09.377024 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-qhqhq_890b343e-ae97-488b-8f5a-52716583d061/prometheus-operator-admission-webhook/0.log" Jul 17 18:26:10.881071 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:10.881047 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-z8jsg_8076afd8-cc00-47d5-93a3-8bdd4e37bc45/networking-console-plugin/0.log" Jul 17 18:26:11.494771 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:11.494707 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kcmzb_36b82608-4a35-44da-9af1-6d56c88cb1e2/console-operator/2.log" Jul 17 18:26:11.498790 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:11.498769 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kcmzb_36b82608-4a35-44da-9af1-6d56c88cb1e2/console-operator/3.log" Jul 17 18:26:11.770057 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:11.769976 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wdmc6/perf-node-gather-daemonset-vf54w"] Jul 17 18:26:11.770347 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:11.770333 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" containerName="maas-api" Jul 17 18:26:11.770398 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:11.770347 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" containerName="maas-api" Jul 17 18:26:11.770398 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:11.770355 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" containerName="maas-api" Jul 17 18:26:11.770398 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:11.770361 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" containerName="maas-api" Jul 17 18:26:11.770502 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:11.770430 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9945cfe-3475-47ac-acda-0a4f393fd858" containerName="maas-api" Jul 17 18:26:11.774921 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:11.774906 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-vf54w" Jul 17 18:26:11.777455 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:11.777432 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wdmc6\"/\"kube-root-ca.crt\"" Jul 17 18:26:11.777772 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:11.777737 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wdmc6\"/\"openshift-service-ca.crt\"" Jul 17 18:26:11.778938 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:11.778918 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wdmc6\"/\"default-dockercfg-87g6t\"" Jul 17 18:26:11.782395 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:11.782361 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wdmc6/perf-node-gather-daemonset-vf54w"] Jul 17 18:26:11.841655 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:11.841632 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f396e05-5510-4c2c-b280-fae2618b7677-sys\") pod \"perf-node-gather-daemonset-vf54w\" (UID: \"3f396e05-5510-4c2c-b280-fae2618b7677\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-vf54w" Jul 17 18:26:11.841807 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:11.841658 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f396e05-5510-4c2c-b280-fae2618b7677-lib-modules\") pod \"perf-node-gather-daemonset-vf54w\" (UID: \"3f396e05-5510-4c2c-b280-fae2618b7677\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-vf54w" Jul 17 18:26:11.841807 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:11.841717 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3f396e05-5510-4c2c-b280-fae2618b7677-podres\") pod \"perf-node-gather-daemonset-vf54w\" (UID: \"3f396e05-5510-4c2c-b280-fae2618b7677\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-vf54w" Jul 17 18:26:11.841807 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:11.841741 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3f396e05-5510-4c2c-b280-fae2618b7677-proc\") pod \"perf-node-gather-daemonset-vf54w\" (UID: \"3f396e05-5510-4c2c-b280-fae2618b7677\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-vf54w" Jul 17 18:26:11.841925 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:11.841815 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkrkn\" (UniqueName: \"kubernetes.io/projected/3f396e05-5510-4c2c-b280-fae2618b7677-kube-api-access-wkrkn\") pod \"perf-node-gather-daemonset-vf54w\" (UID: \"3f396e05-5510-4c2c-b280-fae2618b7677\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-vf54w" Jul 17 18:26:11.943019 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:11.942994 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkrkn\" (UniqueName: \"kubernetes.io/projected/3f396e05-5510-4c2c-b280-fae2618b7677-kube-api-access-wkrkn\") pod \"perf-node-gather-daemonset-vf54w\" (UID: \"3f396e05-5510-4c2c-b280-fae2618b7677\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-vf54w" Jul 17 18:26:11.943420 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:11.943047 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f396e05-5510-4c2c-b280-fae2618b7677-sys\") pod \"perf-node-gather-daemonset-vf54w\" (UID: \"3f396e05-5510-4c2c-b280-fae2618b7677\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-vf54w" Jul 17 18:26:11.943420 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:11.943065 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f396e05-5510-4c2c-b280-fae2618b7677-lib-modules\") pod \"perf-node-gather-daemonset-vf54w\" (UID: \"3f396e05-5510-4c2c-b280-fae2618b7677\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-vf54w" Jul 17 18:26:11.943420 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:11.943090 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3f396e05-5510-4c2c-b280-fae2618b7677-podres\") pod \"perf-node-gather-daemonset-vf54w\" (UID: \"3f396e05-5510-4c2c-b280-fae2618b7677\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-vf54w" Jul 17 18:26:11.943420 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:11.943111 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3f396e05-5510-4c2c-b280-fae2618b7677-proc\") pod \"perf-node-gather-daemonset-vf54w\" (UID: \"3f396e05-5510-4c2c-b280-fae2618b7677\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-vf54w" Jul 17 18:26:11.943420 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:11.943118 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f396e05-5510-4c2c-b280-fae2618b7677-sys\") pod \"perf-node-gather-daemonset-vf54w\" (UID: \"3f396e05-5510-4c2c-b280-fae2618b7677\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-vf54w" Jul 17 18:26:11.943420 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:11.943188 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3f396e05-5510-4c2c-b280-fae2618b7677-proc\") pod \"perf-node-gather-daemonset-vf54w\" (UID: \"3f396e05-5510-4c2c-b280-fae2618b7677\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-vf54w" Jul 17 18:26:11.943420 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:11.943279 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3f396e05-5510-4c2c-b280-fae2618b7677-podres\") pod \"perf-node-gather-daemonset-vf54w\" (UID: \"3f396e05-5510-4c2c-b280-fae2618b7677\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-vf54w" Jul 17 18:26:11.943420 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:11.943282 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f396e05-5510-4c2c-b280-fae2618b7677-lib-modules\") pod \"perf-node-gather-daemonset-vf54w\" (UID: \"3f396e05-5510-4c2c-b280-fae2618b7677\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-vf54w" Jul 17 18:26:11.951130 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:11.951111 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkrkn\" (UniqueName: \"kubernetes.io/projected/3f396e05-5510-4c2c-b280-fae2618b7677-kube-api-access-wkrkn\") pod \"perf-node-gather-daemonset-vf54w\" (UID: \"3f396e05-5510-4c2c-b280-fae2618b7677\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-vf54w" Jul 17 18:26:12.086607 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:12.086585 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-vf54w" Jul 17 18:26:12.220734 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:12.220703 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wdmc6/perf-node-gather-daemonset-vf54w"] Jul 17 18:26:12.222563 ip-10-0-135-140 kubenswrapper[2580]: W0717 18:26:12.222532 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3f396e05_5510_4c2c_b280_fae2618b7677.slice/crio-dc6e9bf809e765466491c82fee2bfd5908981109b04c660145aa23fc0b31d7b9 WatchSource:0}: Error finding container dc6e9bf809e765466491c82fee2bfd5908981109b04c660145aa23fc0b31d7b9: Status 404 returned error can't find the container with id dc6e9bf809e765466491c82fee2bfd5908981109b04c660145aa23fc0b31d7b9 Jul 17 18:26:12.708307 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:12.708279 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-tcqx6_f7bbedb5-767b-4aca-a270-41b0695c2eb2/volume-data-source-validator/0.log" Jul 17 18:26:12.861171 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:12.861138 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-vf54w" event={"ID":"3f396e05-5510-4c2c-b280-fae2618b7677","Type":"ContainerStarted","Data":"c14c33780cd162a6d7f8f6f7f67a5046603ab66921e2c4576afcf845d434016d"} Jul 17 18:26:12.861346 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:12.861192 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-vf54w" event={"ID":"3f396e05-5510-4c2c-b280-fae2618b7677","Type":"ContainerStarted","Data":"dc6e9bf809e765466491c82fee2bfd5908981109b04c660145aa23fc0b31d7b9"} Jul 17 18:26:12.861414 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:12.861354 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-vf54w" Jul 17 18:26:12.878080 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:12.878035 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-vf54w" podStartSLOduration=1.878020845 podStartE2EDuration="1.878020845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:26:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:26:12.876181029 +0000 UTC m=+2219.863397378" watchObservedRunningTime="2026-07-17 18:26:12.878020845 +0000 UTC m=+2219.865237194" Jul 17 18:26:13.827483 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:13.827451 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wcffs_cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703/dns/0.log" Jul 17 18:26:13.849601 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:13.849575 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wcffs_cf18c0f6-26b5-42e6-b9ec-8cf9b8bbf703/kube-rbac-proxy/0.log" Jul 17 18:26:13.920478 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:13.920418 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xh7s7_0ac788ff-552c-4ea0-8de1-857bb7e041cf/dns-node-resolver/0.log" Jul 17 18:26:14.483317 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:14.483289 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jwff2_ed763a53-c3ff-4b3f-98c0-5870995f4a86/node-ca/0.log" Jul 17 18:26:15.523238 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:15.523206 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-llz6h_72d99cfc-2662-4715-9319-a76c4a2a8f85/discovery/0.log" Jul 17 18:26:15.713921 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:15.713893 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-fzbr9_a1cb1641-f574-4c14-96c4-683d35e40c0f/payload-processing/0.log" Jul 17 18:26:15.739207 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:15.739188 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56cbf4fbfd-spcrn_e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8/router/0.log" Jul 17 18:26:16.356924 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:16.356895 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qwg4s_b40ec2a7-8dec-4513-80ca-2255cc34c77c/serve-healthcheck-canary/0.log" Jul 17 18:26:16.889982 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:16.889957 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-5d5xw_960e1622-2795-40a6-bb03-eaf54f315d96/insights-operator/0.log" Jul 17 18:26:16.890466 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:16.890450 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-5d5xw_960e1622-2795-40a6-bb03-eaf54f315d96/insights-operator/1.log" Jul 17 18:26:17.043842 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:17.043811 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kcll6_c351beb9-6176-4e6d-bc0e-65ff5557d85b/kube-rbac-proxy/0.log" Jul 17 18:26:17.067905 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:17.067883 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kcll6_c351beb9-6176-4e6d-bc0e-65ff5557d85b/exporter/0.log" Jul 17 18:26:17.088900 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:17.088880 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kcll6_c351beb9-6176-4e6d-bc0e-65ff5557d85b/extractor/0.log" Jul 17 18:26:18.876312 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:18.876279 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-vf54w" Jul 17 18:26:19.355015 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:19.354984 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5c77fb6b4b-5zxkf_5afbec6f-f189-4c3d-b205-03d41af8485e/manager/0.log" Jul 17 18:26:19.478603 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:19.478570 2580 scope.go:117] "RemoveContainer" containerID="9e0951179b7eac56664c410f3875c3b36f49a15855f09c7dff810e10674397cb" Jul 17 18:26:19.534939 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:19.534914 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cc99fdf4f-cndbb_3011a067-30d8-4661-bb56-f748b7bf344b/manager/0.log" Jul 17 18:26:19.551980 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:19.551963 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cc99fdf4f-cndbb_3011a067-30d8-4661-bb56-f748b7bf344b/copy-manifests/0.log" Jul 17 18:26:19.900991 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:19.900924 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4" event={"ID":"f1b066cc-b55f-446f-8e1c-4e3c13507d1f","Type":"ContainerStarted","Data":"c7bb5139e49153bf9ab9052c860b6654b0c4da80df45b57177ed65521ad62e4d"} Jul 17 18:26:20.907048 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:20.907008 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6568db77d8-t75c4_d9bc4dff-32a6-4117-9b46-3380a2209f2b/manager/0.log" Jul 17 18:26:20.908730 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:20.908708 2580 generic.go:356] "Generic (PLEG): container finished" podID="f1b066cc-b55f-446f-8e1c-4e3c13507d1f" containerID="c7bb5139e49153bf9ab9052c860b6654b0c4da80df45b57177ed65521ad62e4d" exitCode=6 Jul 17 18:26:20.908860 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:20.908764 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4" event={"ID":"f1b066cc-b55f-446f-8e1c-4e3c13507d1f","Type":"ContainerDied","Data":"c7bb5139e49153bf9ab9052c860b6654b0c4da80df45b57177ed65521ad62e4d"} Jul 17 18:26:20.908860 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:20.908818 2580 scope.go:117] "RemoveContainer" containerID="9e0951179b7eac56664c410f3875c3b36f49a15855f09c7dff810e10674397cb" Jul 17 18:26:20.909065 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:20.909039 2580 scope.go:117] "RemoveContainer" containerID="c7bb5139e49153bf9ab9052c860b6654b0c4da80df45b57177ed65521ad62e4d" Jul 17 18:26:20.909275 ip-10-0-135-140 kubenswrapper[2580]: E0717 18:26:20.909256 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4_odh-ai-gateway-infra(f1b066cc-b55f-446f-8e1c-4e3c13507d1f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4" podUID="f1b066cc-b55f-446f-8e1c-4e3c13507d1f" Jul 17 18:26:20.925851 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:20.925830 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4"] Jul 17 18:26:22.052556 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:22.052536 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4" Jul 17 18:26:22.122819 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:22.122791 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1b066cc-b55f-446f-8e1c-4e3c13507d1f-maas-api-service-ca\") pod \"f1b066cc-b55f-446f-8e1c-4e3c13507d1f\" (UID: \"f1b066cc-b55f-446f-8e1c-4e3c13507d1f\") " Jul 17 18:26:22.123128 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:22.123107 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1b066cc-b55f-446f-8e1c-4e3c13507d1f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f1b066cc-b55f-446f-8e1c-4e3c13507d1f" (UID: "f1b066cc-b55f-446f-8e1c-4e3c13507d1f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:26:22.224067 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:22.224033 2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1b066cc-b55f-446f-8e1c-4e3c13507d1f-maas-api-service-ca\") on node \"ip-10-0-135-140.ec2.internal\" DevicePath \"\"" Jul 17 18:26:22.587562 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:22.587530 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-llz6h_72d99cfc-2662-4715-9319-a76c4a2a8f85/discovery/0.log" Jul 17 18:26:22.706194 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:22.706164 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-fzbr9_a1cb1641-f574-4c14-96c4-683d35e40c0f/payload-processing/0.log" Jul 17 18:26:22.723394 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:22.723372 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56cbf4fbfd-spcrn_e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8/router/0.log" Jul 17 18:26:22.922799 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:22.922706 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4" Jul 17 18:26:22.922799 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:22.922740 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4" event={"ID":"f1b066cc-b55f-446f-8e1c-4e3c13507d1f","Type":"ContainerDied","Data":"4d8e7f133da95c43cfb82885387aa77306a735e6b24a393dc08a4f6ee4efd551"} Jul 17 18:26:22.923025 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:22.922823 2580 scope.go:117] "RemoveContainer" containerID="c7bb5139e49153bf9ab9052c860b6654b0c4da80df45b57177ed65521ad62e4d" Jul 17 18:26:22.946937 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:22.946902 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4"] Jul 17 18:26:22.950329 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:22.950307 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ad85eda1-6t6l4"] Jul 17 18:26:23.484233 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:23.484197 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1b066cc-b55f-446f-8e1c-4e3c13507d1f" path="/var/lib/kubelet/pods/f1b066cc-b55f-446f-8e1c-4e3c13507d1f/volumes" Jul 17 18:26:23.960055 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:23.960023 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-llz6h_72d99cfc-2662-4715-9319-a76c4a2a8f85/discovery/0.log" Jul 17 18:26:24.096687 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:24.096656 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-fzbr9_a1cb1641-f574-4c14-96c4-683d35e40c0f/payload-processing/0.log" Jul 17 18:26:24.113031 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:24.113005 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56cbf4fbfd-spcrn_e3f24a24-b24f-4d1d-a0cc-5a8d5195c7a8/router/0.log" Jul 17 18:26:26.467698 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:26.467668 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-kjsbf_4998cf81-b00c-4f06-91e5-056098695a77/migrator/0.log" Jul 17 18:26:26.489394 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:26.489367 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-kjsbf_4998cf81-b00c-4f06-91e5-056098695a77/graceful-termination/0.log" Jul 17 18:26:26.844189 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:26.844159 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-vwvfg_e4f8df35-139a-4910-866b-e4a5609e5e1d/kube-storage-version-migrator-operator/1.log" Jul 17 18:26:26.844859 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:26.844840 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-vwvfg_e4f8df35-139a-4910-866b-e4a5609e5e1d/kube-storage-version-migrator-operator/0.log" Jul 17 18:26:28.170815 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:28.170788 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ngvvf_5ea25ecd-4ba5-4c84-8068-d7adfed46344/kube-multus-additional-cni-plugins/0.log" Jul 17 18:26:28.190395 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:28.190371 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ngvvf_5ea25ecd-4ba5-4c84-8068-d7adfed46344/egress-router-binary-copy/0.log" Jul 17 18:26:28.211550 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:28.211525 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ngvvf_5ea25ecd-4ba5-4c84-8068-d7adfed46344/cni-plugins/0.log" Jul 17 18:26:28.232395 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:28.232376 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ngvvf_5ea25ecd-4ba5-4c84-8068-d7adfed46344/bond-cni-plugin/0.log" Jul 17 18:26:28.256264 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:28.256242 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ngvvf_5ea25ecd-4ba5-4c84-8068-d7adfed46344/routeoverride-cni/0.log" Jul 17 18:26:28.281288 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:28.281271 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ngvvf_5ea25ecd-4ba5-4c84-8068-d7adfed46344/whereabouts-cni-bincopy/0.log" Jul 17 18:26:28.307366 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:28.307347 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ngvvf_5ea25ecd-4ba5-4c84-8068-d7adfed46344/whereabouts-cni/0.log" Jul 17 18:26:28.366000 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:28.365978 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-h9rx7_4c85ec7c-9695-46c8-ba1d-48a401af6a10/kube-multus/0.log" Jul 17 18:26:28.471130 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:28.471060 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mvwcb_f5c93f78-e5a9-40b3-b394-e495edb54560/network-metrics-daemon/0.log" Jul 17 18:26:28.489627 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:28.489605 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mvwcb_f5c93f78-e5a9-40b3-b394-e495edb54560/kube-rbac-proxy/0.log" Jul 17 18:26:29.771978 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:29.771944 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6bnj_6070f265-4c28-44f8-856d-8be554ec058b/ovn-controller/0.log" Jul 17 18:26:29.788861 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:29.788838 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6bnj_6070f265-4c28-44f8-856d-8be554ec058b/ovn-acl-logging/0.log" Jul 17 18:26:29.811982 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:29.811957 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6bnj_6070f265-4c28-44f8-856d-8be554ec058b/kube-rbac-proxy-node/0.log" Jul 17 18:26:29.831414 ip-10-0-135-140 kubenswrapper[2580]: I0717 18:26:29.831396 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6bnj_6070f265-4c28-44f8-856d-8be554ec058b/kube-rbac-proxy-ovn-metrics/0.log"